Very true, there are a lot of small fish biting all the time on your line.
It is hard to keep the smaller fish of under one pound and under, off your line. Lots of action but not at all challenging. There must be larger fish there. The problem is keeping your line in the water long enough to find them.