You might not worry about a simple branch or leaf, but such things can donrrrt hazard individuals swimming with your pool.
Possess a phone installed near your pool which won't have to leave children even for a short while to answer calls.