Do you have bird feeders that are often sought after by squirrels?  We have often had the same problem.  We don't dislike the squirrels, we actually enjoy them just as much as watching birds, but we would rather them leave the bird feeders alone.