I dunno the kind of connection that you've got - but line noise within the house can cause these sort of problems (I've run into it with my cable).
The solution was to split the cable where it enters the house (using a good quality 2 way splitter) and run one leg straight to the modem. The other leg will be sufficient for almost any amount of TV's.
Once I did that, I haven't dropped a connection since!