Keeping the tif folder cleaned out on regular basis is the single best cure for that.
Whithin IE's settings you set the size limit for that folder. Once it becomes full, it has to start swapping out the old to make room for the new. I haven't suffered any slowdowns in years with IE for that reason alone. It's still my preffered browser though I use Opera on occasion. (which I notice no speed increase with btw).