what firewall have you got?
could it be that your had norton internet security 2004 (which includes a firewall) and by removing it you left your PC open to attacks from the net by worms?