That means that you are not infected but recieve only infected Emails. So that is no problem, if you do not open it.
So you are right just delete them.