Simply changing browsers won’t get rid of a vulnerability, you have to either patch it or remove the vulnerability (Java Virtual Machine), if you need JVM, you have to get the latest version.

Even though you switch from IE, it is still an integral part of windows XP, so if you have XP you still need to keep IE up to date.