If you only use POP3 and not Exhange then you loose nothing. Mail shield will take care of that. The outbound emails might not get signed anymore. In any case the next release will have some diagnostic tools implemented for this plugin, so hopefully you will be able to help us diagnose where the problem occurs in order to fix any potential issues for the future.