it sounds like you have an OPEN RELAY server
check with this site: http://www.mxtoolbox.com/diagnostic.aspx
fill in the public name of your mailserver or the public IP.