Skype works poorly if your recipients upload speed is slow.
If you don’t have a 5Ghz adapter then you don’t have to get a dual band router. If you do buy the dual band router, I would suggest Asus.
You can try changing the Wifi channel of your current router.
Use this tool to find a good channel
http://www.metageek.net/products/inssider/