Phone getting very very hot while charging

Hey guys,

I replaced my battery with a new Samsung battery for note and it seems to be working fine. But at times, or may be every time i put my phone on charge, it heats up a lot and doesn't charge at all, when i notice, i unplug it, switch it off and charge again and it works.
Any idea what is going wrong? This never happened with the battery. Also this new battery takes almost 4 hours to get fully charged.

Sent from my GT-N7000 using Tapatalk