What makes you think they're getting hot- touch, smell, smoke? they should be warm, yes... hot, no.... smoking, definitely not! I'd say pull the wheel and drum and see what they look like. Make sure you don't have a wheel cylinder leaking as well. Roll the rubber seal back and see if it drips out. The leakage can cause excess heat and smoke. When you button it back up, the wheel should spin and rotate a time or 2 if adjusted right, but not stop right away or just continue to just spin.
The rear drums should not be extremely hot unless you have just done 4 panic stops in hot weather. To test if brakes are "dragging" simply put the car in neutral. If you are on a level surface you should be able to push the car. Or on a slope, the car should roll.
I touched the wheel and could not keep my hand on the wheel. I did push it forward the other day while I was working on it, but am thinking the brakes are still a little tight. If I loosen them, they have the self-adjusters when you go in reverse, correct?