Your starter may be pulling too much current and welding the contacts of the solenoid together.. I would pull the starter and have it checked. Most auto stores can do this for you - they will tell you how much current it is drawing (of course it will be a no load current).. Hope this helps