Jamo, when i did the handle on my 67, there was a metal sleeve molded into the handle. Couldn't drive the pin all the way through because there was only a hole in one side of the sleeve. Even after removing all the plastic part, still couldn't get the pin out. Ended up cutting the sleeve with a cutoff wheel in a grinder.
As said, take it outta the car.