Often, it gets seized in there. Not to worry. I usually use a pry bar and GENTLY start to pry it out. It' should come out without issue.
On edit: I had the same problem not long ago. I soaked it in WD-40 as mentioned, then I used a hammer and a brass rod and tapped it around the base a few times. The brass is easier on the housing ! That got mine out.
Thanks for the suggestions! I'll try that this weekend.
I've used penetrating oil in the past in a situation like this but this one has "become one with the block"! I hear this is something that has happened to a lot of Cleveland engines. I will try tapping around the base with a brass hammer & using a bar to help lift it out.
I've had suggestions from friends where I USED to consider their advice tell me to "Just use a torch and heat that sucker up and it will pop right out". I think this friend is the same one who said married life is great! Maybe I need new friends???
i had this happen to a bronco once on a 351m a friend of mine had it and he busted the distributer off with a hammer at the base of the block, i had to take the oil pan and oil pump off and beat it out from the bottom, i had a lot of room on the bronco i dont know about on a mustang use pb blaster penetrating spray it is the best
When I work on brass musical instruments, I find it works sometimes getting stuck brass tubing to come out is using a blow dryer with the penetrating oil. That seems to suck it in between the tubes and helps to loosen it. But, on this dizzy, that may not work. The lifting with a bar gently will usually break it loose. Just don't do the gorilla thing.