It was the lose of jobs as industry moved away, a trend started after WW2.

The culture probably helped but it’s a much larger trend than people simply not wanting to live in a conservative town.