The book "White Too Long" provides some insights.
1.) The more religious one is, the more likely one is to be virulently racist.
2.) The more racist one is, the more likely one is to go to church and attend Bible study frequently.
I guess people are just deciding they don't want to spend their Sunday mornings with assholes.