Why was Soapy finally arrested in the novel Police and Hymns?

On the one hand, because the church is a sacred place, the police don't allow a disheveled tramp like Soapy to appear near the church, which is a blasphemy. People need to dress up and have a sincere heart when they go to church, so it seems inevitable that Soapy will be arrested. However, before that, Soapy's six imprisonments were unintentional. Just when he sincerely repented and was ready to turn over a new leaf, he was arrested for "loitering", which is the most ridiculous. On the other hand, it profoundly reflected the reversal of black and white in American society at that time and exposed the cold and chaotic nature of capitalist society.