"To make matters worse" generally means that those ugly things happen and are exposed, and they will get retribution without any explanation. The more they explain, the more eye-catching and ugly they are, and the things that people don't know are made public.
Related words: to make matters worse-broken glass.