Victims of child sex abuse were “rightly angry” at what was allowed to happen to them as children, but seemed “equally traumatised” by their current treatment by authorities, a report has said.