So all the accusations against them were rumors

No, only some details are disputed. It’s undisputed that they were a Nazi collaborator.

but they’re the monster here?

For willingly collaborating with the Nazis? Yes.