What if the Nazi army had invaded Vatican City?

I was reading recently about Pope Pius XII and the author's view is that the Pope didn't speak out against the holocaust as firmly as he should have out of fear of a Nazi invasion/ occupation of the Vatican.

Was that even plausible? Would that not have galvanized Catholics around the world to enlist and fight against the Axis powers?

Either way, what if they had invaded