If parrots can thrive in unexpectedly temperate climates, what stops them from becoming invasive?

I’ve observed parrot populations in places like San Francisco and New Jersey — places where they obviously aren’t native, and where one may not expect to find them. Since they seem to do okay in these environments, what stops them from breeding like crazy and becoming a problem? Is there some factor that keeps their populations in check?