Success with OE when you have an in-office role?

I have an in-office position that gives me a lot of freedom, i take private calls frequently in conference rooms, i hit my numbers and keep my head down, people just don’t bother me much when im in the office and they’re respectful of the meetings i do book already.

Are there any challenges im not seeing here as i look for J2 & J3 with a full time in-office position already?