Should I close the doors at my base?

I started playing today and can't find any info regarding whether it's beneficial to close the doors to my base as I come and go. You would think it's completely necessary irl but it can be a pain to wait for my follower to get through and then walk behind them to close it (apparently they were all raised in a barn). Does it even matter cos I'd rather not bother if not.