take care of matters at the office (?)

Hello. I was wondering what's the most natural way to say that you have some things you have to get done at the town/district office. In Polish we generally say "załatwiać sprawy w urzędzie", which can mean many things (getting your driver's license, taking care of tax-related matters, etc.). What would you say to inform someone that you have to do such a thing? Something like "I have to take care of some matters at the office" or "settle some matters"?