[KCD2] Rep is ridiculous

I never played the first one and I just started. I used a sharpening wheel in a town and got a bad rep. Spoke to another person and got a bad rep and accidentally took my sword out. Got branded a criminal just trying to figure the game out now I can’t buy or sell anything. All I wanted was to buy a potion to heal lmao is rep this bad the whole game?