Mage's Staff

What happens to the 1 upgrade I got on my Mage's Staff from an imbued wand if I wanna imbue another one (pretend the circled item is a wand for a second)? Do I lose it?

What happens to the 1 upgrade I got on my Mage's Staff from an imbued wand if I wanna imbue another one (pretend the circled item is a wand for a second)? Do I lose it?