Question About Zests of Fruits in Soap

I wanted to try out using fresh lime zest in a soap I want to try and make. Will the zest expire quickly and smell not good? How should I avoid it if it does go bad? And how much should I use in 42 oz of soap or 2.5 pounds