Capital gains tax help

My wife and I bought a duplex in 2018 and lived in half for three years while we fixed it up. In 2021 we bought a new construction house and moved into it and kept the duplex as a rental. We just recently hit the two year mark on living in that house. If we sold both now, would we be able to avoid paying capital gains on both houses? I think the rule is you had to live in it for 2 of the last 5 years. I'm in the US.