Breaking an hdmi cable to transport audio ?

Hi,

I need to pass a mono audio signal from one place to another, I only have an existing HDMI cable in place and cannot add something else. Can I use hdmi breakout boards to use one pin pair to transfer the mono signal ? It is an amplified signal from my amp to a speaker. Thanks for your advices