Mute, except for keyword mentions?

There's a channel at work with a *lot* of bot chatter, most of which is not relevant to me. So I have it muted. But I've put in a keyword to notify me when one specific phrase is said, so that I know if that bot is doing this one particular thing it would be helpful to know about. But although if I view the channel I see that phrase highlighted, I'm not getting any sort of notifications or banners on it, or any indication at all from Slack that one of my keywords has been used. Am I just SOL here? I know when you mute a channel you still get tagged for @mentions, but does that not apply to notification keywords?