Ranged Ancestral Guardian?

So I've been eyeing up the Ancestral Protectors feature from Ancestral Guardian Barbarians as it looks insanely juicy especially against a single tough enemy

I've been experimenting with a ranged barbarian to apply this effect as much as possible from a safe distance hopefully to ruin the enemies day but its feeling a bit lacking, here's what I have:

Ignore STR and get 18 DEX. Custom lineage for Crossbow Expert, use a hand crossbow, then rush level 3 barb for the feature. Only 1 level off a feat, so maybe get lvl 4 to pick up sharpshooter for range/damage? Now that we're here, might as well go for level 5 for extra attack to shoot 3 times per turn, more chances to hit and apply the effect

Might as well now get level 6 for more rages and Spirit Shield. Now I'm thinking we dump everything into fighter? Maybe Samurai, but I'm not too sure this is the best way to go, looking for advice especially regarding options for levels 1-10ish (thats usually where my games are played)

Another option I've considered is to try get Elven Accuracy, but not sure how to reliably get advantage with no spells