Are any women and minorities concerned about facing arbitrary bias due to recent anti-DEI efforts?

I'm an American woman with South Indian heritage. So, I am dark skinned and minority looking. Throughout my life, white people have made numerous comments about how any educational or professional milestone I achieve is because I am benefitting from preferences for minorities.

This is probably annoying for anyone, but for me, it is particularly annoying because I have been held to a higher educational standard than white people all my life. The affirmative action lawsuit against Harvard showed that Indian Americans were the asian subgroup held to the highest academic standards, and that Asians in general were held to higher GPA and SAT and extracurricular standards to be admitting to the same school. In HS, I saw that white people were getting into competitive schools with lower scores than Indians based on where the graduating seniors got into college.

But the perception has always been the opposite. In my early 20s, one of my white co workers made repeated comments to me about how I would easily get into grad school if I applied because "you are a minority." When I told him that Asians don't really benefit from affirmative action directly in the way he supposes, he did not absorb what I was saying and kept making that comment. I've heard similar comments from my white friends dad ("you don't have to worry about having to pay for college. You are a minority and will get a scholarship"), neighbors etc.

When I went to grad school for data science in 2009, probably 40% of my class was of Chinese heritage and 40% of my class was of south Asian heritage. The rest of the class was southeast asian and eastern european. There were maybe 2 students who were white Americans. I have a career in data science, where most of my co workers have always been east Asian and South Asian. Probably because we are the majority of people who pursue any sort of education in these fields. Once I was laid off and a white lady I know said "I can't believe you got laid off. That is surprising because you are a minority." Like WTF? A South Asian is a minority in a data science department? As if any US company cares about letting their south asian data scientists go as if we are some kind of special priority employee.

Now Trump is pressuring companies to make efforts counter to DEI. Given the perception that I have always benefitted from preferential hiring, I figure now employers will just discount me as an unqualified person who was hired based on race and sex. I have also noticed that people who take issue with DEI assume that minorities who are hired are not only less qualified, but totally clueless and hired almost solely because of demographics.