I don’t think it’s a given that finetuning address pretraining bias, most LLMs you would have access to are trained on very similar and biased corpora, see any Anthropic or OpenAI alignment paper.

It’s conceptually possible for extensive finetuning + MoE to work accurately enough for this premise to be feasible but it seems incredibly unlikely with what’s available today.

In any case, using a non-explainable AI model to call individuals racist based on their professional work product (which has significant real-world consequences) is still a horrible idea. This doesn’t carry the same impact as mislabeling tweet sentiment.

So we’ve gone from most of us to Elon Musk and yourself? Musk (whose wealth is irrelevant but is second as an FYI) is one of the worst appeals to authority you could be making on this argument.

I’m thinking a multi model approach from classification of a “bias” to the rewriting.

In a perfect world I’d also incorporate a database of scraped tweets and one day video dialog.

Idk about you, but I’d love to see the most racist tweets from a NYT or WSJ journalist, along with the articles they’ve written, a score associated with their content, etc.

This presupposes that NYT or WSJ journalists are making racist tweets in violation of ToS, workplace ethics policies, and basic human decency. Seeing as you’re making a very serious allegation do you have any proof?

I absolutely do not want to live in a world where I (or anyone) am worried that everything said will be publicly assigned an arbitrary “racist” score by a black box. I think most people would agree.