Fine-tuned Llama2-chat often won't even say whether genocide is bad, it insists that it is too complicated a subject to come to such a conclusion, and then says it would be "inappropriate" and possibly offensive to say that genocide is bad.
Which means that it's so strongly finetuned away from saying something that might be a moral judgement that someone might disagree with that it ends up sounding like it's both-sidesing genocide.
Which means that it's so strongly finetuned away from saying something that might be a moral judgement that someone might disagree with that it ends up sounding like it's both-sidesing genocide.