In public, yeah people probably wouldn't care about french speakers, but in a shared environment I definitely would prefer they speak English. My brother use to have to tell his Dutch-Canadian in-laws to speak English when we were at his house. I'd feel the same way at work.