Depends what slice of Britain you're talking about. The upper classes weren't opposed, as you say, but public opinion tended to pretty strongly anti-slavery. Lincoln actively encouraged this; see his public letter to the Manchester workers quoted on Wikipedia. [1]

[1] https://en.wikipedia.org/wiki/United_Kingdom_and_the_America...