As someone that roasts and eats chestnuts, it's kind of odd to play with them. I suppose you ate many and also played, or are they simply not eaten there?
The ones used for conkers are horse chestnuts (typically round in shape), not the same as the ones that are eaten which are spanish chestnuts and normally have flat sides.
Wikipedia indicates that they are a different genus, family, and order, so they are pretty much related in the way that they are both flowering plants.
So they're kind of related like humans are related to weasels, because they're both mammals.