Or you could just reply to the list itself with the word 'remove' in the subject (doesn't work for all list servers). That's how most servers handled subscriptions back in the days and probably still is now.
That would work for a LISTSERV -- but this is a special kind of server that does keep the list as an explicit object. If it's a recipients list in a regular email, that would be different.