What does the severity of the average incident have to do with whether I use a particular mode of transit?
We could add lots of fender-benders between taxiing planes to push down the average severity of each plane "crash." Then they would still be less deadly per mile travelled, but also less severe per incident on average than other modes of transit.
Sure, sorry. Planes cover distance very quickly, and people use them for e.g. a six hour flight covering 4000 miles that they would not otherwise drive; this situation makes planes appear safer "per mile" than alternative valid metrics like "accidents per hour of travel" would.
How far do standards have to fall before that's no longer true?
Recall also that aviation is the safest in aggregate, but the severity of each individual incident tends to be much worse than others.