Numbers aren't part of "the alphabet", so sorting digits within a string by the numeric value makes just as much sense (and is what most users want most of the time) as treating digits as isolated characters (what OP wants).

As an aside, this is also the reason why ISO 8601 is the best date format – it sorts the same way whether you do it alphabetically or lexicographically.