That logic has a flaw: for every 'distance 19' arrangement you find that way, there may be more than one 'distance 20' arrangement one can reach from it in one move.

For example, you have two parents, but that does not imply that, combined, you and all your siblings have more parents than there are in that group of siblings.