There must be cases where this isn't practical. E.g., if the normal treatment for greyscale is to cut off the arm before it spreads, how could you try any alternative treatment?
It isn't, and the answer is "you can't get good data". A good example would be immunotherapy for cancers, which has to be tested alongside treatments with adverse impact on immune function