Is this true with satanle diffusion, too? Because I've fine tuned it with just a folder full of images and txt files with "keyword" as the only line in each text file.

No original weights, there...