Overnight disappearance is bad, yes. Whether normal migration a deal breaker is personal of course. Having a slightly different attitude to your account helps. Don't get too attached to your identity and the archive of toots that builds up. The quality interactions are what make the Fediverse most enjoyable (imho), and those come along fine in a migration of followers/following. And people hitting your old profile, will see the redirection to your new location.