I believe so. The worth of your portfolio is the worth of the assets. Bitcoin dropped a ton in even a month. There are still changes of a few percent possible in less than a day, so yearly balancing sounds insanely dumb to me.
Index funds are usually market cap weighted, so day to day changes in value don't require rebalancing, since if a security suddenly doubles, its market cap does too, and it's therefore still held in the correct proportion to the other securities in the index.