I like wandb but really it's just an aggregated metrics platform and it's cloud based design limits what's possible due to bandwidth constraints.
I like this tool from Nvidia [1] for exploring CNN feature maps. That's more in line with what I'm talking about but it's is an offline tool. I am imagining tools that provide this granularity of information about networks in real-time during training.
