I made SABR - an AI model that helps you visualize the beta/technique on any route, based on your body parameters. You can input a video of you climbing any route, in any orientation or lighting condition (it's truly versatile!). SABR then creates a virtual avatar of your body shape and uses it to climb the route you're climbing. Then, you can compare/contrast.
You can see the demo here:
https://www.youtube.com/watch?v=cnvNPWoYZz4
Will be open sourcing the model, backend, and frontend codebase soon!
Will attach more example outputs and make a detailed document about how the model was built and the research behind it. If this is interesting to you, feel free to sign up to the waitlist on www.climbing.ai (and make sure to sign up for our Discord!)
I originally planned on open sourcing the model, data, weights, and code. Only a few people (me and a couple friends) have access to the hosted model on the web app.
If enough people are on the waitlist, I will consider releasing access. This is very expensive to run so was only considering open sourcing it.
Note: the model works well sometimes, but most of the times it does not. This is an early research preview. Please tamper any expectations. A really good general model requires millions of videos and much more training time so it is really prohibitively expensive. As mentioned before, if someone has the compute, all they have to do is scale the existing dataset and training pipeline (which I will publish open-source in the coming weeks).