for inference, there is https://github.com/bigscience-workshop/petals
however, both are only in the research phase. start tinkering!
