Petals runs Llama 2 (70B) from Colab at 5 tokens/sec | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

		Petals runs Llama 2 (70B) from Colab at 5 tokens/sec (github.com/bigscience-workshop)
		5 points by borzunov on July 19, 2023 \| hide \| past \| favorite \| 3 comments

borzunov on July 19, 2023 | [–]

Chat web app: http://chat.petals.ml

Colab: https://colab.research.google.com/drive/1uCphNY7gfAUkdDrTx21...

Project description: https://github.com/bigscience-workshop/petals

borzunov on July 20, 2023 | | [–]

We've moved to a new domain, the chat is now at https://chat.petals.dev

amrb on July 19, 2023 | [–]

Great project and I'm happy to see it expand to more models!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact