To clarify, > Port of Hugging Face's Transformers library, using the tch-rs crat... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

MuffinFlavored on Feb 20, 2023 | parent | context | favorite | on: Running large language models like ChatGPT on a si...

To clarify,

> Port of Hugging Face's Transformers library, using the tch-rs crate and pre-processing from rust-tokenizers.

> tch-rs: Rust bindings for the C++ api of PyTorch.

Which "backend" does this end up using on Apple Silicon, MPS (Metal Performance Shaders) or OpenCL?

https://pytorch.org/docs/stable/notes/mps.html

I'm going to guess MPS?

smoldesu on Feb 20, 2023 [–]

Whatever your Pytorch install is designed to accelerate. I've got Ampere-accelerated Pytorch running it on my ARM server, I assume MPS is used on compatible systems.

Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact