MLC LLM: Universal LLM Deployment with GPU Acceleration | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		MLC LLM: Universal LLM Deployment with GPU Acceleration (github.com/mlc-ai)
		3 points by crowwork on April 29, 2023 \| hide \| past \| favorite \| 1 comment

crowwork on April 29, 2023 [–]

Supported platforms include:

- Metal GPUs on iPhone and Intel/ARM MacBooks

- AMD and NVIDIA GPUs via Vulkan on Windows and Linux

- NVIDIA GPUs via CUDA on Windows and Linux

- WebGPU on browsers (through companion project WebLLM).

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact