...big implications for running private AI models on your own device

Legendary

@Legendaryy

·Follow

The new M5 Max MacBook with 128 GB of RAM can now easily run Llama 70B as a local LLM. Running that AI 1.5 years ago would’ve taken you a 40k GPU cluster.