How realistic is a local LLM on an M4 Max with 128GB?

When you see the number 128GB, a MacBook Pro for local LLMs suddenly looks like a realistic candidate. I have a record of a Reddit thread in my notes. The focus of the discussion is a configuration ...
Hosted on MSN

Setting up a local LLM is the easy part—here's what you need to do with it next

Running your own LLM is surprisingly easy. Using software such as Ollama or LM Studio, you can install and run local AI models that work completely offline. The size and speed of the models will ...
Hosted on MSN

I tested a local LLM on 5 everyday tasks—only one was actually worth doing

I use local LLMs on a daily basis, but in my personal setup, they're only really useful for a limited selection of tasks. I wanted to see how a local LLM could handle everyday tasks. My most powerful ...