50+ Open-Source Options for Running LLMs Locally

In my previous post I discussed the benefits of using locally hosted open weights LLMs, like data privacy and cost savings. By using mostly free models and occasionally switching to GPT-4, my monthly expenses dropped from 20 USD to 0.50 USD. For mobile access, setting up a port-forward to your local LLM server is a free solution. There are many open-source tools for hosting open weights LLMs local