Docker Model Runner and Compose: Local LLM Development Without the Cloud Bill
8 min read5.5k
Run open models locally with Docker Model Runner, call them through an OpenAI-compatible API from your Compose services, and switch to a cloud provider in production by changing two environment variables.