Large Language Models

Ollama

Official Docs

Ollama Site

The easiest way to run open source models locally.

Installation

With brew brew install ollama or direct download via Link

Usage

# List downloaded models
ollama list

# Download models
ollama pull llama3:latest

# Run models
ollama run llama3

API

Query the model via request

curl http://localhost:11434/api/generate -d '{
  "model": "llama3",
  "prompt": "Write a rock song!",
  "stream": false
}' | json_pp