Large Language Models

LangChain

LangChain is a framework for developing applications powered by LLMs.

Useful code

My Docs

Ollama

Official Docs

Ollama Site

The easiest way to run open source models.

Installation

With brew brew install ollama or direct download via Link

Usage

# List downloaded models
ollama list

# Download models
ollama pull llama3:latest

# Run models
ollama run llama3

API

Query the model via request

curl http://localhost:11434/api/generate -d '{
  "model": "llama3",
  "prompt": "Write a rock song!",
  "stream": false
}' | json_pp