Menu

RAG & LLM Systems

Retrieval pipelines, evals, and production LLM engineering done carefully.

Projects: RAG & LLM Systems

AI Engineering

Ollama

Get up and running with large language models, locally.

Ollama turned local LLM inference into `ollama run llama3` — model management, serving, and a clean API in one Go binary. The fastest path from curiosity to a working local model.

Go
AI Engineering

llama.cpp

LLM inference in plain C/C++ — run capable models on everyday hardware.

llama.cpp made large language models runnable on a laptop CPU with no GPU, no framework, no cluster. The quantization formats it pioneered (GGUF) became the de facto standard for local inference.

C++C