Tag: on-device AI

0

Local RAG Without the Storage Tax: A Hands-On Guide to LEANN

Posted by

You’ve got 100 GB of PDFs, notes, and exported chat logs you’d love to query with natural language. So you reach for the standard RAG playbook: chunk everything, embed it, store the vectors in FAISS or a hosted vector DB. Then you check the index size and it’s 150–700 GB — larger than the data […]

Read More →
0

Ollama vs. llama.cpp: a technical deep dive for developers

Posted by

Running LLMs locally has become a normal part of how developers work. Two tools dominate this space: llama.cpp and Ollama. They look like competitors, but the relationship is more direct — Ollama is built on top of llama.cpp. This post covers the technical differences, where each performs better, and when to use one versus the other. Table of […]

Read More →