Local Privacy First MCP server for Llama.cpp

Kevin B — Mon, 04 Aug 2025 20:33:55 +0000

Hello All-

I built a "Privacy First" Model Context Protocol (MCP) server written in GO that provides text completion capabilities using local LLama.cpp models. This server exposes a single MCP tool that accepts text prompts and ohter parameters and returns AI-generated completions using locally hosted language models. I did this to learn more about protocol itself.

More can be found here about MCP https://modelcontextprotocol.io/overview

Link to my project
https://github.com/kbrisso/byte-vision-mcp

Thanks,
Kevin

Byte-Vision delivers powerful Retrieval Augmented Generation by integrating Llama.Cpp and Elasticsearch's vector search.

Kevin B — Fri, 25 Jul 2025 18:15:10 +0000

Hello All-

Keep your document research private with Byte-Vision! This open-source AI application delivers powerful Retrieval Augmented Generation (RAG) by integrating Llama.Cpp and Elasticsearch's vector search capabilities. The key? It runs 100% locally, ensuring your data never leaves your device.

✨ Key Features

📄 Universal Document Processing - Parse PDFs, text files, and CSVs with built-in OCR for image-based content
🔍 AI-Enhanced Search - Semantic search powered by Elasticsearch and vector embeddings
💬 Conversational AI - Document-specific Q&A and free-form chat with local LLM integration
📊 Research Management - Automatically save and organize insights from document analysis
🔒 Privacy-First - Runs entirely locally with no external data transmission
🖥️ Intuitive Interface - Full-featured UI that simplifies complex document operations

Core Technologies

Wails - Desktop application framework
Go - Backend services and APIs
React - Frontend user interface
Elasticsearch - Document indexing and search
Llama.cpp - Local AI model inference

https://github.com/kbrisso/byte-vision

Thanks,
Kevin Brisson

Forem: Kevin B

Local Privacy First MCP server for Llama.cpp

Byte-Vision delivers powerful Retrieval Augmented Generation by integrating Llama.Cpp and Elasticsearch's vector search.