Forem

astronaut profile picture

astronaut

AI Systems Engineer Building production-grade LLM infrastructure with high-load backend background (Go, distributed systems)

Education

Software Engineer

Pronouns

Max

Work

AI Engineer

Design Recipe: Observability Pyramid for LLM Infrastructure
Cover image for Design Recipe: Observability Pyramid for LLM Infrastructure

Design Recipe: Observability Pyramid for LLM Infrastructure

5
Comments 9
3 min read

Want to connect with astronaut?

Create an account to connect with astronaut. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Build Your Own Spaceport: Local RAG Evaluation with Meta CRAG
Cover image for Build Your Own Spaceport: Local RAG Evaluation with Meta CRAG

Build Your Own Spaceport: Local RAG Evaluation with Meta CRAG

3
Comments 6
4 min read
🧑‍🚀 LLM Engine Telemetry: How to Profile Models and See Where Performance is Lost
Cover image for 🧑‍🚀 LLM Engine Telemetry: How to Profile Models and See Where Performance is Lost

🧑‍🚀 LLM Engine Telemetry: How to Profile Models and See Where Performance is Lost

Comments
5 min read
🧑‍🚀 Choosing the Right Engine to Launch Your LLM (LM Studio, Ollama, and vLLM)
Cover image for 🧑‍🚀 Choosing the Right Engine to Launch Your LLM (LM Studio, Ollama, and vLLM)

🧑‍🚀 Choosing the Right Engine to Launch Your LLM (LM Studio, Ollama, and vLLM)

1
Comments 3
3 min read
🧑‍🚀 Mission Accomplished: How an Engineer-Astronaut Prepared Meta’s CRAG Benchmark for Launch in Docker
Cover image for 🧑‍🚀 Mission Accomplished: How an Engineer-Astronaut Prepared Meta’s CRAG Benchmark for Launch in Docker

🧑‍🚀 Mission Accomplished: How an Engineer-Astronaut Prepared Meta’s CRAG Benchmark for Launch in Docker

1
Comments
3 min read
loading...