Skip to content

Forem

# llm

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Cover image for Running AI Fully Offline on Mobile with Gemma 4 (Android + iOS)

System Rationale

Apr 13

Running AI Fully Offline on Mobile with Gemma 4 (Android + iOS)

#ai #android #llm #mobile

3 min read

Cover image for We open-sourced our AI attack detection engine — 97 MITRE ATLAS rules in a Rust crate

AKAVLABS

Apr 13

We open-sourced our AI attack detection engine — 97 MITRE ATLAS rules in a Rust crate

#rust #security #llm #opensource

3 min read

Cover image for 16 frameworks. One Blind Spot

Andrey Kucherenko

May 6

16 frameworks. One Blind Spot

#ai #agents #llm #opensource

9 min read

Apr 13

How to Track LLM Costs and Rate Limits on AWS Bedrock with an AI Gateway

#aws #llm #opensource #ai

6 min read

Cover image for (The Voice) Multilingual Layer

Nadine

Apr 27

(The Voice) Multilingual Layer

#ai #llm #nlp #security

4 min read

Apr 13

Test Your LLM Outputs in pytest (15ms, No API Key)

#python #testing #llm #pytest

4 min read

soy

Apr 13

Llama4 108B Local Inference, MiniMax M2.7 GGUF Alert, & Ollama Security Scanner

#ai #llm #selfhosted

3 min read

김이더

Apr 13

AI한테 기억을 가르치려면, 잊는 법부터 가르쳐야 한다

#ai #llm #memorybank

2 min read

Cover image for Why your AI response restarts on page refresh (and what it takes to prevent it)

Ably Blog

Apr 13

Why your AI response restarts on page refresh (and what it takes to prevent it)

#ai #architecture #llm #webdev

3 min read

Cover image for Resume tokens and last-event IDs for LLM streaming: How they work & what they cost to build

Ably Blog

Apr 13

Resume tokens and last-event IDs for LLM streaming: How they work & what they cost to build

#ai #architecture #llm #systemdesign

6 min read

Cover image for Persistent Identity Agents: Why Memory Isn’t Enough

NILE GREEN

Apr 13

Persistent Identity Agents: Why Memory Isn’t Enough

#ai #tutorial #agents #llm

2 min read

Apr 13

Building a Voice-Controlled AI Agent That Runs Entirely on Your Laptop

#showdev #agents #ai #llm

3 min read

Apr 13

Build LLM Guardrails in 3 Lines of Python (No API Key, No Cloud)

#python #ai #security #llm

6 min read

Apr 13

Challenges and Accomplishments in the task of building an AI based intent classifier

#agents #ai #llm #nlp

2 min read

Apr 13

Open Source LLMs in 2026: Can Llama 4 / DeepSeek V3 Replace GPT for Business?

#ai #automation #llm #opensource

7 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.