Forem

# benchmark

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
We Benchmarked the Most Popular Code Search Tools. We Beat All of Them.
daynablackwell profile

We Benchmarked the Most Popular Code Search Tools. We Beat All of Them.

#ai #mcp #benchmark #devtools
Comments
11 min read
Two Models Just Hit 90% on Agent Coding. One Cost Less Than a Penny.
vystartasv profile

Two Models Just Hit 90% on Agent Coding. One Cost Less Than a Penny.

#ai #agents #benchmark #llm
Comments
2 min read
The False Positive Tax: a 1:1 TP:FP analysis of eslint-plugin-security
Cover image for The False Positive Tax: a 1:1 TP:FP analysis of eslint-plugin-security
ofri-peretz profile

The False Positive Tax: a 1:1 TP:FP analysis of eslint-plugin-security

#security #eslint #javascript #benchmark
Comments
11 min read
Multi-Shot vs Zero-Shot: When Adding Examples Actually Hurts Accuracy
Cover image for Multi-Shot vs Zero-Shot: When Adding Examples Actually Hurts Accuracy
gabrielanhaia profile

Multi-Shot vs Zero-Shot: When Adding Examples Actually Hurts Accuracy

#ai #llm #prompt #benchmark
Comments
8 min read
How does an AI agent pick from 686 skills in a second?
klymentiev profile

How does an AI agent pick from 686 skills in a second?

#ai #benchmark #embeddings #claudecode
Comments
7 min read
LMR-BENCH: Can LLM Agents Reproduce NLP Research Code? (EMNLP 2025)
jangwook_kim_e31e7291ad98 profile

LMR-BENCH: Can LLM Agents Reproduce NLP Research Code? (EMNLP 2025)

#benchmark #researchreproducibility #llmagents #paperpoc
Comments
5 min read
AI-generated accessibility, an update — frontier models still fail, but skills change the game
mfairchild365 profile

AI-generated accessibility, an update — frontier models still fail, but skills change the game

#a11y #llm #ai #benchmark
Comments 1
6 min read
I Benchmarked 17 ESLint Security Plugins. Only One Found Every Vulnerability.
Cover image for I Benchmarked 17 ESLint Security Plugins. Only One Found Every Vulnerability.
ofri-peretz profile

I Benchmarked 17 ESLint Security Plugins. Only One Found Every Vulnerability.

#security #eslint #javascript #benchmark
Comments
9 min read
Why Code Golfing is the Ultimate Test for Multimodal LLMs (And a New Benchmark to Prove It)
Cover image for Why Code Golfing is the Ultimate Test for Multimodal LLMs (And a New Benchmark to Prove It)
beowolve profile

Why Code Golfing is the Ultimate Test for Multimodal LLMs (And a New Benchmark to Prove It)

#opensource #ai #webdev #benchmark
Comments
1 min read
Claude Sonnet 4.6 vs GPT-4.1 vs Gemini 2.5 Flash: which wins JSON extraction?
shaun_vd_7562913ba77e1e0b profile

Claude Sonnet 4.6 vs GPT-4.1 vs Gemini 2.5 Flash: which wins JSON extraction?

#ai #llm #benchmark #claude
Comments
3 min read
Benchmarks- Kubernetes MCP Servers Passed. That Was Not Enough.
vitas profile

Benchmarks- Kubernetes MCP Servers Passed. That Was Not Enough.

#kubernetes #ai #benchmark #opensource
Comments 1
4 min read
How do you benchmark an MCP server you built?
Cover image for How do you benchmark an MCP server you built?
luuuc profile

How do you benchmark an MCP server you built?

#ai #mcp #claude #benchmark
Comments
8 min read
Model Showdown Round 4: Opus vs Qwen — Writers, Not Coders
carryologist profile
Rob

Model Showdown Round 4: Opus vs Qwen — Writers, Not Coders

#ai #llm #benchmark #agents
Comments
10 min read
Why Most Browser AI Demos Fail on Real Hardware
bruno_juca_7038c22bcca1db profile

Why Most Browser AI Demos Fail on Real Hardware

#ai #inference #hardware #benchmark
Comments
4 min read
The Agentic Gap: Claude Oneshots, Gemma Fails
carryologist profile
Rob

The Agentic Gap: Claude Oneshots, Gemma Fails

#ai #llm #benchmark #homelab
Comments
9 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.