Most tools feel heavier than they need to be

Siddharth — Mon, 22 Dec 2025 10:53:18 +0000

Most software doesn’t feel heavy because it’s slow or badly engineered.
It feels heavy because it asks for attention too often.

Each new feature usually makes sense in isolation. But over time, these decisions stack up — more UI states to understand, more options to consider, more interruptions to flow.

I’ve been thinking a lot about how lightness in tools isn’t about removing power.
It’s about reducing unnecessary decisions.

Curious how others notice this in their daily tools.

From a Pyodide Wrapper to an Edge AI Engine

Siddharth — Wed, 17 Dec 2025 01:00:51 +0000

A few months ago, I shipped v1 of a React library that let you run Python ML models directly in the browser.

It worked — but the feedback was blunt and fair:

“This is basically just a wrapper around Pyodide.”

That line mattered, because it exposed the real problem.

What v1 got right (and wrong)

v1 proved feasibility

Python + WASM + React can work client-side.

But it also broke down fast in real apps:

Inference froze the UI
Workers outlived React components → memory leaks
WASM OOMs caused silent hangs
Cleanup logic was fragile and scattered

Running Python wasn’t the hard part.

Orchestrating failure was.

What changed in v2

v2 is a full rewrite — shifting from a wrapper to an infrastructure layer for Edge ML:

Supervised worker pools

Hung or OOM workers are terminated and replaced automatically.
Strict React lifecycle binding

Component unmount = worker termination. No zombies.
Zero-copy data paths

SharedArrayBuffer where possible to avoid serializing large tensors.

The goal wasn’t speed alone — it was predictability under failure.

Where this is going

I’m now prototyping a Neural Bundler — a build-time compiler that translates Python math logic into WebGPU compute shaders, skipping Pyodide entirely for math-heavy workloads.

Still early. Very promising.

If you’re building client-side ML, edge inference, or anything involving WASM + React, I’d love your thoughts.

Repo link: https://github.com/ShyamSathish005/python-react-ml

Forem: Siddharth

Most tools feel heavier than they need to be

From a Pyodide Wrapper to an Edge AI Engine

What v1 got right (and wrong)

What changed in v2

Where this is going