Forem: Ravikash Gupta

QORA - Native Rust LLM Inference Engine

Ravikash Gupta — Sat, 28 Feb 2026 17:51:01 +0000

Pure Rust inference engine for the SmolLM3-3B language model. No Python runtime, no CUDA, no external dependencies. Single executable + quantized weights = portable AI on any machine.

Downlod 🤗: https://huggingface.co/qoranet/QORA-LLM

Key Architectural Innovation: NoPE (No Position Encoding)
SmolLM3 uses a 3:1 NoPE ratio — 75% of layers have no positional encoding at all. Only layers 3, 7, 11, 15, 19, 23, 27, 31, 35 apply RoPE. This reduces computational overhead and enables better long-context generalization.

Performance Benchmarks
Test Hardware: Windows 11, CPU-only (no GPU acceleration)

QORA-TTS - Native Rust Text-to-Speech Engine

Ravikash Gupta — Sat, 28 Feb 2026 17:47:08 +0000

Pure Rust text-to-speech synthesis engine. No Python runtime, no CUDA, no external dependencies. Single executable + quantized weights = portable TTS on any machine.

Downlod 🤗: https://huggingface.co/qoranet/QORA-TTS

All engines are pure Rust, CPU-only, single-binary executables with no Python dependencies.

Supported Languages
English, Chinese, German, Italian, Portuguese, Spanish, Japanese, Korean, French, Russian, Beijing Dialect, Sichuan Dialect

Quantization
Q4: 4-bit symmetric, group_size=32 (default, 1.5 GB)
F16: Half-precision floats (optional, ~3 GB)
6.4x compression ratio from f32 to Q4

Qoranet's Pure Rust AI Infrastructure

Ravikash Gupta — Sat, 28 Feb 2026 04:02:15 +0000

⚡ QoraNet

Pure Rust AI Infrastructure for the Privacy-First Blockchain

Building AI models that run without Python, without cloud, without paid APIs.
Just Rust. Just your machine. Just freedom.

🧠 What We're Building

QoraNet is building the world's first privacy-first blockchain with native AI infrastructure — and we're open-sourcing the AI models that power it.

Our AI stack is built entirely in Rust using the Burn framework. No Python runtime. No PyTorch. No TensorFlow. No CUDA dependency. No C++ libraries.

One binary. Zero dependencies. Runs anywhere.

🔥 Released Models

QORA-LLM

Pure Rust inference engine — no Python, no CUDA, no external dependencies

Detail	Spec
Architecture	SmolLM3-3B based
Language	Pure Rust (Burn framework)
Dependencies	Zero external ML libraries
Quantization	Optimized for local execution
Platforms	Windows, macOS, Linux, iOS, Android
GPU Required	No — runs on CPU
API Key Required	No
Cost	Free forever

# Clone and run — that's all you need
git clone https://github.com/qora-protocol/qora-llm
cd qora-llm
cargo run --release

qoranet (Qoranet)

QORA (Quantum Orchestrated Runtime Architecture) is a next-gen platform merging AGI, blockchain, and secure digital infrastructure. QORA's mission is to build the future of autonomous, intelligent...

huggingface.co

🗺️ Roadmap — What's Coming

We're building a complete multi-modal AI suite in pure Rust:

Model	Status	Description	Link
QORA-LLM	✅ Released	Language model — chat, reasoning, code	https://huggingface.co/qoranet/QORA-LLM
QORA-TTS	✅ Released	Text-to-speech — voice synthesis	https://huggingface.co/qoranet/QORA-TTS
QORA-Vision-Image	✅ Released	Image + video understanding	https://huggingface.co/qoranet/QORA-Vision-Image
QORA-Vision-Video	✅ Released	Speech-to-text — voice input	https://huggingface.co/qoranet/QORA-Vision-Video
QORA-Agent	📅 Planned	Autonomous AI agent with tool use

Each model follows the same philosophy: pure Rust, zero dependencies, runs locally, free forever.

🏗️ Part of the QoraNet Ecosystem

Our AI models are a core component of the QoraNet blockchain — the world's fastest Layer-1 with mandatory privacy.

┌─────────────────────────────────────────────┐
│            QoraNet Blockchain               │
│          400ms Finality • 100k+ TPS         │
├─────────────┬───────────┬───────────────────┤
│  Privacy    │  DeFi     │  Social           │
│             │           │                   │
│  ZK-SNARKs  │  DEX      │  Encrypted Chat   │
│  PLONK+KZG  │  CLOB     │  Video/Voice      │
│  Stealth    │  Perps    │  AI Assistants    │
│  Addresses  │  Oracle   │  Bot Framework    │
├─────────────┴───────────┴───────────────────┤
│              AI Infrastructure              │
│                                             │
│  QORA-LLM • QORA-TTS • QORA-Vision          │
│  Pure Rust • On-chain billing • Verifiable  │
│  Decentralized inference across validators  │
└─────────────────────────────────────────────┘

Key Blockchain Features

400ms instant finality — 10-50x faster than any EVM chain
Mandatory ZK-SNARK privacy — all tokens private by default
34 native modules — DEX, orderbook, perpetuals, oracle, chat, AI, auth, KYC, and more
Full EVM compatibility — deploy Solidity contracts with built-in privacy
Native encrypted chat — E2E encrypted messaging, video, and voice calls
On-chain AI billing — token-based payments for AI inference

🔐 Our AI Philosophy

Principle	What It Means
Pure Rust	No Python, no C++ FFI, no heavy runtimes
Zero Dependencies	Single binary, nothing else to install
Local First	Runs on your hardware, not our servers
Privacy by Default	Your data never leaves your machine
Free Forever	No API keys, no subscriptions, no limits
Cross Platform	Windows, macOS, Linux, iOS, Android
Open Source	Fully auditable, community-driven

⚡ Why Rust for AI?

Most AI models require Python + PyTorch + CUDA. We took a different path:

	Python Stack	QoraNet (Rust)
Install size	2-10 GB	Single binary
Startup time	10-30 seconds	< 1 second
Memory usage	High (GC overhead)	Minimal (zero-cost abstractions)
GPU required	Usually yes	No
Cross-compile	Painful	Native
Security	Runtime errors	Compile-time safety
Deployment	Docker + dependencies	Copy one file

🤝 Community & Contributing

We're building in the open and welcome contributions:

GitHub: github.com/qora-protocol
Twitter/X: @Qora_Net
LinkedIn: company/qoranet
Reddit: r/QoraNet
Email: info@qoranet.com

📜 License

Our AI models are open source. See individual model repos for specific license details.

Built with 🦀 Rust and 🔥 Burn

AI should be private, fast, free, and yours. We're making that real.

⚡ QoraNet — The Privacy-First Blockchain Infrastructure for AI

I built a free self-hosted memory system for Claude CLI — replaces Supermemory/Mem0/Zep

Ravikash Gupta — Fri, 13 Feb 2026 21:46:20 +0000

## What it does

Hybrid search: FTS5 full-text + vector similarity + importance + recency + access frequency
4 memory types (static, dynamic, episodic, semantic)
4 importance levels (critical → low)
Memory deduplication & auto-merge
Memory graph — link related memories together
Time-decay scoring (recent memories rank higher)
Auto semantic chunking for long texts
LLM-based fact extraction from conversations
Soft delete + restore
Export/import, bulk ops

## Claude CLI integration

MCP server with 8 tools (search, add, update, delete, profile, list, link, stats)
Claude automatically loads your profile at session start
Memories persist across sessions in SQLite
Drop-in .mcp.json — just restart Claude Code

## Also works with any AI app

Vercel AI SDK middleware (6 tools)
OpenAI middleware (auto-inject memories)
Framework-agnostic wrapper (Anthropic, Gemini, Ollama, anything)

## Tech

SQLite + FTS5 + better-sqlite3
5 embedding options (local BM25, OpenAI, Ollama, hybrid)
Zero cloud dependencies
36 tests, all passing

It's a single-folder drop-in. No Docker, no cloud, no API keys needed.

GitHub: https://github.com/blockmandev/ai-memory

Would love feedback from the community. What features would you add?