Forem: Pacy

Introducing TCG, The Cruise god - the world's first multiplayer voice AI concierge, game master, and local guide.

Pacy — Fri, 27 Mar 2026 13:10:33 +0000

We Built a Multiplayer Voice AI That Actually Runs the Party
Live demo: thecruisegod.vercel.app

Six friends. One city. Zero agreement on what to do next.

Here's the thing nobody talks about: every AI voice assistant ever built assumes you're alone. You whisper into it. It whispers back. Clean, personal, useless for a group.

Real life is messier. Three problems hit at once:

Where are we going? Someone's Googling. Someone's scrolling TikTok for vibes. A third texted "idk, you pick." Nobody picks.
Who do we call? The group needs a DJ for Saturday or a barber open right now. Someone texts their cousin. The cousin doesn't respond. The moment dies.
What are we doing right now? You're already together but the energy's flat. The night either catches fire or it doesn't — and it usually doesn't.
No AI handles any of this. And none of them can do it for a whole room at once.

So we built TCG — The Cruise God.

What Is TCG?
TCG is the world's first multiplayer voice AI concierge, game master, and local guide. It's a live, conversational AI that physically drives its own React UI while it talks — serving an entire group simultaneously.

You tap the character. TCG wakes up. You tell it where you are and what the vibe is. It runs the night — out loud, with personality, without anyone touching a single button.

Three modes. Each purpose-built for a real group scenario.

🟢 Locator Mode
"Find us somewhere to go."

Tell TCG the vibe — rooftop bar, late-night spot, live music — and it:

Dynamically builds a contextual search query from your location and energy
Live-scrapes the web via Firecrawl
Reads back real venue recommendations while the UI snaps into a card layout
It's not a Google search. It knows your city, your crew size, and what kind of night you're trying to have.

🔌 Plug Mode
"Find me someone who can handle this."

Need a DJ for next weekend? A same-day mechanic? A barber open right now?

Plug Mode rewrites queries with urgency context — "available now open today same-day" — runs a live search, and voices the results. It's the "who do you know?" answer, surfaced by AI.

🎮 Game Master Mode
"Let's play something."

This is where TCG earns its name.

Say "teach us a drinking game for 6 people, chaotic energy" and TCG doesn't just name a game. It scrapes the full rule set in Markdown via Firecrawl and reads the rules aloud, step by step, to the room.

The UI opens a live Game Session dashboard — scoreboard, current turn, player list, rules summary — that TCG updates as the game progresses.

Plus 9 built-in party tools available on command:

Tool Details
Spin the Bottle Synced with the room's live guest list
Truth or Dare 3 intensity levels
Charades 4 categories
Coin Flip / Dice Roll Voice-triggered
Randomizer Splits guests into named groups
Timer Countdown, voice-controlled
Scoreboard Live tracked
Bill Splitter Camera → Gemini Vision → split result read aloud

The Tech Stack

ElevenLabs — The Heartbeat
We didn't use ElevenLabs just for TTS. We architected 10 custom Client Tools that let the agent autonomously control the React frontend in real-time:

switchMode → Snaps the UI between Locator / Plug / Game Master / Tools
openTool → Opens any party tool on command
showQR → Displays the CruiseHQ join QR code
randomizeGroups → Splits guests into named groups
setGroupLeader → Elects and announces a group captain
updateGameState → Syncs the live scoreboard
displayResults → Populates venue/service result cards
analyzeImage → Opens camera → Gemini Vision
createMemory → Screenshot → Supabase Storage → Trophy + viral caption
stopListening → Cuts the mic at hardware level
TCG says "let me pull that up" — and the UI snaps. The conversation never breaks.

Firecrawl — The Search Pipeline
A production-grade 3-tier pipeline:

Supabase (7-day cache) → Upstash Redis (15-min hot cache) → Firecrawl live scrape
Queries are dynamically rewritten for context. "Chaotic game for 6" becomes:

"for 6 players wild hilarious high-energy party game rules how to play"

Game searches extract full Markdown rule sets. TCG teaches the room, rule by rule, out loud.

Supabase Realtime — The Multiplayer Backbone
Friends scan a QR code from their phones and land in a full CruiseHQ interface. They're not just watching — they're in the room.

Supabase Realtime handles:

Presence tracking — live roster of who's in the room
Broadcast channels — dares, group chats, poll votes, co-host voice transcripts
Sub-second latency across every connected device
When a guest sends TCG a dare from their phone, it's injected as a live user message into the active ElevenLabs voice session. TCG hears it. TCG acts on it. In front of the whole room.

Gemini 2.5 Flash Vision — Eyes for the Room
Vision isn't just about reading text—it's TCG's way of physically "seeing" the party. It integrates directly with the live ElevenLabs voice session as natural context, so TCG actually sees the room and talks about it.

Act as a Referee: Show TCG a chaotic game board, a Charades drawing, or a physical challenge, and its Game Vision acts as an impartial, live judge.
Split the Check: Point the camera at a receipt → TCG reads the total, splits it per person, auto-detects dynamically the currency from your GPS location, and reads the result aloud to the group.
Verify Items: Scan a barcode → instantly validated against the Open Food Facts API to tell you exactly what you're holding.

What Makes It Actually Different
We didn't add "multiplayer" as a feature. We rebuilt the entire architecture around the assumption that the AI is serving a room, not a person.

CruiseHQ submissions: A word submitted from a guest's phone can be silently inserted into the agent's context — invisible to the host's transcript, visible only to TCG. The AI knows the word. The host doesn't. The game works.IT can also be public, leaving the power in your hands. This lets you post dares, suggestions- anything that requires a submission, CruiseHQ is equipped to process.

The Groups trick: When the host says "randomize the groups," the randomizeGroups Client Tool runs, CruiseHQ auto-creates group tabs, every guest's interface updates, and TCG announces the result out loud with personality — all in one voice command.

Wingman Protocols: Users can set secret instructions ("always suggest dive bars", "roast me constantly") that are injected into the ElevenLabs system prompt on every session start. TCG already knows you before you say a word.

Trophy Room: When a moment lands, TCG proactively captures it — screenshot via html2canvas, uploaded to Supabase Storage, saved as a Trophy with a generated viral caption, shared from /trophy-room.

Try It
👉 thecruisegod.vercel.app

Open it on one device. Share the QR code with your friends. Tell TCG where you are.

Let it run the night.

From Clinic to Code: Engineering GozAI, a Clinically- grounded AI Copilot for Low Vision & Visually impaired

Pacy — Mon, 16 Mar 2026 14:33:49 +0000

For the 2.2 billion people experiencing vision impairment globally, standard assistive technology often feels like a burden rather than a bridge.
The seed for my latest project, GozAI, was planted back in 2022 during my 500-level Optometry externship at the University of Ilorin Teaching Hospital (UITH) in Nigeria. Working under the guidance of a low-vision and pediatric specialist, I spent my days with countless patients navigating life with severe visual impairments.
Day after day, I witnessed the same frustrating reality: traditional low-vision aids are incredibly fragmented and prohibitively expensive. Patients were being asked to carry and pay a premium for clunky, single-purpose digital magnifiers.
Even then, it raised a glaring question: We are in the digital age. Why hasn't this been solved using the devices already in our pockets? At the time, I had the clinical domain expertise to know exactly what the solution should look like, but I lacked the software engineering skills to actually build it. The idea stayed on the shelf.

The Catalyst: Agentic Coding and Clinical Reality

Fast forward to 2026. Recent clinical research has completely validated what I saw in the clinic years ago, showing a staggering abandonment rate of up to 50% for specialized assistive gadgets. The primary culprits? Cost, severe battery drain, and the social stigma of carrying them. People don’t want another heavy device to manage. They just want the smartphone they already own to act as their eyes.
At the same time, we entered the era of agentic coding. With recent leaps in AI development tools, the technical barriers to entry that once held me back vanished. By building entirely with Google's Antigravity, I was finally able to take the clinical blueprints from my externship experience and code them into reality.

Building GozAI: A Multimodal Accessibility Copilot

When I entered the Gemini Live Agent Challenge, I set out with an uncompromising goal: build an accessibility copilot that is battery-optimized, emotionally reassuring, and rooted entirely in clinical reality.
GozAI is a real-time voice and vision assistant powered by the Gemini 2.0 Flash Multimodal Live API and hosted on Google Cloud Run. Instead of just building a "talking camera" that overwhelms the user, I engineered it to act as an intelligent, empathetic filter.

Bridging the Gap: Clinical Need & Technical Execution

Verified Clinical Grounding: To ensure GozAI wasn't just another tech novelty, I didn't want it just guessing. I engineered the backend RAG architecture (built using the Google ADK) to strictly rely on real, verified optometry data and textbooks. It operates under strict clinical guardrails, ensuring the advice and spatial orientation it provides are safe and accurate.
Semantic Vibro-Acoustics: Continuous audio feedback causes massive cognitive fatigue for low-vision users. GozAI captures frames at a battery-saving 1 FPS and uses synchronized haptics for navigation. It only delivers audio warnings for immediate hazards, keeping the user's mental bandwidth clear.
The Glaucoma Protocol: Progressive vision loss carries a high risk of depression and anxiety. GozAI’s persona is strictly constrained to be an anchor of psychological safety—calm, steady, and reassuring. It doesn't just see for the user; it acts as a supportive companion.
The UI Navigator: For digital environments, GozAI acts as a bridge where standard screen readers fail. Using Gemini’s multimodal capabilities, it can interpret unlabelled buttons on a screen, read medical labels offline (via Google ML Kit), and even inject synthetic screen taps for the user. ## The Technical Backbone To make this vision a reality, we leveraged a robust Google-native stack:

Flutter PWA / Mobile
└── Gemini Multimodal Live API (Bidirectional WebSocket)
└── Google ADK Agent (Cloud Run)
├── Tool: Optometry Guidelines (Verified RAG)
├── Tool: Medication Lookup (OpenFDA)
├── Tool: SOS → Firestore
└── Tool: Clinical Stats
└── Firebase / Firestore (Companion Memory)
The mobile client connects directly to the Gemini Multimodal Live API via a bidirectional WebSocket, streaming real-time audio and camera frames simultaneously — ensuring near-zero latency for those critical safety moments.

Closing the Gap
GozAI proves that when you combine deep clinical empathy with bleeding-edge tools like the Gemini Live API and Google's Antigravity, you can build solutions that actually restore independence, rather than just adding another gadget to a patient's bag.

Everyone deserves to navigate the world with confidence.

This piece was created for the purposes of entering the Gemini Live Agent Challenge. 🚀

Check out the code: https://github.com/Kryptopacy/GozAI
🌐 Try the Demo: gozai-app.web.app
🚀 Built for: Gemini Live Agent Challenge | Tracks: Live Agents + UI Navigator