Where developers grow together

SahaayaAI — AI That Knows When to Ask for Help

SahaayaAI is a multilingual, real-time voice AI assistance agent designed for difficult customer-support and public-information conversations. Real callers may switch between languages, speak through background noise, interrupt the agent, or provide incomplete information. In these situations, simply generating a confident answer is not enough — the AI must know when it is uncertain. SahaayaAI follows a five-stage operating loop: Understand → Collect → Confirm → Assess → Escalate. It identifies the caller's intent and essential details such as location and service identifiers, while maintaining field-level confidence. When a critical detail is unclear, SahaayaAI does not guess. It asks for confirmation and, if uncertainty remains, escalates the conversation to a human with the relevant transcript, confirmed information, missing information, confidence indicators, and reason for escalation. The prototype demonstrates Hindi + English code-switching, noisy-call handling, interruption awareness, confidence-aware decision making, critical-detail confirmation, and human-in-the-loop escalation using real-time voice communication. Our core principle is simple: AI handles the conversation. Humans handle the decisions. SahaayaAI is designed not to replace human support agents, but to handle the conversation safely until human judgment is needed.

Smart Classroom AI – Voice AI Co-Teacher

Smart Classroom AI is an AI-powered digital classroom designed to ensure continuous learning even when a teacher is unavailable. It combines Agora real-time audio/video communication with Google Gemini AI to provide an interactive AI Co-Teacher that can explain lessons, answer student doubts, support voice interaction, and provide live classroom transcription.

VaayuMitra (Easy and reliable Weather analysis via voice for farmers and fishermen)

VaayuMitra — Bharat's Voice-Native Weather IntelligenceIMD-grounded voice assistant for farmers, fishermen, and disaster teams — district forecasts, sea-state and cyclone alerts in your language, no typing or English needed. What it isVaayuMitra is a voice-native, multilingual meteorological assistant that bridges the last-mile gap between official IMD / INCOIS data and rural-coastal communities. Users speak naturally over web or phone, and get actionable, persona-tailored answers with official source + timestamp — never hallucinated numbers. How it works1. Connect: Browser gets RTC+RTM Token007 via GET /api/get_config, joins Agora SD-RTN.2. Start: POST /api/startAgent launches Agora Conversational AI Engine cloud session with language + persona.3. Converse: ASR → LLM → TTS loop streams audio over RTC, transcripts over RTM, with barge-in interruption.4. Ground: LLM calls POST /mcp FastMCP tools — resolve_location → forecast / nowcast / marine / cyclone / crop advisory — then speaks concise reply in user's language.5. Stop: POST /api/stopAgent + 120s idle_timeout guard prevents free-tier burn.Key Features - 3 personas: farmer (sowing/spraying/irrigation), fisherman (wave, wind, PFZ + 45 km/h safety guard), disaster (evacuation, helplines 1077/112)- Real IMD tools: 5-day forecast, district nowcast, cyclone warnings, marine bulletin, agromet advisory, radar/satellite meta, SOS broadcast- Location intelligence: RapidFuzz over 700+ districts + aliases + Haversine GPS fallback- Multilingual voice: English via Deepgram + MiniMax; Hindi / Marathi / Bhojpuri via Sarvam Saarika v2 + Bulbul v3 + GPT-4o-mini- Cyclone eAtlas: Leaflet GeoJSON tracks + cone of uncertainty + IMD intensity colors- Telephony-first: PSTN dial/hangup + phone-bridge fallback for feature phones- Free-tier guards: managed credentials, 300s IMD cache, circuit-breaker mock fallback, no cloud recording StackAgora RTC + RTM + Conv AI Engine · Next.js 16 / React 19 / UIKit · FastAPI + FastMCP + RapidFuzz · Deepgram / Sarvam / OpenAI / MiniMax