VaayuMitra (Easy and reliable Weather analysis via voice for farmers and fishermen)
Link to open source: https://github.com/Harsh-on-linux/echosphere
Link to Live Project: https://vaayumitra.thedeltacorp.in/
VaayuMitra — Bharat's Voice-Native Weather Intelligence
IMD-grounded voice assistant for farmers, fishermen, and disaster teams — district forecasts, sea-state and cyclone alerts in your language, no typing or English needed.
What it is
VaayuMitra is a voice-native, multilingual meteorological assistant that bridges the last-mile gap between official IMD / INCOIS data and rural-coastal communities. Users speak naturally over web or phone, and get actionable, persona-tailored answers with official source + timestamp — never hallucinated numbers.
How it works
1. Connect: Browser gets RTC+RTM Token007 via GET /api/get_config, joins Agora SD-RTN.
2. Start: POST /api/startAgent launches Agora Conversational AI Engine cloud session with language + persona.
3. Converse: ASR → LLM → TTS loop streams audio over RTC, transcripts over RTM, with barge-in interruption.
4. Ground: LLM calls POST /mcp FastMCP tools — resolve_location → forecast / nowcast / marine / cyclone / crop advisory — then speaks concise reply in user's language.
5. Stop: POST /api/stopAgent + 120s idle_timeout guard prevents free-tier burn.
Key Features
- 3 personas: farmer (sowing/spraying/irrigation), fisherman (wave, wind, PFZ + 45 km/h safety guard), disaster (evacuation, helplines 1077/112)
- Real IMD tools: 5-day forecast, district nowcast, cyclone warnings, marine bulletin, agromet advisory, radar/satellite meta, SOS broadcast
- Location intelligence: RapidFuzz over 700+ districts + aliases + Haversine GPS fallback
- Multilingual voice: English via Deepgram + MiniMax; Hindi / Marathi / Bhojpuri via Sarvam Saarika v2 + Bulbul v3 + GPT-4o-mini
- Cyclone eAtlas: Leaflet GeoJSON tracks + cone of uncertainty + IMD intensity colors
- Telephony-first: PSTN dial/hangup + phone-bridge fallback for feature phones
- Free-tier guards: managed credentials, 300s IMD cache, circuit-breaker mock fallback, no cloud recording
Stack
Agora RTC + RTM + Conv AI Engine · Next.js 16 / React 19 / UIKit · FastAPI + FastMCP + RapidFuzz · Deepgram / Sarvam / OpenAI / MiniMax
This build was uploaded as a hackathon project
