AgoraCare Triage: Multilingual Healthcare Assistance-Line Agent
Link to open source: https://github.com/iamaanahmad/AgoraCare
Link to Live Project: https://agoracare.vercel.app/
AgoraCare Triage is a real-time, voice-native frontline support agent designed for hospital networks and public health helplines. The project's primary purpose is to efficiently triage stressed callers in noisy environments using natural, multilingual code-switching (e.g., seamlessly understanding mixed Hindi and English).
Our goal is to build an AI that can calmly collect critical patient information and confirm its understanding, while strictly adhering to safety guardrails (e.g., refusing to provide medical diagnoses). Crucially, the system features a smart escalation protocol: when the AI detects low confidence, high caller stress, or a situation requiring human medical judgment, it seamlessly transfers the call to a live human operator via Agora RTC. The human agent instantly receives a live dashboard containing a comprehensive summary of the conversation, allowing for immediate and informed human intervention.
Recent Changelog (v1.0.0-rc.1)
✨ New Features & Polish
- Live Agent Dashboard Stats: Added a real-time statistics summary (Total Escalations, Resolved Today, Waiting Patients) to the top of the Live Agent Dashboard.
- Vitals Real-time Simulation: Added a "Simulate Live Data" toggle to the Vitals page that streams randomized mock vitals (Heart Rate & Blood Pressure) to Firestore every 3 seconds for live demo presentations.
- Auto-Assigned Doctors: The Appointment booking flow now uses a dropdown populated with mock specialists based on the AI’s symptom analysis, replacing the manual text input.
🐛 Bug Fixes
- Emergency Call Audio Fix: Resolved an issue where two-way audio was silent during emergency calls by explicitly executing the
.play()command on remote audio tracks upon subscription. - Call Hang-up Sync: Fixed an issue where the Agent Dashboard failed to disconnect if a patient hung up the emergency call. The dashboard now listens for
userLeftevents and auto-resolves the ticket. - Disappearing Legacy Medications: Fixed a critical bug in the database query logic where uploading a new prescription would cause legacy medications (e.g., Metformin, Lisinopril) to disappear from the UI. The app now correctly merges medications from all profile paths.
- Prescription UI State: Adding a medication to the schedule now instantly updates the UI state (showing the "Added" badge) without requiring a page refresh.
- Prescription Status Spinner: Added the missing spinning animation to the "Pending" status icon on the Prescription History tab.
This build was uploaded as a hackathon project
.png "Akshay Nandwana")
The project looks good, but please make sure you are actually using Agora Conversational AI Engine, not only Agora RTC.
Right now, the README mentions Agora Conversational AI, but I couldn’t clearly verify the agent integration in the code. Please ensure your implementation starts/configures an Agora Conversational AI agent and uses it for the real-time voice AI flow.
For the hackathon, Agora Conversational AI usage is mandatory, so please update the implementation if it’s currently only using Agora RTC.
.png "Amaan Ahmad")
.png "Amaan Ahmad")