Sep 6, 2026

AURA: The AI Voice Incident Commander That Joins Your War Room | Agora ConvAI Demo

agora conversational ai ai agent python

๐Ÿšจ AURA โ€” Voice AI Incident Commander | Full End-to-End Demo

When a SEV-1 hits production, every second costs money. Engineers panic, talk over each other, 
throw out conflicting theories โ€” and cognitive overload sets in fast.

AURA is a real-time Voice AI Incident Commander that joins live IT war rooms as an active voice 
participant over Agora SD-RTNโ„ข and Conversational AI Engine. It listens to cross-talk, classifies 
raw speech into structured epistemic evidence, detects engineering contradictions in real-time, 
drives the incident to resolution, and auto-generates a full Google SRE postmortem โ€” all without 
a human scribe.

๐ŸŒ Live Demo: https://aura.akanksha.dev

โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
โฑ๏ธ AURA IN Details
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€

# AURA โ€” Voice AI Incident Commander

Real-time Voice AI Incident Commander that joins live IT war rooms as an active voice participant over Agora SD-RTNโ„ข and Conversational AI Engine.

Deployed at: [aura.akanksha.dev](https://aura.akanksha.dev)

---

## Tech Stack

- **Framework:** Next.js 16 (App Router, Turbopack)
- **Voice & Real-Time:** Agora RTC SDK (WebRTC), Agora Conversational AI Engine, Agora Signaling (RTM 2.x)
- **Animation & Physics:** Motion (`motion/react`)
- **Visuals:** Vanilla CSS Design System ("Operational Calm"), D3-Force (`d3-force`)
- **Testing:** Vitest, React Testing Library, JSDOM
- **Type Safety:** TypeScript 5, Zod

---

## Getting Started

### Prerequisites

- Node.js 20+
- Agora Developer Account (App ID, Certificate, Customer REST Key/Secret)

### Environment Setup

Copy `.env.example` to `.env.local` and populate credentials:

```bash
cp .env.example .env.local
```

Required environment variables:
```bash
# Agora RTC & RTM Configuration
NEXT_PUBLIC_AGORA_APP_ID=your_agora_app_id
AGORA_APP_ID=your_agora_app_id
AGORA_APP_CERTIFICATE=your_agora_app_certificate
AGORA_CUSTOMER_KEY=your_agora_customer_key
AGORA_CUSTOMER_SECRET=your_agora_customer_secret

# Agora Conversational AI Agent ID
NEXT_PUBLIC_AGORA_AGENT_ID=your_agora_agent_id

# Optional Integrations
SLACK_WEBHOOK_URL=https://hooks.slack.com/services/...
NEXT_PUBLIC_BASE_URL=http://localhost:3000
```

### Installation

```bash
npm install
```

### Development Server

```bash
npm run dev
```

Open [http://localhost:3000](http://localhost:3000) to view the application.

---

## Testing & Quality Assurance

### Run Automated Test Suite

AURA features comprehensive unit, component, API route, and integration test suites:

```bash
npm test
```

To run tests in interactive watch mode:
```bash
npm run test:watch
```

### Production Build

```bash
npm run build
```

---

## License

MIT

โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
โœจ KEY FEATURES SHOWN
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
โœ… Real-time Voice Bridge โ€” AURA joins the audio channel via Agora SD-RTNโ„ข WebRTC
โœ… Epistemic Classifier โ€” Classifies speech as Facts, Hypotheses, Decisions, or Action Items
โœ… Contradiction Detection โ€” Flags conflicting engineering theories instantly (LIVE on audio)
โœ… Two-Phase Commit Actions โ€” Stages Jira ticket creation & Slack broadcasts before executing
โœ… Verbal Readback โ€” AURA reads back all decisions to prevent miscommunication
โœ… D3 Microservice Topology โ€” Interactive live dependency graph with blast-radius visualization
โœ… Live Cost Burn Rate โ€” Real-time financial impact tracker in dollars/second
โœ… OODA Loop Tracking โ€” Observe โ†’ Orient โ†’ Decide โ†’ Act phase indicator
โœ… Automated SRE Postmortem โ€” One-click Google SRE Book compliant incident report

โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
๐Ÿ› ๏ธ TECH STACK
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
โ€ข Framework:       Next.js 16 (App Router + Turbopack)
โ€ข Voice & Network: Agora RTC SDK (WebRTC) + Agora Conversational AI Engine + Agora RTM 2.x
โ€ข AI/LLM Layer:    Custom OpenAI-powered LLM proxy with 16-directive incident commander system prompt
โ€ข MCP Bridge:      Model Context Protocol (SSE) for live tool execution
โ€ข Graph:           D3-Force for interactive microservice topology
โ€ข Animation:       Motion (motion/react) with physics-based springs
โ€ข Design System:   Vanilla CSS โ€” "Operational Calm" dark theme
โ€ข Type Safety:     TypeScript 5 + Zod schema validation
โ€ข Testing:         Vitest + React Testing Library (103 tests, 100% pass rate)

โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
๐Ÿ”— LINKS
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
๐ŸŒ Live Demo:     https://aura.akanksha.dev
๐Ÿ“ฆ GitHub Repo:   https://github.com/akanksha-dot-dev/aura
๐Ÿ“– Agora ConvAI:  https://www.agora.io/en/products/conversational-ai/

โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
๐Ÿ“Œ WHAT IS AGORA CONVERSATIONAL AI?
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
Agora's Conversational AI Engine lets you embed real-time AI voice agents directly into WebRTC 
audio channels. AURA uses this to make an LLM-powered agent an actual voice participant in the 
incident bridge โ€” not a passive observer, but a live, speaking, tool-using member of the war room.

โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
๐Ÿ“‹ INCIDENT SCENARIOS AVAILABLE
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
โ€ข SEV-1 Payment Gateway Outage (featured in this video)
โ€ข SEV-2 CDN Cache Invalidation Storm โ€” Global Latency Spike  
โ€ข SEV-0 Authentication Service Compromise โ€” Suspicious Token Generation
โ€ข SEV-1 Kubernetes Node Pool Exhaustion โ€” Pod Eviction Cascade

โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
๐Ÿ—๏ธ ARCHITECTURE HIGHLIGHTS
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
โ€ข /api/agent/start โ€” Summons AURA into the Agora RTC channel via Conversational AI REST API
โ€ข /api/llm/proxy โ€” Custom OpenAI streaming proxy that drives AURA's incident commander persona
โ€ข /api/mcp/sse โ€” Model Context Protocol SSE endpoint exposing tools (log_fact, flag_conflict, create_jira_ticket, post_slack_update, etc.)
โ€ข /api/token โ€” Agora RTC + RTM token generation with App Certificate authentication

โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
๐Ÿท๏ธ TAGS (do not remove)
โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
#AI #VoiceAI #SRE #IncidentManagement #AgentAI #Agora #ConvAI #NextJS #WebRTC 
#DevOps #SiteReliabilityEngineering #OpenAI #MCP #TypeScript #React #RealTimeAI
#AIDemo #AIAgent #LLM #Postmortem #IncidentResponse #EngineeringDemo #BuildInPublic

This build was uploaded as a hackathon project

Hackathon

EchoSphere

View All Projects
Give a star to encourage!Discussion
Start a new conversation!
Login to join the discussion

More Builds by Akanksha

ai python build shrayak hack
buildwithagora ai python next.js agora
Updates