Oct 3, 2026

DashLens

android agora voice-ai kotlin python jetpack-compose multimodal road-safety conversational-ai

DashLens is a hands-free voice and camera co-driver for Android that explains dashboard warning lights from your car's own owner's manual. Point your phone at the instrument cluster and ask "what's this light?". DashLens sees the lamp through the live camera, looks up that exact car's manual, asks the one question that changes the answer (is the engine running? is the parking brake on?), and tells you what to do in a sentence or two. For a stop-now lamp it shows the carmaker's verified roadside helpline, one tap from the dialler.

Built on Agora Conversational AI:

  • Pipeline: Deepgram ASR → gpt-5-mini with live camera frames → ElevenLabs/OpenAI voice.
  • Tools: HTTP tools fetch each car's manual data and helpline. A manual pipeline turned owner's manuals into data for 825 warning lamps across 27 Indian cars.
  • Agora features used: RTM captions, keyword barge-in, and silent UI tags via TTS skip patterns.

In tests it averaged 5.1 s per voice reply and identified 73% of red warning lamps correctly. Built on Agora's Android quickstart (disclosed in the README).

This build was uploaded as a hackathon project

Hackathon

Agora Voice AI Hackathon 2026

View All Projects

2

Give a star to encourage!Discussion
Start a new conversation!
Login to join the discussion