ORION gives surgeons hands-free access to everything — patient data, CT imaging, 3D anatomy, and AI-driven surgical checklists — using only their voice, while their hands never leave the controls.
img source: ohcare.com
During robotic surgery, the surgeon's hands are locked on instrument controls
inside a sterile field. They cannot type, click, or interact with any computer system.
Critical patient data, imaging, and anatomical context require them to
break scrub or rely on circulating staff — both slow, disruptive,
and potentially dangerous at the wrong moment.
ORION routes every voice command to the right specialist agent — protocol, clinical decision, documentation, or screen analysis — no configuration, no delays, no hands.
End-to-end flow from surgeon's voice to real-time surgical intelligence — ADK multi-agent orchestration, Gemini Live API, and a WebSocket audio pipeline.
A production-grade stack using Google's latest multimodal real-time AI, purpose-built ADK agents, and a high-performance WebSocket server.
Connect your microphone, speak a command, and watch ORION route it to the right agent — all in real time.
Click the orb to connect · Say "ORION, show hemoglobin" to begin
This project is designed to demonstrate the capabilities of Gemini Live API & Google ADK. It may contain clinical inaccuracies and has not been reviewed by medical domain experts. Not intended for use in actual clinical settings.
