Future Fire Commander
In 2016, as I ventured into the AR/VR world, I committed myself to mastering Unity software. This effort was aimed not just at conceptualizing, but also at fully implementing a user interface for incident commanders in the firefighting sector. The outcome was an advanced mixed reality system that displayed crucial information like building layouts, personnel positions, and real-time status updates. This system, more than just a data tool, evolved into a sophisticated decision-support mechanism to enhance situational awareness and aid in strategic decision-making under pressure. This project was part of a trio of initiatives, including developing scenarios for Future Command Center 911 call handlers and SWAT teams during school shooting responses, marking significant advancements in emergency and critical situation management.
EXISTING PROBLEMS
Visualize Situation
Through Voice
Manual Whiteboard Accountability Tracking
Information From
Multiple Sources
FUTURE FIRE SCENE
Camera Access
Real Time Information Visualization
Connected Firefighters
with Sensors
Integrating Mixed-Reality and AI Technologies in Firefighting
In developing this futuristic firefighting technology with my colleagues Craig Siddoway and Bert Van Der Zaag, my focus as a designer has been to integrate cutting-edge tools that redefine emergency response. The core of this system is a mixed-reality interface, like the HoloLens, which provides incident commanders with immersive, real-time data visualizations. The use of drones is pivotal, offering varied and comprehensive views of incidents. A key feature of my design is the use of edge intelligence to project holographic displays, such as the locations and activities of firefighters, directly onto the scene. This not only enhances situational awareness but also ensures swift, informed decision-making. The system also includes a stream of crucial information, like live feeds from firefighters' body cameras, their locations, arrival times, and specific tasks, marking a significant leap in how emergency situations are handled and managed.
ARCHITECTURE INNOVATION
Global Showcase of Innovation
The demo of our advanced firefighting technology was showcased at multiple tradeshows, gaining notable recognition at a prestigious public safety conference in Hong Kong.
Integrating Mixed-Reality and AI Technologies in SWAT Operation
After Firefighter demo, CTO and business teams requested Mixed reality experience for other verticals. In my role developing an innovative incident command operation such as school shooting incidents for SWAT teams, I focused on identifying user journeys and overseeing technology implementation, crucial for aligning the system with the needs of future SWAT commanders. My work integrated drones and wearable technology, offering unparalleled real-time situational awareness in complex scenarios like school rescues. I contributed to designing a mixed reality interface, providing a comprehensive view of the entire operation, including building layouts and personnel tracking. This focus on user experience ensured dynamic updating of incident models and automatic suspect profiling, crucial for rapid decision-making. My emphasis on technology implementation was also evident in the system's post-incident analysis capabilities, enhancing strategy refinement and response efficiency, marking a transformative contribution to crisis management.
EXISTING PROBLEMS
Limited Situational Awareness
Inefficient Communication and Coordination
Difficulty in Tracking and Managing Resources
