ARTEMIS: AI-driven Robotic Triage Labeling and Emergency Medical Information System

Abstract

Mass casualty incidents (MCIs) pose a significant challenge to emergency medical services by overwhelming available resources and personnel. Effective victim assessment is the key to minimizing casualties during such a crisis. We introduce ARTEMIS, an AI-driven Robotic Triage labeling and Emergency Medical Information System, to aid first responders in MCI events. It leverages speech processing, natural language processing, and deep learning to help with acuity classification. This is deployed on a quadruped that performs victim localization and preliminary injury severity assessment. First responders access victim information through a Graphical User Interface (GUI) that is updated in real-time. To validate our proposed algorithmic triage protocol, we used the Unitree Go1 quadruped. The robot identifies humans, interacts with them, gets vitals and information, and assigns an acuity label. Simulations of an MCI in software and a controlled environment outdoors were conducted. The system achieved a triage-level classification precision of over 74\% on average and 99\% for the most critical victims, i.e. level 1 acuity, outperforming state-of-the-art deep learning-based triage labeling systems. In this paper, we showcase the potential of human-robot interaction in assisting medical personnel in MCI events.

ARTEMIS System Architecture: a Unitree Go1 quadruped to be used for collecting patient vitals (Heart Rate, Respiratory Rate, $O_2$ Sat., Systolic and Diastolic Blood Pressure, etc.), chief complaints, and age. The Multi-Layer Perceptron (MLP) uses this to classify the patient’s acuity level, which is then displayed on the GUI along with the patient’s location and photograph.

Performance in Sim

The above animations showcase simulations performed in Gazebo Ros1 using Champ framework.

Pose detection

Example of robot demo run with an external view of the robot moving (top) and a camera view from the robot’s perspective (bottom). The captures from what the robot is seeing are sent over to first responders via the GUI

Dataset

To request Y-MED-SYN+ dataset, please contact the primary author, Mr. Revanth Krishna Senthilkumaran (senthilr@purdue.edu).

Citation

@article{senthilkumaran2024artemis,
      title={ARTEMIS: AI-driven Robotic Triage Labeling and Emergency Medical Information System},
      author={Revanth Krishna Senthilkumaran and Mridu Prashanth and Hrishikesh Viswanath and Sathvika Kotha and Kshitij Tiwari and Aniket Bera},
      year={2024},
      eprint={2309.08865},
      archivePrefix={arXiv},
      primaryClass={cs.RO}
}