Projects
- KATE: Technology for Accessibility (LGFG scholarship) [HKA], [KIT]
- PeTRA: Autonomous person transport in hospitals (BMBF funded) [Website]
- High-Level Task Control Framework based on BehaviorTree.CPP with ROS2 [GitHub]
- Dataset for Emergency Detection during Hospital Transports with OpenPose [GitHub]
- Multi-Floor Navigation with Hierarchical Graphs [GitHub]
- ROS 2 Driver for a medical pulseoximeter [GitHub]
Publications
5. “Human-robot interactions in autonomous hospital transports” [ScienceDirect]
- Authors: Andreas Zachariae, Frederik Plahl, Yucheng Tang, Ilshat Mamaev, Björn Hein, Christian Wurll
- 2024, Robotics and Autonomous Systems, Volume 179
Abstract
Human transports in hospitals are labor-intensive and primarily performed in beds to save time. This transfer method does not promote the mobility or autonomy of the patient. To relieve the caregivers from this time-consuming task, a mobile robot is developed to autonomously transport humans around the hospital. It provides different transfer modes including walking and sitting in a wheelchair. The problem that this paper focuses on is to detect emergencies and ensure the well-being of the patient during the transport. For this purpose, the patient is tracked and monitored with a camera system. OpenPose is used for Human Pose Estimation and a trained classifier for emergency detection. We collected and published a dataset of 18,000 images in lab and hospital environments. It differs from related work because we have a moving robot with different transfer modes in a highly dynamic environment with multiple people in the scene using only RGB-D data. To improve the critical recall metric, we apply threshold moving and a time delay. We compare different models with an AutoML approach. This paper shows that emergencies while walking are best detected by a SVM with a recall of 95.8% on single frames. In the case of sitting transport, the best model achieves a recall of 62.2%. The contribution is to establish a baseline on this new dataset and to provide a proof of concept for the human emergency detection in this use case.Citation
@article{zachariaeHumanrobotInteractionsAutonomous2024, title = {Human-robot interactions in autonomous hospital transports}, volume = {179}, copyright = {All rights reserved}, issn = {09218890}, url = {https://linkinghub.elsevier.com/retrieve/pii/S0921889024001398}, doi = {10.1016/j.robot.2024.104755}, language = {en}, urldate = {2024-08-22}, journal = {Robotics and Autonomous Systems}, author = {Zachariae, Andreas and Plahl, Frederik and Tang, Yucheng and Mamaev, Ilshat and Hein, Björn and Wurll, Christian}, month = sep, year = {2024}, pages = {104755}, }
4. “Human Emergency Detection during Autonomous Hospital Transports” [Springer]
- Authors: Andreas Zachariae, Julia Widera, Frederik Plahl, Björn Hein, Christian Wurll
- 2024, Intelligent Autonomous Systems 18
- Best paper candidate of IAS-18, 2023 in Suwon, Korea
Abstract
Human transports in hospitals are labor-intensive and primarily performed in beds to save time. This transfer method does not promote the mobility or autonomy of the patient. To relieve the caregivers from this time-consuming task, a mobile robot is developed to autonomously transport humans around the hospital. It provides different transfer modes including walking and sitting in a wheelchair. The problem that this paper focuses on is to detect emergencies and ensure the well-being of the patient during the transport. For this purpose, the patient is tracked and monitored with a camera system. OpenPose is used for Human Pose Estimation and a trained classifier for emergency detection. We collected and published a dataset of 18,000 images in lab and hospital environments. It differs from related work because we have a moving robot with different transfer modes in a highly dynamic environment with multiple people in the scene using only RGB-D data. To improve the critical recall metric, we apply threshold moving and a time delay. We compare different models with an AutoML approach. This paper shows that emergencies while walking are best detected by a SVM with a recall of 95.8% on single frames. In the case of sitting transport, the best model achieves a recall of 62.2%. The contribution is to establish a baseline on this new dataset and to provide a proof of concept for the human emergency detection in this use case.Citation
@incollection{lee_human_2024, address = {Cham}, title = {Human {Emergency} {Detection} {During} {Autonomous} {Hospital} {Transports}}, volume = {794}, copyright = {All rights reserved}, isbn = {978-3-031-44980-2 978-3-031-44981-9}, url = {https://link.springer.com/10.1007/978-3-031-44981-9_21}, language = {en}, urldate = {2024-04-24}, booktitle = {Intelligent {Autonomous} {Systems} 18}, publisher = {Springer Nature Switzerland}, author = {Zachariae, Andreas and Widera, Julia and Plahl, Frederik and Hein, Björn and Wurll, Christian}, editor = {Lee, Soon-Geul and An, Jinung and Chong, Nak Young and Strand, Marcus and Kim, Joo H.}, year = {2024}, doi = {10.1007/978-3-031-44981-9_21}, pages = {233--245}, }
3. Dataset for Human Emergency Detection
- 18,000 single images from 200 videos as a single label, multiclass classification problem.
- Use case of a moving mobile robot in a highly dynamic environment with multiple people.
- Link to dataset [GitHub]
2. (German) “PeTRA – Autonomer Personentransport in Krankenhäusern” [Article]
- Authors: Andreas Zachariae, Frederik Plahl, Björn Hein, Christian Wurll
- 2022, Forschung aktuell
Abstract
Das Pflegepersonal in Krankenhäusern ist durch zeitaufwändige Transportaufgaben stark gefordert. Um im Kontext des Pflegenotstands weiterhin „gute Pflege“ leisten zu können, ist eine Entlastung notwendig. Das durch das BMBF geförderte Projekt „PeTRA“ hat das Ziel, den Personentransport in Krankenhäusern zu automatisieren. Dieser Beitrag zeigt die Forschungsansätze der Hochschule Karlsruhe im Bereich des autonomen Personentransports. Neben einer modularen Softwarearchitektur und intuitiven Benutzerschnittstellen wurde an einer Überwachung des Gesundheitszustands beim Personentransport geforscht. Zusätzlich integriert die Hochschule Karlsruhe alle Ergebnisse der Projektpartner in einem Demonstrator.Citation
@article{zachariae_petra_2022-1, title = {PeTRA – {Autonomer} {Personentransport} in {Krankenhäusern}}, volume = {2022}, copyright = {All rights reserved}, issn = {1613-4958}, url = {https://www.h-ka.de/fileadmin/Hochschule_Karlsruhe_HKA/Bilder_VW-PK/Publikationen/Forschungsbericht/HKA_ZH_Forschung_aktuell_2022.pdf}, urldate = {2022-11-17}, journal = {Forschung aktuell}, author = {Zachariae, Andreas and Plahl, Frederik and Wurll, Christian and Hein, Björn}, month = {jun}, year = {2022}, pages = {92--95} }
1. (German) “Softwareentwicklung des Personen-Transfer Roboter-Assistenten (PeTRA) zur Unterstützung von Pflegekräften”
- Authors: Andreas Zachariae, Christian Wurll, Moritz Weisenböhler, Javier Moviglia
- 2022, Poster Presentation, 4. Clusterkonferenz „Zukunft der Pflege“
Citation
@inproceedings{zachariae_softwareentwicklung_2022, address = {Hannover}, title = {Softwareentwicklung des {Personen}-{Transfer} {Roboter}-{Assistenten} ({PeTRA}) zur {Unterstützung} von {Pflegekräften}}, copyright = {All rights reserved}, booktitle = {4. {Clusterkonferenz} „{Zukunft} der {Pflege}“}, author = {Zachariae, Andreas and Wurll, Christian and Weisenböhler, Moritz and Moviglia, Javier}, month = {feb}, year = {2022}, pages = {51--52} }