Stroke is one of the most common causes of permanent impairments of arm and hand function. Conventional therapy approaches often provide limited means to objectively track movement progress or to individually adapt the level of support. Our research focuses on an end-effector rehabilitation robot combined with camera-based, markerless motion capture to quantitatively analyze therapeutic movements and adaptively tailor support to each individual patient. Robotic sensor data and image-based information are processed jointly to enable precise motion analysis and to align therapy with real-world, everyday movement demands.

Possible research topics include:

• Analysis and modeling of assistance and compensation strategies in robotic systems
• Fusion of robot and camera data for precise arm position estimation
• Quantitative analysis of movement quality
• Analysis of multimodal sensor data (e.g., EMG, EEG) in neurorehabilitation
• Machine learning and computer vision for rehabilitative applications

Knowledge of Python (or alternatively MATLAB/Simulink) as well as signal processing is recommended. Basic knowledge of robotics or control engineering is an advantage.

Friederike Hicking (Contact)

Within the LOEWE focus area MultiDrug-TDM, an innovative point-of-care sensing system is being developed to determine the concentrations of anticancer drugs directly at the patient’s bedside in pediatric oncology. The goal is a personalized, data-driven dose adjustment in real time without the need for specialized laboratory analysis.

Raman spectroscopy plays a central role, as it captures the molecular composition of a blood sample in a single spectrum. The signal contributions of individual substances overlap, requiring robust spectral unmixing algorithms to determine the concentrations of the respective drugs. In addition, a Virtual Raman Device is being developed, a simulation model of the measurement system that enables the generation of synthetic training data and can be used to optimize measurement parameters.

Possible research topics include:

• Identification of physical prior knowledge for Raman spectra
• Integration of physical constraints into unmixing algorithms
• Comparison of physics-informed and classical unmixing approaches
• Development and training of a Virtual Raman Device

Knowledge in Python is recommended. Prior experiences in machine learning can be beneficial for certain topics.

Malte Drees (Contact)

Camera-based vital signs estimation is becoming an increasingly popular topic in research, with great potential for future applications. It enables contactless monitoring of patients' vital signs, which can help reduce patient stress and shift focus to treatment in emergency situations, rather than attaching sensors, finger clips, etc.

Many vital sign estimation methods, such as PPGI (Photoplethysmography Imaging), rely on model parameters that must be determined through machine learning. A major challenge here is the lack of sufficient training data and data diversity, which is further complicated by data protection regulations.

The solution: generating artificial and simulated training data, consisting of both synthetic videos and simulated vital parameters. The goal is also to simulate potential diseases and dysfunctions so that the resulting algorithms are robust to (pathological) abnormalities.

Possible topics include:

• Modeling of a realistic human body model
• Generation of a stochastic skin and hair model
• Simulation of vital signs for healthy individuals and individuals with illnesses
• Comparison of real and synthetic training data by evaluating the performance of trained algorithms, etc.

Recommended skills: Knowledge of Python. Experience with rendering engines (preferably Blender) is beneficial but not required.Theoretical knowledge of machine learning may be advantageous for certain topics

Tobias Reinhardt (contact)

With electrical impedance tomography (EIT), cross-sectional images of the human body can be generated by injecting small amounts of electrical current and measuring the resulting voltages. Unlike computed tomography (CT), no harmful X-rays are used, and the system is also significantly more cost-effective than an MRI. The potential applications of EIT are diverse: it can be used for respiratory monitoring, for examining the musculoskeletal system, and even in a miniaturized form for monitoring cell growth.

In EIT, both simulated measurements and measurements conducted on test tanks or human subjects are used. Our research focuses on how we can collect large datasets from real measurements and reconstruct them into actual cross-sectional images. These images, for example, could be used to monitor fracture healing.

Possible research topics include:

• Development of new reconstruction algorithms, for example, using machine learning
• Further development of the existing measurement setup
• Investigation of potential application areas for EIT
• Simulation of EIT measurements in Matlab
• Comparison between simulation and real-world data

While knowledge of Python and/or Matlab is recommended, it is not strictly required. Prior experience in machine learning/deep learning can be beneficial for certain topics.

Theresa Nolte (contact)

The quality of treatment for various diseases (such as epilepsy and cardiovascular diseases) has been significantly improved by their early detection using medical measurement methods (such as ECG, EEG, EMG, PPG, CT, MRI, etc.). Unfortunately, these measurement methods often suffer from artifacts and missing sensors, so that they only provide noisy and incomplete data. We are therefore researching robust algorithms that can deal with these artifacts and supplement missing information, for example by fusing with other modalities.

Possible topics for processing are

Robust machine learning & interpretability

Methods for sensor fusion (cameras, wearables, …)

Unsupervised / self-supervised learning for time series

Transfer learning between different modalities

Knowledge of Python and signal processing is recommended. Theoretical knowledge of machine learning / deep learning can be an advantage for some topics.

Jad Haidamous (Kontakt)

Vital parameters such as pulse and respiration are important indicators of various diseases and the general state of health of a person. The gold standard methods, such as electrocardiography for monitoring the heart, usually require contact with the patient, e.g. in the form of adhesive electrodes. We are researching ways to replace these with cameras where possible.

Possible topics include

• Machine Learning & Interpretability
• Multiphysics simulations and rendering of synthetic video data
• Methods for sensor fusion (cameras, wearables, …)
• Photoplethymography imaging
• Robust estimation of heart rate variability

Knowledge of Python (or alternatively Matlab) and signal processing is recommended. Knowledge of Blender or Unreal Engine may be an advantage for some topics.

Our doctoral candidate Maurice Rohr is close to completing his PhD. If you are interested in this topic, please contact Tobias Reinhard.

Tobias Reinhardt (Contact)

Stress is a common cause of sleep problems, concentration disorders, depression or even cardiovascular disease. While stress is often assessed purely subjectively, we are working on recording vital signs in order to make a quantitative statement about a person's well-being. The vital signs are primarily to be recorded non-invasively in order to enable the end user to be as comfortable as possible. In addition, stress can also be recorded in people who are unable to articulate this independently, such as newborn babies or people with disabilities.

While research is mainly focussed on the development of stress caused by acoustic stimuli such as noise, it is not limited to this. Possible areas of application include contactless parameter recording at the workplace, in the car or in bed. The parameters are to be analysed primarily with the help of machine learning algorithms.

Possible topics:

• Non-invasive vital parameter estimation based on cECG, thermographic camera and PPGI
• Sensor fusion for robust parameter estimation
• Quantitative analysis of stress
• Application of machine learning with a focus on computer vision and signal processing
• Implementation of virtual reality environments for test setups

Programming skills in Python or Matlab are recommended. If you are looking for a topic in the field of VR, it is recommended that you have knowledge of C# and Unity programming.

Tizian Dege (Contact)

Physiotherapy is an important part of the treatment of many injuries and illnesses. Ideally, physiotherapy is carried out under the supervision of a healthcare professional who can provide personalised and immediate feedback. But even without direct supervision, exercises at home can be beneficial to the healing process. At the same time, incorrect execution, misjudgement of your own fitness level and overexertion can also lead to inefficient training or, worse still, serious injury.

To mitigate these problems, an automated scoring system can be used to assess the quality of exercise execution and reduce the need for human supervision. Building on advances in the field of computer vision, we are researching the development of such support systems using video-based estimation of human posture.

Possible topics include

• Natural language processing for the automated generation of training data from videos with subtitles
• Analysis of sensor data (EMG, force plates, IMUs) and relation to camera recordings
• Development of biomechanical models of human movement
• Development of methods for the quantitative evaluation of human movement
• Machine learning & computer vision
• Transfer learning & domain adaptation (transfer to infrared cameras)

Knowledge of Python (or alternatively Matlab) and signal processing is recommended. Knowledge of Blender can be an advantage for some topics.

Sebastian Dill (Contact)

Video-based Human State Analysis refers to the use of video footage to assess and interpret the physical, emotional, or psychological states of individuals. This involves analyzing visual data captured by cameras to derive insights about a person's behavior, emotions, actions, or overall well-being.

Possible topics:

• Methods for detecting/tracking human limb movements to correlate with the individual's current state
• Methods for human reflex analyses
• Quantitative analysis of human emotional state
• Machine learning and computer vision

Using tools such as Python, Matlab, classical signal, and image processing

Our doctoral candidate Gökhan Güney is close to completing his PhD. If you are interested in this topic, please contact Tizian Dege or Friederike Hicking.

Tizian Dege (Contact), Friederike Hicking (Contact)