Multimodal Immersives Lernen mit künstlicher Intelligenz für Psychomotorische Fähigkeiten

designs an innovative environment for independent learning of psychomotor skills. For this purpose, the correct movement sequences are recorded by trainers using cameras and sensors. A virtual avatar generated from this recording will then serve as a model for the learners. This can be displayed on a large screen, in an augmented or virtual reality environment, for example. With the help of artificial intelligence and automated error detection, the learning progress is analyzed and individual feedback is generated.

Amazing Services & Apps for you

Explore the capabilities of services and applications deployed in our own Kubernetes cluster.

To gain access you need to contact our team.

Label Studio

The most flexible data annotation tool. Build custom UIs or use pre-built labeling templates.

Grafana

Open source analytics & monitoring solution for every database.

Chronograf

allows you to quickly see the data that you have stored in InfluxDB so you can build robust queries and alerts.

JupyterLab

Latest web-based interactive development environment for notebooks, code, and data.


MLRun

Open MLOps framework for quickly building and managing continuous ML applications across their lifecycle.

InfluxDB

Made for developers to build time-series-based applications quickly and at scale.

Kafka

Distributed event streaming platform for high-performance data pipelines, streaming analytics and data integration.

About What We Do & Who We Are

MILKI-PSY aims to create AI-powered, data-rich, multimodal, immersive learning environments for independent learning of psychomotor skills. In doing so, a cross-domain approach is emerging that enables multimodal recording of expert activities and using these recordings as blueprints for learners. With the help of AI-supported analyses, learning progress is to be supported through automated error detection and generated, individual feedback. This creates holistic, innovative learning environments for learning psychomotor skills, in which personalised, AI-supported learning support enables individual learning processes based on complex data analyses.

The COVID-19 pandemic has shown that many teaching/learning activities can be carried out without physical presence. This is hardly true for psychomotor skills: their development, as they are necessary in many disciplines (e.g. medicine, engineering, chemistry, artistic activities, sports) requires hands-on practice, direct feedback and reflection. In order to achieve the desired learning successes, personnel supervision and material input are therefore indispensable. Both increase costs and limit the scaling possibilities of the study programmes concerned: experts are rare and expensive, and the use of materials causes further costs.

Partners

The collaborative research project "Multimodal Immersive Learning with Artificial Intelligence for Psychomotor Skills" (MILKI-PSY) is led by Prof. Dr. Roland Klemke of the Cologne Game Lab of TH Köln.

Project partners are the Institute for Product Development and Design Technology (IPK) at TH Köln, the German Research Center for Artificial Intelligence (DFKI), RWTH Aachen University, the Leibniz Institute for Human Development and Educational Information (DIPF), and the German Sport University Cologne (DSHS).