2020 1.10 - Learning Kinematic Machine Models from Videos/ClipID:37966 previous clip next clip

The automatic subtitles generated using Whisper Open AI in this video player (and in the Multistream video player) are provided for convenience and accessibility purposes. However, please note that accuracy and interpretation may vary. For more information, please refer to the FAQs (Paragraph 14).
Recording date 2021-11-14

Via

Free

Language

English

Organisational Unit

Lehrstuhl für Informatik 9 (Graphische Datenverarbeitung)

Producer

Friedrich-Alexander-Universität Erlangen-Nürnberg

Format

lecture

, , :
Learning Kinematic Machine Models from Videos for VR/AR training
3rd International Conference on
Artificial Intelligence & Virtual Reality
(Utrecht, Netherlands, December 14, 2020 - December 18, 2020)

In: 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)
DOI: 10.1109/AIVR50618.2020.00028
URL:
BibTeX: Download

VR/AR applications, such as virtual training or coaching, often require a digital twin of a machine. Such a virtual twin must also include a kinematic model that defines its motion behavior. This behavior is usually expressed by constraints in a physics engine. In this paper, we present a system that automatically derives the kinematic model of a machine from RGB video with an optional depth channel. Our system records a live session while a user performs all typical machine movements. It then searches for trajectories and converts them into linear, circular and helical constraints. Our system can also detect kinematic chains and coupled constraints, for example, when a crank moves a toothed rod.

More clips in this category "Technische Fakultät"

2024-05-24
Studon
protected  
2024-05-22
IdM-login
protected  
2024-05-22
IdM-login
protected  
2024-05-17
Studon
protected  
2024-05-16
IdM-login
protected