Behavior Analysis & its Interdisciplinary Applications

The large intra-class variability of articulated objects, e.g., animal bodies, poses a significant challenge for representation learning. Furthermore, the analysis of posture and behavior is of fundamental importance for numerous applications, esp. in biomedicine. Our goal is a model-free approach that learns detailed representations of human and animal posture and temporal kinematics without requiring a preconceived body model or tedious manual annotation of keypoints. Being keypoint-free and rather learning the actual articulation and degrees of freedom that are present in the data avoids introducing model or annotation biases. Our ultimate (application) goal is, thus, an unsupervised, non-invasive, unbiased diagnostic analysis based on behavior analytics.

This site provides a (selective) overview of our research on behavior analysis and its various applications. For a comprehensive list, please visit our publication page.

2021

Understanding Object Dynamics for Interactive Image-to-Video Synthesis

Blattmann, Andreas; Milbich, Timo; Dorkenwald, Michael; Ommer, Björn

Understanding Object Dynamics for Interactive Image-to-Video Synthesis Conference

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

Abstract | Links | BibTeX

Stochastic Image-to-Video Synthesis using cINNs

Dorkenwald, Michael; Milbich, Timo; Blattmann, Andreas; Rombach, Robin; Derpanis, Konstantinos G.; Ommer, Björn

Stochastic Image-to-Video Synthesis using cINNs Conference

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

Links | BibTeX

Behavior-Driven Synthesis of Human Dynamics

Blattmann, Andreas; Milbich, Timo; Dorkenwald, Michael; Ommer, Björn

Behavior-Driven Synthesis of Human Dynamics Conference

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

Links | BibTeX

Unsupervised behaviour analysis and magnification (uBAM) using deep learning

Brattoli, Biagio; Büchler, Uta; Dorkenwald, Michael; Reiser, Philipp; Filli, Linard; Helmchen, Fritjof; Wahl, Anna-Sophia; Ommer, Björn

Unsupervised behaviour analysis and magnification (uBAM) using deep learning Journal Article

In: Nature Machine Intelligence, 2021.

Abstract | Links | BibTeX

2020

Unsupervised Magnification of Posture Deviations Across Subjects

Dorkenwald, Michael; Büchler, Uta; Ommer, Björn

Unsupervised Magnification of Posture Deviations Across Subjects Conference

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.

Links | BibTeX

2017

Unsupervised Video Understanding by Reconciliation of Posture Similarities

Milbich, Timo; Bautista, Miguel; Sutter, Ekaterina; Ommer, Björn

Unsupervised Video Understanding by Reconciliation of Posture Similarities Conference

Proceedings of the IEEE International Conference on Computer Vision (ICCV), 2017.

Links | BibTeX

LSTM Self-Supervision for Detailed Behavior Analysis

Brattoli, Biagio; Büchler, Uta; Wahl, Anna-Sophia; Schwab, M. E.; Ommer, Björn

LSTM Self-Supervision for Detailed Behavior Analysis Conference

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), (BB and UB contributed equally), 2017.

Abstract | Links | BibTeX

Optogenetically stimulating the intact corticospinal tract post-stroke restores motor control through regionalized functional circuit formation

Wahl, Anna-Sophia; Büchler, Uta; Brändli, A.; Brattoli, Biagio; Musall, S.; Kasper, H.; Ineichen, B. V.; Helmchen, F.; Ommer, Björn; Schwab, M. E.

Optogenetically stimulating the intact corticospinal tract post-stroke restores motor control through regionalized functional circuit formation Journal Article

In: Nature Communications, 2017.

Links | BibTeX

2015

Spatiotemporal Parsing of Motor Kinematics for Assessing Stroke Recovery

Antic, B.; Büchler, Uta; Wahl, Anna-Sophia; Schwab, M. E.; Ommer, Björn

Spatiotemporal Parsing of Motor Kinematics for Assessing Stroke Recovery Conference

Medical Image Computing and Computer-Assisted Intervention, Springer, 2015.

Links | BibTeX

2014

Asynchronous Therapy Restores Motor Control by Rewiring of the Rat Corticospinal Tract after Stroke

Wahl, Anna-Sophia; Omlor, W.; Rubio, J. C.; Chen, J. L.; Zheng, H.; Schröter, A.; Gullo, M.; Weinmann, O.; Kobayashi, K.; Helmchen, F.; Ommer, Björn; Schwab, M. E.

Asynchronous Therapy Restores Motor Control by Rewiring of the Rat Corticospinal Tract after Stroke Journal Article

In: Science, vol. 344, no. 6189, pp. 1250–1255, 2014.

Links | BibTeX