Computer Vision in the Digital Humanities

From 2009 to 2020, an interdisciplinary project between computer vision and art history has been embedded within the Computer Vision group of Heidelberg University and is now being continued within the Machine Vision & Learning Group at Ludwig Maximilian University of Munich. Jointly, the group has carried out various tasks on diverse image corpora, including manuscripts, architectural drawings, religious artworks, or photographs, which have been enabled by, for example, an interactive interface developed by the group. Tasks are related to object detection, form analysis and iconography. This is of major use for art historians, since their work is concerned,

For example, with the iconography of the enthroned Madonna (see Holbein) and its depiction in the history of art or tries to find recurrences of objects and figures in various paintings, thereby addressing reception history. Did Bruegel repeatedly depict a figure or object in his famous Wimmelbilder? And do we find similar motifs in other works by different artists? Computer-based methods, as established by the group, assist with answering these questions.

The following sites  provide an overview over past and present works, including interfaces, object detection, form analysis and iconography.


Visual Search Tool

Object Detection

Form Analysis

Iconography

Cuneiform Sign Detection

Neural Style Transfer

Selected Publications

2021

Large-scale interactive retrieval in art collections using multi-style feature aggregation

Ufer, Nikolai; Simon, Max; Lang, Sabine; Ommer, Björn

Large-scale interactive retrieval in art collections using multi-style feature aggregation Journal Article

In: PLoS ONE, vol. 16, no. 11, 2021.

Links | BibTeX

Lang, Sabine; Ommer, Björn

Transforming Information Into Knowledge: How Computational Methods Reshape Art History Journal Article

In: Digital Humanities Quaterly (DHQ), vol. 15, no. 3, 2021.

Links | BibTeX

Kotovenko, Dmytro; Wright, Matthias; Heimbrecht, Arthur; Ommer, Björn

Rethinking Style Transfer: From Pixels to Parameterized Brushstrokes Conference

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

Abstract | Links | BibTeX

2020

Lang, Sabine; Ommer, Björn

Das Objekt jenseits der Digitalisierung Conference

Das digitale Objekt, vol. 7, 2020, ISBN: 978-3-948808-00-6.

Abstract | Links | BibTeX

Ufer, Nikolai; Lang, Sabine; Ommer, Björn

Object Retrieval and Localization in Large Art Collections Using Deep Multi-style Feature Fusion and Iterative Voting Conference

IEEE European Conference on Computer Vision (ECCV), VISART Workshop , 2020.

Abstract | Links | BibTeX

Dencker, Tobias; Klinkisch, Pablo; Maul, Stefan M; Ommer, Björn

Deep learning of cuneiform sign detection with weak supervision using transliteration alignment Journal Article

In: PLoS ONE, vol. 15, 2020.

Abstract | Links | BibTeX

2019

Kotovenko, Dmytro; Sanakoyeu, A.; Lang, Sabine; Ma, P.; Ommer, Björn

Using a Transformation Content Block For Image Style Transfer Conference

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.

Links | BibTeX

Content and Style Disentanglement for Artistic Style Transfer

Kotovenko, Dmytro; Sanakoyeu, Artsiom; Lang, Sabine; Ommer, Björn

Content and Style Disentanglement for Artistic Style Transfer Conference

Proceedings of the Intl. Conf. on Computer Vision (ICCV), 2019.

Links | BibTeX

2018

Bell, P.; Ommer, Björn

Computer Vision und Kunstgeschichte — Dialog zweier Bildwissenschaften Book Chapter

In: Computing Art Reader: Einführung in die digitale Kunstgeschichte, P. Kuroczyński et al. (ed.), 2018.

Links | BibTeX

Lang, Sabine; Ommer, Björn

Attesting Similarity: Supporting the Organization and Study of Art Image Collections with Computer Vision Journal Article

In: Digital Scholarship in the Humanities, Oxford University Press, vol. 33, no. 4, pp. 845-856, 2018.

Links | BibTeX

Lang, Sabine; Ommer, Björn

Reconstructing Histories: Analyzing Exhibition Photographs with Computational Methods Journal Article

In: Arts, Computational Aesthetics, vol. 7, 64, 2018.

Links | BibTeX

Sanakoyeu, A.; Kotovenko, Dmytro; Lang, Sabine; Ommer, Björn

A Style-Aware Content Loss for Real-time HD Style Transfer Conference

Proceedings of the European Conference on Computer Vision (ECCV) (Oral), 2018.

Abstract | Links | BibTeX

2014

Takami, M.; Bell, P.; Ommer, Björn

An Approach to Large Scale Interactive Retrieval of Cultural Heritage Conference

Eurographics Workshop on Graphics and Cultural Heritage, The Eurographics Association, 2014.

Links | BibTeX

Monroy, A.; Bell, P.; Ommer, Björn

Morphological Analysis for Investigating Artistic Images Journal Article

In: Image and Vision Computing, vol. 32, no. 6, pp. 414-423, 2014.

Links | BibTeX

2012

Monroy, A.; Bell, P.; Ommer, Björn

Shaping Art with Art: Morphological Analysis for Investigating Artistic Reproductions Conference

Proceedings of the European Conference on Computer Vision, Workshop on VISART, vol. 7583, Springer, 2012.

Links | BibTeX

2011

Monroy, A.; Kröger, Thorben; Arnold, M.; Ommer, Björn

Parametric Object Detection for Iconographic Analysis Conference

Scientific Computing & Cultural Heritage, 2011.

Links | BibTeX

Schlecht, J.; Carque, Bernd; Ommer, Björn

Detecting Gestures in Medieval Images Conference

Proceedings of the International Conference on Image Processing, IEEE, 2011.

Links | BibTeX

Schlecht, J.; Ommer, Björn

Contour-based Object Detection Conference

BMVC, 2011.

Links | BibTeX

Monroy, A.; Carque, Bernd; Ommer, Björn

Reconstructing the Drawing Process of Reproductions from Medieval Images Conference

Proceedings of the International Conference on Image Processing, IEEE, 2011.

Links | BibTeX