Reducing Bias in AI-Based Analysis of Visual Artworks

Empirical research in science and the humanities is vulnerable to bias which, by definition, implies incorrect or misleading findings. Artificial intelligence-based analysis of visual artworks is vulnerable to bias in ways specific to the domain. Works of art belong to a distinct cultural category that often prioritizes such characteristics as hand-craftsmanship, uniqueness, originality, and imaginative content; works of art are also responsive to diverse social and cultural contexts. Ascertaining which features of an artwork can be rightly ascribed to an objective “truth,” without which the concept of bias is not even relevant, is itself challenging. Incorporating expert knowledge into machine learning applications can help reduce bias in final estimates. We review several sources of bias that can occur across different stages of AI-based analysis, protocols, and best practices for reducing bias, and approaches to measuring these biases. This systematic investigation of various types of bias can help researchers better understand bias, become aware of practical solutions, and ultimately cultivate the prudent adoption of AI-based approaches to artwork analysis.
Related Articles

Machine Learning in the Eyes of a Painting Conservator Publisher: 鶹ýAV
As a conservator specializing in paintings, I first got in contact with machine (deep) learning in 2015, when I was working as part of a team of conservators from the Royal Institute for Cultural Heritage (KIK-IRPA) restoring the Ghent Altarpiece (1426) by the van Eyck brothers.

Use and Misuse of Machine Learning in Anthropology
Machine learning (ML), being now widely accessible to the research community at large, has fostered a proliferation of new and striking applications of these...

Revealing and Reconstructing Hidden or Lost Features in Art Investigation
In recent decades, cultural heritage research—and in particular art investigation—has been undergoing a digital revolution. This is due both to improvements ...