Modeling preferences in photographic images is often re- duced to analyzing intermediate explicit representations (e.g. textual tags) as means of capturing the objective and sub- jective properties of image perception, trying to distill the essence of what gives pleasure. We propose an alternative approach that bypasses the necessity to build an explicit con- ceptual coding of image preferences, operating directly on the raw properties of the images, extracted with heterogeneous feature descriptors. This is achieved through the counting grid model, which fuses together content-based and aesthet- ics themes into a 2D map in an unsupervised way. We show that certain locations in this map correspond to perceptually intuitive image classes, even without relying on tags or other user-defined information. Moreover, we show that users’ in- dividual preferences can be represented as distributions over the map, allowing us to evaluate the affinity between different users’ appreciations. We experiment on a large Flickr dataset, clustering users by affinity, and validating these clusters by checking users that belong to the same Flickr photo groups.

WE LIKE IT! MAPPING IMAGE PREFERENCES ON THE COUNTING GRID

LOVATO, PIETRO;PERINA, Alessandro;CHENG, Dong Seon;Segalin, Cristina;CRISTANI, Marco
2013-01-01

Abstract

Modeling preferences in photographic images is often re- duced to analyzing intermediate explicit representations (e.g. textual tags) as means of capturing the objective and sub- jective properties of image perception, trying to distill the essence of what gives pleasure. We propose an alternative approach that bypasses the necessity to build an explicit con- ceptual coding of image preferences, operating directly on the raw properties of the images, extracted with heterogeneous feature descriptors. This is achieved through the counting grid model, which fuses together content-based and aesthet- ics themes into a 2D map in an unsupervised way. We show that certain locations in this map correspond to perceptually intuitive image classes, even without relying on tags or other user-defined information. Moreover, we show that users’ in- dividual preferences can be represented as distributions over the map, allowing us to evaluate the affinity between different users’ appreciations. We experiment on a large Flickr dataset, clustering users by affinity, and validating these clusters by checking users that belong to the same Flickr photo groups.
2013
Image preferences; image aesthetics; content-based image processing; counting grid.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11562/652162
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 11
  • ???jsp.display-item.citation.isi??? ND
social impact