Frontiers in Multimedia Search

Contents:

  • Setting the stage : From Multimedia Information Retrieval (MIR) to Social Media Retrieval
  • What multimedia search should do for you : Requirements regarding usefulness of multimedia search systems
  • Frontiers of MIR and beyond : Making the most of the user / the collection and search environment / multimedia items /Integration towards useful MIR systems
  • Making impact

This tutorial is set up to provide insights into the most recent developments in the field of multimedia retrieval and to highlight emerging challenges and techniques anticipated to be important for the future of multimedia retrieval. An overview is presented of new algorithms and techniques, concentrating on those approaches that are informed by neighboring fields including information retrieval, speech and language processing and network analysis. Evaluation of new algorithms is discussed, in particular, making use of crowdsourcing for the development of the necessary data sets. The main body of the presentation focuses on possibilities for exploiting and combining available information resources to optimize multimedia search results in view of these usefulness issues. The presenters concentrate on three complementary information sources: user, collection and content. They introduce the concept Social Media Retrieval, which means enhancing the “classical” multimedia information retrieval paradigm by taking into account the information inferred from individual and collaborative interactions of the users with multimedia content. The workshop concludes with a short presentation of the MediaEval benchmark, which offers multimedia retrieval tasks concentrated on social and contextual challenges of multimedia, including geo-coordinate prediction, genre detection and prediction of viewer affective response. The workshop was presented by Dr. Alan Hanjalic and Dr. Martha Larson from the Multimedia Information Retrieval Lab of Delft University of Technology (TU Delft) at the ACM Multimedia conference in november 2011.

The tutorial targets new researchers in the field of multimedia retrieval, providing instruction on how to best approach the multimedia retrieval problem and examples of promising research directions to work on. It is also designed to benefit active multimedia retrieval scientists—those who are searching for new challenges or re-orientation. For those who could not attend the workshop, this extensive PPT presentation is informative and offers a good starting point for further private study in this field.