skip to main content
Idioma:
Tipo de recurso Mostra resultados com: Mostra resultados com: Índice

Crowdsourcing subjective image quality evaluation

Ribeiro, F. ; Florencio, D. ; Nascimento, V.

2011 18th IEEE International Conference on Image Processing, 2011, p.3097-3100

IEEE

Texto completo disponível

Citações Citado por
  • Título:
    Crowdsourcing subjective image quality evaluation
  • Autor: Ribeiro, F. ; Florencio, D. ; Nascimento, V.
  • Assuntos: Conferences ; crowdsourcing ; Humans ; Image quality ; Laboratories ; mean opinion score ; mechanical turk ; MOS ; Multimedia communication ; quality assessment ; Reactive power ; subjective quality ; Transform coding
  • É parte de: 2011 18th IEEE International Conference on Image Processing, 2011, p.3097-3100
  • Descrição: Subjective tests are generally regarded as the most reliable and definitive methods for assessing image quality. Nevertheless, laboratory studies are time consuming and expensive. Thus, researchers often choose to run informal studies or use objective quality measures, producing results which may not correlate well with human perception. In this paper we propose a cost-effective and convenient subjective quality measure called crowdMOS, obtained by having Internet workers participate in MOS (mean opinion score) subjective quality studies. Since these workers cannot be supervised, we propose methods for detecting and discarding inaccurate or malicious scores. To facilitate this process, we offer an open source set of tools for Amazon Mechanical Turk, which is an Internet marketplace for crowdsourcing. These tools completely automate the test design, score retrieval and statistical analysis, abstracting away the technical details of Mechanical Turk and ensuring a user-friendly, affordable and consistent test methodology. We demonstrate crowdMOS using data from the LIVE subjective quality image dataset, showing that it delivers accurate and repeatable results.
  • Editor: IEEE
  • Idioma: Inglês
Voltar para lista de resultados

  • Realização: ABCD-USP USP   Logos de Redes Sociais: Freepik

Buscando em bases de dados remotas. Favor aguardar.