EVALUATION OF TONE MAPPING OPERATORS

Chief investigator: Martin Čadík, email: cadikm@centrum.cz, homepage: http://cadik.posvete.cz

Members: Ondrej Hajdok, Antonín Lejsek, Ondřej Fialka, Michael Wimmer, Alessandro Artusi, Laszlo Neumann

Project web page: http://cadik.posvete.cz/tmo

Project description:

The problem of reproducing high dynamic range images on devices with restricted dynamic range has gained a lot of interest in the computer graphics community. There exist various approaches to this issue, which span several research areas including computer graphics, image processing, color vision, physiological aspects, etc. These approaches assume a thorough knowledge of both the objective and subjective attributes of an image. However, no comprehensive overview and analysis of such attributes has been published so far.

We present an overview about the effect of the basic image attributes in the HDR tone mapping. Furthermore, we propose a scheme of relationships between these attributes, leading to the definition of an overall image quality measure. We present results of subjective psychophysical experiments that we have performed to prove the proposed relationship scheme. Moreover, we also present the evaluation of existing tone mapping methods (operators) with regard to these attributes. Finally, the execution of with-reference and without a real reference perceptual experiments gave us the opportunity to relate the obtained subjective results.

Our effort is not just useful to get into the tone mapping field or when implementing a tone mapping method, but it also sets the stage for well-founded quality comparisons between tone mapping methods. By providing good definitions of the different attributes, user-driven or fully automatic comparisons are made possible at all.


HDR IMAGE AS THE RESULT OF MULTIPLE LDR IMAGES (469517:1)



IMPLEMENTED TONE MAPPING METHODS

Ward, G.

A contrast-based scalefactor for luminance display
DONE DONE

Tumblin, J., Rushmeier, H.

Tone Reproduction for Realistic Images

Chiu, Herf, Shirley, Swamy, Wang, Zimmerman

Spatially Nonuniform Scaling Functions for High Contrast Images

http://www.cs.utah.edu/~shirley/papers/
Extends the works of [Schlick 94], [Tumblin 93], [Ward 94], [Ferwerda 96]

C. Schlick

Quantization Techniques for Visualization of High Dynamic Range Pictures

http://dept-info.labri.u-bordeaux.fr/~schlick/DOC/ewr6.html
CODE AVAILABLE

Tumblin J., Hodgins J., Guenter, B.

Two methods for display of high contrast images

http://www.cs.northwestern.edu/~jet/
Extends the works of [Schlick 94], [Tumblin 93], [Ward 94], [Ferwerda 96]
DONE DONE

Ferwerda, J., Pattanaik, S., Shirley, P., Greenberg, D.

A Model of Visual Adaptation for Realistic Image Synthesis

Reinhard, E., Stark, M., Shirley, P., Ferwerda, J.

Photographic Tone Reproduction for Digital Images

http://www.cs.utah.edu/~reinhard/cdrom/

Drago, F., Myszkowski, K., Annen, T., Chiba, N.

Adaptive Logarithmic Mapping For Displaying High Contrast Scenes

http://www-cg.cis.iwate-u.ac.jp/~frederic/logmap/
CODE AVAILABLE

Tumblin, J., Turk, G.

Low Curvature Image Simplifiers (LCIS): A Boundary Hierarchy for Detail-Preserving Contrast Reduction

http://www.cs.northwestern.edu/~jet/publications.html
CODE AVAILABLE

M. Ashikhmin

A tone mapping algorithm for high contrast images

http://www.cs.sunysb.edu/~ash/tm/

Fredo Durand, Julie Dorsey

Fast bilateral filtering for the display of high-dynamic-range images

http://graphics.csail.mit.edu/~fredo/PUBLI/Siggraph2002/
CODE AVAILABLE

Sumanta N. Pattanaik, Hector Yee

Adaptive Gain Control for High Dynamic Range Image Display


CODE AVAILABLE

Choudhury, P., Tumblin, J.

The Trilateral Filter for High Contrast Images and Meshes

http://www.cs.northwestern.edu/~jet/publications.html
CODE AVAILABLE

Raanan Fattal, Dani Lischinski, Michael Werman

Gradient Domain High Dynamic Range Compression

http://www.cs.huji.ac.il/~danix/hdr/
DONE DONE DONE

Goshtasby, A.

High Dynamic Range Reduction Via Maximization of Image Information

http://www.cs.wright.edu/people/faculty/agoshtas/hdr.html

G. Ward Larson, H. Rushmeier, C. Piatko

A Visibility Matching Tone Reproduction Operator for High Dynamic Range Scenes

http://positron.cs.berkeley.edu/~gwlarson/pixformat/Larsonetal.html
Extends the works of [Ward 94], [Ferwerda 96], CODE AVAILABLE
DONE DONE DONE

Ruifeng Xu, Sumanta N. Pattanaik

High Dynamic Range Image Display Using Level Set Framework


CODE AVAILABLE
DONE DONE DONE

Reinhard, Devlin

Dynamic Range Reduction Inspired by Photoreceptor Physiology

http://www.cs.ucf.edu/~reinhard/pubs.html
CODE AVAILABLE
DONE DONE DONE

Jobson, D.J. and Rahman, Z.U. and Woodell, G.A.

A Multiscale Retinex for Bridging the Gap Between Color Images and the Human Observation of Scenes

abstract
DONE DONE DONE DONE

Pattanaik, S., Tumblin, J., Yee, H., Greenberg, D.

Time-Dependent Visual Adaptation for Fast, Realistic Image Display

http://www.cs.northwestern.edu/~jet/publications.html
CODE AVAILABLE
DONE DONE DONE DONE

Artusi, A., Faisstnauer, Ch., Wilkie, A.

A New Time-Dependent Tone Mapping Model

http://www.cg.tuwien.ac.at/research/TR/01/TR-186-2-01-21Abstract.html
DONE DONE DONE DONE

Greg Spencer, Peter Shirley, Kurt Zimmerman, Donald P. Greenberg

Physically-based glare effects for digital images

http://www.graphics.cornell.edu/pubs/1995/SSZG95.html
Extends the work of [Nakamae 90]
 

Kuang, J., Johnson, G.M., Fairchild M.D.

iCAM06: A refined image appearance model for HDR image rendering


Extends iCAM, MatLab CODE AVAILABLE
  DONE   DONE     DONE

Fredo Durand, Julie Dorsey

Interactive Tone Mapping

http://graphics.csail.mit.edu/~fredo/PUBLI/EGWR2000/

G. Krawczyk, K. Myszkowski, H.-P. Seidel

Lightness Perception in Tone Reproduction for High Dynamic Range Images

[Eurographics 2005]

Computational Model of Lightness Perception in High Dynamic Range Imaging

[Human Vision and Electronic Imaging, 2006]
DONE DONE DONE DONE

R. Mantiuk, K. Myszkowski, H.-P. Seidel

A perceptual framework for contrast processing of high dynamic range images


[Extends the work of Fattal02]
DONE DONE DONE DONE

P. Ledda, L. P. Santos, A. Chalmers

A local model of eye adaptation for high dynamic range images

http://portal.acm.org/citation.cfm?id=1029978

[Afrigraph 2004]
DONE DONE DONE DONE

S. Bae, S. Paris, F. Durand

Two-scale Tone Management for Photographic Look


http://people.csail.mit.edu/soonmin/photolook/

M. Čadík

Perception Motivated Hybrid Approach to Tone Mapping


http://cadik.posvete.cz/hybrid_tmo/

J. Duan, G. Qiu, M. Chen

Comprehensive Fast Tone Mapping for High Dynamic Range Image Visualization


http://www.cs.nott.ac.uk/~qiu/webpages/Papers/PacificGraphics2005-Final.pdf

Min H. Kim, Jan Kautz

Consistent Tone Reproduction


project page (binaries available)
DONE DONE DONE DONE

Zeev Farbman, Raanan Fattal, Dani Lischinski, Richard Szeliski

Edge-Preserving Decompositions for Multi-Scale Tone and Detail Manipulation


project page
DONE DONE DONE DONE

Raanan Fattal

Edge-Avoiding Wavelets and their Applications


project page
DONE DONE DONE DONE

Dawid Pajak, Martin Čadík, Tunc Ozan Aydin, Karol Myszkowski, Hans-Peter Seidel

Visual Maladaptation in Contrast Domain


project page

Sumanta N. Pattanaik, James A. Ferwerda, Mark D. Fairchild, Donald P. Greenberg

A multiscale model of adaptation and spatial vision for realistic image display

P. Irawan, J. A. Ferwerda, S. R. Marschner

Perceptually Based Tone Mapping of High Dynamic Range Image Streams


Extends [Ward97] and [Pattanaik00]

Biswas K. K., Pattanaik S.

A Simple Spatial Tone Mapping Operator for High Dynamic Range Images

L. Meylan, S. Susstrunk

High Dynamic Range Image Rendering Using a Retinex-Based Adaptive Filter


Extends RETINEX, MatLab CODE AVAILABLE
 

Shen-Chuan Tai and Nai-Ching Wang and Yi-Ying Chang and Yen-Cheng Lu

A Two-Stage Contrast Enhancement Algorithm for Digital Images


paper

Adam G. Kirk, James F. O'Brien

Perceptually Based Tone Mapping for Low-Light Conditions

Xin Yang, Ke Xu, Yibing Song, Qiang Zhang, Xiaopeng Wei, Rynson W.H. Lau

Image Correction via Deep Reciprocating HDR Transformation

Robert Wanat, Rafał K. Mantiuk

Simulating and compensating changes in appearance between day and night vision



SIMPLE METHODS

 

Maping to mean value
 

Division by maximum
 

Clipping on value 1
 

Interval mapping (interactive calibration)
 

Exponential mapping


METHODS TO IMPLEMENT (i.e. possible student projects/master's thesis topics)

 TODO  

David Hafner and Joachim Weickert

Variational Image Fusion with Optimal Local Contrast


http://www.mia.uni-saarland.de/Research/Image_Fusion/index.shtml
 TODO  

Minjung Son, Yunjin Lee, Henry Kang, Seungyong Lee

Art-Photographic Detail Enhancement


http://cg.postech.ac.kr/research/art_photograph/
 TODO  

A. Scheel, Stamminger, M., H.-P. Seidel

Tone Reproduction for Interactive Walkthroughs


Extends the works of [Ward 94], [Ward et al. 97]
 TODO  

F. Drago, W. Martens, K. Myszkowski, N. Chiba

Design of a Tone Mapping Operator for High Dynamic Range Images Based upon Psychophysical Evaluation and Preference Mapping


Extends RETINEX
 TODO  

H.T.Chen, T.L.Liu, T.L.Chang

Tone Reproduction: A Perspective from Luminance-Driven Perceptual Grouping


Relates to [Durand02] and [Reinhard02]
 TODO  

D. Lischinski, Z. Farbman, M. Uyttendaele, R. Szeliski

Interactive Local Adjustment of Tonal Values


http://www.cs.huji.ac.il/~danix/itm/
 TODO  

E. P. Bennett, L. McMillan

Fine Feature Preservation for HDR Tone Mapping


http://www.cs.unc.edu/~bennett/HDR/index.htm
Slight modification of Bilateral filtering approach [Durand02]
 TODO  

J. Duan, G. Qiu, and G. D. Finlayson

Learning to display high dynamic range images


http://www.cs.nott.ac.uk/~qiu/LearningIP/cgiv04.pdf
 TODO  

Yee Y. H., Pattanaik S.

Segmentation and adaptive assimilation for detail-preserving display of high-dynamic range images
 TODO  

Rafal Mantiuk, Scott Daly, Louis Kerofsky

Display Adaptive Tone Mapping


piece-wise linear tone curve, non-linear optimization problem, project page (code available)
 TODO  

Li Yuanzhen, Sharan Lavanya, Adelson Edward H

Compressing and companding high dynamic range images with subband architectures


paper
 TODO  

Tamburrino, Daniel and Alleysson, David and Meylan, Laurence and Süsstrunk, Sabine

Digital Camera Workflow for High Dynamic Range Images Using a Model of Retinal Processing


supplementary material
 TODO  

Sylvain Paris, Samuel W. Hasinoff, Jan Kautz

Local Laplacian Filters: Edge-aware Image Processing with a Laplacian Pyramid


OUR PUBLICATIONS

Author Title Publishing details
Aydin, T.O., Čadík, M., Myszkowski, K., Seidel, H.P. Visually Significant Edges

[Paper (pdf)]
[bibTeX entry (bib)] 		ACM Transactions on Applied Perception, Vol. 7, No. 4, Article 27, (Presented at Symposium on Applied Perception in Graphics and Visualization (APGV)), 2010. Images from our article were selected for the TAP front page.
Pajak, D., Čadík, M., Aydin, T.O., Okabe, M., Myszkowski, K., Seidel, H.P. Contrast Prescription for Multiscale Image Editing

[Paper (pdf)]
[Video (captured in realtime)] 		The Visual Computer, Vol. 26, 739–748, ISSN 0178-2789, Springer Verlag, 2010.
Pajak, D., Čadík, M., Aydin, T.O., Myszkowski, K., Seidel, H.P. Visual Maladaptation in Contrast Domain

[Paper (pdf)]
[bibTeX entry (bib)]
[Video (captured in realtime)] 		Proc. of IS&T/SPIE's Human Vision and Electronic Imaging, 2010.

Copyright 2009 Society of Photo-Optical Instrumentation Engineers. One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.
Čadík, M. Perceptually Based Image Quality Assessment and Image Transformations


[bibTeX entry (bib)] 		Ph.D. Thesis, Czech Technical University in Prague, 2008.

Outstanding dissertation award, President of CTU in Prague, December 2009.
Čadík, M., Wimmer, M., Neumann, L., Artusi, A. Evaluation of HDR Tone Mapping Methods Using Essential Perceptual Attributes

[bibTeX entry (bib)]
Computers & Grahics, Elsevier, ISSN 0097-8493, Vol. 32, Issue 3, p. 330-349, 2008.
Čadík, M. Perception Motivated Hybrid Approach to Tone Mapping

[Paper (pdf)]
[Presentation slides (pdf)]
[bibTeX entry (bib)] 		Proceedings of WSCG'2007, p.129-p.136. Pilsen, Czech Republic, 2007.
Čadík, M., Neumann, L. Evaluation of Tone Mapping Operators Using Image Attributes

[bibTeX entry (bib)] 		Computational Aesthetics in Graphics, Visualization and Imaging, 06221, Dagstuhl Seminar Proceedings, 2007
Neumann, L., Čadík, M. Gradient Importance based High Dynamic Range Imaging

[bibTeX entry (bib)] 		Computational Aesthetics in Graphics, Visualization and Imaging, 06221, Dagstuhl Seminar Proceedings, 2007
Čadík, M., Wimmer, M., Neumann, L., Artusi, A. Image Attributes and Quality for Evaluation of Tone Mapping Operators

BibTeX entry (BIB) 		Proceedings of Pacific Graphics 2006, p.35-p.44. National Taiwan University Press, Taipei, Taiwan, 2006.
Čadík, M., Slavík, P. The Naturalness of Reproduced High Dynamic Range Images

[bibTeX entry (bib)] 		In Proceedings of the Ninth International Conference on Information Visualisation, Los Alamitos: IEEE Computer Society, p. 920-925. ISBN 0-7695-2397-8, 2005.


HDR IMAGES AND EXPERIMENTAL DATA

Martin Čadík's testing HDR images and experimental data and input images. A database of various authors  HDR images.
You have my permission to use my image files in your publications and presentations. Whenever you use them, please include a reference to our work as well as web site. We do not own the rights to some of the images in the archive. If you wish to use them, you need to obtain a permission from the respective owners.

Paul Debevec's Light Probe Image Gallery homepage
RIT/MCSL HDR Image Database
Laurence Meylan's HDR images
Erik Reinhard's HDR images


HDR SOFTWARE

PFStmo project homepage.
Photosphere
HDRShop
Photomatix
FDRTools
Photogenics.hdr
Photoshop CS2 and newer


RESOURCES

Paul Debevec's homepage.
Greg Ward's (Larson) homepage.
Kate Devlin's pages on tonemapping.
Patrick Ledda's pages tonemapping operators comparison.