CS497 Advanced Graphics Rendering and Appearance Modeling
Instructor: Yizhou Yu
Spring 2003, TuTh 11:00am-12:15pm, 3211 DCL(TuTh), 57 Everitt

This course covers appearance modeling, photorealistic rendering, nonphotorealistic rendering and image-based rendering. These topics have been fascinating research directions in graphics. Appearance modeling includes texture generation and synthesis, surface reflectance and subsurface scattering modeling, surface detail modeling such as bump/displacement maps, bidirectional texture functions, effects due to erosion and weathering. Graphics rendering techniques try to model the interaction between light and object models to create synthetic images. Object models include both geometry and appearance models. Photorealistic rendering tries to simulate the lighting process in the real world and generate synthetic images comparable to real photographs, while nonphotorealistic (artistic) rendering tries to simulate various artistic painting styles as well as provides visualization techniques to convey the details in shape and surface attributes. Traditional photorealistic rendering algorithms include ray-tracing and radiosity. This course gives an overview of these algorithms, but focuses on recent development on Monte Carlo ray tracing, photon mapping, and natural scene rendering. The part of the course on nonphotorealistic rendering covers recent techniques on silhouette rendering, pen-and-ink illustration, painterly rendering, watercolor simulation etc. Image-based rendering covers panoramic masaicing, light field rendering etc.

Grading is based on MPs and class presentations. The specific allocation is as follows: presentation 10%, MP1 40%, MP2 50%.

MP1 (due March 20, 2003): choose one of the following options:
i) implement reaction-diffusion textures;
ii) implement one of the 2D texture synthesis algorithms or design a new one;
iii) implement one of the algorithms for texture synthesis on arbitrary 3D mesh objects or design your own algorithm;
iv) simulate wavelength dependent reflectance functions considering amplitude splitting interference;
v) simulate reflectance functions considering subsurface scattering in multiple layers.

If you choose either i) or ii), you should produce at least one example where the synthesized textures are mapped onto a 3D polygonal or curved object. This object could be a sphere. Note that it is not trivial to map a rectangular texture onto a sphere.

If you choose either iv) or v), you should implement a simulator generating reflectance functions, and also render at least one curved object (more complicated than a sphere), illuminated with some light sources, using your simulated reflectance functions.

You should be able to show demos of your program in class on March 20. Also turn in a short report describing your implementation and design details along with a small number of examples including related images produced by your program.

MP1 Reports
Matt Belcher Joyce Chau Patrick Lacz Chris Lattner Orion Lawlor Shawn Lindberg Kenton McHenry Xinlai Ni Melissa Poole Wen Su Zheng Sun


Final Project (due May 6, 2003): implement a system or perform preliminary research on a proposed topic in
i) appearance modeling; or
ii) photorealistic rendering; or
iii) nonphotorealistic rendering; or
iv) image-based rendering.

For system implementation, grading is based on the completeness and reliability of the system and the quality of the generated images. For research topics, grading is based on the novelty of the proposed technique and the quality of the experimental results. Turn in a short report describing your implementation and/or experimental details along with some examples.
Be prepared for a demo in class on May 6.

Project Reports
Matt Belcher Joyce Chau Hui Fang Jared Hoberock Patrick Lacz Chris Lattner Orion Lawlor Shawn Lindberg Kenton McHenry Xinlai Ni Melissa Poole Shreeganesh Ramanan Wen Su Zheng Sun


Approximate presentation schedule (subject to change):
April 8, Chris Lattner and Wen Su;
April 10, Matt Belcher and Xinlai Ni;
April 15, Jared Hoberock and Shreeganesh Ramanan;
April 22, Mark Flider and Zheng Sun;
April 24, Orion Lawlor and McHenry Kenton;
April 29, Hui Fang.


Papers

Most of the papers can be found at SIGGRAPH online archives at ACM Digital Library.
  1. Perlin, K., An Image Synthesizer, SIGGRAPH 85.
    See demo at MIT.
  2. Perlin, K., and Hoffert, E.M., Hypertexture, SIGGRAPH 89.
  3. Witkin, A., and Kass, M., Reaction-diffusion textures, SIGGRAPH 91.
    See demo at Caltech.
  4. Texture Synthesis by Non-parametric Sampling, by Efros and Leung, ICCV'99.
    Image Quilting for Texture Synthesis and Transfer, by Efros and Freeman, SIGGRAPH 01.

  5. Texture Synthesis on Surfaces, by G. Turk, SIGGRAPH 01.
    Texture Synthesis over Arbitrary Manifold Surfaces, by Wei and Levoy, SIGGRAPH 01.
  6. Hanrahan, P., and Krueger, W., Reflection from Layered Surfaces due to Subsurface Scattering , SIGGRAPH'93, pp.165-174.
  7. Oren, M., and Nayar, S. K., Generalization of Lambert's Reflectance Model , SIGGRAPH'94, pp.239-246.
  8. Gondek, J. S., Meyer, G. W., and Newman, J. G., Wavelength Dependent Reflectance Functions , SIGGRAPH'94, pp.213-220.
  9. Reflectance and Texture of Real-World Surfaces, by Dana et al., TOG'99
  10. Dorsey, J., and Hanrahan, P., Modeling and Rendering of Metallic Patinas, SIGGRAPH 96.
  11. Cook, R. L., Stochastic Sampling in Computer Graphics, ACM Trans. Graphics, Vol.5, No.1, 1986, pp.51-72.
  12. Lokovic, T. and Veach, E., Deep Shadow Maps, SIGGRAPH 2000, pp.385-392.
  13. Kajiya, J. T., The Rendering Equation, SIGGRAPH'86, pp.143-150.
  14. Jensen, H. W., Global Illumination using Photon Maps , Rendering Techniques'96(Eurographics Workshop on Rendering), Springer-Verlag, pp.21-30, 1996.
  15. Sloan P.-P., Kautz, J. and Snyder, J., Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments, SIGGRAPH 2002, pp.527-536.
  16. Kajiya, J. T., and Von Herzen, B. P., Ray Tracing Volume Densities, SIGGRAPH'84, pp.165-174.
  17. Jensen, H.W., and Christensen, P.H., Efficient Simulation of Light Transport in Scenes with Participating Media using Photon Maps, SIGGRAPH 98.
  18. Jensen, H.W., Marschner, S., Levoy, M., and Hanrahan, P., A Practical Model for Subsurface Light Transport, SIGGRAPH 01.
  19. Klassen, R. V., Modeling the Effect of the Atmosphere on Light, ACM Trans. Graphics, Vol. 6, No.3, July 1987, pp.215-237.
  20. Preetham, A. J., Shirley, P., and Smits, B., A Practical Analytic Model for Daylight , SIGGRAPH'99, pp.91-100.
  21. Gooch, A., Gooch, B., Shirley, P., and Cohen, E., A Non-Photorealistic Lighting Model for Automatic Technical Illustration , SIGGRAPH'98, pp.447-452.
  22. Winkenbach, G., and Salesin, D. H., Computer-Generated Pen-and-Ink Illustration , SIGGRAPH'94, pp.91-100.
    Deussen, O., and Strothotte, T., Computer-Generated Pen-and-Ink Illustration of Trees , SIGGRAPH'2000, pp.13-18.
  23. Markosian, L., Kowalski, M., Trychin, S. J., Bourdev, L. D., Goldstein, D., and Hughes, J., Real-Time Nonphotorealistic Rendering , SIGGRAPH'97, pp.415-420.
  24. Curtis, C. J., Anderson, S. E., Seims, J. E., Fleischer, K. W., and Salesin, D. H., Computer-Generated Watercolor , SIGGRAPH'97, pp.421-430.
  25. Litwinowicz, P., Processing Images and Video for an Impressionist Effect , SIGGRAPH'97, pp.407-414.
    Hertzmann, A., Painterly Rendering with Curved Brush Strokes of Multiple Sizes , SIGGRAPH'98, pp.453-460.
  26. Creating Full View Panoramic Image Mosaics and Environment Maps, by Szeliski and Shum, Siggraph'97
  27. QuickTime VR - An Image-Based Approach to Virtual Environment Navigation, by Chen, Siggraph'95.
  28. Light Field Rendering, by Levoy and Hanrahan, Siggraph'96
    The Lumigraph, by Gortler, Grzeszczuk, Szeliski and Cohen, Siggraph'96
    Dynamically Reparameterized Light Fields, by Isaksen, McMillan and Gortler, Siggraph'2000.
  29. Image-Based Visual Hulls, by Matusik, Buehler, Raskar, Gortler and McMillan, Siggraph 2000.
  30. Surfels: Surface Elements as Rendering Primitives, by Pfister, H., Zwicker, M., van Baar, J., and Gross, M., Siggraph 2000.