340 likes | 357 Views
Explore the milestones, trends, challenges, and future possibilities in computer graphics, including geometry, lights, shading, motion, simulations, data-driven modeling and editing, and output devices.
E N D
Bridging the Gap to the Real Wojciech Matusik Adobe Systems, Inc.
Computer Graphics: Past, Present, Future • Goal of this Talk • Look at Trends • Extrapolate • New Challenges Disclaimer: My personal (very biased) view I have not even taken a cg course. Milestones Time
Computer Graphics: Past, Present, Future • Goal of this Talk • Look at Trends • Extrapolate • New Challenges Milestones • Disclaimer: • I will present my own biased view. Time
A Simulation to Generate Images or Videos Geometry Lights Simulation Shading Motion
Traditional Computer Graphics • Components • Hand Modeled • Procedurally Defined • Analytical Formulas Geometry Lights Simulation Shading Motion Courtesy of Wikimedia
Traditional Computer Graphics: Geometry L-Systems axiom = F production rule F -> FF-[-F+F+F]+[+F-F-F] Geometry Courtesy of Wikimedia Fractals Lights Simulation Shading Courtesy of Wikimedia Perlin Noise, Hypertextures Motion Courtesy of Ken Perlin
Traditional Computer Graphics: Lights Directional Geometry Lights Point Simulation Shading Spot Motion Courtesy of Wikimedia
Traditional Computer Graphics: Shading Phong Geometry Blinn-Phong Lights Cook-Torrance Simulation Shading Cook’s Shade Trees Motion Courtesy of Rob Cook
Traditional Computer Graphics: Animation Keyframing Geometry Lights Simulation Animation Controllers Shading Motion Courtesy of Jessica Hodgins
Traditional Computer Graphics Computer Graphics Real World Lights, Geometry, Shading, Motion, Simulations Editing and User Input
Data-driven Computer Graphics: 90s - now • Progress in development of sensors • Cheap storage and computation power for data processing Input Devices Real World Lights, Geometry, Shading, Motion, Simulations
Data-driven Computer Graphics: Geometry 3D Scanning Geometry Lights Simulation Courtesy of Marc Levoy Shading Motion
Data-driven Computer Graphics: Lights Environment Mapping HDR Imaging Geometry Lights Simulation Courtesy of Wikimedia Courtesy of Paul Debevec Shading Motion
Data-driven Computer Graphics: Shading Geometry Measured Appearance Lights Simulation Shading Courtesy of Kristin Dana Motion Courtesy of Wikimedia
Data-driven Computer Graphics: Animation Geometry Lights Simulation Motion Capture Shading Motion Courtesy of Wikimedia
Data-driven Computer Graphics Input Devices Real World Lights, Geometry, Shading, Motion, Simulations
Data-driven Modeling and Editing Input Devices Real World Lights, Geometry, Shading, Motion, Simulations Editing and User Input
Data-driven Modeling and Editing: Geometry Geometry Lights Simulation Modeling by Example, 2004 Funkhouser et al. Shading Motion
Data-driven Modeling and Editing: Lights Geometry Lights Simulation Shading Skyfinder : Attribute-based Sky Image Search, 2009 Tao et al. Motion
Data-driven Modeling and Editing: Shading Geometry Lights Simulation Shading Data-driven Reflectance Model, 2003 Matusik et al. Motion
Data-driven Modeling and Editing: Animation Geometry Lights Simulation Shading Motion Graphs, 2002 Kovar et al., Lee et al., Arikan & Forsyth Motion
Data-driven Computer Graphics: 90s - now Input Devices Real World Representations Abstractions Simulations Editing and User Input
Computer Graphics: Future Input Devices Real World Representations Abstractions Simulations Editing and User Input Output Devices
Shape Capture, Modeling, and Fabrication User Edits Courtesy of Wikimedia Output 3D Model 3D Printing 3D Scanning Real Object
Motion Capture, Modeling, and Robotics User Edits Courtesy of Wikimedia Courtesy of Wikimedia Humanoid Robot Mocap Motion Model Controller Design Human Motion
Light Field Capture, Modeling, and Display User Edits Courtesy of M.Levoy Courtesy of F. Durand Autostereoscopic Display Camera Array Light Out Light Field 3D Scene
Appearance Capture, Modeling, and Fabrication User Edits Output Data-driven Model Fabrication Measurement Real Material
Challenges: Output Mapping Data Abstraction Data Abstraction Device Capabilities Device Capabilities
Output Mapping Examples • Gamut Mapping • Tone Mapping • Image Retargeting Courtesy of Wikimedia Courtesy of Wikimedia Courtesy of Shai Avidan
Generalized Output Mapping Algorithms • Different Phenomena • Reflectance, Scattering, Deformations, Motion • Rules • Linear vs. Perceptually-Based • Global vs. Local
Future Printers, Displays, and Output Devices • Complex aggregates from base materials with known properties
Future Printers, Displays, and Output Devices Future Output Devices Data-driven Representations and Abstractions Output Mapping
Computer Graphics: Closing the Loop Input Devices Real World Representations Abstractions Simulations Editing and User Input Output Devices
My Vision Statement The future of Computer Graphics and Interactive Techniques lies in novel input and output devices that operate in real-world environments and are accessible to everyone.