CSE 5542 - Real Time Rendering Week 3 & 4

1. CSE 5542 - Real Time Rendering Week 3 & 4

2. Slides(Mostly) Courtesy – E. Angel and D. Shreiner

3. Program Execution • WebGL runs in browser • complex interaction with OS, Window system, browser, & code (HTML and JS) • Simple model • Start with HTML file • files read in asynchronously • start with onload function • event driven input

4. Hardware Rendering Pipeline host interface vertex processing triangle setup pixel processing memory interface

5. Space ? point2 vertices[3] = {point2(0.0, 0.0), point2( 0.0, 1.0), point2(1.0, 1.0)};

6. Coordinate Systems • Units in points - object, world, modelproblem coordinates • Viewing specifications are also in object coordinates • Same for lights • Eventually pixels will be produced in window coordinates • WebGL - internal representations not visible to application but important in shaders

7. Transform Spaces Object Space Screen Space Most important is clip coordinates

8. Shaders – Clip Space Vertex shader must output in clip coordinates Input to fragment shader from rasterizer is in window coordinates Application can provide vertex data in any coordinate system Shader must eventually produce gl_Position in clip coordinates

9. Viewports • Not use entire window for image: gl.viewport(x,y,w,h) • Values in pixels (window coordinates)

10. WebGL Camera • Camera at origin in object space pointing in -z direction • Default viewing volume - box centered at origin with sides of length 2

11. Transformations & Viewing • WebGL - projection with matrix (transformation) before rasterization • Pre 3.1 OpenGL- transformation functions which have been deprecated • glRotate • glTranslate • … • Three choices in WebGL • Application code • GLSL functions • MV.js

12. Orthographic Viewing z=0 z=0 Points projected forward along z axis onto plane z=0

13. Shaders

14. Fragment vs Vertex Shader per vertex lighting per fragment lighting

15. Fragment Shader Applications Texture mapping smooth shading environment mapping bump mapping

16. Other Vertex Shaders • Moving vertices • Morphing • Wave motion • Fractals • Lighting • More realistic models • Cartoon shaders

17. Shader Evolution • First programmable shaders were programmed in an assembly-like manner • OpenGL extensions added functions for vertex and fragment shaders • Cg (C for graphics) C-like language for programming shaders • Works with both OpenGL and DirectX • Interface to OpenGL complex • OpenGL Shading Language (GLSL)

18. OpenGL and GLSL Shader based OpenGL is based less on a state machine model than a data flow model Most state variables, attributes and related pre 3.1 OpenGL functions have been deprecated Action happens in shaders Job is application is to get data to GPU

19. GLSL • OpenGL Shading Language • Part of OpenGL 2.0 and up • High level C-like language • New data types • Matrices • Vectors • Samplers

20. GLSL • C-like with • Matrix and vector types (2, 3, 4 dimensional) • Overloaded operators • C++ like constructors • Similar to Nvidia’s Cg and Microsoft HLSL • Code sent to shaders as source code • As of OpenGL 3.1, application must provide shaders

21. Simple Vertex Shader attribute vec4 vPosition; void main(void) { gl_Position = vPosition; } input from application must link to variable in application built in variable

22. Execution Model Vertex data Shader Program GPU Vertex Shader Primitive Assembly Application Program gl.drawArrays Vertex

23. Simple Fragment Program precision mediump float; void main(void) { gl_FragColor = vec4(1.0, 0.0, 0.0, 1.0); }

24. Execution Model Application Shader Program Fragment Shader Frame Buffer Rasterizer Fragment Fragment Color

25. Still Maximal Portability • Display device independent • Window system independent • Operating system independent

26. Eine Example

27. The Sierpinski Gasket

28. init() var program = initShaders( gl, "vertex-shader", "fragment-shader" ); gl.useProgram( program ); …

29. Sierpinski Gasket (2D) • Start with a triangle • Connect bisectors of sides and remove central triangle • Repeat

30. Example Five subdivisions

31. Gasket == fractal • Consider the filled area (black) and the perimeter (the length of all the lines around the filled triangles) • As we continue subdividing • the area goes to zero • but the perimeter goes to infinity • This is not an ordinary geometric object • It is neither two- nor three-dimensional • It is a fractal (fractional dimension) object

32. Example http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket2.html http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket2.js

33. Gasket Program • HTML file • Same as in other examples • Pass through vertex shader • Fragment shader sets color • Read in JS file

34. Gasket Program var points = []; var NumTimesToSubdivide = 5; /* initial triangle */ var vertices = [ vec2( -1, -1 ), vec2( 0, 1 ), vec2( 1, -1 ) ]; divideTriangle( vertices[0],vertices[1], vertices[2], NumTimesToSubdivide);

35. Draw one triangle /* display one triangle */ function triangle( a, b, c ){ points.push( a, b, c ); }

36. Triangle Subdivision function divideTriangle( a, b, c, count ){ // check for end of recursion if ( count === 0 ) { triangle( a, b, c ); } else { //bisect the sides var ab = mix( a, b, 0.5 ); var ac = mix( a, c, 0.5 ); var bc = mix( b, c, 0.5 ); --count; // three new triangles divideTriangle( a, ab, ac, count-1 ); divideTriangle( c, ac, bc, count-1 ); divideTriangle( b, bc, ab, count-1 ); } }

37. init() var program = initShaders( gl, "vertex-shader", "fragment-shader" ); gl.useProgram( program ); var bufferId = gl.createBuffer(); gl.bindBuffer( gl.ARRAY_BUFFER, bufferId ) gl.bufferData( gl.ARRAY_BUFFER, flatten(points), gl.STATIC_DRAW ); var vPosition = gl.getAttribLocation( program, "vPosition" ); gl.vertexAttribPointer( vPosition, 2, gl.FLOAT, false, 0, 0 ); gl.enableVertexAttribArray( vPosition ); render();

38. Render Function function render(){ gl.clear( gl.COLOR_BUFFER_BIT ); gl.drawArrays( gl.TRIANGLES, 0, points.length ); }

39. Shaders attribute vec4 vPosition; void main() { gl_PointSize = 1.0; gl_Position = vPosition; } precision mediump float; void main() { gl_FragColor = vec4( 1.0, 0.0, 0.0, 1.0 ); }

40. Other Examples http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket1.html http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket1.js

41. Similarly http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket1v2.html http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket1v2.js

42. Psychedelic Gaskets http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket3.html http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket3.js

43. 3D Gaskets

44. Many More Examples http://www.cs.unm.edu/~angel/WebGL/7E/CLASS/

45. Shaders attribute vec4 vPosition; void main() { gl_PointSize = 1.0; gl_Position = vPosition; } precision mediump float; void main() { gl_FragColor = vec4( 1.0, 0.0, 0.0, 1.0 ); }

46. Caveats http://www.cs.unm.edu/~angel/WebGL/7E/code_updates.pdf

47. In Code http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket4.html http://www.cs.unm.edu/~angel/WebGL/7E/02/gasket4.js

48. GLSL Programming Language

49. Data Types • C types: int, float, bool • Vectors: • float vec2, vec3, vec4 • Also int (ivec) and boolean (bvec) • Matrices: mat2, mat3, mat4 • Stored by columns • Standard referencing m[row][column] • C++ style constructors • vec3 a =vec3(1.0, 2.0, 3.0) • vec2 b = vec2(a)

50. Pointers • There are no pointers in GLSL • C structs which can be copied back from functions • Matrices and vectors can be passed to and fro GLSL functions, e.g. mat3 func(mat3 a) • Variables passed by copying