Innovations in high p erformance 2D graphics with DirectX

2. Innovations in high performance 2D graphics with DirectX Dan McLachlan Principal Program Manager Lead Microsoft Corporation 3-191

3. Agenda • DirectX performance improvements • New capabilities in Windows 8.1 • Text • Geometry • Imaging

4. DirectX technologies are core to Windows.

5. Performance demos

6. Agenda • DirectX performance improvements • New capabilities in Windows 8.1 • Text • Geometry • Imaging

8. Existing industry approaches • App does text analysis and replaces code points with bitmaps • Font foundries provide multiple fonts that are aligned, and app draws same text in multiple fonts to get layering • Fonts with embedded bitmaps

9. Multi-color fonts in Windows 8.1 • Supported through new multi-layer glyphs • Extended the Windows OpenType implementation • Still text, so everything else just works. • New system font: Segoe UI Emoji • Supports the most commonly used emoji code points

10. Color font demoDirectWrite / Direct2D

11. Enabling color – DrawTextLayout • d2dContext->DrawTextLayout( • D2D1::Point2F(x, y), • m_layout.Get(), • D2D1_DRAW_TEXT_OPTIONS_CLIP • ); | D2D1_DRAW_TEXT_OPTIONS_ENABLE_COLOR_FONT

12. Enabling color - DrawGlyphRun • d2dContext->DrawGlyphRun(…, glyphRun, … color, …);

13. Enabling color - DrawGlyphRun • colorlayers = dWrite->TranslateColorGlyphRun(…, glyphRun, …); • Foreachlayer in colorLayers { • d2dContext->DrawGlyphRun(…, layer.GlyphRun, … layer.color, …); • }

14. Agenda • DirectX performance improvements • New capabilities in Windows 8.1 • Text • Geometry • Imaging

15. 2D geometry rendering performance • Complex geometry rendering CPU bound • Existing optimization techniques have limitations • Creating bitmaps • Not fully robust to rotations and scales • Bitmaps consume significant resources • Geometry meshes • Only aliased rendering is available

16. Geometry Rendering Solutions • DirectX 11.1 hardware utilization • Geometry needs to be specified with D2D1_FILL_MODE_ALTERNATE • Geometry Realizations

17. Geometry realizations • New Direct2D Geometry class • Enables amortizing generation costs over multiple frames • Creates device-dependent representation • Drawing uses minimal CPU resources • Tuned for optimal GPU resource usage

18. Draw or fill geometryOnce per frame Geometry CPU Work GPU Work Rendered on GPU

19. Create geometry realizationOnce per primitive Geometry CPU Work Geometry Realization Object

20. Draw geometry realizationOnce per frame GPU Work Geometry Realization Rendered on GPU

21. Will geometry realization work for you? • Is your geometry static? • Are the applied transformations only translations, rotations and uniform scales? • How you generate realizations will depend on your range of scale factors.

22. Geometry realizations demoDirect2D

23. Agenda • DirectX performance improvements • New capabilities in Windows 8.1 • Text • Geometry • Imaging

24. Improving image effects performance • Defer rasterization as much as possible • Avoid using a RenderTarget bitmap only once • CommandLists can be helpful when different sections of code generate intermediates • Minimize redundant rasterization • Use RenderTarget bitmaps when you need the same image as input to multiple effects • CommandLists are a tool here too

25. Agenda • DirectX performance improvements • New capabilities in Windows 8.1 • Text • Geometry • Imaging • Image Compression

26. Image considerations in apps • Large part of memory utilization and start up time • Quality versus space trade-offs • Direct2D supports two new compressed image formats

27. Jpeg image loading

28. Jpeg image loading using YCBCR data

29. Analysis of memory usage • Comparison of image data for some common Windows 8 apps.

30. Block compression formats • Native graphics hardware support • BC1 – BC3 DirectX 9+ hardware • BC4 – BC5 DirectX 10+ hardware • BC6 – BC7 DirectX 11+ hardware • 4-8 bits per pixel • Can be up to 87.5 % smaller in memory than RGBA • Lossy image compression • MUST be a multiple of 4 in all dimensions

31. Block compression 00 00 01 02 01 02 01 01 03 03 01 00 02 02 01 00 4x4 block Encoding Color1 Color2 16 – 2bit encoded colors

32. Block compression • Choosing your Block compression format

33. Cut The Rope image comparison Startbg.jpg (Background image) Original BGRA format (7.91MB decoded)

34. Cut The Rope image comparison Startbg.jpg (Background image) BC1 compression (0.99MB decoded)

35. Jpeg to BC-1 Jpeg version1 BC-1 version 1Decoding does not include YCBCR optimizations

36. Using block compressed images • Use current authoring pipeline • Block compressed images are a runtime format • Generate them as part of your app build/packaging

37. How to use Block Compressed images (DDS)

38. Using image compression • Jpeg YCBCR compression • User assets • No conversion necessary • 25% - 63% working set savings over RGBA data • Smaller disk footprint compared to DDS • Block compression (DDS) • App-local assets • Build time conversion • Better with natural images than synthetic ones • 75% - 87.5% working set savings over RGBA data

39. Summary • DirectX performance improvements • New capabilities in Windows 8.1 • Text • Geometry • Imaging

40. Leverage new Windows 8.1 features to make your apps fast and fluid

41. Call to action • Use new color fonts for emoticons AND scalable UI elements • Take advantage of Geometry Realizations to improve geometry rendering performance • Use compressed image formats and maintain compression on GPU for faster load times and better resource utilization

42. Resources • Color Fonts Sample • Geometry Realization Sample • D2D1_FILL_MODE enumeration • Block Compressed Images Sample • JPEG YCBCR Optimizations Sample • Block Compression (MSDN).

43. Other related talks

44. Required Slide *delete this box when your slide is finalized Your MS Tag will be inserted here during the final scrub. Evaluate this session • Scan this QR codeto evaluate this session and be automatically entered in a drawing to win a prize!