260 likes | 499 Views
The Visualization Brazilian Network. Bruno Feijó VisionLab/PUC-Rio. Some Pioneer Results – Brazil. Computing Broadcast Production Electronic Systems: Banking, Voting Software Engineering (LUA, Agents, ...) Visualization in early 80’s: TV Globo Computer Graphics in the Broadcast Industry
E N D
The Visualization Brazilian Network Bruno Feijó VisionLab/PUC-Rio
Some Pioneer Results – Brazil • Computing • Broadcast Production • Electronic Systems: Banking, Voting • Software Engineering (LUA, Agents, ...) • Visualization in early 80’s: TV Globo • Computer Graphics in the Broadcast Industry • Developments with a Spin-off: PDI • First in Television Drama Technology • First to use 1-inch videotape in outdoor shootings • Partnership with Sony • First Outdoor Blue Screen (early 90’s)
The Concept Of Visualization • It is more than data visualization and Virtual Reality applications • Visualization as visual simulation of processes and environments with a technological basis shared by several strategic sectors • Game = cinema = TV = simulator = … • Strategic Macrosector • Digital Content Production, Broadcast, Cinema, Oil, Games, Defense, …
VisualizationFuture scenario • Computational Holography • Entertainment, Defense, Communication, Education • Artificial Intelligence • Ultra-Definition (4K, 8K, …) • Water • The Connection Point • A single point with information, education, entertainment, communication, and services – ...visual
Visualization Brazilian NetworkRBV • Strategic development policy – Minister of Science and Technology • A network of intelligence connecting industry and academy • Research, Development and Innovation • Goals: To organize the visualization sector and to promote innovation in order to increase competitiveness • Structured by competences
Economic Cluster (Pole) RBVCurrent Competences Strategic Kernel – RBV JPessoa Digital Production Pole of Olinda Pole of Games - PortoDigital 1 PE: [1] Games and Simulation (UFPE) 3 2 4 [2] Broadcast and Digital Content Prodution (PUC-Rio) Rio: [3] Energy, Gas, and Oil (UFRJ) 5 SP: [4] Industrial (USP) RG: [5] Security and Defense (PUC-RS) Rio VisionLab/PUC-Rio Lamce/UFRJ University Labaligned With R&D&I&Business Pole Rio Cine&Video UFRJ Technological Park (under construction)
The Model Of Regional Integrated Axis Strategic Kernels: clusters of intelligence executing National Strategic Projects National Strategic Projects: Global projects involving more than one Competence and having economic feasibility Specific Project: Isolated project belonging to a Competence International organisms National Development Bank Government Sectors Strategic firms Mechanism for Economic Feasibility Sub-network (capilarity) Incubators R&D Lab (University) Cluster of Production and Business P&D Market R&D Training Services New Products Studios to rent Clusters and Motion Capture Offices for resource allocation Production system support Representatives of agencies for development Infrastructure for technical support Pilot Axis VisionLab-PoleRio Digital Production Commission Key Concepts: • Local Productive Clusters • Strategic firms - Logistics - Resource equalization - Management uniformity - First organizing, financing later Conection to other networks and groups of excellence through inductions or projects in consortium
VisionLab/Pole Rio VisionLab Pole Rio Cine&Video VisionLab Campus PUC-Rio, Gávea Studios & VisionLab Firms ( 100) Business Center Studios VisionLab Expansion Area
R&D And Innovation In RBV • Emerging and developing country • Low- cost high technology • Simplicity • Cross-functional development • Between sectors or companies • Focus on processes • Secrecy versus patent • Secrecy, short life cycle, and steps ahead • Research papers and product documentation
Special Effects 3x cheaper and 2x faster Realistic Simulation through time VisionLab for BAND/NBP/RTP (Portugal) Acident Simulation for TV Drama (3D models + image) VisionLab for NBP/RTP (Portugal) 3D model
Low Cost Touch Screen Interface camera Low cost High speed High accuracy No sound sensors Array of infrared LEDs projector acrylic Platform: Windows Media Encoder .Net plastic film
IPTV Experiments Active Objects Simultaneous Broadcasting - digital TV - internet http://www.shoptime.com.br/apollo/internetTV.do
Interactive Digital TVPUC-Rio model Screen Layout for Digital TV Application (VisionLab) Text Status Middleware (NCL/Telemidia) Menu Standard Traffic Main Text Interactivity icon Watermark Interactivity icon Wheather
(in the compressed domain) Low-Cost Digital Asset Management
HW And SW For HD Stereo Projection VisionLab Absolute Technologies The most compact 2K stereo projection system in Brazil VLab Stereo Player - 2K (High Definition) - no flicking - no audio dependence
Image-based Rendering for Games & Simulations Conventional 3D model Relief impostor (an image in real time) Shading model CPU-GPU Parallel Architecture
3D Game Engines, Experimental Games, and Mobile Games Multiplayer Online Game in Mobile Phones
Storytelling for Interactive TV and Defense The plot has a logical structure. Scenes are predicates with pre e post-conditions, e.g.: attack(draco, princess_castle). Red scenes should wait and green scenes are free to connect. Automatic animation of the attack scene, corresponding to the predicate attack Current scene • There are variations, but the backbone of the plot is not destroyed • There are both global visions and local/individual visions of the plot • The characters are intelligents, but fuzzy and emotional – this is Affective Computing in Participative Games • Dramatic Gaming vs Action Game
E7 terror admiration E6 astonishment E8 fear timidity trust uncertainty surprise acceptance extasy delight grief gloominess sadness joy E5 E1 interest boredom 0.5 annoyance disgust loathing 1.0 anticipation vigilance anger fury E2 E4 E3 Emotional Talking Heads VisionLab TeleMídia IMPA Facial animation Emotion Model Virtual Narrator
Preprocessing Shading Tracking Image-based shading for 2D Animation Pipeline for the Preprocessing Module VisionLab IMPA Shading Example
Compression for Irregular Meshes Two vectors of integers only (V and M) 3D Bunny with 9672 triangles compressed with the CLERS code (red for C, dark blue for L, green for E, yellow for R, and light blue for S) C – create; L – left; E – end; R – right; S – split Example: CCCCcRsLcRCCcRsLEsLRLRE CHalfEdge Structure VisionLab Mechanics Dept. Mathematics Dept.