1 / 16

Videoconferencing Project

Videoconferencing Project. Project Concept and Background Checkpoint Structure Bells and Whistles. Objectives. Broad “brush” overview of the project Details will be covered in the lab lectures, starting next week

sandrao
Download Presentation

Videoconferencing Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Videoconferencing Project • Project Concept and Background • Checkpoint Structure • Bells and Whistles CS 150 - Spring 2007 – Lec. #11: Course Project - 1

  2. Objectives • Broad “brush” overview of the project • Details will be covered in the lab lectures, starting next week • NOTE: anything discussed in the lab lectures and project checkpoint write-ups supercedes what I describe here! • Neil and Allen have a working implementation of the project • They know the project better than I do! Listen to them! CS 150 - Spring 2007 – Lec. #11: Course Project - 2

  3. Course Project: Videoconferencing System • Not quite this… but: • Video camera capture • CRT video display • Serial compressed video2-way transmission between two stations • Wireless communications • (no audio this semester) • Implemented in a Xilinx FPGA on theCalinx boards in the lab • Groups of two -- your Lab #4/#5 partner • Commit to a TA now for grading purposes CS 150 - Spring 2007 – Lec. #11: Course Project - 3

  4. Video & AudioPorts Four 100 Mb Ethernet Ports AC ’97 Codec & Power Amp Video Encoder & Decoder 8 Meg x 32 SDRAM Flash Card & Micro-drive Port Quad Ethernet Transceiver Prototype Area Xilinx Virtex 2000E Seven Segment LEDDisplays Calinx EECS 150 Lab/Project Protoboard CS 150 - Spring 2007 – Lec. #11: Course Project - 4

  5. Video Decoder Multiport SDRAM Memory System Video Encoder SDRAM (Checkpoint #0) Camera Display Videostream Video Decoder Multiport Arbitration Video Encoder (Checkpoint #1) Checkpoint #2 Wireless Transceiver (Checkpoint #3) Checkpoint #4 Complete Videoconferencing System CS 150 - Spring 2007 – Lec. #11: Course Project - 5

  6. Checkpoint #0/#1/#2: SDRAM Interface • Memory protocols • Bus arbitration • Address phase • Data phase • DRAM is large, but few address lines and slow • Row & col address • Wait states • Synchronous DRAM provides fast synchronous access current block • Little like a cache in the DRAM • Fast burst of data • Arbitration for shared resource CS 150 - Spring 2007 – Lec. #11: Course Project - 6

  7. Checkpoint #1: Video Encoding • Pixel Array: • Digital image represented by matrix of values, where each is a function of the information surrounding it in the image; single element in image matrix: picture element or pixel (includes info for all color components) • Array size varies for different apps and costs: some common sizes shown • Frames: • Illusion of motion created by successively flashing still pictures called frames CS 150 - Spring 2007 – Lec. #11: Course Project - 7

  8. Checkpoint #1: Video Encoding • Video details fairly complex and involve many choices: • NTSC vs. PAL, HDTV, … • Interleaved even-odd frames (TV) vs. progress scan (computer and digital displays) • Frame size, frame rate • Pixel encodings: RGB, YUV/YCB (Luminance, Chrominance -- brightness plus color difference signals) • Subsampling to reduce data demands (compression trick) • Inputs: ITU-R BT.601 Format (Digital Broadcast NTSC) • Outputs: Component video, S-video to drive LCDs in lab • Fortunately, Calinx board has a chip on-board that deals with much of the grungy details … CS 150 - Spring 2007 – Lec. #11: Course Project - 8

  9. Interfacing details for ITU-601 Pixels per line 858 Lines per frame 525 Frames/sec 29.97 Pixels/sec 13.5 M Viewable pixels/line 720 Viewable lines/frame 487 With 4:2:2 chroma sub-sampling, send 2 words/pixel (Cr/Y/Cb/Y) Words/sec = 27MEncoder runs off a 27MHz clock Control info (horizontal & vertical synch) is multiplexed on data lines Encoder data stream show to right See video tutorial documents on course documentation web page! ITU-R BT.656 Details CS 150 - Spring 2007 – Lec. #11: Course Project - 9

  10. Checkpoint #1: Video Encoder • Display driver processes pixels within frame buffer • Drive ADV7194 video encoder device to output correct NTSC video • Gain lots of experience reading data sheets • Dictates the 27 MHz operation rate • Used throughout graphics subsystem CS 150 - Spring 2007 – Lec. #11: Course Project - 10

  11. Analog Devices ADV7194: ITU 601/656 in, Composite Video Out Supports: Multiple input formats and outputs Operational modes, slave/master Used in default mode: ITU-601 as slave s-video output Digital input side connected to Virtex pins Analog output side wired to on board connectors or headers I2C interface for initialization: Wired to Virtex Calinx On-Board Video Encoder CS 150 - Spring 2007 – Lec. #11: Course Project - 11

  12. SDRAM READ Burst Timing CS 150 - Spring 2007 – Lec. #11: Course Project - 12

  13. Checkpoint #2: Video Decode • Pretty much the reverse of the encoding process of Checkpoint #1 • We will provide the base Verilog for video decode • You will need to integrate video decode with your SDRAM arbitrated write port • Integrate with your Checkpoint #1 CS 150 - Spring 2007 – Lec. #11: Course Project - 13

  14. Checkpoint #3: Wireless Transceiver • This will involve interfacing to the wireless transceiver chip on the Calinx2 board • Neil working on a clear description of how this works CS 150 - Spring 2007 – Lec. #11: Course Project - 14

  15. Checkpoint Build Up to Complete Project • Week #7: Lab #6/Checkpoint #0 -- Basic SDRAM Subsystem • Week #8: Checkpoint #1 -- SDRAM to Video Display (Encoder) • Week #9: Checkpoint #2 -- Local Video System • Video Capture (Decoder) to SDRAM to Video Display (Encoder) • Video Decoder Verilog will be provided to you • Week #10/11 : Checkpoint #3 -- Wireless Transceiver • Midterm #2 scheduled for Week #10 • Spring break between Week #10 and #11 • Week #12/13: Checkpoint #4 -- Putting it altogether • Video Capture to SDRAM to Wireless Transceiver to SDRAM to Video Display • Week #14: Final Report CS 150 - Spring 2007 – Lec. #11: Course Project - 15

  16. Possible Bells and Whistles • Still thinking about this but here are some ideas: • Performance tuning: larger remote display, higher refresh rate • Sending more data per unit time via compression/decompression through the wireless transceiver • Your good idea here • NOTE: We don’t necessary know how to implement these ourselves! (these haven’t been implemented in the TA solution, for example) • NOTE: There will be a bonus for an early demo of the complete project at the end of Week #12 (one week early) • NOTE: Extra credit will be limited to 20% extra points and no extra credit unless the standard functionality works CS 150 - Spring 2007 – Lec. #11: Course Project - 16

More Related