780 likes | 917 Views
A QoS approach for Multimedia Consumer Terminals - A case for Conditionally Guaranteed Budgets -. Reinder J. Bril. 23-11-2004. Multimedia Consumer Terminals and QoS. Multimedia Consumer Terminals audio/video: perception is key high volume electronics: cost-constrained
E N D
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking A QoS approach forMultimedia Consumer Terminals- A case for Conditionally Guaranteed Budgets - Reinder J. Bril 23-11-2004
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Multimedia Consumer Terminals and QoS • Multimedia Consumer Terminals • audio/video: perception is key • high volume electronics: cost-constrained • requires average-case resource allocation • High quality audio and video: • have real-time requirements • Quality of Service (QoS) • “collective effort of service performances that determine the degree of satisfaction of the user of that service”(International Telecommunications Union)
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking University of Madrid (dit/UPM) University of Illinois at Urbana- Champaign (UIUC) University of Mannheim University of St. Petersburg Multi-disciplinary QoS approach V-QoS Quality of Service Resource Management (QoS-RM) Scalable Video Algorithms (SVA) ITEA/Europa, ITEA/Robocop, OZONE, …
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Conditionally Guaranteed Budgets • Conclusion
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • Media processing from dedicated HW to SW • Platforms are resource constraint • High quality video has real time requirements • A QoS approach • Conditionally Guaranteed Budgets • Conclusion
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Adaptive applications • Budget-based resource manager • Control hierarchy • Conditionally Guaranteed Budgets • Conclusion
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Conditionally Guaranteed Budgets • Resource allocation conflict • Extension of QoS approach • Analysis • Conclusion
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Cable modem DVB Tuner IEEE 1394 interface RF Tuner CVBS interface YC interface VGA DVD CDx front end Multimedia Consumer Terminals Focus: Receivers in broad-cast environments High-quality video applications
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Traditional High-End TV Architecture Traditional TV sets andSet-Top Boxes: • Fixed algorithms for fixed HW architectures • Upgrade for new services and applications is problematic • Systems are not flexible
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Digital video platform Expectations: • Upgradeable for new servicesand applications • Fast time-to-market for new features • Enabling approach for product families
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking SW-Modules Algorithm 4 Algorithm 4 Algorithm 3 High- end Algorithm 3 Mid- range Algorithm 2 Algorithm 2 Low- end Algorithm 1 Algorithm 1 max min HW Architectures vs. SW Applications Product Families Resources
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Algorithm 4 Algorithm 3 Algorithm 2 Low- end Algorithm 1 Algorithm 1 Flexibility Mode 2 Mode 3 Mode 1
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Algorithm 3 Algorithm 3 Low- end Algorithm 1 Scalability Alg. 4 Alg. 1 Mode 2 Mode 1
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Algorithm 3 Algorithm 3 Algorithm 3 Low- end Algorithm 1 Smooth mode transition Alg. 4 Alg. 1 Alg. 1 Transitory Final Initial
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking traditional systems traditional systems Quality Cost scalable approach scalable approach target limit target limit Functionality Functionality Platform constraints
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Platform constraints • Cost-effectiveness requirement • High volume: low bill of material • Low power • Software solutions are relatively expensive(mm2 silicon / power) • Average case and worst-case are far apart
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Fluctuating resource requirements load worst-case structural load running average temporal load time
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Fluctuating resource requirements • Temporal load changes (very frequent) • from I frame to B frame • more or less motion • transient high peaks • Structural load changes (less frequent) • scene change • from movie to camera • from news to commercial
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Platform constraints • Cost-effectiveness requirement • High volume: low bill of material • Low power • Software solutions are relatively expensive(mm2 silicon / power) • Average case and worst-case are far apart • Conclusion:Aim for average-case resource allocation
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking up-scaled High quality video TV companies invest heavily in video enhancement,e.g. temporal up-scaling Input stream: 24 Hz (movie) original Rendered stream: 60 Hz (TV screen)
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking up-scaled displayed High quality video TV companies invest heavily in video enhancement,e.g. temporal up-scaling Input stream: 24 Hz (movie) original • Deadline miss leads to “wrong” picture. • Deadline misses tend to come in bursts (heavy load). • Valuable work may be lost.
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking up-scaled displayed High quality video TV companies invest heavily in video enhancement,e.g. temporal up-scaling Input stream: 24 Hz (movie) original QoS trade-off (at run-time): Lesser picture quality often better than temporal incorrectness.
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking High quality video • QoS = degree of user satisfaction • User satisfaction has to do with perception: • Lesser picture quality often better than temporal incorrectness. • Quality fluctuations are perceived as non-quality. • With a scene change, the brain needs some time to re-focus. • Most people focus on one thing at a time (user focus) • User focus normally is at • the center of a window, • the window that received the latest (remote) command. • Only video specialists can make the necessary trade-offs.
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Multimedia Consumer Terminals - Summary • Media processing from dedicated HW to SW • Flexibility & scalability • Fast time-to-market • Product families • Platform constraints • Aim for average-case resource allocation • High quality video • Has real-time requirements; • is about perception -> QoS; • real-time is a QoS parameter; • QoS is primarily an application-domain issue.
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Adaptive applications • Budget-based resource manager • Control hierarchy • Conditionally Guaranteed Budgets • Conclusion
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking DVD main pip disk mode 1: main mode 2: main + pip mode 3: main + pip + disk User applications Input Output Media processing Modes In mode 3, main+pip+diskcan not run at highest quality.
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking DVD main: scalable digitizer: non-scalable pip: scalable mixer : non-scalable disk: non-scalable hierarchical task Application execution model (prototype) audio rend audio dec. read dmux dec. sharp enh. mixer digit scaler hw scaler enc. writer enc. buffer enc. task Both mainandpipare scalable. data transfer dec scalable task connection to HW IO
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Quality Resource needs Scalable Algorithm
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking s1 s2 Detail Filter Amplitude Control Noise Measurement QL0 QL1 QL2 QL3 Example: Sharpness Enhancement Filter AC NM No No No 1D No No 2D No No 2D Yes Yes
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking QL0 QL2 QL4 Resource range for SVA examples QL0 QL1 QL4
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking CPU timeapp. 2 budget 2 CPU timeapp. 1 budget 1 time Budget-based resource manager • Temporal isolation: • Reserved, guaranteed, and enforced budgets • e.g. 20% of the CPU time every 20 ms; • Applications run on a “virtual platform”;
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Dynamic load (reminder) • Temporal load changes (very frequent) • from I frame to B frame • more or less motion • transient high peaks • Structural load changes (less frequent) • scene change • from movie to camera • from news to commercial • Mode change (infrequent) • functional change • external trigger
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Control hierarchy • Dynamic load at different time-scales: • Temporal load changes; • Structural load changes; • Mode change. • Layers of control, e.g. • local quality control of applications; • global system utility control.
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Optimizes system utility, sets quality levels + allocates resources Global system utility control Adaptive applications Local quality control Provide quality levels + estimated resource req. … SVAs Provides guaranteed resource budgets Resource manager Co-operative QoS approach
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Overview • Multimedia Consumer Terminals • A QoS approach • Conditionally Guaranteed Budgets • Why: Resource allocation conflict • How: Extension of QoS approach • Analysis • Conclusion
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking structural load running average temporal load Resource requirements (reminder) load time
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking structural load running average temporal load Resource allocation: worst-case load Not cost-effective time
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Instantaneous budget increase structural load running average Not yet feasible temporal load Resource allocation: close to average load time
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Instable output quality structural load running average Not acceptable forimportant applications temporal load Resource allocation: close to average load time
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking “wasted” structural load running average Not cost-effective temporal load Resource allocation: close to average load time
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Resource allocation conflict Structural load increase +close-to-average resource allocation yields • either instable output quality not acceptable for important applications • or “wasted” resources not cost-effective
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking B Instantaneous budget increase structural load running average Anticipated increase temporal load Conditionally guaranteed budgets: Why? load B time
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking CGB Conditionally guaranteed budgets: How? Basic approach (MIA and LIA): • Two modes of quality settings + allocation: Normal mode(low load for MIA) Anticipated mode(high load for MIA) MIA QMIA, BMIA QMIA, BMIA+BMIA LIA QLIA,N, BLIA+BLIA QLIA,A, BLIA
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Inform MIA, LIA, and RM about both modes Global system utility control modes Adaptive applications MIA LIA Normal mode Anticipated mode Normal mode Anticipated mode Resource manager (RM) Normal mode Anticipated mode Conditionally guaranteed budgets: How?
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Global system utility control Adaptive applications MIA LIA Normal mode Anticipated mode Normal mode Anticipated mode Resource manager (RM) Normal mode Anticipated mode Conditionally guaranteed budgets: How? Running in normal mode
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Global system utility control Adaptive applications MIA LIA Normalmode Anticipated mode Normal mode Anticipated mode Resource manager (RM) Normal mode Anticipated mode Conditionally guaranteed budgets: How? MIA detects load increase, claims BMIA, and switches mode Claim BMIA Mode transition
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Conditionally guaranteed budgets: How? Global system utility control Adaptive applications MIA LIA Normal mode Anticipated mode Normal mode Anticipated mode Inform LIA RM switches mode instantaneously, andinforms LIA Resource manager (RM) Normal mode Anticipated mode Mode transition
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Conditionally guaranteed budgets: How? Global system utility control Adaptive applications MIA LIA LIA switches mode Normal mode Anticipated mode Normal mode Anticipated mode Resource manager (RM) Normal mode Anticipated mode Running in anticipated mode
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Conditionally guaranteed budgets: How? • Summary basic approach: • Assumption: • Anticipation of resource needs and modes; • Allocation phase: • Informing MIA, LIA, and RM about modes; • Delegation of mode changes to MIA; • Execution phase: • Release and claim of resources by MIA; • Instantaneous mode change by RM.
Reinder J. Bril, r.j.bril@tue.nl TU/e Informatica, System Architecture and Networking Conditionally guaranteed budgets: How? • How to change budgets instantaneously ? • In-the-place-of resource consumption • LIA consumes BLIA exactly whenMIA would have consumed BMIA