1 / 29

An ANFIS-based Hybrid Video Quality Prediction Model for Video Streaming over Wireless Networks

An ANFIS-based Hybrid Video Quality Prediction Model for Video Streaming over Wireless Networks. Information & Communication Technologies. Asiya Khan, Lingfen Sun & Emmanuel Ifeachor 19 th Sept 2008 University of Plymouth United Kingdom {asiya.khan; l.sun; e.ifeachor} @plymouth.ac.uk.

xylia
Download Presentation

An ANFIS-based Hybrid Video Quality Prediction Model for Video Streaming over Wireless Networks

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. An ANFIS-based Hybrid Video Quality Prediction Model for Video Streaming over Wireless Networks Information & Communication Technologies Asiya Khan, Lingfen Sun & Emmanuel Ifeachor 19th Sept 2008 University of Plymouth United Kingdom {asiya.khan; l.sun; e.ifeachor} @plymouth.ac.uk IEEE NGMAST 16-19 Sept, Cardiff, UK

  2. Presentation Outline Background Video quality for wireless networks Current status Aims of the project Main Contributions Classification of video content into three main categories Impact of application and network level parameters on video quality Novel non-intrusive video quality prediction models based on ANFIS in terms of MOS score and Q value[3] Conclusions and Future Work IEEE NGMAST 16-19 Sept, Cardiff, UK

  3. Background – Video Quality for Wireless Networks(1) Video Quality Measurement Subjective method (Mean Opinion Score -- MOS) Objective methods Intrusive methods (e.g. PSNR, Q value[3]) Non-intrusive methods (e.g. ANN-based models) Why do we need to predict video quality? Multimedia services are increasingly accessed with wireless components For Quality of Service (QoS) control for multimedia applications IEEE NGMAST 16-19 Sept, Cardiff, UK

  4. Background – Video Quality for Wireless Networks(2) Full-ref Intrusive Measurement Encoder Decoder End-to-end perceived video quality Raw video MOS/Q Degraded video Raw video Received video Simulated system Application Parameters Network Parameters Application Parameters Video quality: end-user perceived quality(MOS), an important metric. Affected by application and network level and other impairments. Video quality measurement: subjective (MOS) or objective (intrusive or non-intrusive) Ref-free Non-Intrusive Measurement MOS/Q IEEE NGMAST 16-19 Sept, Cardiff, UK

  5. Current Status and Motivations(1) Lack of an efficient non-intrusive video quality measurement method Current video quality prediction methods mainly based on application level or network level parameters Neural network based models not widely used for video quality prediction. NN models based on application parameters and content characteristics but NOT considered network parameters OR NN models based on application and network parameters without considering content types IEEE NGMAST 16-19 Sept, Cardiff, UK

  6. Current Status and Motivations(2) NN databases are mainly based on subjective tests As subjective test is time consuming, costly and stringent, available databases are limited and cannot cover all the possible scenarios Only a limited number of subjects attended MOS tests Proposed test bed is based on NS2 with an integrated tool Evalvid[4] – as it gives a lot of flexibility for evaluating different topologies and parameter settings used. IEEE NGMAST 16-19 Sept, Cardiff, UK

  7. Current Status and Motivations(3) Content adaptation is a hot topic and is suited to neural network model as ANNs can learn from content change. Why use ANFIS-based Artificial Neural Networks(ANN)? Video quality is affected by many parameters and their relationship is thought to be non-linear ANN can learn this non-linear relationship Fuzzy systems are similar to human reasoning(not just 0 or 1) ANFIS(Adaptive Neural-Fuzzy Inference System) combines the advantages of neural networks and fuzzy systems IEEE NGMAST 16-19 Sept, Cardiff, UK

  8. Aims of the Project NS2 + Evalvid Encoder Packetizer De-packetizer Decoder End-to-end perceived video quality (MOS/Q) Raw video Degraded video Sender Receiver MOS/Q Classification of video content into three main categories Impact of application and network level parameters on video quality using objective measurement. Novel non-intrusive video quality prediction models based on ANFIS in terms of MOS score and Q value[3] Ref-free ANFIS-based Non-intrusive Measurement IEEE NGMAST 16-19 Sept, Cardiff, UK

  9. Classification of Video Contents Test Sequences Classified into 3 Categories of: Slow Movement(SM) – video clip ‘Akiyo’ for training and ‘Suzie’ for validation. Gentle Walking(GW) – video clip ‘Foreman’ for training and ‘Carphone’ for validation. Rapid Movement(RM) – video clip ‘Stefan’ for training and ‘Rugby’ for validation. All video sequences were in the qcif format (176 x 144), encoded with MPEG4 video codec [6] IEEE NGMAST 16-19 Sept, Cardiff, UK

  10. List of Variable Test Parameters Application Level Parameters: Frame Rate FR (10, 15, 30fps) Send BitrateSBR (18, 44, 80kb/s for SM & GW; 80, 104, 512kb/s for RM) Network Level Parameters: Packet Error Rate PER (0.01, 0.05, 0.1, 0.15, 0.2) Link Bandwidth LBW (32, 64, 128kb/s for SM; 128, 256, 384kb/s for GW; 384, 512, 768, 1000kb/s for RM) IEEE NGMAST 16-19 Sept, Cardiff, UK

  11. Testbed Combinations Parameters values are typical of video streaming over 3G to WLAN applications IEEE NGMAST 16-19 Sept, Cardiff, UK

  12. Simulation set-up CBR background traffic 1Mbps Mobile Node Video Source Variable link 11Mbps 10Mbps, 1ms transmission rate All experiments conducted with open source Evalvid[4] and NS2[5] IEEE NGMAST 16-19 Sept, Cardiff, UK

  13. Simulation Platform Video quality measured by taking average PSNR over all the decoded frames. MOS scores calculated from conversion from Evalvid[4]. Q[3] obtained from the same testing combinations. IEEE NGMAST 16-19 Sept, Cardiff, UK

  14. Impact of Application & Network Level Parameters on Video Quality(1) MOS vs Send Bitrate vs Packet error rate for SM, GW • Video quality of GW fades very rapidly with • higherpacket loss(acceptableupto ~ 8%) • Increasing the SBR does not compensate • for higher packet loss. • p • Video quality for SM acceptable upto • packet loss of 20%(MOS>3.5) IEEE NGMAST 16-19 Sept, Cardiff, UK

  15. Impact of Application & Network Level Parameters on Video Quality(2) MOS vs SBR vs PER for RM • Video quality for RM is similar to GW • acceptable ~ 5% packet loss • MOS vs SBR vs LBW for SM • Increasing the LBW as expected • improves the video quality. Also if the • SBR > LBW due then video quality • Worsens due to network congestion. IEEE NGMAST 16-19 Sept, Cardiff, UK

  16. Impact of Application & Network Level Parameters on Video Quality(3) • MOS vs SBR vs LBW for GW & RM • GW RM • Same as SM IEEE NGMAST 16-19 Sept, Cardiff, UK

  17. Impact of Application & Network Level Parameters on Video Quality(4) • MOS vs FR vs SBR for SM, GW & RM • SM GW RM • Increasing the frame rate increases the video quality upto 15fps IEEE NGMAST 16-19 Sept, Cardiff, UK

  18. Impact of SBR and FR • SBR exhibits a great influence on quality. • Increasing the SBR increases the video quality. • However it does not compensate for higher packet loss. • Content category of SM very low SBR of 18kb/s gives acceptable video • quality (MOS > 3.5) for communication standards • FR is not as significant as SBR. • Improvement of quality for FR greater than 15fps is negligible • Impact of PER and LBW • Quality reduces drastically with the increase of PER • Increase in LBW will only improve video quality if SBR is less than the • LBW due to network congestion problems. The effect of LBW is • generally measured in terms of packet error rate or delay. Impact of Application & Network Level Parameters on Video Quality(5) IEEE NGMAST 16-19 Sept, Cardiff, UK

  19. Developed an ANFIS-based artificial neural network model • (using MATLAB). • Identified four variables as inputs to ANFIS-based ANN • Frame rate • Send bitrate • Packet error rate • Link bandwidth • Two outputs (MOS and Q value[3]) • Q value[3] (the decodable frame rate) is a relatively new • application level metric and is defined as the number of • decodable frames over the total number of frames sent by • video source. Non-intrusive Video Quality Prediction Models based on ANFIS(1) IEEE NGMAST 16-19 Sept, Cardiff, UK

  20. Novel Non-intrusive Video Quality Prediction Models based on ANFIS(2) MOS/Q FR, SBR, PER, LBW ANFIS-based ANN Architecture The entire system architecture consists of five layers, namely, a fuzzy layer, a product layer, a normalized layer, a defuzzy layer and a total output layer. IEEE NGMAST 16-19 Sept, Cardiff, UK

  21. Novel Non-intrusive Video Quality Prediction Models based on ANFIS(3) ANFIS-based ANN Learning Model Application Level Content Type ANFIS-based ANN Learning Model FR SBR Video Packet CT MOS/Q PER LBW Network Level A total of 450 samples (patterns) were generated based on Evalvid[4] as the training set and 210 samples as the validation dataset for the 3 CTs. IEEE NGMAST 16-19 Sept, Cardiff, UK

  22. Novel Non-intrusive Video Quality Prediction Models based on ANFIS(4) Evaluation of the ANFIS-based Learning Model for SM MOS/Qpred = a1MOS/Qmeasured + b1 IEEE NGMAST 16-19 Sept, Cardiff, UK

  23. Novel Non-intrusive Video Quality Prediction Models based on ANFIS(5) Evaluation of the ANFIS-based Learning Model for GW MOS/Qpred = a1MOS/Qmeasured + b1 IEEE NGMAST 16-19 Sept, Cardiff, UK

  24. Novel Non-intrusive Video Quality Prediction Models based on ANFIS(6) Evaluation of the ANFIS-based Learning Model for RM MOS/Qpred = a1MOS/Qmeasured + b1 IEEE NGMAST 16-19 Sept, Cardiff, UK

  25. Novel Non-intrusive Video Quality Prediction Models based on ANFIS(7) Generated a validation dataset from different video clips in the three content types and different set of values for the four input parameters (total 210 samples). Obtained good prediction accuracy in terms of the correlation coefficient (R2)and root mean error squared for the validation dataset using an ANFIS-based neural network. This suggested that the ANFIS-based neural network model works well for video quality prediction in general. IEEE NGMAST 16-19 Sept, Cardiff, UK

  26. Conclusions Classified the video content in three categories. Investigated and analyzed the combined effects of application and network parameters on end-to-end perceived video quality based on MOS and Q value[3]. SBR and PER have a great impact on video quality. FR is not as significant and LBW is very difficult to measure. Based on the application and network level parameters successfully developed an ANFIS-based learning model to predict video quality for MPEG4 video streaming over wireless network application. IEEE NGMAST 16-19 Sept, Cardiff, UK

  27. Future Work Classifying the video content objectively. Propose one model for all contents. Extend to Gilbert Eliot loss model. Use subjective data. Propose adaptation mechanisms for QoS control. IEEE NGMAST 16-19 Sept, Cardiff, UK

  28. References Selected References ITU-T. Rec P.800, Methods for subjective determination of transmission quality, 1996. Video quality experts group, multimedia group test plan, Draft version 1.8, Dec 2005, http://www.vqeg.org. C. Lin, C. Ke, C. Shieh and N. Chilamkurti, “The packet loss effect on MPEG video transmission in wireless networks”, Proc. of the 20th Int. Conf. on Advanced Information Networking and Applications (AINA).Vol. 1, 2006, pp. 565-72. J. Klaue, B. Tathke, and A. Wolisz, “Evalvid – A framework for video transmission and quality evaluation”, In Proc. Of the 13th International Conference on Modelling Techniques and Tools for Computer Performance Evaluation, Urbana, Illinois, USA, 2003, pp. 255-272. NS2, http://www.isi.edu/nsnam/ns/. Ffmpeg, http://sourceforge.net/projects/ffmpeg M. Ries, O. Nemethova and M. Rupp, “Video quality estimation for mobile H.264/AVC video streaming”, Journal of Communications, Vol. 3, No.1, Jan. 2008, pp. 41-50. S. Mohamed, and G. Rubino, “A study of real-time packet video quality using random neural networks”, IEEE Transactions on Circuits and Systems for Video Technology , Publisher, Vol. 12, No. 12. Dec. 2002, pp. 1071-83. P. Calyam, E. Ekicio, C. Lee, M. Haffner and N. Howes, “A gap-model based framework for online VVoIPQoE measurement”, Journal of Communications and Networks, Vol. 9, No.4, Dec. 2007, pp. 446-56. IEEE NGMAST 16-19 Sept, Cardiff, UK

  29. Contact details http://www.tech.plymouth.ac.uk/spmc Asiya Khan asiya.khan@plymouth.ac.uk Dr Lingfen Sun l.sun@plymouth.ac.uk Prof Emmanuel Ifeachore.ifeachor@plymouth.ac.uk http://www.ict-adamantium.eu/ Any questions? Thank you! IEEE NGMAST 16-19 Sept, Cardiff, UK

More Related