Application-driven cross-layer optimization for video streaming over wireless networks

Mobile multimedia applications require networks that optimally allocate resources and adapt to dynamically changing environments. Cross-layer design (CLD) is a new paradigm that addresses this challenge by optimizing communication network architectures across traditional layer boundaries. In this article we discuss the relevant technical challenges of CLD and focus on application-driven CLD for video streaming over wireless networks. We propose a cross-layer optimization strategy that jointly optimizes the application layer, data link layer, and physical layer of the protocol stack using an application-oriented objective function in order to maximize user satisfaction. In our experiments we demonstrate the performance gain achievable with this approach. We also explore the trade-off between performance gain and additional computation and communication cost introduced by cross-layer optimization. Finally, we outline future research challenges in CLD.     

Quality-aware cross-layer scheduling for robust video streaming over wireless channels

In the case of video streaming over wireless channels, burst errors may lead to serious video quality degradation. By jointly exploiting the scheduling mechanism on different communication layers, this paper proposes a quality-aware cross-layer scheduling scheme to achieve unequal error control for each Latency-constraint Frame Set (LFS) of a video stream. After a network-layer agent at base station firstly utilizes the network-layer packet scheduling to provide packet-granularity importance classification for the current LFS, a link-layer agent at base station further utilizes the Radio-Link-Unit (RLU) scheduling to implement finer selective retransmission of the current LFS. Under scheduling delay and bandwidth constraints, the proposed scheme can be aware of the application-layer quality and time-varying channel conditions, and hence burst errors can simply be shifted to lower-priority transmission units in the current LFS. Simulation results demonstrate that the proposed scheme has strong robustness against burst errors, and thus improves the overall received quality of the video stream over wireless channels.     

Rate control for streaming video over wireless

Rate control is an important issue in video streaming applications for both wired and wireless networks. A widely accepted rate control method in wired networks is TCP-friendly rate control (TFRC) (Floyd, 2000). It is equation-based rate control in which the TCP-friendly rate is determined as a function of packet loss rate, round-trip time, and packet size. TFRC assumes that packet loss in wired networks is primarily due to congestion, and as such is not applicable to wireless networks in which the main cause of packet loss is at the physical layer. In this article we review existing approaches to solve this problem. Then we propose multiple TFRC connections as an end-to-end rate control solution for wireless video streaming. We show that this approach not only avoids modifications to the network infrastructure or network protocol, but also results in full utilization of the wireless channel. NS-2 simulations, actual experiments over a 1/spl times/RTT CDMA wireless data network, and video streaming simulations using traces from the actual experiments are carried out to characterize the performance and show the efficiency of our proposed approach.     

SSIM-based error-resilient cross-layer optimization for wireless video streaming

The traditional Sum of Squared Error (SSE)-based cross-layer optimization has been shown to be an effective way to improve the quality of service for wireless video streaming. However, recent research works show that the SSE-based optimization metric does not always provide the video distortion measurement that matches well with the video quality degradation observed by the human vision system. Taking advantage of the Structural SIMilarity (SSIM) metric in measuring the video perceptual quality, a SSIM-based error-resilient cross-layer optimization scheme is proposed to improve the perceptual quality for the real-time wireless video streaming in this paper. Besides the video data rate adjustment and the link adaption including the Modulation and Coding Scheme (MCS) selection, the error-resilient Rate-Distortion Optimization (RDO) for each encoding unit is introduced into the cross-layer optimization process to ensure that the video data are transmitted efficiently and reliably over the time-varying wireless channel. In addition, to ensure that cross-layer optimization scheme is more practical, a low-complexity optimal parameter selection algorithm that exploits the MCS-SNR relationship and the Rate-Quantization (R-Q) model is proposed. Experimental results show that significant performance improvements in terms of the perceptual video quality and the computational complexity are achieved for the proposed cross-layer optimization scheme.     

Multiuser cross-layer resource allocation for video transmission over wireless networks

With the advancement of video-compression technology and the wide deployment of wireless networks, there is an increasing demand for wireless video communication services, and many design challenges remain to be overcome. In this article, we discuss how to dynamically allocate resources according to the changing environments and requirements, so as to improve the overall system performance and ensure individual quality of service (QoS). Specifically, we consider two aspects with regard to design issues: cross-layer design, which jointly optimizes resource utilization from the physical layer to the application layer, and multiuser diversity, which explores source and channel heterogeneity for different users. We study how to efficiently transmit multiple video streams, encoded by current and future video codecs, over resource-limited wireless networks such as 3G/4G cellular system and future wireless local/metropolitan area networks (WLANs/WMANs).     

End-to-end optimized TCP-friendly rate control for real-time video streaming over wireless multi-hop networks

Rate control is an important issue in video streaming applications. The most popular rate control scheme over wired networks is TCP-Friendly Rate Control (TFRC), which is designed to provide optimal transport service for unicast multimedia delivery based on the TCP Reno’s throughput equation. It assumes perfect link quality, treating network congestion as the only reason for packet losses. Therefore, when used in wireless environment, it suffers significant performance degradation because of packet losses arising from time-varying link quality. Most current research focuses on enhancing the TFRC protocol itself, ignoring the tightly coupled relation between the transport layer and other network layers. In this paper, we propose a new approach to address this problem, integrating TFRC with the application layer and the physical layer to form a holistic design for real-time video streaming over wireless multi-hop networks. The proposed approach can achieve the best user-perceived video quality by jointly optimizing system parameters residing in different network layers, including real-time video coding parameters at the application layer, packet sending rate at the transport layer, and modulation and coding scheme at the physical layer. The problem is formulated and solved as to find the optimal combination of parameters to minimize the end-to-end expected video distortion constrained by a given video playback delay, or to minimize the video playback delay constrained by a given end-to-end video distortion. Experimental results have validated 2–4 dB PSNR performance gain of the proposed approach in wireless multi-hop networks by using H.264/AVC and NS-2.     

QoSMOS: cross-layer QoS architecture for wireless multimedia sensor networks

Wireless multimedia sensor networks (WMSNs), having inherent features and limited resources, require new quality of service (QoS) protocols for real-time and multimedia applications. In this paper, we present a cross-layer QoS architecture (QoSMOS), that unifies network and link layers into a single communication module for QoS provisioning. Based on QoSMOS architecture, we developed an example reference cross-layer protocol, named cross-layer communication protocol (XLCP), enabling scalable service differentiation in WMSNs. Comprehensive analysis of simulation results indicate that the proposed architecture successfully differentiates service classes in terms of soft delay, reliability and throughput domains. A comparative analysis of XLCP and its counterparts is also given to show the superiority of the cross-layer protocol.     

Collaborative resource exchanges for peer-to-peer video streaming over wireless mesh networks

Peer-to-peer collaboration paradigms fundamentally change the passive way wireless stations currently adapt their transmission strategies to match available resources, by enabling them to proactively influence system dynamics through exchange of information and resources. In this paper, we focus on delay-sensitive multimedia transmission among multiple peers over wireless multi-hop enterprise mesh networks. We propose a distributed and efficient framework for resource exchanges that enables peers to collaboratively distribute available wireless resources among themselves based on their quality of service requirements, the underlying channel conditions, and network topology. The resource exchanges are enabled by the scalable coding of the video content and the design of cross-layer optimization strategies, which allow efficient adaptation to varying channel conditions and available resources. We compare our designed low complexity distributed resource exchange algorithms against an optimal centralized resource management scheme and show how their performance varies with the level of collaboration among the peers. We measure system utility in terms of the multimedia quality and show that collaborative approaches achieve ~50% improvement over non-collaborative approaches. Additionally, our distributed algorithms perform within 10% system utility of a centralized optimal resource management scheme. Finally, we observe 2-5 dB improvement in decoded PSNR for each peer due to the deployed cross-layer strategy     

Content-based FGS coding mode determination for video streaming over wireless networks

Video streaming is the major subject of Amendment for MPEG-4 and it is developed in response to the growing needs on a video-coding standard for the video communication. The fine-granular scalability (FGS) combined with the temporal scalability addresses a variety of challenging problems in delivering video. The FGS video encoder makes the coding mode decision based on the video content and the current available bandwidth in order to achieve higher perceptual video quality. In this paper, we develop a mode selection method to find the most suitable scalable coding mode from six coding schemes: FGS, FGST, FGS-SE, and FGST with background composition based on the contents of the video sequences.     

A game theoretic approach to video streaming over peer-to-peer networks

We consider the problem of foresighted multimedia resource reciprocation in peer-to-peer (P2P) networks, which consist of rational peers aiming at maximizing their individual utilities. We introduce an artificial currency (credit) to take into account the characteristics of different parts of the video signal. The resource reciprocation with the proposed credit metric can be formulated as a stochastic game, in which the peers determine their optimal strategies using Markov Decision Process (MDP) framework. The introduced framework can be applied to the general video coding, and in particular, is suitable for the scalable video where various parts of the encoded bit stream have significantly different importance for the video quality.     

Optimized video streaming over 802.11 by cross-layer signaling

Seamless video streaming over wireless links imposes strong demands on video codecs and the underlying network. It is not sufficient that only the video codec or only the radio adapts to changes in the wireless link quality; efforts should be applied in both layers, and - if possible - synchronized. Also, the disturbing effect of possible background traffic over the same shared medium has to be taken into account. In this article we present a communication architecture for video streaming over 802.11 that is capable of adapting to changes in the link quality and sharing of the wireless channel in various use scenarios. Experimental results show that substantial improvements in the quality of the video can be obtained by applying link adaptation and cross-layer signaling techniques.     

A cross-layer scheduling algorithm with QoS support in wireless networks

Scheduling plays an important role in providing quality of service (QoS) support to multimedia communications in various kinds of wireless networks, including cellular networks, mobile ad hoc networks, and wireless sensor networks. The authors propose a scheduling algorithm at the medium access control (MAC) layer for multiple connections with diverse QoS requirements, where each connection employs adaptive modulation and coding (AMC) scheme at the physical (PHY) layer over wireless fading channels. Each connection is assigned a priority, which is updated dynamically based on its channel and service status; the connection with the highest priority is scheduled each time. The authors' scheduler provides diverse QoS guarantees, uses the wireless bandwidth efficiently, and enjoys flexibility, scalability, and low implementation complexity. Its performance is evaluated via simulations.     

3D visual experience oriented cross-layer optimized scalable texture plus depth based 3D video streaming over wireless networks

3D video streaming over the mobile Internet generally incurs the inferior 3D visual experience due to the time-varying characteristics of wireless channel. The conventional video streaming optimization methods generally neglect the harmony among different networking protocol layers. This paper proposes a cross-layer optimized texture plus depth based scalable 3D video streaming method to improve the expected 3D visual experience of the user by systematically considering the application layer texture-video/depth/FEC bit-rate allocation, MAC layer multi-channel allocation, and physical layer modulation and channel coding scheme (MCS) selection. In the cross-layer optimization, a networking-related 3D visual experience model which fuses the overlapped retinal view visual quality and depth sensation with mimicking human vision system is established to predict the 3D visual experience under the specific parameter configurations of different protocol layers. The efficiency and effectiveness of the proposed cross-layer optimized 3D video streaming method has been validated by subjective and objective experimental results.     

QoE in video streaming over wireless networks: perspectives and research challenges

The deployment of 3G/LTE networks and advancements in smart mobile devices had led to high demand for multimedia streaming over wireless network. The rapid increasing demand for multimedia content poses challenges for all parties in a multimedia streaming system, namely, content providers, wireless network service providers, and smart device makers. Content providers and mobile network service providers are both striving to improve their streaming services while utilizing advancing technologies. Smart device makers endeavor to improve processing power and displays for better viewing experience. Ultimately, the common goal shared by content providers, network service providers, and smart device manufactures is to improve the QoE for users. QoE is both an objective and a subjective metric measuring the streaming quality experience by end users. It may be measured by streaming bitrate, playback smoothness, video quality metrics like Peak to Signal Noise Ratio, and other user satisfaction factors. There have been efforts made to improve the streaming experiences in all these aspects. In this paper, we conducted a survey on existing literatures on QoE of video streaming to gain a deeper and more complete understanding of QoE quality metrics. The goal is to inspire new research directions in defining better QoE and improving QoE in existing and new streaming services such as adaptive streaming and 3D video streaming.     

A novel closed-form expression for the probability of starvation in video streaming over wireless networks

Telecommunication Systems - The moments-matching method is employed to provide an approximate distribution of the amount of data that can be transmitted over a wireless channel during any arbitrary...     

A cross-layer framework for multi-layer-video multicast with QoS requirements in multirate wireless networks

We propose a cross-layer framework for efficient multi-layer-video multicast with rate adaptation and quality-of-service (QoS) requirements in multirate wireless networks. We employ time division multiple access at the physical layer to transmit different video layers' data. The multicast sender then dynamically regulates the transmission rate and time-slot allocation based on the channel state information (CSI) and loss QoS requirements imposed by upper protocol layers. Under our proposed cross-layer framework, we first design a rate adaptation algorithm to fulfill the diverse loss QoS requirements for all video layers while achieving high multicast throughput. We then develop a time-slot allocation scheme which synchronizes data transmission across different video layers. Also conducted are simulation results to validate and evaluate our designed adaptive multicasting schemes under the proposed cross-layer framework.