Deep reinforcement learning based relaying for buffer-aided cooperative communications

The advances in deep reinforcement learning (DRL) have shown a great potential in solving physical layer-related communication problems. This paper investigates DRL for the relay selection in buffer-aided (BA) cooperative networks. The capability of DRL in handling highly-dimensional problems with large state and action spaces paves the way for exploring additional degrees-of-freedom by relaxing the restrictive assumptions around which conventional cooperative networks are usually designed. This direction is examined in our work by advising and analyzing advanced DRL-based BA relaying strategies that can cope with a variety of setups in multifaceted cooperative networks. In particular, we advise novel BA relaying strategies for both parallel-relaying and serial-relaying systems. For parallel-relaying systems, we investigate the added value of merging packets at the relays and of activating the inter-relay links. For serial-relaying (multi-hop) systems, we explore the improvements that can be reaped by merging packets and by allowing for the simultaneous activation of sufficiently-spaced hops. Simulation results demonstrate the capability of DRL-based BA relaying in achieving substantial improvements in the network throughput while the adequate design of the reward/punishment in the learning process ensures fast convergence speeds.     

Deep learning based physical layer security for terrestrial communications in 5G and beyond networks: A survey

The key principle of physical layer security (PLS) is to permit the secure transmission of confidential data using efficient signal-processing techniques. Also, deep learning (DL) has emerged as a viable option to address various security concerns and enhance the performance of conventional PLS techniques in wireless networks. DL is a strong data exploration technique which can be used to learn normal and abnormal behavior of 5G and beyond wireless networks in an insecure channel paradigm. Also, since DL techniques can successfully predict future new instances by learning from existing ones, they can successfully predict new attacks, which frequently involve mutations of earlier attacks. Thus, motivated by the benefits of DL and PLS, this survey provides a comprehensive review that overviews how DL-based PLS techniques can be employed for solving various security concerns in 5G and beyond networks. The survey begins with an overview of physical layer threats and security concerns in 5G and beyond networks. Then, we present a detailed analysis of various DL and deep reinforcement learning (DRL) techniques that are applicable to PLS applications. We present the specific use-cases of PLS design for each type of technique, including attack detection, physical layer authentication (PLA), and other PLS techniques. Then, we present an in-depth overview of the key areas of PLS where DL can be used to enhance the security of wireless networks, such as automatic modulation classification (AMC), secure beamforming, PLA, etc. Performance evaluation metrics for DL-based PLS design are subsequently covered. Finally, we provide insights to the readers about various challenges and future research trends in the design of DL-based PLS for terrestrial communications in 5G and beyond networks.     

Multi-task learning approach for modulation and wireless signal classification for 5G and beyond: Edge deployment via model compression

Future communication networks must address the scarce spectrum to accommodate extensive growth of heterogeneous wireless devices. Efforts are underway to address spectrum coexistence, enhance spectrum awareness, and bolster authentication schemes. Wireless signal recognition is becoming increasingly more significant for spectrum monitoring, spectrum management, secure communications, among others. Consequently, comprehensive spectrum awareness on the edge has the potential to serve as a key enabler for the emerging beyond 5G (fifth generation) networks. State-of-the-art studies in this domain have (i) only focused on a single task – modulation or signal (protocol) classification – which in many cases is insufficient information for a system to act on, (ii) consider either radar or communication waveforms (homogeneous waveform category), and (iii) does not address edge deployment during neural network design phase. In this work, for the first time in the wireless communication domain, we exploit the potential of deep neural networks based multi-task learning (MTL) framework to simultaneously learn modulation and signal classification tasks while considering heterogeneous wireless signals such as radar and communication waveforms in the electromagnetic spectrum. The proposed MTL architecture benefits from the mutual relation between the two tasks in improving the classification accuracy as well as the learning efficiency with a lightweight neural network model. We additionally include experimental evaluations of the model with over-the-air collected samples and demonstrate first-hand insight on model compression along with deep learning pipeline for deployment on resource-constrained edge devices. We demonstrate significant computational, memory, and accuracy improvement of the proposed model over two reference architectures. In addition to modeling a lightweight MTL model suitable for resource-constrained embedded radio platforms, we provide a comprehensive heterogeneous wireless signals dataset for public use.     

A dual phase genetic algorithm for improved initial access in 5G millimeter wave communication

Initial access (IA) in 5G millimeter wave (mmWave) communication is the problem of establishing a directional link between the base station (BS) and the user equipment (UE). For a multiple-input multiple-output (MIMO) system, where both the BS and UE have many antennas, finding the optimal beams can be prohibitively expensive in terms of delay and computation. In this work, we propose a meta-heuristic approach which is a modified dual-phase genetic algorithm. Since it is a meta-heuristic approach, it is generic and hence does not require extensive modifications to apply to different scenarios, it also does not require context information such as prior knowledge of channel state or statistics of user behavior. The proposed method is using iterative search for the optimal beams, but switch to a different fine-grained search phase on later iterations in order to quickly converge to the local optimum. The effect of this approach is analyzed in terms of capacity achieved vs number of transmit and receive antennas at BS and UE, codebook size, outage probability, total transmitted power, and other parameters specific to this particular dual-phase method. The proposed work has shown improved performance when compared to the existing similar work done in Souto et al. (2019) in terms of capacity achieved (2.12%), reduced power consumption (8.57%), and reduced IA delay (35% to 50%).     

Efficient DTCWT-TSVR algorithm for dense 5G mmWave Indoor Hotspot Communications

An efficient Dual Tree Discrete Wavelet Transform (DTDWT) based Twin Support Vector Regression (TSVR) algorithm is conceived in this article and applied to 28, 38, 60 and 73-GHz LOS (Line-of-Sight) wireless multipath transmission system in 5G Indoor Hotspot (InH) settings (empty, simple, semi-complex and complex conference rooms) under small receiver sensitivity threshold. The algorithm establishes a denoising process in the learning phase based on DTCWT which is suitable for time-series data. Additionally, the Close-In (CI) free space reference distance path loss model is analyzed and the large-scale propagation and probability distribution functions are investigated by determining the PLE (Path Loss Exponent) and the standard deviation of Shadow Factor (SF) for each indoor hotspot scenario under consideration. Performance are analyzed and evaluated in terms of Bit Error Rate (BER), Normalized Mean Squares Error (NMSE) and Root Mean Squares Error Vector Magnitude (RMS EVM).     

Enabling 5G indoor services for residential environment using VLC technology

Visible light communication (VLC) has emerged as a viable complement to traditional radio frequency (RF) based systems and as an enabler for high data rate communications for beyond-5G (B5G) indoor communication systems. In particular, the emergence of new B5G-based applications with quality of service (QoS) requirements and massive connectivity has recently led to research on the required service-levels and the development of improved physical (PHY) layer methods. As part of recent VLC standards development activities, the IEEE has formed the 802.11bb “Light Communications (LC) for Wireless Local Area Networking” standardization group. This paper investigates the network requirements of 5G indoor services such as virtual reality (VR) and high-definition (HD) video for residential environments using VLC. In this paper, we consider such typical VLC scenarios with additional impairments such as light-emitting diode (LED) nonlinearity and imperfect channel feedback, and propose hyperparameter-free mitigation techniques using Reproducing Kernel Hilbert Space (RKHS) methods. In this context, we also propose using a direct current biased optical orthogonal frequency division multiplexing (DCO-OFDM)-based adaptive VLC transmission method that uses precomputed bit error rate (BER) expressions for these RKHS-based detection methods and performs adaptive BER-based modulation-order switching. Simulations of channel impulse responses (CIRs) show that the adaptive transmission method provides significantly improved error rate performance, which makes it promising for high data rate VLC-based 5G indoor services.     

A novel deep deterministic policy gradient model applied to intelligent transportation system security problems in 5G and 6G network scenarios

Traffic congestion has been an actual problem in large cities, causing personal inconvenience and environmental pollution. To solve this problem, new applications for Intelligent Transportation System (ITS) have been created, to monitor actual traffic conditions. Therefore, fast, reliable and safe systems are desirable for creating a real intelligent transportation environment. Deep learning algorithms have been proposed for a better understanding of traffic behavior from a security-related perspective. Thus, we aim to maximize the safety problems using a deep learning algorithm, where a novel policy gradient model is presented for detecting vehicular misuse. The proposed model uses a triple network replay algorithm, maximizing the network convergence speed. Three networks are selected to optimize the policy network variables. Finally, the replay algorithm is partitioned with the aim of obtaining a faster model. Simulations on a real urban map are performed in a scenario with the integration of 5G or 6G networks. An architectural model for the integration of a Vehicular Ad-hoc Network (VANET) and cellular networks is determined in software-defined networking (SDN). The results show that the accuracy prediction of the proposed system presents better performance compared to related studies, where the proposed model increases its convergence speed and cumulative reward. Thus, the ITS improvement by the proposed deep learning algorithm increases the prediction accuracy, and reduces the transmission delay, treating the traffic path according to the congestion.     

Physical layer security using beamforming techniques for 5G and beyond networks: A systematic review

It has been predicted that by the year 2030, 5G and beyond 5G (B5G) networks are expected to provide hundreds of trillions of gigabytes of data for various emerging applications such as augmented, mixed, and virtual reality (AR/MR/VR), wireless computer-brain interfaces (WCBI), connected robotics and autonomous systems. Most of these applications share data with each other using an open channel, i.e., the Internet. The open and broadcast nature of wireless channel makes the communication susceptible to various types of attacks (e.g., eavesdropping, jamming). Thus, there is a strong requirement to enhance the secrecy of wireless channel to maintain the privacy and confidentiality of transmitted data. Physical layer security (PLS) has evolved as a novel concept and robust alternative to cryptography-based techniques, which have a number of drawbacks and practical issues for 5G and beyond networks. Beamforming is an energy-efficient PLS technique, that involves steering of the transmitted signal in a particular direction, while considering that an intruding user attempts to decode the transmitted data. Motivated from these points, this article summarizes various beamforming based PLS techniques for secure data transmission in 5G and B5G networks. We investigate the eight most promising techniques for beamforming in PLS: Non-Orthogonal Multiple Access (NOMA), Full-Duplex Networks, Massive Multiple-Input Multiple-Output (MIMO), Cognitive Radio (CR) Network, Relay Network, Simultaneous Wireless Information and Power Transfer (SWIPT), UAV Communication Networks and Space Information Networks, and Heterogeneous Networks. Moreover, various physical layer threats and countermeasures associated with 5G and B5G networks are subsequently covered. Lastly, we provide insights to the readers about constraints and challenges for the usage of beamforming-based PLS techniques in various upcoming future applications.     

An improved TOA estimation algorithm based on denoised MVDR for B5G positioning

This paper proposes an improved minimum variance distortionless response (MVDR) based TOA estimation algorithm for 5G NR signals under multipath environments. The proposed algorithm achieves high resolution by exploiting a large number of subcarriers of 5G signals and reduces the dimension of the covariance matrix involved in MVDR substantially by utilizing a novel smoothing scheme. Since MVDR requires a relatively high signal-to-noise ratio (SNR), a denoising method is used to improve the TOA estimation performance. Simulation results show that the proposed algorithm achieves much higher resolution than the Bartlett beamformer (BF) and the TOA estimation accuracy remains high over a wide range of SNRs.     

5G通信平台下的新型MRI系统架构展望

随着5G技术的成熟及商用,无线数据通信的便捷和高效将给人们生活带来巨大的改变.本文基于高速无线网络通信平台,提出了一种新型的磁共振成像（MRI）系统拓扑结构.该架构改变了传统MRI系统结构,采用无线传输方式代替现有的有线连接;此外,多台MRI系统还可共享一个控制中心,提高了控制中心的利用率,单台系统的成本也得以降低,从而使得MRI系统无线化、共享化.     

An energy efficient scheme by exploiting multi-hop D2D communications for 5G networks

The multi-hop Device-to-Device (M-D2D) communication has a potential to serve as a promising technology for upcoming 5G networks. The prominent reason is that the M-D2D communication has the potential to improve coverage, enhanced spectrum efficiency, better link quality, and energy-efficient communication. One of the major challenges for M-D2D communication is the mitigation of interference between the cellular user (CUs) and M-D2D users. Considering this mutual interference constraint, this work investigates the problem of optimal matching of M-D2D links and CUs to form spectrum-sharing partners to maximize overall sum rates of the cell under QoS and energy efficiency (EE) constraints. In this paper, we investigate the interference management for multi-hop (more than one-hop) D2D communication scenarios where we propose a channel assignment scheme along with a power allocation scheme. The proposed channel assignment scheme is based on the Hungarian method in which the channel assignment for M-D2D pairs is done by minimum interference value. The power allocation scheme is based on Binary Particle swarm optimization (BPSO). This scheme calculates the specific power values for all the individual M-D2D links. We have done a comprehensive simulation and the result portrays that our proposed scheme performs better compared to the previous work mentioned in the literature. The results clearly indicate that the proposed scheme enhances the EE of up to 13% by producing the optimal assignment of channels and power for the CUs and M-D2D users.     

Task offloading for vehicular edge computing with imperfect CSI: A deep reinforcement approach

This article examines a multi-user mobile edge computing (MEC) system for the Internet of Vehicle (IoV), where one edge point (EP) nearby the vehicles can help assist in processing the compute-intensive tasks. For the MEC networks, the majority of existing works concentrate on the minimization of system cost of task offloading under the perfect channel estimation, which however fails to consider the practical limitation of imperfect channel estimation (CSI) because of vehicles’ high-mobility. Therefore, the goal of our study is to reduce the delay as well as energy consumption (EC) of computation and communication with imperfect CSI, which are the two significant performance metrics of MEC network. With this aim, we first express the system cost as a form of the linear combination of the delay and EC, and then formulate the optimization problem for the system cost. Moreover, a novel deep approach is proposed, which is integrated by deep reinforcement learning (DRL) with the Lagrange multiplier to jointly minimize the system cost. In particular, the DRL algorithm is employed to obtain the capable offloading strategy, while the Lagrange multiplier is used to obtain the bandwidth allocation. The simulated results are finally presented to show that the devised approach outperforms the traditional ones.     

5G/NGPON Evolution and Convergence: Developing on Spatial Multiplexing of Optical Fiber Links for 5G Infrastructures

ABSTRACT

The offering of demanding telecommunication services as promised by the 5G specifications raise the necessity for high capacity, flexible, adaptive, and power conserving fronthaul. Toward this goal, the role of the passive optical network which is responsible for interconnecting the central office (CO) with the cell-sites is crucial. Among the latest related technologies that need to be integrated in the context of the next generation passive optical networks (NGPONs), the most promising for increasing the provided bandwidth, is the optical spatial multiplexing. In this paper, we present the key 5G technologies, focusing on spatial division multiplexing, which constitutes the main innovation of the blueSPACE 5G Infrastructure Public Private Partnership (5G PPP) project. Exploiting the recent developments on multicore fibers (MCFs), optical beamforming networks (OBFNs), analog radio over fiber (ARoF), and spatial-spectral resources granularity in the context of Spectrally Spatially Flexible Optical Networks (SS-FONs), we describe a complete approach for the 5G fronthaul, emphasizing on the efficient allocation of optical resources while aiming at minimizing energy consumption. The modeled optimization problem is thoroughly presented, and the introduced scheme is evaluated through a real-world based simulation scenario, exhibiting quite promising results.     

A multi-channel and multi-user dynamic spectrum access algorithm based on deep reinforcement learning in Cognitive Vehicular Networks with sensing error

In this paper, a spectrum access problem is proposed to improve the spectrum access rates of secondary vehicles in Cognitive Vehicular Networks, where the channel capacity mathematic model is established under the conditions of spectrum sensing errors rates and the dynamic occupancy spectrum rates. Meanwhile, an improved Q-learning method is proposed to conform the dynamic communication under the different conditions of the reward functions. In this function, a Deep Q Network method with a modified reward function (IDQN) is proposed to deal with the situation of multi-vehicle in multi-channel. In order to verify the effectiveness of the IDQN method, the Myopic method, the improved Q-learning method, and the traditional DQN method are compared on Python. The simulation results shown that the proposed IDQN method not only outperforms the compared methods in terms of channel utilization and channel capacity but also improves the ability that the vehicle adapts to the dynamic communication environment.     

基于块稀疏贝叶斯学习的多任务压缩感知重构算法

本文提出一种基于块稀疏贝叶斯学习的多任务压缩感知重构算法, 利用块稀疏的单测量矢量模型求解多任务重构问题. 通过对信号统的计特性和稀疏块内的结构特性进行联合数学建模, 将稀疏重构问题转贝叶斯框架下的特征参数的迭代更新问题. 本文算法不需要信号稀疏度和噪声强度的先验信息, 是一种高效的盲重构算法. 仿真实验表明, 本文算法能有效利用信号的统计特性和结构信息, 在重构精度和收敛速率方面能够很好地折衷.     

A survey on UAV placement optimization for UAV-assisted communication in 5G and beyond networks

With the increase in capacity demands and the requirement of ubiquitous coverage in the fifth generation and beyond wireless communications networks, unmanned aerial vehicles (UAVs) have acquired a great attention owing to their outstanding characteristics over traditional base stations and relays. UAVs can be deployed faster and with much lower expenditure than ground base stations. In addition, UAVs can enhance the network performance thanks to their strong line-of-sight link conditions with their associated users and their dynamic nature that adapts to varying network conditions. Optimization of the UAV 3D locations in a UAV-assisted wireless communication network was considered in a large body of research as it is a critical design issue that greatly affects communication performance. Although the topic of UAV placement optimization was considered in few surveys, these surveys reviewed only a small part of the growing literature. In addition, the surveys were brief and did not discuss many important design issues such as the objectives of the optimization problem, the adopted solution techniques, the air-to-ground channel models, the transmission media for access and backhaul links, the limited energy nature of the UAV on-board batteries, co-channel interference and spectrum sharing, the interference management, etc. Motivated by the importance of the topic of UAV placement optimization as well as the need for a detailed review of its recent literature, we survey 100 of the recent research papers and provide in-depth discussion to fill the gaps found in the previous survey papers. The considered research papers are summarized and categorized to highlight the differences in the deployment scenario and system model, the optimization objectives and parameters, the proposed solution techniques, and the decision-making strategies and many other points. We also point to some of the existing challenges and potential research directions that have been considered in the surveyed literature and that requires to be considered