认知无线电网络中基于抢占式排队论的频谱切换模型

针对认知无线电网络中认知用户广义传输时间的优化问题, 提出了一种基于抢占式续传优先权M/G/m排队理论的频谱切换模型. 在该排队模型中, 为了最小化认知用户广义传输时间, 采用混合排队-并列式服务的排队方式. 在此基础上, 深入分析多个认知用户、多个授权信道、多次频谱切换条件下认知用户信道使用情况, 从而推导出广义传输时间表达式. 最后探讨了该模型下自适应频谱切换策略. 仿真结果表明, 相比于已有的频谱切换模型, 该模型不仅能够更加完整地描述认知用户频谱切换行为, 而且使得认知用户传输时延更小, 广义传输时间更短. 此外, 认知无线电网络允许的认知用户服务强度增加, 能够容纳的认知用户数量增多. 因此, 该模型提升了认知用户频谱切换的性能, 更好地实现了认知用户与授权用户的频谱共享.     

Resource allocation for LTE-based cognitive radio network with queue stability and interference constraints

We consider the problem of interference management and resource allocation in a cognitive radio network (CRNs) where the licensed spectrum holders (primary users) share their spare capacity with the non-licensed spectrum holders (secondary users). Under such shared spectrum usage the transmissions of the secondary users should have a minimal impact on the quality of service (QoS) and the operating conditions of the primary users. Therefore, it is important to distinguish the two types of users, and formulate the problem of resource allocation considering hard restrictions on the user-perceived QoS (such as packet end-to-end delay and loss) and physical-layer channel characteristics (such as noise and interference) of the primary users. To achieve this goal, we propose to assign the bandwidth and transmission power to minimize the total buffer occupancy in the system subject to capacity constraints, queue stability constraints, and interference requirements of the primary users. We apply this approach for resource allocation in a CRN built upon a Third Generation Partnership Project (3GPP) long-term evolution (LTE) standard platform. Performance of the algorithm is evaluated using simulations in OPNET environment. The algorithm shows consistent performance improvement when compared with other relevant resource allocation techniques.     

Cooperative spectrum sensing protocols and evaluation with IEEE 802.15.4 devices

Spectrum Sensing is one of the important tasks for wireless devices. By sensing the spectrum, wireless devices sense their radio environment and perform spectrum access accordingly to reduce collisions. Due to radio propagation effects and inherent noise in the measurements, performance of todays wireless technologies with individual spectrum sensing cannot solve the hidden node problem. Cooperative sensing is seen as a way to improve the performance of wireless devices improving the radio bandwidth utilization and minimizing interference among wireless devices. To the best of our knowledge, this is the first work which provides protocols for cooperative sensing and presents experimental results with IEEE 802.15.4 devices. We present and implement protocols and applications for primary, secondary and cooperative users with a dedicated control channel. Thereby, the secondary user receiver serves as a first cooperative node in the system which reduces collisions between primary and secondary users. We evaluate the system performance with receiver sensing and additional cooperative nodes. We also propose a mechanism to extend the protocol for multiple secondary users sharing the same control channel. Based on the evaluations, we also provide recommendations for usage of cooperative sensing with focus on IEEE 802.15.4.     

Route selection for interference minimization to primary users in cognitive radio ad hoc networks: A cross layer approach

An opportunistic routing problem in a cognitive radio ad hoc network is investigated with an aim to minimize the interference to primary users (PUs) and under the constraint of a minimum end-to-end data rate for secondary users (SUs). Both amplify-and-forward (AF) and decode-and-forward (DF) relaying techniques are considered for message forwarding by SU nodes in the network. Unlike popular transmit power control based solutions for interference management in cognitive radio networks, we adopt a cross layer approach. The optimization problem is formulated as a joint power control, channel assignment and route selection problem. Next, closed form expression for transmission power is derived and corresponding channel selection scheme and routing metric are designed based on this solution. The proposed route selection schemes are shown to depend not only on gains of the interference channels between SUs and PUs but also on the values of the spectrum sensing parameters at the SU nodes in the network. Two distributed routing schemes are proposed based on our analysis; (i) optimal_DF and (ii) suboptimal_AF. The routing schemes could be implemented using existing table driven as well as on demand routing protocols. Extensive simulation results are provided to evaluate performance of our proposed schemes in random multihop networks. Results show significant reduction in PUs’ average interference experience and impressive performance as opportunistic routing schemes can be achieved by our schemes compared to traditional shortest path based routing schemes. Performance improvement is also reported over prominent recent schemes.     

Distributed dynamic spectrum access through multi-agent deep recurrent Q-learning in cognitive radio network

This paper addresses the problem of distributed dynamic spectrum access in a cognitive radio (CR) environment utilizing deep recurrent reinforcement learning. Specifically, the network consists of multiple primary users (PU) transmitting intermittently in their respective channels, while the secondary users (SU) attempt to access the channels when PUs are not transmitting. The problem is challenging considering the decentralized nature of CR network where each SU attempts to access a vacant channel, without coordination with other SUs, which result in collision and throughput loss. To address this issue, a multi-agent environment is considered where each of the SUs perform independent reinforcement learning to learn the appropriate policy to transmit opportunistically so as to minimize collisions with other users. In this article, we propose two long short-term memory (LSTM) based deep recurrent Q-network (DRQN) architectures for exploiting the temporal correlation in the transmissions by various nodes in the network. Furthermore, we investigate the effect of the architecture on success rate with varying number of users in the network and partial channel observations. Simulation results are compared with other existing reinforcement learning based techniques to establish the superiority of the proposed method.     

Transmit power and bits/channel use adaption in competitive cognitive radio networks

In this paper, we propose an optimization framework to determine the distribution of power and bits/channel use to secondary users in a competitive cognitive radio networks. The objectives of the optimization framework are to minimize total transmission power, maximize total bits/channel use and also to maintain quality of service. An upper bound on probability of bit error and lower bound on bits/channel use requirement of secondary users are considered as quality of service. The optimization problem is also constrained by total power budget across channels for a user. Simulating the framework in a centralized manner shows that more transmit power is required to allocate in a channel with higher noise power. However, allocation of bits/channel use is directly proportional to signal to interference plus noise power ratio. The proposed framework is more capable of supporting high bits/channel use requirement than existing resource allocation framework. We also develop the game theoretic user based distributed approach of the proposed framework. We see that user based distributed solution also follows centralized solution.     

A single-channel single-winner auction model for homogeneous channel allocation in CRNs

Cognitive radio (CR) is a novel intelligent technology which enables opportunistic access to temporarily unused licensed frequency bands. A key functionality of CR is to distribute free channels efficiently amongst Secondary Users (SUs) boosting spectrum usage to assist the escalating wireless applications world wide. In this context, this paper introduces a channel allocation mechanism which enables SUs (CR enabled unlicensed users) to dynamically access unused spectrum bands to fulfill their spectrum needs. We model the channel allocation problem as a sealed-bid single-sided auction which primarily aims at maximizing the overall spectrum utilization. Market based spectrum auctions in CR networks motivate licensed users to participate and lease their under utilized radio resources to gain monetary benefits. Sequential bidding is applied to this model for auctioning homogeneous channels, which reduces communication overhead. Bid submission takes into account two major CR constraints, namely, dynamics in spectrum opportunities and differences in channel availability time, which on incorporation provide disruption free data transmission to the SUs. We reduce resource wastage in this model by performing multiple auction rounds. Application of second price auction determines winning bidders and their respective payments to auctioneer. The design of our auction mechanism is supported with the proofs of truthfulness and individually rational properties. Furthermore, experimental results indicate that our model outperforms an existing auction method. Spectrum utilization values show 22 to 75% improvement in our model with changing number of SUs, and 23 to 93% improvement in our model with changing number of channels.     

An adaptive step-size spectrum auction mechanism for two-tier heterogeneous networks

Recently, with the rapid growth of demands for wireless communications, dynamic spectrum allocation is one of the key technologies in cognitive radio networks to resolve the realistic problem of low utilization efficiency of spectrum. It mainly focuses on how the spectrum owner dynamically allocates idle spectrum to secondary users who have no licensed spectrum for communications. In this paper, a dynamic spectrum allocation model based on auction theory in a two-tier heterogeneous network is proposed, in which the primary users (PUs) are the sellers, the central processor (CP) auctioneer is the coordinator, and femtocell base station (FBS) as the buyer bids for the idle spectrum and act as a wireless access point that provides communication services for secondary users (SUs). Its basic process is as follows: the auctioneer gradually raises the spectrum price from the reserved price; each bidder decides whether participates in the purchase or not. It is characterized by distributed execution and low complexity which can reduce unnecessary information exchange between primary users or secondary users. Meanwhile it can enhance the utilization of spectrum and improve the efficiency of the auction by generate the incentive mechanism.     

Robust secrecy rate maximization in IRS-assisted cognitive radio networks

In this paper, we focus on the secrecy rate maximization problem in intelligent reflecting surface (IRS)-assisted cognitive radio (CR) networks. In order to improve the security, there is a common scheme to add artificial noise (AN) to the transmitted signal, which is also applied in this paper. Further, in CR networks, the secondary users always cannot obtain accurate channel state information (CSI) about the primary user and eavesdropper. By taking jointly design for the IRS phase shift matrix, the transmitted beamforming of the secondary base station (BS), and the covariance matrix of AN, our objective is to maximize the minimal secrecy rate of all secondary users. Due to the serious coupling among the designed variables, it cannot be solved by conventional methods. We propose an alternating optimization (AO) algorithm. In simulation results, we apply primary users and secondary users randomly distributed in the communication area, which numerically demonstrate the superiority of our proposed scheme.     

Outlier-aware cooperative spectrum sensing in cognitive radio networks

This paper considers the problem of cooperative spectrum sensing in cognitive radio networks (CRN). Communication in CRNs may be disrupted due to the presence of malicious secondary users (SU) or channel impairments such as shadowing. This paper proposes a spatio-frequency framework that can detect and track malicious users and anomalous measurements in CRNs. The joint problem of spectrum sensing and malicious user identification is posed as an optimization problem that aims to exploit the sparsity inherent to both, spectrum occupancy and malicious user occurrence. Proposed scheme obtains improved performance by utilizing node location information, and can handle missing or inaccurate location information, and noisy SU reports. A distributed block-coordinate descent-based algorithm is proposed that is shown to outperform the state-of-the-art PCA-based approach, and is flexible enough to defeat a variety of attacks encountered in SU networks. An online algorithm, that can handle incorporate multiple SU readings sequentially and adapt to time-varying channels, primary user, and malicious user activity, is also proposed and shown to be consistent. Simulation results demonstrate the efficacy of the proposed algorithms.     

Deep Q-learning based optimal resource allocation method for energy harvested cognitive radio networks

In this article, we propose a deep Q-learning based algorithm for optimal resource allocation in energy harvested cognitive radio networks (EH-CRN). In EH-CRN, channel resources of primary users (PU) networks are shared with secondary users (SU) and energy harvesting allows nodes of the CRN to acquire energy from the environment for operation sustainability. However, amount of energy harvested from the environment is not fixed and requires dynamic allocation of resources for obtaining optimum network and throughput capacity. In this work, we overcome the limitations of existing Q-learning based resource allocation schemes which are constrained by large state-space systems and have slow convergence. Proposed deep Q-learning based algorithm improves the resource allocation in EH-CRN, while considering quality of service (QoS), energy and interference constraints. Simulation results show that proposed algorithm provide improved convergence and better resource utilization compared to other techniques in literature.     

Optimal Channel Selection algorithm for CRahNs

As the data traffic is increasing, the spectrum bands are getting congested. It causes low latency and unreliable communication. Additional spectrum can be utilized to solve this problem but moving towards higher frequency means higher power requirement and increased cost. Cognitive radio network is another solution to this problem. It helps the nodes of a network to use the channels of the nearby bands which are not being used at that time. However, it has several challenges. One of these challenges is the transmission collision with the primary users of the network. Researchers have been working on this problem. However, it is still a major concern for the researchers. This paper proposes an algorithm that selects the optimal cognitive channel for the data transmission by the secondary user in such a way so that the transmission collision with the PU is minimized. After comparison with the existing latest similar protocol, the proposed protocol has shown 5.6% improvement in the throughput, 5.3% improvement in PDR. The delay is decreased by 0.6% and the transmission collision with PUs is reduced by 2.5%.     

Intelligent resource allocation for transmission security on IRS-assisted spectrum sharing systems with OFDM

In this paper, intelligent reflecting surface (IRS) technology is employed to enhance physical layer security (PLS) for spectrum sharing communication systems with orthogonal frequency division multiplexing (OFDM). Aiming to improve the secondary users’ secrecy rates, a design problem for jointly optimizing the transmission beamforming of secondary base station (SBS), the IRS’s reflecting coefficient and the channel allocation is formulated under the constraints of the requirements of minimum data rates of primary users and the interference between users. As the scenario is highly complex, it is quite challenging to address the non-convexity of the optimization problem. Thus, a deep reinforcement learning (DRL) based approach is taken into consideration. Specifically, we use dueling double deep Q networks (D3QN) and soft Actor–Critic (SAC) to solve the discrete and continuous action space optimization problems, respectively, taking full advantage of the maximum entropy RL algorithm to explore all possible optimal paths. Finally, simulation results show that our proposed approach has a great improvement in security transmission rate compared with the scheme without IRS and OFDM, and our proposed D3QN-SAC approach is more effective than other approaches in terms of maximum security transmission rate.     

Kurtosis based spectrum sensing in cognitive radio

In this paper, we consider spectrum sensing in cognitive radio networks based on higher order statistics. The kurtosis, a fourth order statistic, which is a measure of deviation from Gaussianity, is used as a detection statistic. An optimum threshold is set up based on the Neyman–Pearson criterion and an analytical expression for upper bound on probability of miss is derived for a single pair of primary and secondary users. Further, we also propose a collaborative spectrum sensing scheme for more than one secondary user and it is shown by simulations that the proposed kurtosis based method outperforms the energy based spectrum hole detection method significantly.     

Multi-channel sensing and resource allocation in energy constrained cognitive radio networks

We consider a cognitive radio network in a multi-channel licensed environment. Secondary user transmits in a channel if the channel is sensed to be vacant. This results in a tradeoff between sensing time and transmission time. When secondary users are energy constrained, energy available for transmission is less if more energy is used in sensing. This gives rise to an energy tradeoff. For multiple primary channels, secondary users must decide appropriate sensing time and transmission power in each channel to maximize average aggregate-bit throughput in each frame duration while ensuring quality-of-service of primary users. Considering time and energy as limited resources, we formulate this problem as a resource allocation problem. Initially a single secondary user scenario is considered and solution is obtained using decomposition and alternating optimization techniques. Later we extend the analysis for the case of multiple secondary users. Simulation results are presented to study effect of channel occupancy, fading and energy availability on performance of proposed method.     

Traffic-Aware Green Cognitive Radio

Cognitive Radio Network (CRN) has emerged as an effective solution to the spectrum under-utilization problem, by providing secondary users (SUs) an opportunistic access to the unoccupied frequency bands of primary users (PUs). Most of the current research on CRN are based on the assumption that the SU always has a large amount of data to transmit. This leads to the objective of SU throughput maximization with a constraint on the allowable interference to the PU. However, in many of the practical scenarios, the data arrival process of the SU closely follows an ON–OFF traffic model, and thus the usual throughput optimization framework may no longer be suitable. In this paper, we propose an intelligent data scheduling strategy which minimizes the average transmission power of the SU while maintaining the transmission delay to be sufficiently small. The data scheduling problem has been formulated as a finite horizon Markov Decision Process (MDP) with an appropriate cost function. Dynamic programming approach has been adopted to arrive at an optimal solution. Our findings show that the average transmitted power for our proposed approach can be as small as 36.5% of the power required for usual throughput maximization technique with insignificant increase in average delay.     

Positioning-based framework for secondary spectrum usage

In this paper, we introduce a framework encompassing the creation and the exploitation of secondary spectrum usage opportunities. The paper develops a complete positioning-based framework to assess the feasibility of supporting secondary communications on frequencies which are released by primary spectrum management methodologies. In particular, the paper analyzes four possible combinations, depending on known/unknown positions of primary/secondary transceivers. Afterwards, the paper focuses on a specific applicability case, where the dynamic spectrum management mechanism of a WCDMA-based network operator aims at releasing certain frequencies in a large area when possible and thus facilitating secondary exploitation of the released spectrum. Moreover, some practical examples are introduced to show the different procedures when secondary networks with infrastructure are sharing the same frequency with a mobile network. In this context, results have been obtained to assess the practical usability of the released spectrum under different conditions as well as the efficiency of different dynamic spectrum management methodologies.     

HF spectrum activity prediction model based on HMM for cognitive radio applications

Although most of the research on Cognitive Radio is focused on communication bands above the HF upper limit (30 MHz), Cognitive Radio principles can also be applied to HF communications to make use of the extremely scarce spectrum more efficiently. In this work we consider legacy users as primary users since these users transmit without resorting to any smart procedure, and our stations using the HFDVL (HF Data+Voice Link) architecture as secondary users. Our goal is to enhance an efficient use of the HF band by detecting the presence of uncoordinated primary users and avoiding collisions with them while transmitting in different HF channels using our broad-band HF transceiver.A model of the primary user activity dynamics in the HF band is developed in this work to make short-term predictions of the sojourn time of a primary user in the band and avoid collisions. It is based on Hidden Markov Models (HMM) which are a powerful tool for modelling stochastic random processes and are trained with real measurements of the 14 MHz band.By using the proposed HMM based model, the prediction model achieves an average 10.3% prediction error rate with one minute-long channel knowledge but it can be reduced when this knowledge is extended: with the previous 8 min knowledge, an average 5.8% prediction error rate is achieved.These results suggest that the resulting activity model for the HF band could actually be used to predict primary users activity and included in a future HF cognitive radio based station.     

Spectrum mobility in cognitive radio network using spectrum prediction and monitoring techniques

The spectrum mobility during data transmission is an integral part of the cognitive radio network (CRN) which is conventionally two types for instance reactive and proactive. In the reactive approach, the cognitive user (CU) switches its communication after the emergence of the primary user (PU), where the detection of emergence of PU relies either on spectrum sensing and/or monitoring. Due to certain limitations of the reactive approach such as: (1) loss at least one packet on the emergence of PU and (2) resource (bandwidth) wastage if the periodic sensing is used for mobility, the researchers have introduced the concept of proactive spectrum mobility. In this approach, the emergence of PU is predicted on the bases of pre-available spectrum information, and switching is performed before true emergence of the PU, in order to avoid even the single packet loss. However, the imperfect spectrum prediction is a major milestone for the proactive spectrum mobility. Recently, due to introduction of the spectrum monitoring simultaneous to the data transmission, the reactive approach has come into lime-light again, however, it suffers from the ‘single packet loss’ and ‘imperfect spectrum monitoring’ issues. Therefore in this paper, we have exploited the spectrum monitoring and prediction techniques, simultaneously for the spectrum mobility, in order to enhance the performance of cognitive radio network (CRN). In the proposed strategy, the decision results of the spectrum prediction and monitoring techniques are fused using AND and OR fusion rules, for the detection of emergence of PU during the data transmission. Further, the closed-form expressions of the resource wastage, achieved throughput, interference power at PU and data-loss for the proposed approaches as well as for the prediction and monitoring approaches are derived. Moreover, the simulation results for the proposed approaches are presented and validation is performed by comparing the results with prediction and monitoring approach. In a special case, when the prediction error is zero, the graphs of all metric values overlies the spectrum monitoring approach, which further validates the proposed approach.     

Power allocation for cognitive underlay networks with spectrum band selection

In this paper, we study the cooperative communication of a cognitive underlay network by utilizing the diversity of multiple spectrum bands. In particular, we assume that the transmission power of the secondary user (SU) is subject to different joint constraints, such as peak interference power of the multiple primary users (PUs), peak transmission power of the SU, outage tolerate interference, and outage probability threshold. Accordingly, two power allocation schemes are considered on the basis of the minimum interference channel from the SU to the PU and the channel state information of the primary user link. Furthermore, the SU can select one of the three transmission modes following the channel state conditions, namely as cellular, device-to-device, or switching mode, to transmit the signal to the secondary user receiver. Given this setting, two power allocation schemes over a spectrum band selection strategy are derived. In addition, closed-form expressions for the outage probability of three modes are also obtained to evaluate the performance of the secondary network. Most importantly, a closed-form expression for the peak interference power level of the PU, which is considered as one of the most important parameters to control the SU’s transmission power, is derived by investigating the relation of two considered power allocation schemes in the practise. Finally, numerical examples show that the outage performance of secondary network in the switching mode outperforms the one of the cellular and device-to-device (D2D) mode for all considered power allocation schemes.