Space-Air-Ground Integrated Mobile Crowdsensing for Partially Observable Data Collection by Multi-Scale Convolutional Graph Reinforcement Learning

Mobile crowdsensing (MCS) is attracting considerable attention in the past few years as a new paradigm for large-scale information sensing. Unmanned aerial vehicles (UAVs) have played a significant role in MCS tasks and served as crucial nodes in the newly-proposed space-air-ground integrated network (SAGIN). In this paper, we incorporate SAGIN into MCS task and present a Space-Air-Ground integrated Mobile CrowdSensing (SAG-MCS) problem. Based on multi-source observations from embedded sensors and satellites, an aerial UAV swarm is required to carry out energy-efficient data collection and recharging tasks. Up to date, few studies have explored such multi-task MCS problem with the cooperation of UAV swarm and satellites. To address this multi-agent problem, we propose a novel deep reinforcement learning (DRL) based method called Multi-Scale Soft Deep Recurrent Graph Network (ms-SDRGN). Our ms-SDRGN approach incorporates a multi-scale convolutional encoder to process multi-source raw observations for better feature exploitation. We also use a graph attention mechanism to model inter-UAV communications and aggregate extra neighboring information, and utilize a gated recurrent unit for long-term performance. In addition, a stochastic policy can be learned through a maximum-entropy method with an adjustable temperature parameter. Specifically, we design a heuristic reward function to encourage the agents to achieve global cooperation under partial observability. We train the model to convergence and conduct a series of case studies. Evaluation results show statistical significance and that ms-SDRGN outperforms three state-of-the-art DRL baselines in SAG-MCS. Compared with the best-performing baseline, ms-SDRGN improves 29.0% reward and 3.8% CFE score. We also investigate the scalability and robustness of ms-SDRGN towards DRL environments with diverse observation scales or demanding communication conditions.     

Synthesis of PNIPAAm-g-P4VP Microgel as Draw Agent in Forward Osmosis by RAFT Polymerization and Reverse Suspension Polymerization to Improve Water Flux

Microgels have unique and versatile properties allowing their use in forward osmosis areas as a draw agent. In this contribution, poly(4-vinylpyridine) (P4VP) was synthesized via RAFT polymerization and then grafted to a poly(N-Isopropylacrylamide) (PNIPAAm) crosslinking network by reverse suspension polymerization. P4VP was successfully obtained by the quasiliving polymerization with the result of nuclear magnetic resonance and gel permeation chromatography characterization. The particle size and particle size distribution of the PNIPAAm-g-P4VP microgels containing 0, 5, 10, 15 and 20 wt% P4VP were measured by means of a laser particle size analyzer. It was found that all the microgels were of micrometer scale and the particle size was increased with the P4VP load. Inter/intra-molecular-specific interactions, i.e., hydrogen bond interactions were then investigated by Fourier infrared spectroscopy. In addition, the water flux measurements showed that all the PNIPAAm-g-P4VP microgels can draw water more effectively than a blank PNIPAAm microgel. For the copolymer microgel incorporating 20 wt% P4VP, the water flux was measured to be 7.48 L∙m⁻²∙h⁻¹.     

Optimal Energy-Storage Configuration for Microgrids Based on SOH Estimation and Deep Q-Network

Energy storage is an important adjustment method to improve the economy and reliability of a power system. Due to the complexity of the coupling relationship of elements such as the power source, load, and energy storage in the microgrid, there are problems of insufficient performance in terms of economic operation and efficient dispatching. In view of this, this paper proposes an energy storage configuration optimization model based on reinforcement learning and battery state of health assessment. Firstly, a quantitative assessment of battery health life loss based on deep learning was performed. Secondly, on the basis of considering comprehensive energy complementarity, a two-layer optimal configuration model was designed to optimize the capacity configuration and dispatch operation. Finally, the feasibility of the proposed method in microgrid energy storage planning and operation was verified by experimentation. By integrating reinforcement learning and traditional optimization methods, the proposed method did not rely on the accurate prediction of the power supply and load and can make decisions based only on the real-time information of the microgrid. In this paper, the advantages and disadvantages of the proposed method and existing methods were analyzed, and the results show that the proposed method can effectively improve the performance of dynamic planning for energy storage in microgrids.     

Development of a ~3He Gas Filling Station at the China Spallation Neutron Source

At the China Spallation Neutron Source(CSNS), we have developed a custom gas-filling station, a glassblowing workshop, and a spin-exchange optical pumping(SEOP) system for producing high-quality ~3He-based neutron spin filter(NSF) cells. The gas-filling station is capable of routinely filling ~3He cells made from GE180 glass of various dimensions, to be used as neutron polarizers and analyzers on beamlines at the CSNS. Performance tests on cells fabricated at our gas-filling station are conducted via neutron transmission and nuclear-magneticresonance measurements, revealing nominal filling pressures, and a saturated ~3He polarization in the region of 80%, with a lifetime of approximately 240 hours. These results demonstrate our ability to produce competitive NSF cells to meet the ever-increasing research needs of the polarized neutron research community.     

KEADA: Identifying Key Classes in Software Systems Using Dynamic Analysis and Entropy-Based Metrics

Software maintenance is indispensable in the software development process. Developers need to spend a lot of time and energy to understand the software when maintaining the software, which increases the difficulty of software maintenance. It is a feasible method to understand the software through the key classes of the software. Identifying the key classes of the software can help developers understand the software more quickly. Existing techniques on key class identification mainly use static analysis techniques to extract software structure information. Such structure information may contain redundant relationships that may not exist when the software runs and ignores the actual interaction times between classes. In this paper, we propose an approach based on dynamic analysis and entropy-based metrics to identify key classes in the Java GUI software system, called KEADA (identifying KEy clAsses based on Dynamic Analysis and entropy-based metrics). First, KEADA extracts software structure information by recording the calling relationship between classes during the software running process; such structure information takes into account the actual interaction of classes. Second, KEADA represents the structure information as a weighted directed network and further calculates the importance of each node using an entropy-based metric OSE (One-order Structural Entropy). Third, KEADA ranks classes in descending order according to their OSE values and selects a small number of classes as the key class candidates. In order to verify the effectiveness of our approach, we conducted experiments on three Java GUI software systems and compared them with seven state-of-the-art approaches. We used the Friedman test to evaluate all approaches, and the results demonstrate that our approach performs best in all software systems.     

Spider Silk-Improved Quartz-Enhanced Conductance Spectroscopy for Medical Mask Humidity Sensing

Spider silk is one of the hottest biomaterials researched currently, due to its excellent mechanical properties. This work reports a novel humidity sensing platform based on a spider silk-modified quartz tuning fork (SSM-QTF). Since spider silk is a kind of natural moisture-sensitive material, it does not demand additional sensitization. Quartz-enhanced conductance spectroscopy (QECS) was combined with the SSM-QTF to access humidity sensing sensitively. The results indicate that the resonance frequency of the SSM-QTF decreased monotonously with the ambient humidity. The detection sensitivity of the proposed SSM-QTF sensor was 12.7 ppm at 1 min. The SSM-QTF sensor showed good linearity of ~0.99. Using this sensor, we successfully measured the humidity of disposable medical masks for different periods of wearing time. The results showed that even a 20 min wearing time can lead to a >70% humidity in the mask enclosed space. It is suggested that a disposable medical mask should be changed <2 h.     

An Encryption Algorithm for Region of Interest in Medical DICOM Based on One-Dimensional eλ-cos-cot Map

Today, with the rapid development of the Internet, improving image security becomes more and more important. To improve image encryption efficiency, a novel region of interest (ROI) encryption algorithm based on a chaotic system was proposed. First, a new 1D eλ-cos-cot (1D-ECC) with better chaotic performance than the traditional chaotic system is proposed. Second, the chaotic system is used to generate a plaintext-relate keystream based on the label information of a medical image DICOM (Digital Imaging and Communications in Medicine) file, the medical image is segmented using an adaptive threshold, and the segmented region of interest is encrypted. The encryption process is divided into two stages: scrambling and diffusion. In the scrambling stage, helical scanning and index scrambling are combined to scramble. In the diffusion stage, two-dimensional bi-directional diffusion is adopted, that is, the image is bi-directionally diffused row by column to make image security better. The algorithm offers good encryption speed and security performance, according to simulation results and security analysis.     

Metabolic Profile of Agropyron repens (L.) P. Beauv. Rhizome Herbal Tea by HPLC-PDA-ESI-MS/MS Analysis

Agropyron repens (L.) P. Beauv. (couch grass) is a world-wide infesting rhizomatous plant with pharmacological applications. Chemical research is focused on its allelopathic and anti-inflammatory components, which are mainly present in the essential oil. Conversely, the aqueous extracts have been sparingly investigated, although the herbal tea is by far the most used formulation. To fill the gap, the metabolic profile of Agropyron repens rhizome herbal tea was investigated by electrospray ionization (ESI) tandem–mass spectrometry (MS/MS); the phenolic profile was investigated by HPLC-PDA-ESI-MS/MS. ESI-MS fingerprinting was provided, evidencing diagnostic ions for saccharides, organic acids and amino acids. The HPLC-PDA-ESI-MS/MS analysis evidenced at least 20 characteristic phenolic compounds, the most representative being caffeoyl and feruloyl quinic esters, followed by coumaric, caffeic and ferulic acids, and hesperidin among flavonoids. In addition, the essential amino acid tryptophan was identified for the first time. The results suggest new perspectives of applications for Agropyron repens rhizome.     

Synthesis of Halopyrazole Matrine Derivatives and Their Insecticidal and Fungicidal Activities

Matrine is a traditional botanical pesticide with a broad-spectrum biological activity that is widely applied in agriculture. Halopyrazole groups are successfully introduced to the C13 of matrine to synthesize eight new derivatives with a yield of 78–87%. The insecticidal activity results show that the introduction of halopyrazole groups can significantly improve the insecticidal activity of matrine on Plutella xylostella, Mythimna separata and Spodoptera frugiperda with a corrected mortality rate of 100%, which is 25–65% higher than matrine. The fungicidal activity results indicate that derivatives have a high inhibitory effect on Ceratobasidium cornigerum, Cibberella sanbinetti, Gibberrlla zeae and Collectot tichum gloeosporioides. Thereinto, 4-Cl-Pyr-Mat has the best result, with an inhibition rate of 23–33% higher than that of matrine. Therefore, the introduction of halogenated pyrazole groups can improve the agricultural activity of matrine.