基于MapReduce的K-means聚类算法的优化

针对传统的聚类算法K-means对初始中心点的选择非常依赖,容易产生局部最优而非全局最优的聚类结果,同时难以满足人们对海量数据进行处理的需求等缺陷,提出了一种基于MapReduce的改进K-means聚类算法。该算法结合系统抽样方法得到具有代表性的样本集来代替海量数据集;采用密度法和最大最小距离法得到优化的初始聚类中心点;再利用Canopy算法得到粗略的聚类以降低运算的规模;最后用顺序组合MapReduce编程模型的思想实现了算法的并行化扩展,使之能够充分利用集群的计算和存储能力,从而适应海量数据的应用场景。文中对该改进算法和传统聚类算法进行了比较,比较结果证明其性能优于后者。这表明该改进算法降低了对初始聚类中心的依赖,提高了聚类的准确性,减少了聚类的迭代次数,降低了聚类的时间,而且在处理海量数据时表现出较大的性能优势。     

云环境下的高效K-Medoids并行算法

传统聚类算法K-Medoids对初始点的选择具有随机性,容易产生局部最优解;替换聚类中心时采用的全局顺序替换策略降低了算法的执行效率;同时难以适应海量数据的运算。针对上述问题,提出了一种云环境下的改进K-Medoids算法,该改进算法结合密度法和最大最小原则得到优化的聚类中心,并在Canopy区域内对中心点进行替换,再采用优化的准则函数,最后利用顺序组合MapReduce编程模型的思想实现了算法的并行化扩展。实验结果表明,该改进算法与传统算法相比对初始中心的依赖降低,提高了聚类的准确性,减少了聚类的迭代次数,降低了聚类的时间。     

多种深度学习方法组合应用于小样本空间目标分类研究

随着近年来光谱探测仪器灵敏度、精确度和易用度的不断提升,光谱技术已经深入到各行各业的物质成分的鉴定与分析中。对于空间目标的光谱观测是传统光学观测的重要拓展之一,因其具有的非接触、无损伤等优点而备受关注,然而由于观测条件所限,空间目标的光谱数据量极小,通过传统方法对其进行分类分析达不到较好效果,必须探求提高分类精度的方法。首先,通过1.2 m空间目标光学望远镜上搭载的光谱相机终端获取空间目标高光谱图像;再通过天文学测光IRAF方法,提取空间目标的一维光谱数据;为对空间目标光谱进行分类,提出一种结合多种深度学习方法解决小样本数据量的空间目标分类问题。该方法应用密度聚类方法将空间目标粗糙分类,一维生成对抗网络方法增加空间目标数据,一维卷积神经网络方法将空间目标精细分类,三者组合进而达到较好的实验效果,整体精度约为79.1%（基于密度聚类、过采样、一维卷积神经网络方法组合、基于K-means、一维生成对抗网络、一维卷积神经网络方法组合和基于K-means、过采样、一维卷积神经网络方法组合的整体精度分别约为78.4%,77.9%和77.2%）。粗糙分类模型中,密度聚类方法比K-means方法整体精度平均高出约为0.67%;数据增广模型中,一维生成对抗网络方法比过采样方法整体精度平均高出约为1.52%;精细分类模型中,一维卷积神经网络方法二层网络比三层网络整体精度平均仅高出约为0.003%,但是运算时间更长。四种组合方法精度均高于单一方法。实验结果表明本文提出的组合方法在小样本空间目标类别未知情况下,可实现细分类且精度较高,为实现空间目标极小数据量下的图谱一体化分析,提供一定参考价值。     

基于K-均值聚类与夹角余弦法的多光谱分类算法

近年来对高光谱与多光谱进行分类去混的研究方法很多,K-均值聚类算法与光谱相似度计算算法都属于成熟的分类算法.作者在对其研究基础上,将K-均值算法进行改进,并融入光谱相似度匹配算法,形成一种新的光谱分类算法,找出两条距离最远的光谱作为参考光谱,用欧氏距离法或夹角余弦法对数据立方体进行分类,并且从数据立方体中删除属于这两条谱线的其余谱线,同时找出与两条参考光谱距离最远或者夹角最大者作为第三条参考光谱,对剩余数据立方体进行新的分类,并在此算法上用多光谱数据立方体进行了试验验证.通过ENVI用K-均值(K-means)进行分类,与改进的K-means算法和夹角余弦法Matlab仿真结果进行比较,后两种对于两种气泡的分类效果都很好,对背景的分类改进的K-means算法效果较好,尤其是欧氏距离法能将背景完整地分离出来.     

基于谱聚类与类间可分性因子的高光谱波段选择

随着遥感技术和成像光谱仪的发展,高光谱遥感图像的分辨率不断提高,其庞大的数据量在提高其遥感探测能力的同时,也给分析和处理带来了很大的困难。高光谱波段选择可以有效减少数据冗余,提高分类识别精度和处理效率。因此如何从多达数百个波段的高光谱图像中选择出具有较好分类识别能力的波段组合是亟待解决的问题。针对上述问题,采用基于图论的谱聚类算法,将原始高光谱图像中的波段作为待聚类的数据点,利用互信息描述两两波段间的相似度,生成相似度矩阵。再根据图谱划分理论,将相似度矩阵生成的非规范化图拉普拉斯矩阵进行谱分解,得到类间相似度小且类内相似度大的类簇;然后根据地物类型计算各波段的类间可分性因子,将其作为类簇内进一步选择代表性波段的参考指标,达到降维的目的;最后通过支持向量机与最小距离分类方法对波段选择后的图像分类。该方法区别于传统的无监督聚类方法,采用基于图论的谱聚类算法,并根据先验知识计算类间可分性因子来选择波段。通过与自适应波段选择算法和基于自动子空间划分的波段指数算法的对比实验,结果表明：两组实验当聚类数目达到相对最佳时,该波段选择方法支持向量机图像总分类精度达到94.08%和94.24%以上,最小距离分类图像总分类精度达到87.98%和89.09%以上,有效保留了光谱信息,提高了分类精度。     

一种基于模糊C均值聚类小数据量计算最大Lyapunov指数的新方法

在小数据量计算最大Lyapunov指数的过程中,为了减少人为因素识别线性区域带来的误差,提出一种基于模糊C均值聚类的新方法.该方法根据平均发散程度指数曲线的变化特征,利用分类算法进行识别.首先,利用小数据量算法对混沌时间序列进行计算得到平均发散程度指数集合;其次,利用模糊C均值聚类算法对平均发散程度指数集合进行分类,得到不饱和数据;然后,对不饱和的二阶差分数据进行分类,得到零附近波动数据并剔除粗大误差,再对保留的有效数据利用统计方法识别出线性区域;最后,对线性区域进行最小二乘法拟合得到最大Lyapunov指数.为了验证该算法的有效性,对著名Logistic和Hénon混沌系统进行了仿真,所得结果接近理论值.实验表明,所提出的新方法与主观识别方法比较,计算结果更加准确.     

基于高阶胡氏矩的多目标图象识别算法

本文提出了一种多目标图像识别算法,此算．法以小波变换和目标区域分割算法实现图象的前期处理,以高阶胡氏矩为基础,利用k邻近法构建了分类器,实现了多类目标的识别与分类,仿真实验证明,此算法具有较高的识别精度。     

基于高阶胡氏矩的多目标图象识别算法

本文提出了一种多目标图象识别算法,算法以小波变换和目标区域分割算法实现图象的前期处理,以高阶胡氏矩为基础,利用k邻近法构建了分类器,实现了多类目标的识别与分类.仿真实验证明,此算法具有较高的识别精度.     

基于改进谱聚类的重叠绿苹果识别方法

水果的可见光谱目标识别是实现农业自动化采摘至关重要的一步。在水果识别的过程中,由于重叠和遮挡的影响使得目标识别困难,识别率不高。本文针对自然环境中果实重叠的识别问题,利用谱聚类算法对图像进行分割,然后使用随机霍夫变换实现果实的识别和定位。针对传统算法运算复杂度高,运算速度慢的问题,本文提出了基于均值漂移和稀疏矩阵原理的改进谱聚类算法。首先使用均值漂移算法对图像进行预分割,均值漂移是一种用于密度梯度的无参估计法。该算法实质是一种迭代,先计算出偏移量,根据偏移量移动点,如此反复,直到偏移量为零即收敛到一点为止。利用均值漂移算法除去大多数的背景像素,为减少谱聚类算法的计算量做准备。然后提取预分割图像的有用信息即图像中像素对之间相似度的描述,将提取的图像特征信息映射到稀疏矩阵中,并使用K-means算法将其分类。得到最终的分类结果,实现对预处理图像的再次分割。然后恢复图像分割区域的颜色,使用彩色向量梯度提取边缘轮廓,对得到的轮廓图像使用随机霍夫变换,并在检测过程中设置半径参数的范围从而进一步加快算法的运行速度。经过检测可以得到目标的圆心坐标和半径,从而实现重叠绿苹果的识别。降低了谱聚类的数据处理量,提高了算法的运行速度。经过试验分析和算法对比,该算法得到较高的重合度95.41%,较低的误差率4.59%和误检率3.05%。     

一种改进的基于层次聚类的说话人自动聚类算法

说话人聚类是语音识别以及音频检索等众多语音应用的重要组成部分.提出一种改进的基于层次聚类的说话人聚类算法,对层次聚类法做出了进一步改进:(1)改进误差平方和准则以提高聚类速度;(2)引入假设检验方法确定类别数目;(3)提出一种稳健的在线聚类方法以解决对新到来的语音段进行聚类的问题.在聚类实验中,算法的平均类纯度和说话人纯度分别为96.7%和96.6%.实验结果还表明,相比手工标注说话人信息,将该算法的聚类结果应用于说话人自适应可降低系统的误识率.     

Theoretical analysis and simulation of conjugate heights for dual-conjugate AO system in lidar

A multi-conjugate adaptive optics （MCAO） can offer a possibility of widening field of view （FOV） characterized by the isoplanatic angle, and the choose of conjugate height becomes a basic problem for MCAO, which influences the size of iosplanatic angle. Considering the application of lidar, the isoplanatic angle＇s expressions of two deformable mirrors （DMs） MCAO for uplink and downlink are deduced. The effects of conjugate heights for dual-conjugate AO are thoughtfully discussed, and the isoplanatic angles are further analyzed. The results show that the isopanatic angle varies with the conjugate height and reaches the maximum as the conjugate height is at the optimal altitude. Moreover, the optimal conjugate height changes with the propagation distance.     

Quick single-photon detector with many avalanche photo diodes working on the time division

Due to the limit of response speed of the present single-photon detector, the code rate is still too low to come into practical use for the present quantum key distribution (QKD) system.A new idea is put up to design a quick single-photon detector.This quick single-photon detector is composed of a multi-port optic-fiber splitter and many avalanche photo diodes (APDs).Au of the ports with APDs work on the time division and cooperate with a logic discriminating and deciding unit driven by the clock signal.The operation frequency lies on the number N of ports, and can reach N times of the conventional single-photon detector.The single-photon prompt detection can come true for high repetition-rate pulses.The applying of this detector will largely raise the code rate of the QKD, and boost the commercial use.     

Characterization of PolyA and PolyC mismatches by Raman spectroscopy

A.C mismatches are studied by Raman spectral characterization of PolyA, PolyC, and their equimolar complex in solution of 0.14 mol/L Na ,pH7.0.Experimental results show that A·C mismatches occur to be A/B (mainly A) conformers, and unlike Watson-Crick base pairing, this kind of mismatches is stabilized by only one hydrogen bond involving cytosine N4H2 and adenine N7.The formation of A·C complex makes the base stacking interactions much stronger, and conformation of the backbone more ordered, which leads to obvious Raman hypochromic effect with some shifts in corresponding bands.     

Improvement of four-wave mixing-based wavelength conversion efficiency in dispersion shifted fiber by 40-GHz clock pumping

40-GHz clock modulated signal as a pump to improve the efficiency of four-wave mixing (FWM)-based wavelength conversion in a 26.5-km dispersion shifted fiber (DSF) is investigated. The experimental results demonstrate that the conjugated FWM component has higher intensity with the clock pumping than that with the continuous-wave (CW) light pumping. The improvement of FWM-based wavelength conversion efficiency is negligible when the pump power is less than Brillouin threshold. But when the pump power is greater than Brillouin threshold, the improvement becomes significant and increases with the increment of pump power. The improvement can increase up to 9 dB if pump power reaches 17 dBm.     

Multi-pulse operation of a Kerr-lens mode-locked femtosecond laser

Our experimental results show that the presence of a proper amount of negative group velocity dispersion is essential to multi-pulse operation of a Kerr-lens mode-locked femtosecond laser. We demonstrate that the pulse separations and the number of pulses contained within a cavity round trip are strongly dependent on the initial perturbations. The results allow us to get a better understanding on the influences of the convoluted self-phase modulation and intra-cavity dispersions on the stable multi-pulse oscillation in a Kerr-lens mode-locked femtosecond laser.     

Propagation of Helmholtz-Gauss beams in weak turbulent atmosphere

Based on the Rytov approximation of light propagation in weak turbulent atmosphere,the closed-form expressions of field and average irradiance of each one of the four fundamental families of Helmholtz-Gauss (HzG)beams:cosine-Gauss beams,stationary Mathieu-Gauss beams,stationary parabolic-Gauss beams,and Bessel-Gauss beams,which are propagating in weak turbulent atmosphere,are obtained.The results show that the field and average irradiance can be written as the product of four factors:complex amplitude depending on the z-coordinate only,a Ganssian beam.a factor of complex phase perturbation induced by atmospheric turbulence,and a complex scaled version of the transverse shape of the non-diffracting beam.The effect of weak atmospheric turbulence on irradiance distribution of the HzG beam can be ignored.     

An effective method for reducing speckle noise in digital holography

An effective method for reducing the speckle noise in digital holography is proposed in this paper.Different from the methods based on classical filtering technique,it utilizes the multiple holograms which are generated by rotating the illuminating light continuously.The intensity images reconstructed by a series of holograms generated by rotating the illuminating light possess different speckle patterns.Hence by properly averaging the reconstructed intensity fields,the speckle noises can be reduced greatly.Experimental results show that the proposed method is simple and effective to reduce speckle noise in digital holography.     

Influence of purity of HfO2 on reflectance of ultraviolet multilayer

The impurities in two kinds of HfO2 materials and in their corresponding single layer thin films were determined through glow discharge mass spectrum technology and secondary ion mass spectrometry(SIMS) equipment respectively.It was found that ZrO2 was the main impurity in the two kinds of HfO2 either in the original HfO2 materials or in the electron beam deposited films.In addition,the difference of Zr content in the two kinds of HfO2 single laver films was much laxger than that of the other impurities such as Ti and Fe.which showed that it was just ZrO2 that made the difference between the optical performance of the film products including the two kinds of HfO2.With these two kinds of HfO2 and the same kind of SiO2.we deposited HfO2/SiO2 multilayer reflective coatings at the wavelength of 266 nm.Experimental results showed that the reflectances of these two mirrors were about 99.85% and 99.15% respectively,which agreed well with the designed results what were based on the optical constants obtained from the corresponding single layer thin films.     

Speech enhancement by array crosstalk resistant ANC and spectrum subtraction

Microphone array-based speech enhancement has great importance for speech communications and speech recognition. To reduce the aperture of the microphone array and to increase the effect of the speech enhancement will greatly broaden the application areas of the microphone array. An array crosstalk resistant adaptive noise cancellation method is therefore presented. And then an improved spectral subtraction algorithm is further cascaded to obtain better enhancement results. Theoretic analysis and experiments indicate that the proposed scheme needs only a very small microphone array while it simultaneously achieves a higher SNR improvement. Besides, the proposed scheme can be used in many noisy environments and is easy for real-time implementation.