基于非冗余轮廓波的图像质量可伸缩编码算法

提出一种用非冗余轮廓波的中低比特率图像质量可伸缩编码算法。该算法采用双正交小波分解和方向滤波器组(DFB)实现图像的非冗余稀疏表示, 不但具有轮廓波对图像中线状奇异性边缘和纹理细节的稀疏表示特点, 而且克服了轮廓波变换系数4/3冗余的缺点。算法中对图像非冗余轮廓波系数各子带系数分布进行统计分析, 通过对变换系数的重新组合, 构造了有利于图像编码的空间方向树结构, 并统计验证了其零树特性, 采用分级树集合分裂和阈值量化达到图像质量可伸缩的嵌入式编码。实验结果表明,其解码算法在中低比特率压缩情况下, 压缩后重构图像的感知质量明显优于小波域SPIHT,JPEG2000编码标准, 峰值信噪比PSNR值与JPEG2000相当, 而图像纹理和边缘细节的视觉效果优于JPEG2000和小波域SPIHT算法。     

色彩再现的多光谱图像压缩

针对多光谱图像在色度高保真再现等领域的应用,为提高压缩效率,进一步存储传输,提出了WF系列编码方法,设计了APWS_RA算法,进而提出了一种低复杂度、光照稳定性好且支持跨设备再现的WF_APWS_RA压缩算法。首先研究了现有的基于光谱均方误差的小波嵌入编码原理,提出了色感应失真准则和视觉特性矩阵W;同时,优化了APWS编码算法的码率分配,形成APWS_RA编码算法;最后,结合以上技术,以色度误差准则指导编码,对视觉加权后的多光谱图像数据进行aPWS_rA编码,命名为WF_APWS_RA。WF_APWS_RA算法融合人眼视觉特性矩阵W,利用吸引力传播(Affinity Propagation)聚类挖掘加权图像的谱间冗余,小波变换去除其空间冗余,最后结合误差补偿机制和码率分配策略进行小波编码。实验表明,在相同比特率下,较现有低复杂度经典编码算法,WF系列编码方法能更有效地保留光谱中的色度信息,APWS_RA算法的重建光谱误差最小,WF_APWS_RA算法的重建色度精度优势明显。     

色彩再现的多光谱图像压缩

针对多光谱图像在色度高保真再现等领域的应用, 为提高压缩效率, 进一步存储传输, 提出了WF系列编码方法, 设计了APWS_RA算法, 进而提出了一种低复杂度、光照稳定性好且支持跨设备再现的WF_APWS_RA压缩算法。首先研究了现有的基于光谱均方误差的小波嵌入编码原理, 提出了色感应失真准则和视觉特性矩阵W;同时, 优化了APWS编码算法的码率分配, 形成APWS_RA编码算法;最后, 结合以上技术, 以色度误差准则指导编码, 对视觉加权后的多光谱图像数据进行aPWS_rA编码, 命名为WF_APWS_RA。WF_APWS_RA算法融合人眼视觉特性矩阵W, 利用吸引力传播(Affinity Propagation)聚类挖掘加权图像的谱间冗余, 小波变换去除其空间冗余, 最后结合误差补偿机制和码率分配策略进行小波编码。实验表明, 在相同比特率下, 较现有低复杂度经典编码算法, WF系列编码方法能更有效地保留光谱中的色度信息, APWS_RA算法的重建光谱误差最小, WF_APWS_RA算法的重建色度精度优势明显。     

双树小波变换与小波树稀疏联合的低场CS-MRI算法

压缩感知理论常用在磁共振快速成像上,仅采样少量的K空间数据即可重建出高质量的磁共振图像.压缩感知磁共振成像技术的原理是将磁共振图像重建问题建模成一个包含数据保真项、稀疏先验项和全变分项的线性组合最小化问题,显著减少磁共振扫描时间.稀疏表示是压缩感知理论的一个关键假设,重建结果很大程度上依赖于稀疏变换.本文将双树复小波变换和小波树稀疏联合作为压缩感知磁共振成像中的稀疏变换,提出了基于双树小波变换和小波树稀疏的压缩感知低场磁共振图像重建算法.实验表明,本文所提算法可以在某些磁共振图像客观评价指标中表现出一定的优势.     

基于离散余弦变换的语音压缩采样和编码算法

针对语音无线通信中带宽资源受限的问题,提出基于压缩采样的低速率语音编码算法。以基尼系数为指标,比较不同稀疏变换域下语音信号的稀疏性,分析常见重构算法对语音信号压缩采样观测信号的重构特性。对标准耳蜗滤波器——伽马啁啾滤波器组的参数进行研究,并以梯度投影稀疏重建(GPSR)算法重构语音信号。利用语音质量感知评估(PESQ)、信噪比和主观听觉测试,对编解码后的合成语音信号进行了质量评估。实验表明,基于压缩感知的语音编码器以4 kbps的低速率对语音进行编码时,PESQ得分可达到3.16,计算复杂度相对较低,可以用于实际的语音编码环境。     

基于局部约束群稀疏的红外图像超分辨率重建

针对红外图像分辨率低、视觉质量差等问题,提出基于局部约束群稀疏模型的红外图像超分辨率重建方法.考虑到红外图像的纹理自相似性和原子系数的群结构稀疏性,首先建立了基于局部约束的群稀疏表示模型.然后,在假定低分辨率图像空间和高分辨率图像空间具有相似流形的前提下,联合局部约束群稀疏表示模型和K-SVD(K奇异值分解)方法,训练得到高低分辨率图像对应的群结构字典对.最后,通过高分辨字典和对应的红外图像群稀疏表示系数重建得到高分辨率的红外图像.实验结果表明,本文方法具有更好的超分辨率效果,无论是在客观评价指标还是主观视觉效果方面都有明显的提高.     

基于聚类和小波变换的多光谱图像压缩算法

针对多光谱图像压缩算法现存的时空复杂度高、光谱特性利用不充分等问题,研究了多光谱图像的谱间稀疏等价表示及其聚类实现途径,进而设计了一种基于谱间自适应聚类和小波变换的多光谱图像压缩算法。算法利用吸引力传播聚类产生多光谱图像的谱间稀疏等价表示、在低复杂度下去除图像的谱间冗余,使用二维小波变换去除稀疏表示成分的空间冗余,采用分层树集合分割排序算法(SPIHT)进行压缩编码,并通过误差补偿机制提高多光谱图像重建质量。实验表明,该算法在保证较低时间和空间复杂度的基础上,较SPIHT等同类经典压缩算法,在相同的压缩比下,明显提高了重建图像的峰值信噪比,是一种通用有效的多光谱图像压缩算法。     

基于感兴趣区域的幅型比变换新方法

基于人类视觉系统对运动目标比较敏感的特性,提出了一种新的幅型比变换方法.综合时空信息提取视频序列中的运动目标,利用图像修复技术对被提取运动目标后的视频图像进行背景修补.采用插值算法以不同的方式分别缩放运动目标和修复后的背景,并将变换后的运动目标与背景相叠加合成相应幅型比的视频图像.实验结果表明:此方法避免了已有幅型比变换方法的缺陷,保证了变换后运动目标的无失真性,与人类的视觉感知有较好的一致性.     

基于感兴趣区域的幅型比变换新方法

基于人类视觉系统对运动目标比较敏感的特性,提出了一种新的幅型比变换方法.综合时空信息提取视频序列中的运动目标,利用图像修复技术对被提取运动目标后的视频图像进行背景修补.采用插值算法以不同的方式分别缩放运动目标和修复后的背景,并将变换后的运动目标与背景相叠加合成相应幅型比的视频图像.实验结果表明：此方法避免了已有幅型比变换方法的缺陷,保证了变换后运动目标的无失真性,与人类的视觉感知有较好的一致性.     

基于生物视觉特征和视觉心理学的视频显著性检测算法

提出了一种空域和时域相结合的视频显著性检测算法.对单帧图像,受视觉皮层层次化感知特性和Gestalt视觉心理学的启发,提出了一种层次化的静态显著图检测方法.在底层,通过符合生物视觉特性的特征图像（双对立颜色特征及亮度特征图像）的非线性简化模型来合成特征图像,形成多个候选显著区域;在中层,根据矩阵的最小Frobenius-范数（F-范数）性质选取竞争力最强的候选显著区域作为局部显著区域;在高层,利用Gestalt视觉心理学的核心理论,对在中层得到的局部显著区域进行整合,得到具有整体感知的空域显著图.对序列帧图像,基于运动目标在位置、运动幅度和运动方向一致性的假设,对Lucas-Kanade算法检测出的光流点进行二分类,排除噪声点的干扰,并利用光流点的运动幅度来衡量运动目标运动显著性.最后,基于人类视觉对动态信息与静态信息敏感度的差异提出了一种空域和时域显著图融合的通用模型.实验结果表明,该方法能够抑制视频背景中的噪声并且解决了运动目标稀疏等问题,能够较好地从复杂场景中检测出视频中的显著区域.     

Dynamic cardiac MRI reconstruction using motion aligned locally low rank tensor (MALLRT)

Various sparse transform models have been explored for compressed sensing-based dynamic cardiac MRI reconstruction from vastly under-sampled k-space data. Recently emerged low rank tensor model using Tucker decomposition could be viewed as a special form of sparse model, where the core tensor, which is obtained using high-order singular value decomposition, is sparse in the sense that only a few elements have dominantly large magnitude. However, local details tend to be over-smoothed when the entire image is conventionally modeled as a global tensor. Moreover, low rankness is sensitive to motion as spatiotemporal correlation is corrupted by spatial misalignment between temporal frames. To overcome these limitations, this paper presents a novel motion aligned locally low rank tensor (MALLRT) model for dynamic MRI reconstruction. In MALLRT, low rank constraint is enforced on image patch-based local tensors, which correspond to overlapping blocks extracted from the reconstructed high-dimensional image after group-wise inter-frame motion registration. For solving the proposed model, this paper presents an efficient optimization algorithm by using variable splitting and alternating direction method of multipliers (ADMM). MALLRT demonstrated promising performance as validated on one cardiac perfusion MRI dataset and two cardiac cine MRI datasets using retrospective under-sampling with various acceleration factors, as well as one prospectively under-sampled cardiac perfusion MRI dataset. Compared to four state-of-the-art methods, MALLRT achieved substantially better image reconstruction quality in terms of both signal to error ratio (SER) and structural similarity index (SSIM) metrics, and visual perception in preserving spatial details and capturing temporal variations.     

Structural similarity based single image super-resolution with nonlocal regularization

Recently, sparse coding based image super-resolution has attracted increasing interests. This paper proposes an improved image super-resolution method, by incorporating structural similarity (SSIM) index and nonlocal regularization into the framework of image super-resolution via sparse coding. Firstly, an algorithm of combining SSIM based sparse coding and K-SVD is proposed to train the high resolution (HR) and low resolution (LR) dictionary pairs. And then, the sparse representations of observed LR image are sought to reconstruct the HR image with the trained LR and HR dictionary pairs by exploiting nonlocal self-similarities. Experimental results demonstrate the effectiveness of the proposed method, both in its visual effects and in quantitative terms.     

Image quality assessment in multiband DCT domain based on SSIM

The performance of image quality assessment method based on SSIM (structural similarity) is better than the PSNR (peak signal to noise ratio), but the assessment effects of SSIM is poor for seriously blurred image, therefore, the model that combined HVS (human visual sensitivity) and SSIM was established. The basic idea is based on the human eye's sensitivity to different frequency distortion image, the image is two-dimensional discrete cosine transform frequency component into low, mid, high-frequency component, to obtain the frequency component of light, contrast and structural information, using Pearson coefficient for weight and sum processing to the sub-image according to frequency bands of different sensitive degree, finally, get the sharpness of the image. Through nonlinear regression analysis of objective assessment and DMOS, experiments showed that this method was closer to human perception than SSIM and GSSIM for serious blurred distortion image. At the same time, compared to conventional algorithm MAE (mean absolute error), MSE (mean square error) and PSNR, this model was more consistent with human visual characteristics.     

FD: A feature difference based image clutter metric for targeting performance

Previous image clutter metrics were proposed based on the sensitivity of human visual perception to one feature of image. In this paper, a novel feature difference based image clutter metric is proposed by fully considering low-level image features, such as step edges, lines and Mach bands. As phase congruency is an invariant property of image features, the phase congruency (PC) is used to quantify the feature difference between the target and clutter images. Because PC is invariant to changes in image contrast while human visual perception is sensitive to contrast changes, a directional contrast (DC) feature is developed to calculate the contrast difference between the two images. Then we utilize the DC of the target image as an information content weighting measure to pool the local difference map to be a clutter metric. Comparative experiments demonstrate that this clutter metric correlates stronger with detection probabilities, false alarm probabilities and mean search times than previously proposed metrics.     

The Multi-Focus-Image-Fusion Method Based on Convolutional Neural Network and Sparse Representation

Multi-focus-image-fusion is a crucial embranchment of image processing. Many methods have been developed from different perspectives to solve this problem. Among them, the sparse representation (SR)-based and convolutional neural network (CNN)-based fusion methods have been widely used. Fusing the source image patches, the SR-based model is essentially a local method with a nonlinear fusion rule. On the other hand, the direct mapping between the source images follows the decision map which is learned via CNN. The fusion is a global one with a linear fusion rule. Combining the advantages of the above two methods, a novel fusion method that applies CNN to assist SR is proposed for the purpose of gaining a fused image with more precise and abundant information. In the proposed method, source image patches were fused based on SR and the new weight obtained by CNN. Experimental results demonstrate that the proposed method clearly outperforms existing state-of-the-art methods in addition to SR and CNN in terms of both visual perception and objective evaluation metrics, and the computational complexity is greatly reduced. Experimental results demonstrate that the proposed method not only clearly outperforms the SR and CNN methods in terms of visual perception and objective evaluation indicators, but is also significantly better than other state-of-the-art methods since our computational complexity is greatly reduced.     

Improvement in appearance of colors for elderly persons using lightness transform

The color of an object appears to be different for elderly and young persons. This is because human visual features vary with on age. In general, the spectral transmittance of the crystalline lens of an elderly person is lower than that of a young person. The low spectral transmittance decreases the brightness of the visual field. This phenomenon affects the color appearance of an image in human visual perception. In this paper, a lightness transform method is proposed to improve the color appearance of images for elderly persons. In the proposed method, colors that are difficult for an elderly person to see are transformed into colors that are easy to see by adding lightness contrast. The performance of the proposed method is confirmed in experiments using digital images.     

Perception,comfort and performance criteria for human beings exposed to whole body pure yaw vibration and vibration containing yaw and translational components

Human perception thresholds, in both the presence and the absence of visual cues, and equal sensation contours for low frequency whole body pure yaw vibration were investigated. The results from these and other laboratory tests were combined with field test data for the human response to predominantly yaw vibration, caused by rotational oscillations of civil structures about a vertical axis of the human subjects, to provide guidelines for probable human response to pure yaw vibration at different levels in a variety of circumstances. Relationships have also been derived to allow assessment of the probable responses of occupants of fixed structures to motion which exposes them to the more common case of simultaneous yaw and horizontal translational components of vibration.     

Visual attention guided image fusion with sparse representation

Image fusion techniques aim at transferring useful information from the input source images to the fused image. The common assumption for most fusion approaches is that the useful information is defined by local features such as contrast, variance, and gradient. However, there is no consideration of global visual attention of the whole source images which indicates the “interesting” information of the source images. In this paper, we firstly review the patch-based image fusion methods which attract the attention and interest of many researchers. Then, a visual attention guided patch-based image fusion method is proposed. The visual attention maps of the source images are calculated from the sparse represent coefficients of the source images. Then, the sparse coefficients are fused with the guidance of visual attention maps in order to emphasize the global “interesting” objects in the source images. Finally, the fused image is reconstructed from the fused sparse coefficients. The new fusion strategy ensures that the objects being “interesting” for our visual system are preserved in the fused image. The proposed approach is tested on infrared and visual, medical, and multi-focus images. The results compared with those of traditional methods show obvious improvement in objective and subjective quality measurements.     

基于立体舒适度的立体图像感知距离估计

提出了一种基于立体舒适度的双目图像感知距离估计方法.首先,推导双目立体图像的立体深度;然后进行主观实验获取实际人眼感知到的深度,分析其与立体深度间的差异;最后,将立体舒适度作为生理因素,建立感知距离、立体深度与视觉舒适度之间的关联关系,并得出感知距离的计算模型.在IVY公共数据集上进行实验验证,结果表明:当视觉舒适度值较高时,模型预测值的平均绝对值误差与均方根误差较主观评测值分别减少了0.0049、0.0073;而当视觉舒适度值较低时,平均绝对值误差与均方根误差分别减少了0.0721、0.0594.本模型结果更接近人类主观感知到的深度.