Coded aperture enhanced catadioptric optical system for omnidirectional image deblurring

Mirror curvature in the catadioptric camera often leads to noticeable blurring artifacts in omnidirectional imaging. Proper deblurring method is challenging because the blur kernel is difficult to estimate. A coded aperture enhanced catadioptric optical system is proposed in this paper that allows for image deblurring. The enhancement is designed by inserting a patterned occluder within the aperture of the camera lens. The captured omnidirectional image can be recovered to all-focus image though certain deconvolution method. Experiments on a variety of scenes (indoor/outdoor) demonstrate the benefits of using the coded apertures over conventional circular apertures. The sharp image obtained can be combined for various catadioptric applications, including omnidirectional monitoring systems, intelligent omnidirectional systems and robotics.     

去散焦模糊的折反射全向成像系统设计

随着高分辨率传感器和大光圈的采用,光圈和反射面曲率造成的折反射全向成像散焦模糊问题越发突出。提出了一种有效去除散焦模糊的折反射全向成像系统设计。理论分析折反射成像散焦模糊的原因,建立全向图点扩展函数与实景空间物点及成像系统虚像位置的关系;在一次曝光成像时间内匀速旋转镜头对焦环,通过累积曝光使全向图散焦模糊核具有期望的空间不变性;利用反卷积算法对散焦模糊全向图进行复原,得到全局清晰的全向图像。该方法较好地解决了折反射全向成像散焦模糊问题,对提高折反射全向成像质量,促进其在相关领域的广泛应用具有重要意义。     

An improved Richardson-Lucy algorithm based on local prior

Ringing is one of the most common disturbing artifacts in image deconvolution. With a totally known kernel, the standard Richardson-Lucy (RL) algorithm succeeds in many motion deblurring processes, but the resulting images still contain visible ringing. When the estimated kernel is different from the real one, the result of the standard RL iterative algorithm will be worse. To suppress the ringing artifacts caused by failures in the blur kernel estimation, this paper improves the RL algorithm based on the local prior. Firstly, the standard deviation of pixels in the local window is computed to find the smooth region and the image gradient in the region is constrained to make its distribution consistent with the deblurring image gradient. Secondly, in order to suppress the ringing near the edge of a rigid body in the image, a new mask was obtained by computing the sharp edge of the image produced using the first step. If the kernel is large-scale, where the foreground is rigid and the background is smoothing, this step could produce a significant inhibitory effect on ringing artifacts. Thirdly, the boundary constraint is strengthened if the boundary is relatively smooth. As a result of the steps above, high-quality deblurred images can be obtained even when the estimated kernels are not perfectly accurate. On the basis of blurred images and the related kernel information taken by the additional hardware, our approach proved to be effective.     

Motion deblurring using edge map with blurred/noisy image pairs

Motion deblurring methods using blurred/noisy image pairs usually include denoising process of the noisy image. Because both remaining noise and distorted fine details in the denoised image cause an error on deblurring, we propose an algorithm using an edge map of the noisy image to retain sharp edge information while neglecting noise in any smooth region that does not contain information about the motion that occurred during the exposure. In addition, the blur kernel is efficiently estimated by employing the fast total variation regularization method for the gradients of blurred and noisy images only on edge regions. For latent image restoration, another fidelity term is added, which compares the gradients of the noisy and estimated latent images on edge regions to preserve the fine details of the noisy image. To model a sparse distribution of real-world image gradients, a deconvolution method imposing hyper-Laplacian priors based on an alternating minimization scheme is also derived to restore a latent image efficiently. Experimental results show that the peak signal-to-noise ratios of the restored images against the original latent images have been increased by 11.1% on average, when compared to the existing algorithms using an image pair.     

An improved image deconvolution approach using local constraint

Conventional deblurring approaches such as the Richardson–Lucy (RL) algorithm will introduce strong noise and ringing artifacts, though the point spread function (PSF) is known. Since it is difficult to estimate an accurate PSF in real imaging system, the results of those algorithms will be worse. A spatial weight matrix (SWM) is adopted as local constraint, which is incorporated into image statistical prior to improve the RL approach. Experiments show that our approach can make a good balance between preserving image details and suppressing ringing artifacts and noise.     

Single image motion deblurring: An accurate PSF estimation and ringing reduction

In this paper we have proposed a single image motion deblurring algorithm that is based on a novel use of dual Fourier spectrum combined with bit plane slicing algorithm and Radon transform (RT) for accurate estimation of PSF parameters such as, blur length and blur angle. Even after very accurate PSF estimation, the deconvolution algorithms tend to introduce ringing artifacts at boundaries and near strong edges. To prevent this post deconvolution effect, a post processing method is also proposed in the framework of traditional Richardson–Lucy (RL) deconvolution algorithm. Experimental results evaluated on the basis of both qualitative and quantitative (PSNR, SSIM) metrics, verified on the dataset of both grayscale and color blurred images show that the proposed method outperforms the existing algorithms for removal of uniform blur. A comparison with state-of-the-art methods proves the usefulness of the proposed algorithm for deblurring real-life images/photographs.     

Blind motion deblurring using multiple images

Recovery of degraded images due to motion blurring is a challenging problem in digital imaging. Most existing techniques on blind deblurring are not capable of removing complex motion blurring from the blurred images of complex structures. One promising approach is to recover the clear image using multiple images captured for the scene. However, in practice it is observed that such a multi-frame approach can recover a high-quality clear image of the scene only after multiple blurred image frames are accurately aligned during pre-processing, which is a very challenging task even with user interactions. In this paper, by exploring the sparsity of the motion blur kernel and the clear image under certain domains, we propose an alternative iteration approach to simultaneously identify the blur kernels of given blurred images and restore a clear image. Our proposed approach is not only robust to image formation noises, but is also robust to the alignment errors among multiple images. A modified version of linearized Bregman iteration is then developed to efficiently solve the resulting minimization problem. Experiments show that our proposed algorithm is capable of accurately estimating the blur kernels of complex camera motions with minimal requirements on the accuracy of image alignment. As a result, our method is capable of automatically recovering a high-quality clear image from multiple blurred images.     

Single frame blind image deconvolution by non-negative sparse matrix factorization

Novel approach to single frame multichannel blind image deconvolution has been formulated recently as non-negative matrix factorization problem with sparseness constraints imposed on the unknown mixing vector that accounts for the case of non-sparse source image. Unlike most of the blind image deconvolution algorithms, the novel approach assumed no a priori knowledge about the blurring kernel and original image. Our contributions in this paper are: (i) we have formulated generalized non-negative matrix factorization approach to blind image deconvolution with sparseness constraints imposed on either unknown mixing vector or unknown source image; (ii) the criteria are established to distinguish whether unknown source image was sparse or not as well as to estimate appropriate sparseness constraint from degraded image itself, thus making the proposed approach completely unsupervised; (iii) an extensive experimental performance evaluation of the non-negative matrix factorization algorithm is presented on the images degraded by the blur caused by the photon sieve, out-of-focus blur with sparse and non-sparse images and blur caused by atmospheric turbulence. The algorithm is compared with the state-of-the-art single frame blind image deconvolution algorithms such as blind Richardson-Lucy algorithm and single frame multichannel independent component analysis based algorithm and non-blind image restoration algorithms such as multiplicative algebraic restoration technique and Van-Cittert algorithms. It has been experimentally demonstrated that proposed algorithm outperforms mentioned non-blind and blind image deconvolution methods.     

Blind image deconvolution using sparse and redundant representation

This work devotes to the image deconvolution problem that restores clear image from its blurred and noisy measurements with little prior about the blur. A deconvolution method based on sparse and redundant representation theory is developed in this paper. It firstly represents the blur and image over different redundant dictionaries and imposes sparsity constraint to their representation coefficients respectively, then alternately estimates them using an iterative algorithm employing optimization technique. Experimental results on astronomical images show that the proposed method can achieve as good performance as the method requiring a known blur, which demonstrates its effectiveness.     

基于去模糊空间变换RCNN的毫米波图像目标检测（英文）

提出一种包含去模糊的空间变换区域卷积神经网络的目标检测算法.首先,基于主动毫米波圆柱扫描成像原理对人体进行三维成像(频率24~30 GHz),建立毫米波图像数据集.然后,估计毫米波图像的模糊核,通过卷积去噪网络获得图像先验知识,将其集成到半二次分裂的优化方法中,以实现非盲目去模糊.最后,由定位网络、网格生成器和采样网络三部分组成空间变换网络,将它融入到特征提取网络中,在去模糊后实现目标检测.通过该非盲目去模糊算法得到的图像的峰值信噪比可达27.49 dB,目标检测算法的平均精度可达80.9%.实验结果表明,与现有的先进方法相比,该方法可以有效地提高图像质量和检测精度,为毫米波图像中隐藏危险品的目标检测提供了新的技术支持.     

基于稀疏先验的空间目标图像盲反演方法

针对图像盲反演算法未考虑空间目标图像自身特性,致使对空间目标图像细节信息恢复不理想、重构图像中易产生边界伪像等不足之处,提出了一种基于稀疏表示的联合稀疏先验约束盲反演算法.首先,结合空间目标图像梯度的稀疏特性,采用图像梯度的L 0范数提取有利于模糊核估计的图像显著边缘信息;其次,采用L p范数和L 0范数对图像的梯度分布和空间域进行稀疏约束,以保证反演图像的像素点间具有显著的对比度,同时保证图像中包含边缘和纹理等细节信息;最后,采用拉普拉斯分布先验对模糊核进行约束,以保证模糊核的稀疏特性.采取交替迭代策略对所提出的模型进行优化求解,从而得到模糊核和空间目标图像的估计值.实验结果表明,相比于几种具有代表性的盲反演算法,提出的方法能估计出更准确的模糊核,对图像边缘和纹理等细节信息具有更好的恢复能力,在主观评价和客观评价方面均取得了较好的反演性能.     

基于结构字典学习的图像复原方法

本文提出一种新的结构字典学习方法,并利用它进行图像复原。首先给出结构字典学习的基本内容和方法,然后将傅里叶正则化方法和结构字典学习方法有效整合到图像复原算法中。结构字典学习方法是先将原图像进行结构分解,再分别学习出每个结构图像中的字典,最后利用这些字典对原图像进行稀疏的表示。结合傅里叶正则化,提出了一种有效的迭代图像复原算法:第一步在傅里叶域利用正则化反卷积方法得到图像的初步估计;第二步采用结构字典学习的方法对遗留的噪声进行去噪处理。实验结果表明,提出的方法在改进信噪比和视觉质量上都要优于6种先进的图像复原方法,改进的信噪比平均提升0.5 d B以上。     

基于多相组重建的航空图像超分辨率算法

为提高航空图像的空间分辨率, 提出一种基于多相组重建的超分辨率算法. 融合图像间的互补信息, 将多帧低分辨率图像作为图像基, 参考帧分解为多相组, 利用差异采样特性构建图像基与参考帧之间的的多相组线性关系重建得到高分辨率图像的多项组, 经图像多相分解逆变换获得融合的高分辨率图像. 根据该融合图像的局部内容和结构信息自适应调整控制核核函数, 应用改进的控制核回归算法去除图像模糊和噪声得到清晰的超分辨率图像. 与传统算法相比, 该算法无需图像配准和迭代过程, 计算效率极大地提高. 实验结果表明, 本文算法能够有效提高航空图像的空间分辨率, 在定量评价指标和主观视觉效果方面都有显著提高.     

Interlaced scan CCD image motion deblur for space-variant motion blurs

Motion blur is caused by camera shakes or object motions during exposure when the shutter speed is relatively slow. As for the object motion blur, the degradation of a CCD image is often characterized by space-variant motion blurs, since objects are often moving in different directions at different speeds. But most image restorations for space-variant motion blurs are addressed only for progressive scan CCD images. To address the space-variant image restorations for interlaced scan images, we propose a novel image restoration scheme. First, one interlaced scan image frame is required, which is divided into the odd field and the even field images. These two field images are further segmented into rectangular blocks. The motion vectors are computed in these rectangular blocks using an efficient block matching algorithm. Second, image restoration is performed in these rectangular blocks using a constrained least square algorithm in the odd or even field image, which can both preserve edge structures and remove noises. Our novel scheme is illustrated by restoring a space-variant blurred moving boat image and a synthetic blurred image.     

运动与离焦模糊图像的复原

在运动和离焦所引起的图像模糊的情况中,本文提出了一种新的基于霍夫变换区分离焦模糊和运动模糊两类模糊的方法.该方法通过比较霍夫变换矩阵中的亮点数来区分两类模糊,不仅正确率达到100%,而且抗干扰性能好;其次通过对运动模糊图像做两次方向微分,估计其模糊方向,提高了模糊方向的估计准确度;最后利用改进的Prewiit算子和费米函数计算模糊图像的刃边函数,进而得到图像的调制传递函数,再利用维纳滤波复原图像.实验结果表明:本文算法不仅具有有效性和强抗噪音能力,而且对图像的信噪比要求可以低到20 dB;与传统算法相比,提高了图像的复原质量.     

单幅模糊图像点扩散函数估计的梯度倒谱分析方法研究

针对单幅图像复原算法引入先验信息导致复杂度高、运算效率低的问题, 提出了单幅模糊图像点扩散函数估计的梯度倒谱分析方法. 首先给出了单幅模糊图像梯度倒谱估计其点扩散函数的基本原理, 利用相位恢复策略复原了二维点扩散函数相位信息, 实现了点扩散函数的快速估计; 其次, 为鉴别点扩散函数估计精度, 建立了图像梯度保真约束的全变分正则化图像复原模型, 并采用快速稳定收敛的交替方向策略优化能量函数; 通过对仿真和实拍单幅模糊图像进行的测试实验结果表明, 该方法快速准确地估计出点扩散函数, 克服了传统复原算法收敛速度慢的缺点, 有效抑制了振铃效应、保护了边缘信息, 为大尺寸单幅图像复原的工程化实现提供了理论和技术基础. 关键词： 图像复原 点扩散函数 梯度倒谱分析 全变分     

Motion blur parameters estimation for image restoration

This paper deals with estimation of parameters for motion blurred images. The objectives are to estimate the length (L) and the blur angle (θ) of the given degraded image as accurately as possible so that the restoration performance can be optimised. Gabor filter is utilized to estimate the blur angle whereas a trained radial basis function neural network (RBFNN) estimates the blur length. Once these parameters are estimated the conventional restoration is performed. To validate the proposed scheme, simulation has been carried out on standard images as well as in real images subjected to different blur angles and lengths. The robustness of the scheme is also validated in noise situations of different strengths. In all situations, the results have been compared with standard schemes. It is in general observed that the proposed scheme outperforms its counterparts in terms of restoration parameters and visual quality.     

离焦模糊图像超分辨力盲复原算法分析

根据计算机模拟和实际拍摄的离焦模糊标准分辨力靶标图像,对提出的离焦模糊图像超分辨力盲复原算法进行了分析研究,对比了超分辨力盲复原算法与几种典型复原算法的效果,以及在不同离焦模糊半径下该算法的复原效果。实验结果表明,该算法对深度离焦模糊图像具有较明显的复原效果,复原图像相比较于模糊图像分辨力提高1倍;显著改善了标准分辨力靶标图像的可分辨组块。可分辨组块可以定量地描述复原算法对图像分辨力的改善程度。该算法已经应用到实际工作当中,并获得了较好的效果。     

多局部残差连接注意网络的图像去模糊

针对现有的基于卷积神经网络的图像去模糊算法存在图像纹理细节恢复不清晰的问题,提出了一种基于多局部残差连接注意网络的图像去模糊算法。首先,采用一个卷积层进行浅层特征提取;其次,设计了一种新的基于残差连接和并行注意机制的多局部残差连接注意模块,用于消除图像模糊并提取上下文信息;再次,采用一个基于扩张卷积的成对连接模块进行细节恢复;最后,利用一个卷积层重建清晰图像。实验结果表明：在GoPro数据集上的PSNR (peak signal to noise ratio)和SSIM (structure similarity)分别为31.83 dB、0.927 5,在定性和定量两方面都表明所提方法能够有效地恢复模糊图像的纹理细节,网络性能优于对比方法。     

基于Markov约束的泊松最大后验概率超分辨率图象复原法

提出了基于Markov约束的泊松最大后验概率(Poisson-MAP)超分辨率图象复原方法(MPMAP),该方法把Poisson-MAP法和Markov随机场先验分布有机地结合在一起.实验表明,该方法能有效地减少和去除复原图象中的噪音和振荡条纹,提高图象复原质量,具有很好的超分辨率复原能力.