基于ZedBoard的超分辨率视频复原系统

为了实现超分辨率视频图像的实时复原,设计了以ZedBoard可编程片上系统为基础的超分辨率视频复原系统。系统包括基于V4L2(Video for Linux 2)的USB摄像头视频采集、基于小波变换的超分辨率复原算法处理和基于Qt的图形用户界面制作以及视频输出。采用双线性、双立方和小波变换算法分别对Lena图像进行复原处理,峰值信噪比PSNR值分别为29.516、29.843、31.368。实验结果表明,提出的基于小波的超分辨率复原算法优于传统的插值算法,基于ZedBoard的超分辨视频复原系统复原效果良好。     

双正交小波插值的CCD图像超分辨恢复

给出了一种构造双正交小波滤波器的设计方法,应用该方法得到的双正交小波对低分辨率图像进行小波分解。对分解后的图像结构进行分析,提出双三次插值与方向插值相结合的方法,对分解后图像插值。对插值后图像小波逆变换,得到超分辨率图像。应用于CCD图像,获得了比双线性插值高的峰值信噪比(25.3090dB),图像细节信息增强了。实验结果表明,算法应用于CCD图像不仅提高了图像的空间分辨率,同时也提高了图像的峰值信噪比,还比较好地保留了图像的边缘信息,且经过该方法恢复后的图像更适合人眼观察,细节丰富,更加清晰,畸变小,是一种提高CCD图像空间分辨率的有效方法。     

Performance comparison of bilinear interpolation, bicubic interpolation, and B-spline interpolation in parallel phase-shifting digital holography

To improve the quality of reconstructed images, we apply bicubic interpolation and B-spline interpolation to parallel phase-shifting digital holography for the first time. The effectiveness of bilinear interpolation, bicubic interpolation, and B-spline interpolation in parallel phase-shifting digital holography is shown by a numerical simulation. In the simulation result, the application of bicubic interpolation and B-spline interpolation succeeded in decreasing the rootmean- square error of the reconstructed image by 12.6 and 11.9%, respectively.     

一种图像非线性形变的恢复方法

几何成像系统中非线性形变图像的恢复仍是一个未能很好解决的课题。针对常见的双二次、双三次形变图像,提出了以不完全双二次、双三次插值法拟合形变图像,根据形变的特点采用牛顿迭代法和双线性灰度插值法对图像进行恢复。用所提出的方法对失真图像进行恢复,结果表明,仅选用少量参考点便可得到良好的效果。     

Adaptive computer-generated hologram using interpolation method

Kinoform synthesis by an electro-optic hybrid system using an interpolation method is proposed. A programmable liquid crystal spatial light modulator is used as a kinoform. The phase distribution of the kinoform is optimized using the simulated annealing. The cost function is represented by the mean square error between a desired image stored in a computer and a reconstructed image detected by a charge coupled device camera. The interpolation method enables one to reduce the random noise effect in the reconstructed image. Some experimental results are presented. Presented at 1996 International Topical Meeting on Optical Computing (OC’96), April 21–25, Sendai, Japan.     

Fast single image super-resolution using estimated low-frequency k-space data in MRI

PurposeSingle image super-resolution (SR) is highly desired in many fields but obtaining it is often technically limited in practice. The purpose of this study was to propose a simple, rapid and robust single image SR method in magnetic resonance (MR) imaging (MRI).MethodsThe idea is based on the mathematical formulation of the intrinsic link in k-space between a given (modulus) low-resolution (LR) image and the desired SR image. The method consists of two steps: 1) estimating the low-frequency k-space data of the desired SR image from a single LR image; 2) reconstructing the SR image using the estimated low-frequency and zero-filled high-frequency k-space data. The method was evaluated on digital phantom images, physical phantom MR images and real brain MR images, and compared with existing SR methods.ResultsThe proposed SR method exhibited a good robustness by reaching a clearly higher PSNR (25.77dB) and SSIM (0.991) averaged over different noise levels in comparison with existing edge-guided nonlinear interpolation (EGNI) (PSNR=23.78dB, SSIM=0.983), zero-filling (ZF) (PSNR=24.09dB, SSIM=0.985) and total variation (TV) (PSNR=24.54dB, SSIM=0.987) methods while presenting the same order of computation time as the ZF method but being much faster than the EGNI or TV method. The average PSNR or SSIM over different slice images of the proposed method (PSNR=26.33 dB or SSIM=0.955) was also higher than the EGNI (PSNR=25.07dB or SSIM=0.952), ZF (PSNR=24.97dB or SSIM=0.950) and TV (PSNR=25.70dB or SSIM=0.953) methods, demonstrating its good robustness to variation in anatomical structure of the images. Meanwhile, the proposed method always produced less ringing artifacts than the ZF method, gave a clearer image than the EGNI method, and did not exhibit any blocking effect presented in the TV method. In addition, the proposed method yielded the highest spatial consistency in the inter-slice dimension among the four methods.ConclusionsThis study proposed a fast, robust and efficient single image SR method with high spatial consistency in the inter-slice dimension for clinical MR images by estimating the low-frequency k-space data of the desired SR image from a single spatial modulus LR image.     

Directional variation adaptive image resolution enhancement

The goal of image interpolation is to produce a high-resolution image from its low-resolution counterpart. It has significant applications in video sensor network, where the resolution of images usually needs to be enhanced at the end user due to the limited transmission bandwidth. The key challenge of image interpolation is to preserve the edge structure of the image. In this paper, a new image interpolation approach is proposed to adaptively adjust the interpolation according to the directional variations of images. More specifically, at each pixel position to be interpolated, its neighboring pixels are projected onto 1D direction according to a number of proposed patterns. Then the direction, of which the variation is smallest, is chosen as the direction to perform image interpolation. Experimental results are provided to show that the proposed approach outperforms several conventional edge-directed image interpolation algorithms.     

Rapid Diffusion Weighted Imaging with Enhanced Resolution

In this paper, a new, fast compressively sensed diffusion magnetic resonance image enhancement technique is presented. This algorithm aims to overcome two major obstacles—image resolution limitation and algorithm reconstruction time efficiency-by combining a highly sparse k–q-space sampling pattern with super-resolution (SR) image enhancement. Similar to the RoSA (rotating single-shot acquisition) acceleration scheme, the presented algorithm takes advantage of simultaneous k–q-space sampling procedures being able to implement directly with no hardware modifications. The method sequentially processes compressively sensed k-space’s semi-PROPELLER blades with respect to appropriately synchronized diffusion directions. The dMR image structure is expressed as a kind of minimum-spanning tree. It fades out distortions of the image’s features. Moreover, as contrasted with numerous other super-resolution algorithms, the presented method overcomes the simplifying motion model as well as blur kernel and noise estimation issues. The simulation and experimental studies have been conducted using a dMRI scanner as well as a phantom input. Combining super-resolution with time-efficient data sets resulted in a reduction of motion artifacts, improving edge delineation as well as spatial resolution.     

稀疏阈值的超分辨率图像重建

为了解决基于字典学习的超分辨重构算法耗时过长的问题,提出了基于稀疏阈值模型的图像超分辨率重建方法。首先,将联合字典理论与图像块稀疏阈值方法相结合,训练得到高、低分辨率过完备图像字典对。接着,通过稀疏阈值OMP算法对图像特征块进行稀疏表示。然后,通过高分辨率字典重构出初始的超分辨图像。最后,通过改进迭代反投影算法对初始的超分辨图像进行全局优化,从而进一步提高图像重构质量。实验结果表明,超分辨图像重构平均峰值信噪比(PSNR)为30.1 d B,平均结构自相似度(SSIM)为0.937 9,平均计算时间为10.2 s。有效提高了超分辨重构的速度,改善了重构高分辨图像的质量。     

A real-time video encoded particle imaging tracking technique for velocity measurement

A real-time video encoded particle imaging tracking technique (VPIT) for velocity measurement has been developed. It can currently capture images of a seeded particle flow field at up to a video rate of 25 pictures per second. The method as shown in this paper is suitable for measuring a slow sparsely seeded flow. A VPIT image presents a triplet image pattern. The image has been encoded into a single video frame with the time history of three events. This is achieved by synchronising the video (CCIR) signal from a CCD (charge coupled device) camera, operating in frame integration mode with a suitable light source. The principle of VPIT demonstrates how the direction and the magnitude of the velocity can be recorded for a sequence or track of particles. The VPIT triplet images resolve several common difficulties associated with the application of PIV. Firstly, the time history of the laser pulse can be ‘labeled’ on an individual particle image. Secondly, there is no velocity direction ambiguity in the VPIT image. Thirdly, it is possible to extract the acceleration of the particle from a single VPIT frame. Finally, for a sequence of captured frames, the problems of particle path tracking are simplified, because each VPIT image has a video encoded time sequence ‘labelled’ on it.     

Measurements of the diffusion coefficient of nanoparticles by selective plane illumination microscopy

A laser-based selective plane illumination microscope is developed for the visualization of polystyrene nanospheres about 100 nm in diameter in water at a distance more than 600 μm from microcell walls. The contrast and brightness of particle images are high enough to record them by a video camera with a frame rate of up to 60 frames per second without using an image intensifier. The diffusion coefficients of monodisperse polystyrene nanospheres obtained using this microscope and the image processing software developed by the authors are presented. The measured diffusion coefficients provide the possibility to determine nanosphere diameters with a relative error not exceeding 5%.     

基于半像素错位的多幅图像重建高分辨率图像技术研究

介绍了一种基于半像素错位的多幅图像重建高分辨率图像技术。分析了半像素错位的多幅图像与高分辨率图像各像素灰度值的对应关系 ,并从CCD数字化采样的角度进行了论证。同时 ,结合实际摄像机CCD结构 ,求出了高分辨率图像重建的计算公式 ,并通过实验进行了验证和完善。重建的本质是以原高分辨率图像的 4邻域平均图像为基础 ,增加一定比例的边缘细节信息 ,去接近原高分辨率图像。CCD的动态范围越大 ,图像的灰度级越多 ,那么计算误差就越小 ,图像的边缘细节信息就可以利用更多 ,重建的图像就越接近原高分辨率图像。通过实验和分析表明 ,利用半像素错位的多幅低分辨率图像重建高分辨率图像的原理是正确的 ,方案是可行的     

基于双阈值Huber范数估计的图像正则化超分辨率算法

多帧图像超分辨率算法利用图像间的互补信息, 可以从一系列具有亚像素位移的低分辨率影像数据中重建出高分辨率图像. 在众多超分辨率算法中, 正则化方法以其求解病态问题的有效性而被广泛应用, 但在此类方法中, 最优估计算子的估计准确度对最后的重建结果有着较大的影响. 本文在现有正则化超分辨率重建算法的基础上, 提出了一种基于双阈值Huber范数的极大似然估计算子, 可以提高Huber范数对于阈值取值的容忍性和算子估计精度; 并给出了基于该算子的正则化超分辨率算法的迭代公式. 通过对仿真图像进行重建, 结果表明算法可有效地抑制各种噪声并保证重建效果; 同时将此算法应用于实际图像的超分辨率重建, 有效地提高了目标影像的空间分辨率. 关键词： 图像处理 图像重建 超分辨率 正则化     

Infrared super-resolution imaging method based on retina micro-motion

With the wide application of infrared focal plane arrays (IRFPA), military, aerospace, public security and other applications have higher and higher requirements on the spatial resolution of infrared images. However, traditional super-resolution imaging methods have increasingly unable to meet this requirement in technology. In this paper, we adopt the achievement that the human retina micro-motion is the important reason why the human has the hyperacuity ability. Based on the achievement, we bring forward an infrared super-resolution imaging method based on retina micro-motion. In the method, we use the piezoelectric ceramic equipment to control the infrared detector moving variably within a plane parallel to the focal plane. The motion direction is toward each other into a direction of 90°. In the four directions of the movement, we get four sub-images and generate a high spatial resolution infrared image by image interpolation method. In the process of the shifting movement of the detector, we set the threshold of the detector response and record the response time difference when adjacent pixel responses are up to the threshold. By the method, we get the object’s edges, enhance them in the high resolution infrared image and get the super-resolution infrared image. The experimental results show that our proposed super-resolution imaging methods can improve the spatial resolution of the infrared image effectively. The method will offer a new idea for the super-resolution reconstruction of infrared images.     

Real-time, continuous-wave terahertz imaging by use of a microbolometer focal-plane array

Real-time, continuous-wave terahertz imaging is demonstrated with a 10 mW, 2.52 THz (118.8 microm) far-infrared gas laser and a 160 x 120 element microbolometer camera. The microbolometer camera is designed for wavelengths of 7.5-14 microm but retains sensitivity at terahertz (THz) frequencies. The setup has no moving parts, and transmission-mode THz images can be obtained at the video rate of 60 frames/s. The peak signal-to-noise ratio is estimated to be 13 dB for a single frame of video, acquired in 16 ms. With this setup, THz imaging through a FedEx envelope is demonstrated, showing the feasibility of real-time mail screening.     

结合深度学习的非下采样剪切波遥感图像融合

遥感图像融合是指将不同传感器得到的具有不同观测特性的图像信息有选择、有策略地结合起来,以得到具有更优观测特性的新图像的方法。提出一种深度学习结合非下采样剪切波变换(NSST)的遥感图像融合算法,利用改进的超分辨率重建网络对多光谱图像(MS)进行空间分辨率增强,全色图像(PAN)参考重建后的多光谱图像的每个分量进行直方图匹配。将对应通道的图像进行NSST变换,分别得到低频子带和若干高频子带。低频子带通过使用基于梯度域的自适应加权平均规则来获得低频融合系数,高频子带采用局部空间频率最大值规则来获得高频融合系数,最后经逆NSST变换重构获得融合图像。对不同数据集中的City和Inland多光谱图像采用双三次插值方法进行上采样,作者提出算法的通用图像质量指数(UIQI)分别为0.988 6和0.932 1,光谱角映射(SAM)分别为1.872 1和2.143 2。实验结果表明,图像结构更加清晰,保存的光谱信息更加完整,融合图像质量优于对比算法,融合图像更利于人类视觉观察。     

视频判读系统分析

本文就光电测量提出了以CCD进行视频捕获,将获得的视频图象通过采集卡滤波、A/D转换为数字图象,存储在计算机内存中,根据具体要求选择相应的算法,由计算机对其进行分析处理.     

基于凸优化的傅里叶叠层成像技术研究

在傅里叶叠层成像（FPM）过程中采集的低分辨率图像会对重建图像质量产生直接影响,已有的研究提出用图像超分辨率重建技术和对低分辨率图像进行传统去噪处理的方法来解决该问题,但超分辨率重建的方法需要采集大量的原始图像,会加大采集端的时间损耗,而传统去噪算法会造成原始信息丢失,严重影响重构图像质量。因此论文引入凸优化算法,噪声图像的恢复可以通过求解一个凸优化模型来实现,并用迭代收缩阈值算法来求解该模型,算法中采用Barzilai-Borwein（BB）规则在每次迭代时初始化线搜索步长,加快收敛速度,选用软阈值函数,使图像去噪时原始信息丢失减少,最终重构图像的PSNR为27.634 6 dB,SSIM为0.926 1,所需处理时间为5.850 s,因此基于凸优化的傅里叶叠层成像技术具有时间损耗不大的情况下提高重构图像质量的优点。     

Videokymography: High-speed line scanning of vocal fold vibration

A digital technique for high-speed visualization of vibration, called videokymography, was developed and applied to the vocal folds. The system uses a modified video camera able to work in two modes: high-speed (nearly 8,000 images/s) and standard (50 images/s in CCIR norm). In the high-speed mode, the camera selects one active horizontal line (transverse to the glottis) from the whole laryngeal image. The successive line images are presented in real time on a commercial TV monitor, filling each video frame from top to bottom. The system makes it possible to observe left-right asymmetries, open quotient, propagation of mucosal waves, movement of the upper and, in the closing phase, the lower margins of the vocal folds, etc. The technique is suitable for further processing and quantification of recorded vibration.     

基于特征匹配的快速鲁棒数字稳像

针对手持移动摄像装置拍摄视频序列相邻帧间存在平移、小角度旋转运动,而且易受噪声、光照变化的影响等问题,提出一种基于优化Oriented FAST and rotated BRIEF(ORB)特征匹配的实时鲁棒电子稳像算法。对相邻帧预处理后用Oriented FAST算子检测特征点,再用Rotated BRIEF描述提取的特征点并采用近邻汉明距离匹配特征点对,然后采用级联滤波去除误匹配点对,最后使用迭代最小二乘法(ILSM)拟合模型参量进行运动补偿实现稳像。图像匹配测试和稳像实验结果表明:基于改进的ORB算法的电子稳像方法补偿每一帧的时间均小于0.1 s,定位精度可达亚像素级,能有效补偿帧间平移旋转运动,而且对噪声和光照变化有较强鲁棒性。经稳像处理后,实拍视频质量明显提高,峰值信噪比（PSNR）平均提高了10 db。