Design of a computer game using an eye-tracking device for eye's activity rehabilitation

An eye mouse interface that can be used to operate a computer using the movement of the eyes is described. We developed this eye-tracking system for eye motion disability rehabilitation. When the user watches the screen of a computer, a charge-coupled device will catch images of the user's eye and transmit it to the computer. A program, based on a new cross-line tracking and stabilizing algorithm, will locate the center point of the pupil in the images. The calibration factors and energy factors are designed for coordinate mapping and blink functions. After the system transfers the coordinates of pupil center in the images to the display coordinate, it will determine the point at which the user gazed on the display, then transfer that location to the game subroutine program. We used this eye-tracking system as a joystick to play a game with an application program in a multimedia environment. The experimental results verify the feasibility and validity of this eye-game system and the rehabilitation effects for the user's visual movement.     

A new image processing method for evaluating the pupillary responses in a HMD-type eye-tracking device

In this paper, a new image processing method for evaluating the pupillary responses is described. This system is based on an eye-tracking system, using eye tracking and pattern recognition techniques with appropriate hardware and software. This pupillary response evaluation system includes a head-mounted display and a pinhole CCD camera. When the subject uses the head-mounted display to browse the screen of a computer, the CCD camera catches images of the subject's eye and transmits it to the computer. The program in the computer calculates the location and size of the pupil in the images. The pupil area calculation weighting function, visual fatigue detection, concentration detection, and eye/HMD slide compensation are included in the system. This allows the system to detect the pupil under different conditions. This system will know if anyone is using the system, then it evaluates the operating conditions of the subject, if the adjustment is correct, and guides the operator in using the system. The experimental results verified that this image system provides an economical and effective method for evaluating pupillary responses.     

一种根据布朗运动测量玻尔兹曼常量的新方法

利用显微镜和CCD图像采集工具对聚丙烯小球的布朗运动进行了研究,通过拍摄粒子运动图像并利用MATLAB程序进行图片处理,读取每一时刻布朗粒子的坐标.基于对大量数据的统计分析,计算出了玻尔兹曼常量,与理论值的相对误差约为4%.同时,验证了布朗运动位移服从正态分布以及粒子位移均方值与时间成正比的关系.     

A new data processing and calibration method for an eye-tracking device pronunciation system

In this paper, a new data processing and calibration method for a pronunciation system of an eye-tracking device is described. The eye-tracking device was created using both head mounted display (HMD) technology and remote operation capabilities. A pattern recognition computer program was used to distinguish the pupil position and calculate its coordinates.This system can be adapted to provide a digital speech function. A new method for processing the image of the eye in the PC-based system was also developed. With one video CCD camera and frame grabber analyzing a series of human pupil images while the subject is gazing at the screen, an auto-calibration algorithm is used to obtain the direction of the eye gaze in real time. The computers provide the speech sound according to the location where the eye gazes exceed 0.5 s. The availability of multipurpose in this eye-tracking system with very simple equipment will be reconfirmed for future advanced research.     

An eye-tracking and head-control system using movement increment-coordinate method

In this paper a novel design which combines an eye-tracking device with a head gesture control module is discussed. In the eye-tracking mode, the user wears goggles, and two tiny CCD cameras capture the eye image from the screen with the help of a video capture card. In the head gesture control mode, a light source projector is turned on, and the CCD camera detects the position of the light source. The locations of the spots on the screen and on the image pupil of the eye image are calculated, compared with the previous point and are subsequently mapped to the point on the screen. The movement increment-coordinate control is also discussed, which could improve the ease of use of the computer.     

A structured light-based system for human heads

The 3-D modeling of heads by using optical triangulation techniques is of great interest in the context of virtual reality, telecommunication and computer animation. This paper presents a structured light-based system mainly for human heads. It is named “3-D Laser Color Scanner” (3DLCS). A 3-D model is obtained with a cylindrical scan. The laser beam is switched on and off using a “light valve” and two successive CCD frames are captured, one with the laser line showing and one without. We can simplify the laser line extracting by subtracting these two images.In this system, two CCD cameras are used to avoid occlusion problems. Color information is read from the CCD when the laser light is absent. Since traditional laser scanner will miss the range data in the low-reflectance areas such as the hair area of human head, a shape from silhouette algorithm is presented to overcome this problem. Finally, we give some results using our system. The resulting model is suitable for many applications.     

A scribing laser marking system using DSP controller

Laser marking is an important branch of laser processing technology, and has been widely used in many fields of industry. Digital signal processor (DSP) is an incredibly fast and powerful microprocessor that can deal with signals in real time. Not only it is portable but has the ability to integrate the processing signals of subsystems. In this research, it is emphasized that we designed a scribing laser marking system based on a DSP in galvanometric marking method. To control the rotating angle of the galvanometric scanning mirrors more accurately, we combine the D/A converter of the DSP with the human–machine interface successfully. The whole marking system is not only inexpensive, but also miniaturized.     

X射线法测量的ICF靶丸参数的图像分析

 在ICF靶丸参数测量中，采用接触X射线显微辐射照相法获得靶核的X射线吸收底片图像，将该底片放置于显微镜下并用CCD获得了数字化图像。基于该数字化图像信息，编写了一套完整的计算机算法来计算靶参数。采用辐向平均法标定出靶中心，采用图像强度函数对半径的二阶微分来确定出靶层分界位置，计算精度约为0.2pixels。     

基于图像处理的钢坯侧面形状检测系统

基于机器视觉的钢坯侧面形状检测系统是由面阵CCD、激光发射器、激光接收器以及工控计算机等组成。通过面阵CCD拍摄到钢坯侧面图像,经过工业控制计算机进行数字图像处理分析和计算,提取钢坯侧面边缘高度和厚度,进而通过专用软件分析出钢坯头部和尾部的形状信息,从而有效地对入口钢坯翘头扣尾的异常状态发出报警信号。将异常信号传送给外围控制系统,以实现对钢坯的控制。     

视频判读系统分析

本文就光电测量提出了以CCD进行视频捕获,将获得的视频图象通过采集卡滤波、A/D转换为数字图象,存储在计算机内存中,根据具体要求选择相应的算法,由计算机对其进行分析处理.     

一种基于增强现实的室内漫游系统

提出了一种基于增强现实的室内漫游系统,在这个系统中用户通过HMD观察增强的视景。在这个视景中不但包含真实布景的图像,还包含有计算机生成的虚拟物体的图像。为了实现虚实场景之间的注册,在HMD上安装有两个摄像机:场景摄像机与跟踪摄像机。并且在用户所在房间的顶部安装了一系列的红外标志点,这些标志点的图像由跟踪摄像机获取,并通过位置估计算法计算用户头部的位置和姿态。另外,通过一对安装有ARtoolKit标志点的手套,实现用户与虚拟环境之间的交互。最后,一套海底漫系统被开发出来,以验证整个漫游系统的可用性     

基于嵌入式计算机的核测系统设计与应用

嵌入式系统以功能专一、集成度高、可靠性高、功耗低等优点,在核测量领域方面有着巨大的应用前景。设计基于嵌入式计算机PCM-3343核测量系统具有模拟信号采集、脉冲信号采集、开关量信号采集、模拟输出、开关量信号输出等功能,以触摸屏、液晶屏、键盘鼠标作为人机交互接口。根据功能要求,硬件上设计了基于PC104总线的具有相应功能电路模块,软件方面设计了基于FPGA的功能模块、基于Windows CE 6.0的嵌入式操作系统的应用程序和基于迪文触摸屏的软件界面。该系统在核电厂硼浓度计、反应堆集中数据采集系统、数字反应性仪等设备上均有良好应用。     

A rehabilitation training system with double-CCD camera and automatic spatial positioning technique

This study aimed to develop a computer game for machine vision integrated rehabilitation training system. The main function of the system is to allow users to conduct hand grasp-and-place movement through machine vision integration. Images are captured by a double-CCD camera, and then positioned on a large screen. After defining the right, left, upper, and lower boundaries of the captured images, an automatic spatial positioning technique is employed to obtain their correlation functions, and lookup tables are defined for cameras. This system can provide rehabilitation courses and games that allow users to exercise grasp-and-place movements, in order to improve their upper limb movement control, trigger trunk control, and balance training.     

水洞流场PIV显示与分析系统离轴测试校正

粒子图像测速技术(PIV)通过测量被测流场截面上每一位置点的速度,获得整个被测流场的信息.在PIV一般应用中所使用的照明激光片光与成像CCD装置的拍摄方向是垂直的,在某些应用场合受测试条件的限制,需要采用离轴方式进行测量,此时CCD成像方向与照明的激光片光不垂直,而是有一定夹角.离轴测试方式将对PIV系统的光学成像系统、示踪粒子选择和粒子图像处理带来影响.实验采用Scheimpflug离轴聚焦的方法对表面镀银高反射率的示踪粒子进行成像,通过调整成像透镜与CCD像面的夹角可获得清晰的粒子成像,并利用网格校正板和软件计算处理等方法有效校正了由于离轴测试带来的影响.     

应用时域相位解包方法的三维形貌测量系统

设计一套基于时域相位解包方法的三维形貌测量系统 ,克服了传统解包方法中的误差传播效应 ,可以应用于复杂物体表面及复杂环境下的三维形貌测量。由计算机生成光栅并通过液晶投影仪投射到待测物体表面 ,用CCD摄像机采集图像并通过图像采集卡存贮到计算机中进行处理 ,实现了测量的自动化 ,完成一次高精度的测量仅需几秒钟时间。用两个特殊的人头像完成的实验证明了系统的优越性     

Wave front reconstruction of Fresnel off-axis holograms with compensation of aberrations by means of phase-shifting digital holography

Off-axis holograms recorded with a CCD camera are numerically reconstructed in amplitude by calculating through the Fresnel–Kirchhoff integral. A phase-shifting Mach–Zehnder interferometer is used for recording four-quadrature phase-shifted off-axis holograms. The basic principle of this technique and its experimental verification are described. We show that the application of this algorithm allows for the suppression of the zero order of diffraction and of the twin image and that the contrast of the reconstructed images can be further enhanced by digital compensation of the aberrations introduced by the holographic recording system     

On-line conveyor belts inspection based on machine vision

Under the background that mining conveyor belts are prone to failure in operation, the on-line fault detection technique based on machine vision for conveyor belts is investigated. High-brightness linear light sources arranged to a vaulted shape provide light for a line-array CCD camera to capture high-quality belt images. A fast image segmentation algorithm is proposed to deal belt images on-line. The algorithm for detecting longitudinal rip and belt deviation which are serious threat to the mine safety production from binary belt images is presented. Then, an on-line visual belt inspection system is developed. The laboratory testing results testify the validity of the visual inspection system.     

菲涅耳非相干数字全息大视场研究

菲涅尔非相干相关全息术(Fresnel incoherent correlation holography, FINCH)通过空间光调制器(spatial light modulator, SLM)将来自物点的光波分解为曲率半径不同的两束自相干光,干涉条纹由CCD记录.由于受限于SLM与CCD的像素数目及像素尺寸, FINCH技术与光学全息术相比记录视场要小得多.本文通过对FINCH系统的记录过程进行理论分析,给出了SLM所能记录的视场角,说明通过调控加载在SLM上的双透镜光轴中心,能够扩大SLM的有效直径从而将SLM的有效记录范围增大2.77倍,有效扩大了系统的记录视场.搭建了非相干光反射式数字全息记录系统并对理论分析进行了实验验证,结果表明:在SLM上依次加载不同光轴中心位置的双透镜掩模进行FINCH记录及再现,将得到的各子图像拼接融合可以得到高分辨率大视场图像,为菲涅尔非相干全息术在高分辨大视场显微成像的进一步应用提供了有力支撑.     

一种多光路光轴平行性检测系统

介绍一种用于检测多光路光电设备光轴平行性的测试系统,该系统采用准直平行光管提供无穷远目标,并融合了CCD图像采集处理和计算机技术,通过计算目标靶十字中心和激光光斑中心之间在CCD上的像素跨距,计算出红外、可见光以及激光三轴相互间的平行性误差,系统的计算误差小于5。