A novel device for head gesture measurement system in combination with eye-controlled human–machine interface

This study describes the design and combination of an eye-controlled and a head-controlled human–machine interface system. This system is a highly effective human–machine interface, detecting head movement by changing positions and numbers of light sources on the head. When the users utilize the head-mounted display to browse a computer screen, the system will catch the images of the user's eyes with CCD cameras, which can also measure the angle and position of the light sources. In the eye-tracking system, the program in the computer will locate each center point of the pupils in the images, and record the information on moving traces and pupil diameters. In the head gesture measurement system, the user wears a double-source eyeglass frame, so the system catches images of the user's head by using a CCD camera in front of the user. The computer program will locate the center point of the head, transferring it to the screen coordinates, and then the user can control the cursor by head motions. We combine the eye-controlled and head-controlled human–machine interface system for the virtual reality applications.     

An eye behavior measuring device for VR system

This work presents an eye-tracking and pupil size-measuring device that interfaces with a computer for applications useful in psychometry, ophthalmology, physiology and virtual reality (VR) systems. This system utilizes a change-coupled device (CCD) camera, appropriate lenses, PC with frame grabber and a DSP unit with various types of VR equipment, i.e., HMD, simulator or LCD projection device. The digital signal processing unit is used to calculate the average brightness and contrast of the VR video image. A CCD camera with various attachments can be mounted on various VR systems to capture the human eye image for testing. An image capture card and a personal computer are used to analyze the test image. From the eye digital image, the computer obtains data on the pupil size and a trace of the tested eye. A pattern recognition computer program and five measurement parameters are used to distinguish the position of the pupil, calculate the pupil location coordinate and analyze the physical conditions of the user. These data can be plotted against the average brightness and contrast of the VR video image in real time. This information is shown on the screen of a personal computer and used for cross-link analysis. This eye-tracking interface can determine the position of a subject's pupil and map that position into a display point on a computer screen. The pupil size and location data versus the average brightness and contrast of a VR video image are computed in real time.     

A new data processing and calibration method for an eye-tracking device pronunciation system

In this paper, a new data processing and calibration method for a pronunciation system of an eye-tracking device is described. The eye-tracking device was created using both head mounted display (HMD) technology and remote operation capabilities. A pattern recognition computer program was used to distinguish the pupil position and calculate its coordinates.This system can be adapted to provide a digital speech function. A new method for processing the image of the eye in the PC-based system was also developed. With one video CCD camera and frame grabber analyzing a series of human pupil images while the subject is gazing at the screen, an auto-calibration algorithm is used to obtain the direction of the eye gaze in real time. The computers provide the speech sound according to the location where the eye gazes exceed 0.5 s. The availability of multipurpose in this eye-tracking system with very simple equipment will be reconfirmed for future advanced research.     

A new image processing method for evaluating the pupillary responses in a HMD-type eye-tracking device

In this paper, a new image processing method for evaluating the pupillary responses is described. This system is based on an eye-tracking system, using eye tracking and pattern recognition techniques with appropriate hardware and software. This pupillary response evaluation system includes a head-mounted display and a pinhole CCD camera. When the subject uses the head-mounted display to browse the screen of a computer, the CCD camera catches images of the subject's eye and transmits it to the computer. The program in the computer calculates the location and size of the pupil in the images. The pupil area calculation weighting function, visual fatigue detection, concentration detection, and eye/HMD slide compensation are included in the system. This allows the system to detect the pupil under different conditions. This system will know if anyone is using the system, then it evaluates the operating conditions of the subject, if the adjustment is correct, and guides the operator in using the system. The experimental results verified that this image system provides an economical and effective method for evaluating pupillary responses.     

一种基于光学干涉原理的图像分割方法

 介绍了基于光学干涉原理的图像分割理论算法。在计算机上模拟一个均匀相干光源、一个滤波器和一个接收屏。选择强度 相位的转换曲线，将输入图像的强度信息转化成伪相位信息，并显示在滤波器上。利用光源照明滤波器上的相位图，在接收屏上得到其干涉条纹。再通过选择阈值对干涉图进行分割得到二值图，从而实现输入图像的边缘分割。计算结果表明，该方法得到的图像轮廓，与Sobel 算子效果相当。与实验结果对比分析可得，改善硬件并实现良好的分割效果的关键在于：控制光源的相干长度，或增大液晶的点阵间隔，并利用CCD相机和计算机相连，对干涉图进行二值化。     

CCD摄像法采集激光光斑图像方法研究

为了测量大尺寸激光光斑图像,对CCD摄像法采集漫反射的激光光斑图像方法进行了研究。采用CCD摄像机捕获经漫反板反射的激光光斑图像,光斑图像进行去背景处理后,根据系统噪声特性对光斑图像进行提取,再利用透视投影原理对畸变的光斑图像进行了校正,最后根据人眼对彩色图像敏感的特性,利用灰度级一彩色变换法对光斑图像进行了伪彩色处理。结果表明,CCD漫反射法能够准确地测量大尺寸激光光斑图像。     

Line-laser-based yarn shadow sensing break sensor

In this paper, a line-laser-based yarn break sensor is proposed. In the proposed sensor, yarns are illuminated by a line laser placed on one side of the yarn plane. A screen is placed on the other side and the image formed on the screen is detected by a camera. The total number of yarns is compared with the total number of shadows formed by the yarns or the total number of light spots formed due to the distances between yarns. If the total number of yarns to be detected is greater than the total number of shadows or light spots formed due to the distances between the yarns, the sensor warns of breaking. In the proposed method, evaluation is made using only light spots or shadows formed by the yarns. Consequently, the yarn type, structure, color, or dimensions do not affect the results.Design principles of the line-laser-based yarn break sensor, which consists of a screen and a Charged Coupled Device (CCD) camera, are presented. The screen displays the shadows formed by the yarns and the light spots formed due to the distances between them. The CCD camera detects the image on the screen. Formation of the shadows by the yarns is explained and an analytical formula that expresses the dimensions of the shadows is obtained. The detection area of the sensor is expressed relative to the total number of yarns, yarn thickness, and distances between the yarns. Line laser radiation angle and light spot intensity equations are obtained relative to the width of the detection area and the height of the line laser placement. The screen length is obtained relative to the number of yarns and the placement of the laser, the yarn plane, and the screen.Different placement situations of the line laser (transmitter), the screen, and the CCD camera (receiver) relative to the yarn plane are discussed. An experimental setup is developed to test the system. The image formed on the screen is studied.     

全塑料光学生命探测仪关键技术研究

制作了单丝直径为250 μm、像素数为4096、长度为15 m的塑料光纤传像束. 研究表明: 原始图像经过该15 m长的光纤传像束后, 仍有25%保留, 完全可以满足图像目视观察或CCD图像采集的需要. 以此光纤传像束为核心部件, 分别设计、制作了目视式生命探测仪样机, 以及与CCD、图像采集卡、笔记本电脑一体化的智能型光学生命探测仪样机. 最后, 演示了该系统对被困人员搜救的有效性. 此系统不但可用于地震、矿难等场合被埋人员的搜索, 也可用于高压强电磁干扰环境、保密部门、易燃易爆等特殊场合的视频监视.     

像管极限分辨力客观测试评价方法的研究

根据圆孔夫朗和费衍射理论,从波长和能量的角度分析比较了人眼和CCD成像系统的极限分辨力,计算了荧光屏辐射光中的红外成分对CCD成像系统的影响。分析结果表明,在一定条件下,采用CCD成像系统进行的像管分辨力测试结果可以客观评价像管的极限分辨能力。     

基于激光透射法测量平板玻璃的厚度

为实现平板玻璃厚度的非接触检测,采用透射法由线激光光源组成双向对称的测量光路,以线阵CCD作为传感器,采用USB图像采集卡实时提取图像,根据自适应边界阈值定位,通过灰度重心法提取目标像素中心.结果表明该方法厚度测量值在误差允许范围内,满足测量要求.     

一种全场三维共焦检测的新方法

提出了一种利用微光学阵更合成器件实现全场三维面形并行检测、记录的共焦方法。此方法的关键是，在共焦系统中引入一一微光学耻列合成器件来产生一点光源阵列，实现了对同一一剖面同时并行检测，并首次采用了ＣＣＤ面阵像元取代上孔光阑直接截取三维信息光强。本文讨论了该方法的三信息检测原理，响应关系，给出了初步的实验结果和三维重构图。     

Design of a computer game using an eye-tracking device for eye's activity rehabilitation

An eye mouse interface that can be used to operate a computer using the movement of the eyes is described. We developed this eye-tracking system for eye motion disability rehabilitation. When the user watches the screen of a computer, a charge-coupled device will catch images of the user's eye and transmit it to the computer. A program, based on a new cross-line tracking and stabilizing algorithm, will locate the center point of the pupil in the images. The calibration factors and energy factors are designed for coordinate mapping and blink functions. After the system transfers the coordinates of pupil center in the images to the display coordinate, it will determine the point at which the user gazed on the display, then transfer that location to the game subroutine program. We used this eye-tracking system as a joystick to play a game with an application program in a multimedia environment. The experimental results verify the feasibility and validity of this eye-game system and the rehabilitation effects for the user's visual movement.     

基于液晶局部选通系统的硬件算法的研究

鉴于CCD相机在强光照射时会产生光晕,CCD敏感面像素之间互相影响,进而导致成像模糊不清,提出一种克服光晕现象的像质增强算法.利用HTPS(高温聚硅)液晶具有可实时控制各像素光透过率的特性,使液晶和主CCD由光纤光锥进行像素一对一耦合.用Cyclone II芯片作为图像处理单元,测光CCD采集图像信息,控制液晶改善图像质量.实验结果表明,该系统能够精确控制HTPS液晶上每个像素的透过率,使CCD相机能在强光下正常成像,其灰度分辨能力提高了1倍,从而提高了图像的清晰度.     

光子计数法测量微光像增强器背景噪声分布特性

针对微光像增强器噪声特性,理论上分析了微光像增强器背景光子噪声特点。设计了采用光子计数法及使用类针孔微弱光照度计对微光像增强器的背景噪声进行测量的方案。在三代微光像增强器信噪比测量装置中,采用类针孔微弱光照度计对微光像增强器无光照时荧光屏上Ф0.2 mm光斑的照度进行了测量实验。对于空间特性,以荧光屏中心点为圆心的同心圆上照度值不均匀性小于1%;对于时间特性,在微光像增强器工作大约270 min后,荧光屏中心点照度值会达到稳定状态。以各个空间点和时间点照度值为基础分析了无光照时像增强器背景噪声在时间和空间的分布特性,为评价微光像增强器的噪声特性提供了数据支持。     

高精度CCD室内立靶测试系统设计

针对室内靶道,设计了一种基于双线阵CCD图像采集的立靶密集度测试系统,论述了系统的工作原理和组成。提出了一种新的数学模型,有效地抑制了传统测试方法中对两个相机相对位置的精度要求,配合阵列LED背射主动光源,通过一体化靶架设计,提高了测试精度,极大地减少了系统布靶时间。实弹射击试验验证了系统的工作性能。结果表明,所研制的测试系统布靶快捷,在1m×1m测试范围内,立靶坐标偏差均方根小于1mm,能够实现连发测试。     

Analysis of Purkinje images as an effective method for estimation of intraocular lens implant location in the eyeball

The implantation of an artificial intraocular lens (IOL) into a capsular bag in place of an extracted natural, but nontransparent lens is a standard therapy method in the case of cataract. Any decentration or tilt of the IOL can cause a deterioration of the retinal image quality, thus decreasing the vision quality. The analysis of the relative position of Purkinje images being a reflection of the point light source from the refracting surfaces of the eyeball determines the location of IOL inside the eye and thus enables to state its wrong or correct location. The paper describes the Purkinje experimental setup consisting of an illuminator (several infrared LEDs arranged in a circle), an imaging telecentric lens and image recording CCD camera and reports details of the system calibration The usefulness of the experimental setup has been proven both in laboratory conditions using artificial model of the eyeball and in measurements on human subjects. Simulations of the retinal image with different decentrations or tilts are shown.     

CCD尺寸测量光学系统设计原理

介绍ＣＣＤ尺寸测量光学系统的设计原理．重点分析远心光路中的像点弥散、一维光纤列阵照明系统及利用像点弥散斑评价ＣＣＤ光学系统像质的方法。给出一种ＣＣＤ测量光学系统设计实例及其像质评价结果．     

基于暗瞳图像的人眼视线估计

虹膜外边缘受眼睑遮挡较为严重时, 会给虹膜中心的准确提取造成很大的困难. 为此, 提出利用放置在相机轴外的红外光源产生的暗瞳图像估计瞳孔中心, 该方法避免了提取虹膜外边缘遇到的遮挡问题. 首先利用角膜反射光斑在相机像面中的位置估计角膜所在球体中心的三维空间坐标, 作为眼球的平动信息; 然后考察瞳孔中心与角膜球体中心在相机成像面投影位置的相对偏移, 作为眼球的转动信息; 最后利用人工神经网络完成视线特征向量与注视点坐标间的映射. 在人眼区域定位的问题上, 利用两部大视场相机, 采用自适应增强算法和主动表观模型算法实现眼部区域的准确定位, 该步骤可以将提取反射光斑和瞳孔中心需要考虑的图像区域限定在较小的范围内. 实验结果表明, 本文视线估计方法在水平方向上的平均误差为0.62°, 在竖直方向上的平均误差为1.05°, 是解决视线点估计的有效方法. 关键词： 暗瞳 人工神经网络 自适应增强 主动表观模型     

头盔显示器视差自动测量中眼位点的自动对准

自动测量头盔显示器的视差时，用CCD相机取代人眼的主观读取，由于机器视觉不如人眼灵活，CCD相机在人眼观察点才能确保移动时采集的图像是完整的，从而保证全视场的视差测量。该文提出采用模式搜索法在头盔显示器光学平面内实现CCD相机自动对准人眼观察点(眼位点)，从而实现头盔显示器全视场视差的自动测量。对该自动测量系统的测量原理，以及CCD相机自动对准眼位点的实现过程进行了详细论述与说明，对测量精度与效率，对准精度与重复定位精度进行了实验分析。实验结果表明，该方法能够快速、准确、自动地对准眼位点，定位精度为±0.071°，与摆头法测量视差系统进行对比实验，全视场视差测量效率高，重复精度高。     

基于CCD传感的激光粒度测试技术研究

颗粒测试在工业生产和科学研究中涉及的领域非常广泛,常用的颗粒粒度及其分布的测试方法是激光粒度测试法,其具有测试精度高、测量速度快、重复性好和可测粒径范围宽等突出优点。CCD传感器有灵敏度高、分辨率高、噪声小和较大的动态范围等优点,其作为激光粒度仪的探测器提高光强分辨率的应用已经很普遍了。为提高测量精度,通过对CCD传感技术的研究,应用图像处理的方法来设计光电探测器,搭建了基于米氏散射原理的激光粒度测试系统。实验结果表明,用CCD传感器采集光散射图像,再对图像进行处理,D50与D10误差在6%之内,D90误差在1%之内,降低了测量的重复误差。