A novel device for head gesture measurement system in combination with eye-controlled human–machine interface

This study describes the design and combination of an eye-controlled and a head-controlled human–machine interface system. This system is a highly effective human–machine interface, detecting head movement by changing positions and numbers of light sources on the head. When the users utilize the head-mounted display to browse a computer screen, the system will catch the images of the user's eyes with CCD cameras, which can also measure the angle and position of the light sources. In the eye-tracking system, the program in the computer will locate each center point of the pupils in the images, and record the information on moving traces and pupil diameters. In the head gesture measurement system, the user wears a double-source eyeglass frame, so the system catches images of the user's head by using a CCD camera in front of the user. The computer program will locate the center point of the head, transferring it to the screen coordinates, and then the user can control the cursor by head motions. We combine the eye-controlled and head-controlled human–machine interface system for the virtual reality applications.     

A new data processing and calibration method for an eye-tracking device pronunciation system

In this paper, a new data processing and calibration method for a pronunciation system of an eye-tracking device is described. The eye-tracking device was created using both head mounted display (HMD) technology and remote operation capabilities. A pattern recognition computer program was used to distinguish the pupil position and calculate its coordinates.This system can be adapted to provide a digital speech function. A new method for processing the image of the eye in the PC-based system was also developed. With one video CCD camera and frame grabber analyzing a series of human pupil images while the subject is gazing at the screen, an auto-calibration algorithm is used to obtain the direction of the eye gaze in real time. The computers provide the speech sound according to the location where the eye gazes exceed 0.5 s. The availability of multipurpose in this eye-tracking system with very simple equipment will be reconfirmed for future advanced research.     

A new image processing method for evaluating the pupillary responses in a HMD-type eye-tracking device

In this paper, a new image processing method for evaluating the pupillary responses is described. This system is based on an eye-tracking system, using eye tracking and pattern recognition techniques with appropriate hardware and software. This pupillary response evaluation system includes a head-mounted display and a pinhole CCD camera. When the subject uses the head-mounted display to browse the screen of a computer, the CCD camera catches images of the subject's eye and transmits it to the computer. The program in the computer calculates the location and size of the pupil in the images. The pupil area calculation weighting function, visual fatigue detection, concentration detection, and eye/HMD slide compensation are included in the system. This allows the system to detect the pupil under different conditions. This system will know if anyone is using the system, then it evaluates the operating conditions of the subject, if the adjustment is correct, and guides the operator in using the system. The experimental results verified that this image system provides an economical and effective method for evaluating pupillary responses.     

An eye behavior measuring device for VR system

This work presents an eye-tracking and pupil size-measuring device that interfaces with a computer for applications useful in psychometry, ophthalmology, physiology and virtual reality (VR) systems. This system utilizes a change-coupled device (CCD) camera, appropriate lenses, PC with frame grabber and a DSP unit with various types of VR equipment, i.e., HMD, simulator or LCD projection device. The digital signal processing unit is used to calculate the average brightness and contrast of the VR video image. A CCD camera with various attachments can be mounted on various VR systems to capture the human eye image for testing. An image capture card and a personal computer are used to analyze the test image. From the eye digital image, the computer obtains data on the pupil size and a trace of the tested eye. A pattern recognition computer program and five measurement parameters are used to distinguish the position of the pupil, calculate the pupil location coordinate and analyze the physical conditions of the user. These data can be plotted against the average brightness and contrast of the VR video image in real time. This information is shown on the screen of a personal computer and used for cross-link analysis. This eye-tracking interface can determine the position of a subject's pupil and map that position into a display point on a computer screen. The pupil size and location data versus the average brightness and contrast of a VR video image are computed in real time.     

An eye-tracking and head-control system using movement increment-coordinate method

In this paper a novel design which combines an eye-tracking device with a head gesture control module is discussed. In the eye-tracking mode, the user wears goggles, and two tiny CCD cameras capture the eye image from the screen with the help of a video capture card. In the head gesture control mode, a light source projector is turned on, and the CCD camera detects the position of the light source. The locations of the spots on the screen and on the image pupil of the eye image are calculated, compared with the previous point and are subsequently mapped to the point on the screen. The movement increment-coordinate control is also discussed, which could improve the ease of use of the computer.     

A rehabilitation training system with double-CCD camera and automatic spatial positioning technique

This study aimed to develop a computer game for machine vision integrated rehabilitation training system. The main function of the system is to allow users to conduct hand grasp-and-place movement through machine vision integration. Images are captured by a double-CCD camera, and then positioned on a large screen. After defining the right, left, upper, and lower boundaries of the captured images, an automatic spatial positioning technique is employed to obtain their correlation functions, and lookup tables are defined for cameras. This system can provide rehabilitation courses and games that allow users to exercise grasp-and-place movements, in order to improve their upper limb movement control, trigger trunk control, and balance training.     

基于暗瞳图像的人眼视线估计

虹膜外边缘受眼睑遮挡较为严重时, 会给虹膜中心的准确提取造成很大的困难. 为此, 提出利用放置在相机轴外的红外光源产生的暗瞳图像估计瞳孔中心, 该方法避免了提取虹膜外边缘遇到的遮挡问题. 首先利用角膜反射光斑在相机像面中的位置估计角膜所在球体中心的三维空间坐标, 作为眼球的平动信息; 然后考察瞳孔中心与角膜球体中心在相机成像面投影位置的相对偏移, 作为眼球的转动信息; 最后利用人工神经网络完成视线特征向量与注视点坐标间的映射. 在人眼区域定位的问题上, 利用两部大视场相机, 采用自适应增强算法和主动表观模型算法实现眼部区域的准确定位, 该步骤可以将提取反射光斑和瞳孔中心需要考虑的图像区域限定在较小的范围内. 实验结果表明, 本文视线估计方法在水平方向上的平均误差为0.62°, 在竖直方向上的平均误差为1.05°, 是解决视线点估计的有效方法. 关键词： 暗瞳 人工神经网络 自适应增强 主动表观模型     

主客观结合人眼波前像差测量系统的设计与实验

设计了主客观方法相结合的人眼波前像差测量系统。该系统的控制部分以工控机为中心,实现了对离焦补偿装置、LCD视标显示装置和可变形镜驱动器的控制。使用Hartmann-Shack传感器对人眼出瞳的波前像差进行测量,光路中加入了能够显示各种视标和测试图案的LCD,从而考虑到了主观调节对人眼像差的影响,能够对人眼的视觉质量进行全面衡量,实现了客观测量和主观测量在光路中的结合。使用该系统分别测量得到了模拟眼和活体人眼的波前像差,并对主客观测量结果进行了信息融合,能够为个性化的人眼屈光矫正提供有用的依据。     

折/衍混合增强现实头盔显示器光学系统设计

利用衍射光学元件独有的负色散性质和可实现光波面任意相位调制的特点 ,在光学系统中引入衍射面 ,设计了出瞳距离为 2 6mm ,出瞳直径为 12mm ,视场角为 2 0°(H)× 15 .4°(V)的用于增强现实的折 /衍混合穿透式双通道头盔显示器的光学系统。设计的系统内、外两个光通道的光能量利用率分别达到 1/4和 1/2。系统分辨力适合采用分辨率为 80 0× 6 0 0、像元尺寸为 33μm的图像源。设计结果 ,系统镜头直径小于 4 6mm ,满足用于双目显示的要求。设计结果表明 ,该系统不仅在结构上满足使用者因素的要求 ,而且成像质量接近衍射极限 ,具有很高的分辨率 ,色差和畸变非常小。设计结果完全满足用于增强现实的要求。     

视线跟踪输入及其图像处理

介绍了视线跟踪输入人机交互系统的原理和构成,特别是数字图像处理技术在其中的应用。以辅助光源在人眼角膜上的普尔钦斑点及瞳孔偏移为依据,通过对实验照片进行图像处理及分析来检测和判断视线输入方向。提出了在使用过程中在头部微小变动时视线输入方向的修正方法。同时也阐述了通过眼睛盯视实现对计算机外设的控制。结果表明,视线跟踪输入实现了人眼与计算机之间的实时信息交互,为今后以眼动输入作为人机交互手段的自适应平台的开发打下了一定的基础。     

一种新颖的智能眼镜光学系统设计方法

提出采用Fresnel微结构的曲面波导微投影光学系统眼镜设计思想,理论分析了所提光学系统的成像原理,给出了光学设计方法,并运用该方法设计了一套样机,曲面波导板近眼表面(即前表面)曲率半径为140.0 mm,后表面曲率半径为143.5 mm,中心厚度为1.7 mm,材料选PMMA (即有机玻璃),微型显示器选0.23″硅基OLED显示屏,分辨率640×480(象素),出瞳直径选为8 mm,眼点距约为18 mm,视场角9.6°(H)×7.2°(V),调制传递函数(MTF)在空间分辨率30 lp/mm时,中心视场MTF接近0.45,全视场大于0.2。从而验证了该方法的可行性。     

Eye pupil detection system using an ensemble of regression forest and fast radial symmetry transform with a near infrared camera

In this paper, we focus on pupil center detection in various video sequences that include head poses and changes in illumination. To detect the pupil center, we first find four eye landmarks in each eye by using cascade local regression based on a regression forest. Based on the rough location of the pupil, a fast radial symmetric transform is applied using the previously found pupil location to rearrange the fine pupil center. As the final step, the pupil displacement is estimated between the previous frame and the current frame to maintain the level of accuracy against a false locating result occurring in a particular frame. We generated a new face dataset, called Keimyung University pupil detection (KMUPD), with infrared camera. The proposed method was successfully applied to the KMUPD dataset, and the results indicate that its pupil center detection capability is better than that of other methods and with a shorter processing time.     

用计算机模拟点电荷在二维平面上的静电场

二维平面上的点电荷的静电场是静电场问题的基础，作者独立开发了软件用以模拟，此程序由用户决定点电荷的所有参数，快速地生成视阈内的等势线与电场线，使用户方便的获得电场直观印象，并可以得到任意点的电势与场强，该程序操作简单，对于学生、教师的学与教都能起到很好的辅助作用。     

Hybrid diffractive-refractive 67°-diagonal field of view optical see-through head-mounted display

Design of a wide-angle off-axis optical see-through head-mounted display (HMD) becomes a challenge since its weight and size are constrained by human factors. Diffractive optics has the potential to play a key role in several areas of head-mounted display. They can reduce size and weight while providing some unique functions that would be difficult to implement with conventional refractive optics. This paper presents a 67°-diagonal field of view, wide spectral band hybrid diffractive-refractive see-through head-mounted display (HMD) using off-axis optics. It possesses a 10 mm exit pupil and a 22 mm eye relief, and satisfies the requirements of human factors. The whole optical system is suitable for a 20 mm-diagonal color liquid crystal display (LCD) with XGA resolution.     

60°对角视场的折/衍混合透视型头盔显示器

分析了离轴、大视场角透视型头盔显示器光学系统的设计方法，提出了利用衍射光学的独特性质设计了大视场、宽波段、离轴折/衍混合透视型头盔显示器光学系统.该系统具有10 mm的出瞳直径和22 mm的出瞳距离，且满足人因素要求.另外，该系统色差仅14 μm，系统口径小于46 mm，满足双目视觉要求.整个系统适合具有15 mm对角直径SVGA分辩率的彩色液晶显示器（LCD）.     

激光跟踪测量系统中的光学误差分析

论述了在激光跟踪测量系统中由跟踪转镜机构和猫眼逆反射器产生的光学误差,并分析了它们对测量结果产生的影响。通过仿真得到了"计算中心点"的坐标。利用光学理论计算了跟踪转镜机构入射光束偏心和镜面偏心产生的误差。从猫眼的球度误差、材料折射率误差和光学中心误差几个方面对猫眼产生的光学误差进行了分析。结果表明,猫眼的误差对测量精度影响较大,因此要求猫眼精度要高。     

视频图象分析处理系统应用研究

本文描述了一种基于视频图象的分析处理系统,结合工程应用实践,提出利用微机终端显示器作为象框坐标测量器,实现对视频图象的分析处理.不仅具有丰富的数字图象处理功能,还可对原始图象进行增强和细分等处理.     

超轻小型投影式头盔显示系统折-衍混合物镜设计

在一个7片物镜的基础上,设计出一个折射和一个5片镜的折衍混合投影物镜系统,并给出了详细设计过程及性能评价。系统针对33.02 mm(1.3英寸)微显示器设计,视场为56°,出瞳直径为10 mm,出瞳距离为25mm。设计的折射系统和折衍混合系统的镜头直径分别为28 mm和22.4 mm,重量分别只有33 g和11.9 g,且最大畸变分别为3.2%和0.17%,分辨率满足SXGA显示模式。两系统均满足投影式头盔显示器在交互环境、医学可视化训练和数字化个兵等领域的使用要求。     

基于ybar-y图的光学结构计算方法研究

本文基于y_bar-y图, 建立了计算光学系统一阶结构的数学模型, 并利用粒子群优化算法对模型进行了求解, 可以自动优化出各种光学系统的一阶结构. 编写了一套含图形用户界面(GUI)的软件, 将光学系统的基本设计要求进行处理后导入GUI, 求解之后利用商用光学设计软件如ZEMAX等, 将一阶结构转换为实际透镜结构, 然后经过透镜优化, 就可以设计出满足要求的光学系统. 根据本文所提出的光学结构计算方法, 首先进行了1300万像素手机摄像物镜的设计, 该物镜使用了4片非球面, 各项性能指标能够满足设计要求. 然后设计出一套头盔显示光学系统的目镜, 使用了两片非球面透镜实现了90°的视场角, 其他的性能指标也都满足要求. 两类光学系统的设计实例验证了该方法是一种可靠的光学系统一阶结构获取方法.     

51单片机控制人眼角膜半径测量

叙述利用５１单片机来控制人眼角膜半径的测量原理，给出了设计程序，该方法可以实现测量的自动化及数显功能，并能存储被测人眼角膜半径值，屈光度值及双眼的屈光度差值，通过微型打印机可将所需数据输出。