Evolution of curves on a surface driven by the geodesic curvature and external force

We study a flow of closed curves on a given graph surface driven by the geodesic curvature and external force. Using vertical projection of surface curves to the plane we show how the geodesic curvature-driven flow can be reduced to a solution of a fully nonlinear system of parabolic differential equations. We show that the flow of surface curves is gradient-like, i.e. there exists a Lyapunov functional nonincreasing along trajectories. Special attention is placed on the analysis of closed stationary surface curves. We present sufficient conditions for their dynamic stability. Several computational examples of evolution of surface curves driven by the geodesic curvature and external force on various surfaces are presented in this article. We also discuss a link between the geodesic flow and the edge detection problem arising from the image segmentation theory.     

A geometric flow approach for region-based image segmentation-theoretical analysis

In this paper, we analyze the well-posedness of an image segmentation model. The main idea of that segmentation model is to minimize one energy functional by evolving a given piecewise constant image towards the image to be segmented. The evolution is controlled by a serial of mappings, which can be represented by B-spline basis functions. The evolution terminates when the energy is below a given threshold. We prove that the correspondence between two images in the segmentation model is an injective and surjective mapping under appropriate conditions. We further prove that the solution of the segmentation model exists using the direct method in the calculus of variations. These results provide the theoretical support for that segmentation model.     

Local histograms and image occlusion models

The local histogram transform of an image is a data cube that consists of the histograms of the pixel values that lie within a fixed neighborhood of any given pixel location. Such transforms are useful in image processing applications such as classification and segmentation, especially when dealing with textures that can be distinguished by the distributions of their pixel intensities and colors. We, in particular, use them to identify and delineate biological tissues found in histology images obtained via digital microscopy. In this paper, we introduce a mathematical formalism that rigorously justifies the use of local histograms for such purposes. We begin by discussing how local histograms can be computed as systems of convolutions. We then introduce probabilistic image models that can emulate textures one routinely encounters in histology images. These models are rooted in the concept of image occlusion. A simple model may, for example, generate textures by randomly speckling opaque blobs of one color on top of blobs of another. Under certain conditions, we show that, on average, the local histograms of such model-generated-textures are convex combinations of more basic distributions. We further provide several methods for creating models that meet these conditions; the textures generated by some of these models resemble those found in histology images. Taken together, these results suggest that histology textures can be analyzed by decomposing their local histograms into more basic components. We conclude with a proof-of-concept segmentation-and-classification algorithm based on these ideas, supported by numerical experimentation.     

Using Conventional Edge Detectors and Postsmoothing for Segmentation of Spotted Microarray Images

Segmentation of spotted microarray images is important in generating gene expression data. It aims to distinguish foreground pixels from background pixels for a given spot of a microarray image. Edge detection in the image processing literature is a closely related research area, because spot boundary curves separating foregrounds from backgrounds in a microarray image can be treated as edges. However, for generating gene expression data, segmentation methods for handling spotted microarray images are required to classify each pixel as either a foreground or a background pixel; most conventional edge detectors in the image processing literature do not have this classification property, because their detected edge pixels are often scattered in the whole design space and consequently the foreground or background pixels are not defined. In this article, we propose a general postsmoothing procedure for estimating spot boundary curves from the detected edge pixels of conventional edge detectors, such that these conventional edge detectors together with the proposed postsmoothing procedure can be used for segmentation of spotted microarray images. Numerical studies show that this proposal works well in applications.

Datasets and computer code are available in the online supplements.     

From restoration by topological gradient to medical image segmentation via an asymptotic expansion

The aim of this article is to present an application of the topological asymptotic expansion to the medical image segmentation problem. We first recall the classical variational of the image restoration problem, and its resolution by topological asymptotic analysis in which the identification of the diffusion coefficient can be seen as an inverse conductivity problem. The conductivity is set either to a small positive coefficient (on the edge set), or to its inverse (elsewhere). In this paper a technique based on a power series expansion of the solution to the image restoration problem with respect to this small coefficient is introduced. By considering the limit when this coefficient goes to zero, we obtain a segmented image, but some numerical issues do not allow a too small coefficient. The idea is to use the series expansion to approximate the asymptotic solution with several solutions corresponding to positive (larger than a threshold) conductivity coefficients via a quadrature formula. We illustrate this approach with some numerical results on medical images.     

Detection and quantification of pore,solid and gravel spaces in CT images of a 3D soil sample

In this study, we scanned the core of a cylindrical soil sample (60mm diameter and 100mm height) by X-ray Computed Tomography (CT) producing 300 consecutive 2D digital images with 16-bit gray level depth and a resolution of 32 microns (image size 676 × 676 pixels). The aim of this work was to determine the geometry and spatial distribution of the elements in a sample, related in this case to pore, solid and gravel, inside each 2D image for the latter reconstruction of the corresponding 3D approximation of the elements using the total set of 300 soil images. Therefore, it was possible to determine the relative percentage of each element present in each 2D image and, correspondingly, the structure and total percentage in the 3D reconstruction. The identification of elements in the 2D image slices was very well accomplished using three standard segmentation algorithms: k-Means, Fuzzy c-Means and Otsu multilevel. In order to compare and evaluate the quality of results, a non-uniformity (NU) measure was applied such that low values were indicative of homogeneous regions. Due to the depth of the greyscale of the images, the results were very similar with comparable statistics and homogeneity (NU values) among the detected materials of the three algorithms. That suggests that the pore, solid and gravel spaces were very well identified, and this is reflected through their connectivity in the 3D reconstruction. Additionally, the gray level depth was reduced to 8 bits and the same study was undertaken. In this case, the quality of results was comparable to the previous ones, as the number of elements and NU values were very close. However, this also depends largely on the high resolution of the images. Thereby, the soil sample of this work was very well characterized using the simplest and most common algorithms for image segmentation thanks to the high contrast and resolution, and regardless the depth of the grey-level.     

Family constraining of iterative algorithms

In constraining iterative processes, the algorithmic operator of the iterative process is pre-multiplied by a constraining operator at each iterative step. This enables the constrained algorithm, besides solving the original problem, also to find a solution that incorporates some prior knowledge about the solution. This approach has been useful in image restoration and other image processing situations when a single constraining operator was used. In the field of image reconstruction from projections a priori information about the original image, such as smoothness or that it belongs to a certain closed convex set, may be used to improve the reconstruction quality. We study here constraining of iterative processes by a family of operators rather than by a single operator.     

A fast level set model of multi‐atlas labels fusion for 3D MRI tissues segmentation with application of split Bregman method

In this paper, we propose a new fast level set model of multi‐atlas labels fusion for 3D magnetic resonance imaging (MRI) tissues segmentation. The proposed model is aimed at segmenting regions of interest in MR images, especially the tissues such as the amygdala, the caudate, the hippocampus, the pallidum, the putamen, and the thalamus. We first define a new energy functional by taking full advantage of an image data term, a length term, and a label fusion term. Different from using the region‐scalable fitting image data term and length term directly, we define a new image data term and a new length term, which is also incorporated with an edge detect function. By introducing a spatially weight function into the label fusion term, segmentation sensitivity to warped images can be largely improved. Furthermore, the special structure of the new energy functional ensures the application of the split Bregman method, which is a significant highlight and can improve segmentation efficiency of the proposed model. Because of these promotions, several good characters, such as accuracy, efficiency, and robustness have been exhibited in experimental results. Quantitative and qualitative comparisons with other methods have demonstrated the superior advantages of the proposed model.     

基于小波多分辨率分析和改进窄带法的C-V水平集图像分割模型

本文研究了基于小波分析改进的C-V模型图像分割问题.利用小波多分辨率分析和改进的窄带水平集方法,获得了比传统C-V模型分割速度更快、准确度更高、算法复杂度更低的分割结果.推广了C-V水平集模型如何快速准确地分割灰度不均匀的图像和窄带水平集法等结果.     

New normalized nonlocal hybrid level set method for image segmentation

This article introduces a new normalized nonlocal hybrid level set method for image segmentation. Due to intensity overlapping, blurred edges with complex backgrounds, simple intensity and texture information, such kind of image segmentation is still a challenging task. The proposed method uses both the region and boundary information to achieve accurate segmentation results. The region information can help to identify rough region of interest and prevent the boundary leakage problem. It makes use of normalized nonlocal comparisons between pairs of patches in each region, and a heuristic intensity model is proposed to suppress irrelevant strong edges and constrain the segmentation. The boundary information can help to detect the precise location of the target object, it makes use of the geodesic active contour model to obtain the target boundary. The corresponding variational segmentation problem is implemented by a level set formulation. We use an internal energy term for geometric active contours to penalize the deviation of the level set function from a signed distance function. At last, experimental results on synthetic images and real images are shown in the paper with promising results.     

Image segmentation by level set evolution with region consistency constraint

Image segmentation is a key and fundamental problem in image processing, computer graphics, and computer vision. Level set based method for image segmentation is used widely for its topology flexibility and proper mathematical formulation. However, poor performance of existing level set models on noisy images and weak boundary limit its application in image segmentation. In this paper, we present a region consistency constraint term to measure the regional consistency on both sides of the boundary, this term defines the boundary of the image within a range, and hence increases the stability of the level set model. The term can make existing level set models significantly improve the efficiency of the algorithms on segmenting images with noise and weak boundary. Furthermore, this constraint term can make edge-based level set model overcome the defect of sensitivity to the initial contour. The experimental results show that our algorithm is efficient for image segmentation and outperform the existing state-of-art methods regarding images with noise and weak boundary.     

Multi-Label Markov Random Fields as an Efficient and Effective Tool for Image Segmentation,Total Variations and Regularization

One of the classical optimization models for image segmentation is the well known Markov Random Fields (MRF) model. This model is a discrete optimization problem, which is shown here to formulate many continuous models used in image segmentation. In spite of the presence of MRF in the literature, the dominant perception has been that the model is not effective for image segmentation. We show here that the reason for the non-effectiveness is due to the lack of access to the optimal solution. Instead of solving optimally, heuristics have been engaged. Those heuristic methods cannot guarantee the quality of the solution nor the running time of the algorithm. Worse still, heuristics do not link directly the input functions and parameters to the output thus obscuring what would be ideal choices of parameters and functions which are to be selected by users in each particular application context.We describe here how MRF can model and solve efficiently several known continuous models for image segmentation and describe briefly a very efficient polynomial time algorithm, which is provably fastest possible, to solve optimally the MRF problem. The MRF algorithm is enhanced here compared to the algorithm in Hochbaum (2001) by allowing the set of assigned labels to be any discrete set. Other enhancements include dynamic features that permit adjustments to the input parameters and solves optimally for these changes with minimal computation time. Several new theoretical results on the properties of the algorithm are proved here and are demonstrated for images in the context of medical and biological imaging. An interactive implementation tool for MRF is described, and its performance and flexibility in practice are demonstrated via computational experiments.We conclude that many continuous models common in image segmentation have discrete analogs to various special cases of MRF and as such are solved optimally and efficiently, rather than with the use of continuous techniques, such as PDE methods, which restrict the type of functions used and furthermore, can only guarantee convergence to a local minimum.     

Two-Stage Image Segmentation Scheme Based on Inexact Alternating Direction Method

Image segmentation is a fundamental problem in both image processing and computer vision with numerous applications. In this paper, we propose a two-stage image segmentation scheme based on inexact alternating direction method. Specifically, we first solve the convex variant of the Mumford-Shah model to get the smooth solution, and the segmentation is then obtained by applying the K-means clustering method to the solution. Some numerical comparisons are arranged to show the effectiveness of our proposed schemes by segmenting many kinds of images such as artificial images, natural images, and brain MRI images.     

基于直方图初始化的有效的多区域Mumford-Shah图像分割方法（英文）

The Mumford-Shah energy functional is a successful image segmentation model. It is a non-convex variational problem and lacks of good initialization techniques so far. In this paper, motivated by the fact that image histogram is a combination of several Gaussian distributions, and their centers can be considered as approximations of cluster centers, we introduce a histogram-based initialization method to compute the cluster centers. With this technique, we then devise an effective multi-region Mumford-Shah image segmentation method, and adopt the recent proximal alternating minimization method to solve the minimization problem. Experiments indicate that our histogram initialization method is more robust than existing methods,and our segmentation method is very effective for both gray and color images.     

3D Anisotropic Diffusion on GPUs by Closed-Form Local Tensor Computations

We present an efficient implementation of volumetric anisotropic image diffusion filters on modern programmable graphics processing units (GPUs), where the mathematics behind volumetric diffusion is effectively reduced to the diffusion in 2D images. We hereby avoid the computational bottleneck of a time consuming eigenvalue decomposition in $\mathbb{R}^3$. Instead, we use a projection of the Hessian matrix along the surface normal onto the tangent plane of the local isodensity surface and solve for the remaining two tangent space eigenvectors. We derive closed formulas to achieve this and prevent the GPU code from branching. We show that our most complex volumetric anisotropic diffusion filters gain a speed up of more than 600 compared to a CPU solution.     

低分辨率医学图像的多图谱分割方法

基于多图谱的图像分割方法因其分割精度高和鲁棒性强,在医学图像分割领域被广泛研究,主要包含图像配准和标签融合两个步骤.目前对多图谱分割方法的研究通常都是在图谱图像和待分割目标图像具有相同分辨率的情况下展开的.然而,由于受图像采集时间,采集设备等影响,临床实践中采集的影像大多是低分辨率数据,使得目前在影像研究中广泛使用的方法无法有效应用于临床实践.因此,针对这一问题,我们结合图像超分辨率恢复方法,提出了精确鲁棒的低分辨率医学图像的多图谱分割方法,实验结果显示提出的方法显著地提高了多图谱分割方法的分割精度.     

A Nash-game approach to joint image restoration and segmentation

We propose a game-theoretic approach to simultaneously restore and segment noisy images. We define two players: one is restoration, with the image intensity as strategy, and the other is segmentation with contours as strategy. Cost functions are the classical relevant ones for restoration and segmentation, respectively. The two players play a static game with complete information, and we consider as solution to the game the so-called Nash equilibrium. For the computation of this equilibrium we present an iterative method with relaxation. The results of numerical experiments performed on some real images show the relevance and efficiency of the proposed algorithm.     

On Plateau’s problem for soap films with a bound on energy

We prove existence and almost everywhere regularity of an area minimizing soap film with a bound on energy spanning a given Jordan curve in Euclidean space R ³.The energy of a film is defined to be the sum of its surface area and the length of its singular branched set. The class of surfaces over which area is minimized includes images of disks, integral currents, nonorientable surfaces and soap films as observed by Plateau with a bound on energy. Our area minimizing solution is shown to be a smooth surface away from its branched set which is a union of Lipschitz Jordan curves of finite total length.     

Using a level set approach for image segmentation under interpolation conditions

In this paper, we propose a new 2D segmentation model including geometric constraints, namely interpolation conditions, to detect objects in a given image. We propose to apply the deformable models to an explicit function using the level set approach (Osher and Sethian [24]); so, we avoid the classical problem of parameterization of both segmentation representation and interpolation conditions. Furthermore, we allow this representation to have topological changes. A problem of energy minimization on a closed subspace of a Hilbert space is defined and introducing Lagrange multipliers enables us to formulate the corresponding variational problem with interpolation conditions. Thus the explicit function evolves, while minimizing the energy and it stops evolving when the desired outlines of the object to detect are reached. The stopping term, as in the classical deformable models, is related to the gradient of the image. Numerical results are given. AMS subject classification 74G65, 46-xx, 92C55