Feature generation based on relation learning and image partition for occluded person re-identification

In order to solve the challenging tasks of person re-identification(Re-ID) in occluded scenarios, we propose a novel approach which divides local units by forming high-level semantic information of pedestrians and generates features of occluded parts. The approach uses CNN and pose estimation to extract the feature map and key points, and a graph convolutional network to learn the relation of key points. Specifically, we design a Generating Local Part (GLP) module to divide the feature map into different units. Based on different occluded conditions, the partition mode of GLP has high flexibility and variability. The features of the non-occluded parts are clustered into an intermediate node, and then the spatially correlated features of the occluded parts are generated according to the de-clustering operation. We conduct experiments on both the occluded and the holistic datasets to demonstrate its effectiveness.     

Transformer-based global–local feature learning model for occluded person re-identification

Most recent occluded person re-identification (re-ID) methods usually learn global features directly from pedestrian images, or use additional pose estimation and semantic analysis model to learn local features, while ignoring the relationship between global and local features, thus incorrectly retrieving different pedestrians with similar attributes as the same pedestrian. Moreover, learning local features using auxiliary models brings additional computational cost. In this work, we propose a Transformer-based dual-branch feature learning model for occluded person re-ID. Firstly, we propose a global–local feature interaction module to learn the relationship between global and local features, thus enhancing the richness of information in pedestrian features. Secondly, we randomly erase local areas in the input image to simulate the real occlusion situation, thereby improving the model’s adaptability to the occlusion scene. Finally, a spilt group module is introduced to explore the local distinguishing features of pedestrian. Numerous experiments validate the effectiveness of our proposed method.     

HSP-MFL: A High-level Semantic Property driven Multi-task Feature Learning Network for unsupervised person Re-ID

Unsupervised person re-identification aims to distinguish different pedestrians from discriminative representations on the basis of unlabeled data. Currently, most unsupervised Re-ID approaches explore visual representations to generate pseudo-labels for model’s training, which may suffer from background noise and semantic loss. To tackle this problem, this paper proposes a High-level Semantic Property driven Multi-task Feature Learning Network (HSP-MFL) to firstly introduce three high-level semantic properties for unsupervised person Re-ID. Technically, we design a novel Multiple Feature Fusion Module (MFFM) to deeply explore the complex correlation among multiple semantic and visual features to capture the discriminative feature cues, as well as a multi-task training scheme to generate robust fusion features. The architecture is quite simple and does not consume extra labeling costs. Extensive experiments on three datasets demonstrate that both high-level semantic properties and multi-task learning are effective in performance improvement, yielding SOTA mAPs for unsupervised person Re-ID.     

Fine-grained-based multi-feature fusion for occluded person re-identification

Many previous occluded person re-identification(re-ID) methods try to use additional clues (pose estimation or semantic parsing models) to focus on non-occluded regions. However, these methods extremely rely on the performance of additional clues and often capture pedestrian features by designing complex modules. In this work, we propose a simple Fine-Grained Multi-Feature Fusion Network (FGMFN) to extract discriminative features, which is a dual-branch structure consisting of global feature branch and partial feature branch. Firstly, we utilize a chunking strategy to extract multi-granularity features to make the pedestrian information contained in it more comprehensive. Secondly, a spatial transformer network is introduced to localize the pedestrian’s upper body, and then introduce a relation-aware attention module to explore the fine-grained information. Finally, we fuse the features obtained from the two branches to obtain a more robust pedestrian representation. Extensive experiments verify the effectiveness of our method under the occlusion scenario.     

Privacy-Preserving Image Template Sharing Using Contrastive Learning

With the recent developments of Machine Learning as a Service (MLaaS), various privacy concerns have been raised. Having access to the user’s data, an adversary can design attacks with different objectives, namely, reconstruction or attribute inference attacks. In this paper, we propose two different training frameworks for an image classification task while preserving user data privacy against the two aforementioned attacks. In both frameworks, an encoder is trained with contrastive loss, providing a superior utility-privacy trade-off. In the reconstruction attack scenario, a supervised contrastive loss was employed to provide maximal discrimination for the targeted classification task. The encoded features are further perturbed using the obfuscator module to remove all redundant information. Moreover, the obfuscator module is jointly trained with a classifier to minimize the correlation between private feature representation and original data while retaining the model utility for the classification. For the attribute inference attack, we aim to provide a representation of data that is independent of the sensitive attribute. Therefore, the encoder is trained with supervised and private contrastive loss. Furthermore, an obfuscator module is trained in an adversarial manner to preserve the privacy of sensitive attributes while maintaining the classification performance on the target attribute. The reported results on the CelebA dataset validate the effectiveness of the proposed frameworks.     

基于通道注意力机制和多尺度卷积的行人重识别

针对真实环境中由于复杂背景和物体遮挡、角度变换、行人姿态变化带来的行人重识别(person re-identification,person re-ID) 问题,设计了基于通道注意力(efficient channel attention,ECA) 机制和多尺度卷积(poly-scale convolution,PSConv) 的行人重识别模型。首先利用残差网络提取全局特征,在网络末端加入基于ECA机制及PSConv的特征融合模块,将全局特征和该模块提取的全局特征进行融合,之后将新的全局特征进行分割得到局部特征,最后将新的全局特征和分割得到的局部特征融合得到最终特征,并计算损失函数。模型在Market1501和DukeMTMC-reID 数据集上进行实验验证。在Market1501数据集中,Rank-1和平均精度均值分别达到94.3%和85.2%,在DukeMTMC-reID数据集中,上述两参数分别达到86.3%和75.4%。实验结果可知,该模型可应对实际环境中的复杂情况,增强行人特征的辨别力,有效提高行人重识别的准确率和精度。     

本土IC封测业面临的挑战

2006年中国大陆封测业销售额496．6亿元,比2005年增长了44％,占2006年中国IC产业销售额的50．8％,未达到国际公认的设计业：制造业：封测业=30％：40％：30％的要求。目前大陆IC封装以中低端DIP、SOP（SSOP、TSOP）、QFP（LQFP、TQFP）为主,正在向高附加值、多引脚数QFP、MCM（MCP）、BGA、CSP、SiP、PiP、PoP等中高端封装过渡。近年来,本土封装在技术上的某些领域有所突破,如江阴长电FBP、南通富士通MCM（MCP）、BGA、中电科技第13所CBGA等,但是仍面临着全球IC大厂、IC封测厂、产能、技术和人才等多方面的挑战,只有正视这些挑战,采取积极措施,克服弊端,才能进步。文章最后得出结论,未来5年,中国IC封测业有可能成为全球最大的半导体封测基地。     

基于注意力机制与局部关联特征的行人重识别北大核心CSCD

由于行人在真实场景下易受到背景、遮挡、姿态等问题的影响,为获取行人图像中更具辨别能力的特征,提出一种基于注意力机制和局部关联特征的行人重识别方法。首先,在网络框架中嵌入注意力模块以关注图像中表达能力强的特征;然后,利用图像中相邻区域的关联得到局部关联特征,并结合全局特征。本文方法在Market1501和DukeMTMC-ReID数据集上进行实验,Rank-1指标分别达到了95.3%和90.1%。结果证明,本文方法能充分获取判别力强的特征信息,使模型具有较强的识别能力。     

基于二阶混合注意力的行人重识别

基于注意力机制的行人重识别方法更多利用图像中 一阶信息,忽略了特征中二阶信息 ,不能挖掘特征图之间的相关性和细粒度信息。提出一种基于二阶混合注意力的行人重 识别算法(second-order mixed attention module,SMAN)。二阶混合注意力模块(second-order mixed attention module,SOMA)由二阶通道注意力(second-order channel attention,SOCA)和二阶空间注意力模 块(second-order information,SOSA)组成,该方法将全局协方差池函数嵌入到SOCA和SOSA模块中,学习特征中二阶信息 。SOCA模块学习特征图之间相关性,SOSA模块则重新为特征图分配权重,关注特征图空间域 的细粒度信息。SMAN算法在Market-1501和 DukeMTMC-ReID数据集上的首位准确率分别 为 94.3%和87.1%,mAP分别达到85.7%和74.5%,同时使用类激活图验证SOMA模块的影响 ,实验表 明SMAN算法充分利用特征图的通道域和空间域中二阶信息。算法的性能优于现有的一些基于 注意力机制行人重识别方法,甚至接近某些优秀的方法。     

基于连续模型的人员疏散仿真分析

行人流连续模型直观地反映人群疏散过程中的疏散特征,本文基于行人流连续模型。研究行人在典型疏散场景下的疏散特征．在COMSOL中建立行人流连续模型及其方程,通过编写MATLAB代码,实现了连续模型及其循环求解框架．利用快速扫描法求解Eikonal方程得到背景场值,在每一步迭代循环中将背景场值作为模型的初始变量导入,调用COMSOL计算模块求解模型的瞬态控制方程．通过两个标准算例,重现了典型的行人流自组织现象,验证了连续模型的合理性．结果表明,本文的疏散仿真分析模型和计算程序是可靠的,疏散仿真分析可以为实际工程中的人员疏散方案的制定以及平面设计与安全布置等方面提供技术支撑．