Xiaoyan Jiang and Yongbin Gao and Zhijun Fang and Bo Huang“An End-to-End Human Segmentation by Region Proposed Fully Convolutional Network” IEEE Access

团队负责人姜晓燕老师的论文“An End-to-End Human Segmentation by Region Proposed Fully Convolutional Network” 被SCI期刊IEEE Access接收,祝贺!

Abstract:
Person segmentation in images has various applications, for example, smart home, human-computer interaction, and scene perception for self-driving cars, which are a key feature of the Internet of Things. Due to limitations in performance, such as accuracy and runtime, most traditional methods do not fulfill the practical requirements. Deep learning-based modern segmentation systems become prevalent. Fully convolutional network (FCN), as a classic image semantic segmentation method, directly optimizes the semantic map from the original image in a pixel-wise manner without using pixel-correlations or global object information. In this paper, we propose an efficient end-to-end person segmentation network structure fusing the person detection network with the FCN. The person detection network estimates the region of interest of persons and enforces the segmentation network to focus on the optimization of person segmentation. The loss function of the proposed network considers both the segmentation error and the detection bias error. In addition, the lightweight design of the detection network that optimizes only person bounding-box coordinates enables real-time person detection. The experimental comparison and analysis of several different networks on several datasets show the effectiveness of the proposed fusion strategy. The approach shows a promising practical application potential by fast running time and high segmentation accuracy.

Download: [官方链接]

Keywords: Person segmentation, fully convolutional network, object detection network, internet of things.

Photos:

Xiaoyan Jiang and Zhijun Fang and Neal N Xiong“Data Fusion-Based Multi-Object Tracking for Unconstrained Visual Sensor Networks” IEEE Access

团队负责人姜晓燕老师的论文“Data Fusion-Based Multi-Object Tracking for Unconstrained Visual Sensor Networks” 被SCI期刊IEEE Access接收,祝贺!

Abstract:
Camera node perception capability is one of the crucial issues for visual sensor networks, which belongs to the field of Internet of Things. Multi-object tracking is an important feature in analyzing object trajectories across multiple cameras, thus allowing synthesis of data and security analysis of images in various scenarios. Despite intensive research in the last decades, it remains challenging for tracking systems to perform in real-world situations. We therefore focus on key issues of multi-object state estimation for unconstrained multi-camera systems, e.g., data fusion of multiple sensors and data association. Unlike previous work that rely on camera network topology inference, we construct a graph from 2-D observations of all camera pairs without any assumption of network configuration. We apply the shortest path algorithm to the graph to find fused 3-D observation groups. Our approach is thus able to reject false positive reconstructions automatically, and also minimize computational complexity to guarantee feasible data fusion. Particle filters are applied as the 3-D tracker to form tracklets that integrate local features. These tracklets are modeled by a graph and linked into full tracks incorporating global spatial-temporal features. Experiments on the real-world PETS2009 S2/L1 sequence show the accuracy of our approach. Analyses of the different components of our approach provide meaningful insights for object tracking using multiple cameras. Evidence is provided for selecting the best view for a visual sensor network.

Download: [官方链接]

Keywords: Data fusion, graph theory, Internet of Things, particle filters, visual sensor networks.

Photos:

Xiaoyan Jiang and Marcel Simon and Yuan Yang and Joachim Denzler“Multi-marker tracking for large-scale X-ray stereo video data” Signal Processing-Image Communication

Abstract:
Analyzing large amounts of video data is one of the key challenges in the trend towards big data. In the field of medical research, for example, to analyze infected cardiac movements, stereo X-ray sequences of beating animal hearts implanted with radiopaque markers are recorded. As manual annotation of exact marker positions in large-scale recordings is time-consuming and infeasible, research on automatic tracking of multiple markers is a crucial task. We propose an efficient two-stage graph-based data association approach to tackle this problem. Difficulties of the sequences like 2D occlusions, low contrast, inhomogeneous movement, and inaccurate detections, are considered in the framework. Reconstructed 3D observations are modeled and connected using a weighted directed acyclic graph to obtain tracklets with high confidence via shortest path extraction. Afterwards, tracklets are linked into longer tracks by a tracklet graph in a similar manner while global features are adopted. The approach is validated on eight X-ray cardiac datasets of beating sheep hearts with various diseases. Outperforming standard tracking approaches, e.g. particle filter, the experimental results show a high accuracy comparable to human experts and efficiency in the meantime. The proposed approach is generic and can be directly applied to other video data as well.

团队负责人姜晓燕老师的论文“Multi-marker tracking for large-scale X-ray stereo video data”被SCI期刊《Signal Processing-Image Communication》 接收,祝贺!

Download: [官方链接]

Keywords: Multi-object tracking, Data association, Directed acyclic graph, X-ray, Big data.

Photos: