Abstract
Our aim is to provide a pixel-wise instance-level labeling of a monocular image in the context of autonomous driving. We build on recent work [32] that trained a convolutional neural net to predict instance labeling in local image patches, extracted exhaustively in a stride from an image. A simple Markov random field model using several heuristics was then proposed in [32] to derive a globally consistent instance labeling of the image. In this paper, we formulate the global labeling problem with a novel densely connected Markov random field and show how to encode various intuitive potentials in a way that is amenable to efficient mean field inference [15]. Our potentials encode the compatibility between the global labeling and the patch-level predictions, contrast-sensitive smoothness as well as the fact that separate regions form different instances. Our experiments on the challenging KITTI benchmark [8] demonstrate that our method achieves a significant performance boost over the baseline [32].
Keywords
Markov random fieldComputer scienceENCODEArtificial intelligenceConvolutional neural networkConditional random fieldPattern recognition (psychology)Image segmentationSegmentationHeuristicsMarkov chainInferencePixelComputer visionMachine learning
Affiliated Institutions
Related Publications
Monocular Object Instance Segmentation and Depth Ordering with CNNs
In this paper we tackle the problem of instance-level segmentation and depth ordering from a single monocular image. Towards this goal, we take advantage of convolutional neural...
DenseASPP for Semantic Segmentation in Street Scenes
Semantic image segmentation is a basic street scene understanding task in autonomous driving, where each pixel in a high resolution image is categorized into a set of semantic l...
Markov random fields with efficient approximations
Markov Random Fields (MRFs) can be used for a wide variety of vision problems. In this paper we focus on MRFs with two-valued clique potentials, which form a generalized Potts m...
End-to-End Instance Segmentation with Recurrent Attention
While convolutional neural networks have gained impressive success recently in solving structured prediction problems such as semantic segmentation, it remains a challenge to di...
The mean field theory in EM procedures for blind Markov random field image restoration
A Markov random field (MRF) model-based EM (expectation-maximization) procedure for simultaneously estimating the degradation model and restoring the image is described. The MRF...
Publication Info
- Year
- 2016
- Type
- preprint
- Citations
- 206
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
206
OpenAlex
Cite This
Ziyu Zhang,
Sanja Fidler,
Raquel Urtasun
(2016).
Instance-Level Segmentation for Autonomous Driving with Deep Densely Connected MRFs.
.
https://doi.org/10.1109/cvpr.2016.79
Identifiers
- DOI
- 10.1109/cvpr.2016.79