Abstract

Abstract Deep convolutional neural networks have performed remarkably well on many Computer Vision tasks. However, these networks are heavily reliant on big data to avoid overfitting. Overfitting refers to the phenomenon when a network learns a function with very high variance such as to perfectly model the training data. Unfortunately, many application domains do not have access to big data, such as medical image analysis. This survey focuses on Data Augmentation, a data-space solution to the problem of limited data. Data Augmentation encompasses a suite of techniques that enhance the size and quality of training datasets such that better Deep Learning models can be built using them. The image augmentation algorithms discussed in this survey include geometric transformations, color space augmentations, kernel filters, mixing images, random erasing, feature space augmentation, adversarial training, generative adversarial networks, neural style transfer, and meta-learning. The application of augmentation methods based on GANs are heavily covered in this survey. In addition to augmentation techniques, this paper will briefly discuss other characteristics of Data Augmentation such as test-time augmentation, resolution impact, final dataset size, and curriculum learning. This survey will present existing methods for Data Augmentation, promising developments, and meta-level decisions for implementing Data Augmentation. Readers will understand how Data Augmentation can improve the performance of their models and expand limited datasets to take advantage of the capabilities of big data.

Keywords

Computer scienceOverfittingDeep learningArtificial intelligenceMachine learningBig dataArtificial neural networkTransfer of learningConvolutional neural networkBenchmark (surveying)Data scienceData mining

Affiliated Institutions

Related Publications

Fractional Max-Pooling

Convolutional networks almost always incorporate some form of spatial pooling, and very often it is alpha times alpha max-pooling with alpha=2. Max-pooling act on the hidden lay...

2014 arXiv (Cornell University) 335 citations

Network In Network

Abstract: We propose a novel deep network structure called In Network (NIN) to enhance model discriminability for local patches within the receptive field. The conventional con...

2014 arXiv (Cornell University) 1037 citations

Publication Info

Year
2019
Type
article
Volume
6
Issue
1
Citations
11041
Access
Closed

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

11041
OpenAlex
251
Influential

Cite This

Connor Shorten, Taghi M. Khoshgoftaar (2019). A survey on Image Data Augmentation for Deep Learning. Journal Of Big Data , 6 (1) . https://doi.org/10.1186/s40537-019-0197-0

Identifiers

DOI
10.1186/s40537-019-0197-0

Data Quality

Data completeness: 81%