Will jpeg compression affect training and classification using Convolutional Neural Networks

user_7384658 0
Viewed 5302

We are working with a company that has more than 2 million images in jpeg. They want to collect more images. The purpose of the images are machine classification and to find small objects like bolts and small water leaks. the number of images are high, but the examples for training are small, maybe only 100 samples or less.

Our suggestion to the company is to store the data in the original 10 or 12 bit png/tiff format uncompressed. they want to use the jpeg format since they can collect more data in a shorter time (4 images pre second) and do not need all that disk space.

does anyone know how storage of jpeg compared to png format will affect both training of samples and then finding/classification later?

I have searched with Google. It returns many answers on how you can improve jpeg quality by using deep learning. Rest of the answers is about how to process cats and dogs using libraries on the internet. There is one article that say that jpeg compression affects the recognition, but very little about what sort of images, what type of objects you look for etc.

When you look for large objects like dogs and cats, you will have many features, curves, colours, histograms and other features that can be used. Looking for very small objects with few characteristics is more complex.

Does anyone know of any article about this subject? Key question: Should I store my images in png or lossless tiff or can I use jpeg compression for later use in deep learning?

convolutional-neural-network deep-learning machine-learning image
3 Answers

TL;DR: Yes, but not that much. Unless you are considering <10 JPEG quality parameter, you should be safe.

Longer version:

I highly recommend an article called Understanding How Image Quality Affects Deep Neural Networks. As you may guess authors checked how different distortions (JPEG, JPEG 2000, blur, and noise) affect the performance of usual CNN architectures (VGG, AlexNet, GoogLeNet).

Apparently, all tested nets perform in a similar way and only severe JPEG compressions (quality < 10) can hurt them.

The only thing is that nothing from ResNet family was tested, but I don't see why it can be drastically different.

user_22240810

It shouldn't matter what format you store in if the data is same. But of course, Jpeg is lossy and might lose some information and this might give lower accuracies (but not significant change) which might as well be due to random weight initialization

But it shouldn't matter much as the loss is not too much and the images are still recognizable to human eyes. In fact, if there are so many images perhaps jpeg is a better idea to store as it takes less space.

user_32369250
Related