DeepCloud: Ground-Based Cloud Image Categorization Using Deep Convolutional Features

DeepCloud: Ground-Based Cloud Image Categorization Using Deep Convolutional Features

Accurate ground-based cloud image categorization is a critical but challenging task that has not been well addressed. One of the essential issues that affect the performance is to extract the representative visual features. Nearly all of the existing methods rely on the hand-crafted descriptors (e.g., local binary patterns, CENsus TRsansform hISTogram, and scale-invariant feature transform). Their limited discriminative power indeed leads to the unsatisfactory performance. To alleviate this, we propose “DeepCloud” as a novel cloud image feature extraction approach by resorting to the deep convolutional visual features. In the recent years, the deep convolutional neural network (CNN) has achieved the promising results in lots of computer vision and image understanding fields. Nevertheless, it has not been applied to cloud image classification yet. Thus, we actually pay the first effort to fill this blank. Since cloud image classification can be attributed to a multi-instance learning problem, simply employing the convolutional features within CNN cannot achieve the promising result. To address this, Fisher vector encoding is applied to executing the spatial feature aggregation and high-dimensional feature mapping on the raw deep convolutional features. Moreover, the hierarchical convolutional layers are used simultaneously to capture the fine textural characteristics and high-level semantic information in the unified manner. To further leverage the performance, a cloud pattern mining and selection method are also proposed. It targets at finding the discriminative local patterns to better distinguish the different kinds of clouds. The experiments on a challenging ground-based cloud image data set demonstrate the superiority of the proposition over the state-of-the-art methods.
DeepCloud: Ground-Based Cloud Image Categorization Using Deep Convolutional Features
Published in: IEEE Transactions on Geoscience and Remote Sensing Volume: 55Issue: 10, Oct. 2017 )
Date of Publication: 30 June 2017

What we provide:

  • Complete Research Assistance

Technology Involved:-



  • Complete Code of this paper
  • Complete Code of the approach to be propose
  • A document containing complete explanation of code and research approach
  • All materials used for this research
  • Solution to all your queries related to your work