Distributed Cloud Deep Learning Architecture for Complex Image Analysis and Run-time Prediction Tool

Abstract

Hyperspectral imaging is a rare research tool and has been transformed into a commodity product found in a wide field. Currently, standard data processing methods that specialize in special hyperspectral accumulation structures are required. Also, with the advent of data collection and development in the field of sensory devices, it has rendered previous processing tools in vain. To manage this huge increase in the amount of data, a consistent cloud distribution method is required. Hyperspectral images (HSIs) have several spectral band channels that make the study very difficult. In this paper, an in-depth reading method of the novel with a modified autoencoder is proposed as a cloud-based use of HSI analysis, which provides a measure of lesser error rates and high accuracy of classification models. In line with this, a list of four tools has been proposed to calculate the actual number of workers, cores, and iterations required to achieve the desired accuracy for a specified amount of run-time. This will help cloud managers get a basic idea of computational needs and help them allocate resources more efficiently. The entire architecture was simulated on Spark servers and was verified experimentally by checking that the proposed architecture performs the function of efficient management and analysis of large HSI. © 2021, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.