SlideShare a Scribd company logo
1 of 10
Download to read offline
International Journal of Electrical and Computer Engineering (IJECE)
Vol. 13, No. 6, December 2023, pp. 7115~7124
ISSN: 2088-8708, DOI: 10.11591/ijece.v13i6.pp7115-7124 ๏ฒ 7115
Journal homepage: http://ijece.iaescore.com
Visualization of hyperspectral images on parallel and
distributed platform: Apache Spark
Abdelali Zbakh1
, Mohamed Taj Bennani2
, Adnan Souri3
, Outman El Hichami4
1
National School of Business and Management Tangier (ENCGT), ER-MSI, Abdelmalek Essaรขdi University, Tetouan, Morocco
2
LPAIS Laboratory, Computing Science Department, Faculty of Sciences Dhar El Mahraz Fez, Sidi Mohamed Ben Abdellah University,
Fez, Morocco
3
New Technology Trends for Innovation, Faculty of Sciences Tetouan, Abdelmalek Essaรขdi University, Tetouan, Morocco
4
Applied Mathematics and Computer Sciences Team, Higher Normal School, Abdelmalek Essaadi University, Tetouan, Morocco
Article Info ABSTRACT
Article history:
Received Jan 2, 2023
Revised May 3, 2023
Accepted Jun 4, 2023
The field of hyperspectral image storage and processing has undergone a
remarkable evolution in recent years. The visualization of these images
represents a challenge as the number of bands exceeds three bands, since
direct visualization using the trivial system red, green and blue (RGB) or hue,
saturation and lightness (HSL) is not feasible. One potential solution to
resolve this problem is the reduction of the dimensionality of the image to
three dimensions and thereafter assigning each dimension to a color.
Conventional tools and algorithms have become incapable of producing
results within a reasonable time. In this paper, we present a new distributed
method of visualization of hyperspectral image based on the principal
component analysis (PCA) and implemented in a distributed parallel
environment (Apache Spark). The visualization of the big hyperspectral
images with the proposed method is made in a smaller time and with the same
performance as the classical method of visualization.
Keywords:
Dimension reduction
Hyperspectral
MapReduce
Principal component analysis
Spark platform
Visualization
This is an open access article under the CC BY-SA license.
Corresponding Author:
Abdelali Zbakh
National School of Business and Management Tangier (ENCGT), ER-MSI, Abdelmalek Essaรขdi University
Tetouan, Morocco
Email: a.zbakh@uae.ac.ma
1. INTRODUCTION
Currently, digital display devices produce a color image for the human eye using a combination of
three primitive colors. So, a classic red, green and blue (RGB) color image is a combination of three layers
(bands): RGB. A hue, saturation and lightness (HSL) color image is a combination of: HSL [1]. On the contrary,
we find hyperspectral images composed of hundreds of layers (bands). A hyperspectral image can be described
as a three-dimensional data cube consisting of two spatial dimensions and one spectral dimension. In this
representation, each pixel contains a spectrum of wavelengths within the visible-near infrared range, spanning
from 400 to 1,400 nanometers.
Hyperspectral imaging is frequently used in the field of remote sensing, environment monitoring [2],
[3], polarimetric imaging, land cover classification [4], [5] and multimodal medical imaging. In astronomy, for
example, hyperspectral imagery is used to archive soil and space observations. In medical imaging,
hyperspectral imaging is used for the detection of diseases such as cancer [6].
Hyperspectral imaging produces high-dimensional data where each pixel in the image is represented
by a spectrum of measurements across many different wavelengths. However, the high dimensionality of this
data can make it challenging to analyze and interpret. Now, how to visualize a hyperspectral cube and give the
user, not usually specialist, a synthetic view of the data contained in the image with the minimum possible loss,
๏ฒ ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124
7116
and facilitate the interpretation of the image. Among the first solutions proposed is to visualize all the cube in
the form of a video sequence, each layer of the cube is represented by an image. However, when we work in
the plan and with a lot of hyperspectral images of large spectral dimensions, this solution remains difficult to
practice.
So, to visualize a hyperspectral image in color and in the plan with the number of spectral bands which
exceeds three bands, it is often necessary to reduce the dimensionality of hyperspectral images and obtain, from
the original image, a composite image that consists of three bands. Dimension reduction techniques such as
principal component analysis (PCA) or t-distributed stochastic neighbor embedding (t-SNE) can be employed
to transform the high-dimensional hyperspectral data into a lower-dimensional space while preserving as much
of the information as possible. By reducing the number of dimensions, it becomes easier to visualize and
interpret the data. By visualizing the reduced-dimensional data, researchers and analysts can gain insights into
the underlying patterns and relationships in the data, which can help with tasks such as identifying and
classifying different materials or objects in the scene. This, in turn, can have applications in fields such as
remote sensing, agriculture, and environmental monitoring. Several methods of visualizing hyperspectral
images exist: Methods based on spectral band selection [7]โ€“[9], methods based on weighting [5], methods
based on optimization [6] and projection-based methods [10].
To bypass the computational problem posed by the processing of large hyperspectral cube [11], [12].
We will use an open source framework named Apache Spark [13], which distributes data storage in memory
random-access memory (RAM) and processes the data in parallel. This choice has given us a considerable gain
in the time of visualization of a hyperspectral image.
The rest of this paper is structured in the following manner: in section 2, we will present the related
work on the hyperspectral image visualization methods. Next, in section 3, we will describe our parallel
distributed visualization approach based on the PCA projection method. In section 4, we will experiment
our approach on several free hyperspectral images. And we finish the paper with a conclusion and
perspectives.
2. RELATED WORKS OF HYPERSPECTRAL IMAGE VISUALIZATION METHODS
In the field of hyperspectral imaging, there are several methods used to visualize a hyperspectral
image. The literature review revealed that the four main methods used for this purpose are based on band
selection, weighting, optimization, and transformation. The first method is based on band selection [7]โ€“[9]. To
visualize a hyperspectral image in an RGB representation system, three spectral bands must be selected from
the original hyperspectral image composed of hundreds of bands. Then, each band will be assigned to a color:
red, green and blue. This type of visualization method is used in the AVIRIS browser [14]. The visualization
with this method is fast, but we take, just the existing data in the three selected bands and the data from other
bands will be ignored. So, a large amount of existing information in the image is lost. The second method is
based on weighting [15]. This method provides an image resulting from a linear combination of the input image
bands. In this method there are two types: Method based on stretched color matching functions (CMFs) and
Method based on bilateral filtering. The advantage of this method is the use of all the bands of the image, but
the problem arises in the choice of the same weight that will be attributed to the pixels of the image by ignoring
the variety of pixels. The third method is based on optimization [16]. In this method, some functions are
applied to the image according to the optimized criterion. We find: Method based on Markov random field
and Method based on multi maximization goals. The big challenge for this method is how to find the right
function to apply it to the image. The last method is based on transformation. With this method, we can
visualize a hyperspectral image by projecting the original image on a smaller dimension (three for example).
Over the past few years, several techniques of dimensionality reduction have emerged to decrease the
dimensionality of hyperspectral data to a lower-dimensional space, important examples include: Hessian
eigenmap embedding, locally linear embedding (LLE), isometric feature mapping (ISOMAP), Laplacian
eigenmap embedding, diffusion maps, conformal maps, independent component analysis (ICA) [17] and PCA
[18], [19].
In this paper, we will use the PCA algorithm of the last method to do the visualization. PCA is among
the dimension reduction algorithms that can be implemented effectively and which is used successfully in
commercial remote sensing applications [20]. Since we are visualizing a large hyperspectral image, PCA does
a lot of computation time [11], [12]. So, to solve this problem, we will use a distributed and parallel
computing.
At present, there exist two widely-used libraries that offer a parallel distributed implementation of
the PCA algorithm: MLlib on spark [21], [22] and the Mahout based on MapReduce [23]. Elgamal [24]
demonstrated that these two libraries do not allow a flawless analysis of a large mass of data and introduced
a novel implementation of PCA called sPCA. This proposed algorithm exhibits superior scalability and
Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ
Visualization of hyperspectral images on parallel and distributed platform: Apache Spark (Abdelali Zbakh)
7117
accuracy compared to its competitors. Wu et al. [25] proposed a new distributed parallel implementation for
the PCA algorithm. The implementation is done using the Spark platform and the results obtained are
compared with a serial implementation on MATLAB and a parallel implementation on Hadoop. The
comparison demonstrates the effectiveness of the proposed implementation in terms of both precision and
computation time.
3. THE PROPOSED VISUALIZATION APPROACH
To comprehend the information concealed within the hyperspectral image cube or extract a relevant
portion of the image, visualization is often employed. However, due to the limitations of human perception,
we can only visualize a limited number of hyperspectral bands (typically up to 3). Before embarking on the
visualization of our hyperspectral image, it is necessary to reduce the number of spectral bands to 3 without
compromising the quality of information. In the subsequent steps, we will employ PCA, a widely used
technique in various domains such as dimensionality reduction, image processing, data visualization, and
discovering underlying patterns within the data.
3.1. Classic PCA algorithm
PCA [26] is a dimensionality reduction technique employed to reduce the dimensions of a matrix
containing quantitative data. This approach enables the extraction of the dominant profiles from the matrix. To
utilize the PCA algorithm (refer to Algorithm 1) on the hyperspectral image, we consider the hyperspectral
image M as a matrix of size (๐‘š = ๐ฟ ร— ๐ถ, ๐‘), where C represents the number of columns, L represents the
number of rows, and N represents the number of bands in the image. It is important to note that ๐‘š >> ๐‘,
indicating a significantly higher number of pixels than the number of spectral bands. Every row of the matrix
M corresponds to a pixel vector. For example, the first pixel is represented by the vector: [๐‘€11, ๐‘€12, โ€ฆ , ๐‘€1๐‘],
with M1j is the value of the pixel 1 taken by the spectrum of number j. Each column of the matrix M
represents the values of all pixels in the image captured by a specific spectrum. For example, ๐‘€๐‘–1 =
[๐‘€11, ๐‘€21, โ€ฆ , ๐‘€๐‘š1] represents the data of the image taken by the spectrum 1. In the formula (1), ๐‘€๐‘—
ฬ…ฬ…ฬ…ฬ… denoted
the average of column j and ๐œŽ๐‘— denoted the standard deviation of column j. In the formula (2), ๐‘€๐‘…๐ถ๐‘‡
. ๐‘€๐‘…๐ถ
denoted the matrix product between the transpose of the matrix ๐‘€๐‘…๐ถ and the matrix ๐‘€๐‘…๐ถ.
Algorithm 1. Classical PCA algorithm
Algorithm Classical_PCA(M)
Input: matrix M of dimension (m, N)
Output: matrix U of dimension (m,3)
# Calculate the reduced centered matrix of M denoted: MRC
โˆ’ for each ๐‘– = 1. . . ๐‘š and for each ๐‘— = 1. . . ๐‘
๐‘€๐‘…๐ถ๐‘–๐‘— =
Mijโˆ’Mj
ฬ…ฬ…ฬ…ฬ…
๐œŽ๐‘—
(1)
With ๐‘€๐‘—
ฬ…ฬ…ฬ…ฬ… =
1
๐‘š
โˆ‘ ๐‘€๐‘–๐‘—
๐‘š
๐‘–=1 and ๐œŽ๐‘—2
=
1
๐‘š
โˆ‘ (๐‘€๐‘–๐‘— โˆ’ ๐‘€๐‘—
ฬ…ฬ…ฬ…ฬ…)2
๐‘š
๐‘–=1
# Calculate the correlation matrix of size (N, N) denoted: MC
๐‘€๐ถ =
1
m
(MRCT
. MRC) (2)
โˆ’ Calculate the eigenvalues and eigenvector of the MC matrix denoted:
[๐€, ๐‘ฝ]
โˆ’ Sort the eigenvector in descending order of the eigenvalues and take the first k
columns of ๐‘ฝ(๐’Œ < ๐‘ต)
โˆ’ Project the matrix M on the vector
๐‘ฝ: ๐‘ผ = ๐‘ด. ๐‘ฝ
โˆ’ use the new matrix U of size (m, k) for the visualization of the hyperspectral image
โˆ’ return U
3.2. Proposed distributed and parallel PCA algorithm
Due to the large size of hyperspectral images, the traditional PCA algorithm necessitates
computationally intensive processing. In this section, we will introduce a parallel distributed implementation
method of the algorithm utilizing the Spark platform. Given that a hyperspectral image captures the same
scene across multiple spectral bands, we can decompose the hyperspectral image into individual images,
๏ฒ ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124
7118
each representing a specific spectrum (as depicted in Figure 1). First, we start by transforming the
hyperspectral cube of the image into a one-dimensional V vector of size N. Each element of V contains an
image of size Lร—C according to a certain band Figure 1. Now, each Vt image, will be stored in the memory
RAM as a resilient distributed data set (RDD). To make a parallel distributed implementation of PCA, we
will leverage the map-reduce paradigm of Spark. The proposed algorithm operates in the following
manner:
Figure 1. Descriptive diagram of the proposed PCA algorithm
Step 1: Calculate the reduced centered matrix of V:
As previously mentioned, the vector V comprises multiple images, with each image Vt represented
by a matrix (referred to as a resilient distributed data in Spark notation) of size (L, C), where L represents
the number of rows in the image and C represents the number of columns. Hence, in order to compute the
reduced centered matrix of V, denoted as MRC, a parallel distributed computation is performed on each
image Vt.
โˆ’ Calculate the centered matrix of V denoted MC algorithm 2:
๐‘€๐ถ๐‘ก๐‘–๐‘— = ๐‘‰๐‘ก๐‘–๐‘— โˆ’ ๐‘‰๐‘ก
ฬ… for each ๐‘– = 1 to L and for each ๐‘— = 1 to ๐ถ (3)
with
๐‘‰๐‘ก
ฬ… = โˆ‘ โˆ‘ (
1
๐ฟ๐‘ฅ๐ถ
๐‘ฅ ๐‘‰๐‘ก๐‘–๐‘—)
๐ถ
๐‘—=1
๐ฟ
๐‘–=1
Algorithm 2. Calculating the centered matrix with Spark
Algorithm Center_Images (V)
Input: vector images V
Output: vector of centered images MC
For each image Vt do
Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ
Visualization of hyperspectral images on parallel and distributed platform: Apache Spark (Abdelali Zbakh)
7119
Map1:
for each line i of image Vt do
calculate X[i]=sum (Vti)
return X
Reduce1:
calculate the average of X denoted avg
Map2:
for each line i of image Vt
for each value Vti,j
calculate MC tij= Vtij-avg
return MC
In the formula 3, ๐‘‰๐‘ก
ฬ… denoted the average of image ๐‘‰๐‘ก
โˆ’ Calculate the reduced centered matrix of M denoted MRC algorithm 3:
๐‘€๐‘…๐ถ๐‘ก๐‘–๐‘— =
MCtij
ฯƒt
for each ๐‘– = 1 to ๐ฟ and for each ๐‘— = 1 to ๐ถ (4)
with
๐œŽ๐‘ก
2
=
1
๐ฟ๐‘ฅ๐ถ
โˆ‘ โˆ‘ (๐‘‰๐‘ก๐‘–๐‘— โˆ’ ๐‘‰๐‘ก
ฬ…
๐ถ
๐‘—=1 )
๐ฟ
๐‘–=1
2
or
๐œŽ๐‘ก
2
=
1
๐ฟ๐‘ฅ๐ถ
โˆ‘ โˆ‘ (๐‘€๐ถ๐‘ก๐‘–๐‘—
๐ถ
๐‘—=1 )
๐ฟ
๐‘–=1
2
In the formula 4, ๐œŽ๐‘ก denoted the standard deviation of image ๐‘‰๐‘ก.
Algorithm 3. Calculating the reduced centered matrix with Spark
Algorithm Reducing_Images (MC)
Input: vector images V centered
Output: the reduced centered matrix MRC
For each image centered ๐‘€๐ถ๐‘ก do
Map1:
# Calculate the standard deviation of image Vt denoted ฯƒt
for each line ๐‘– of image ๐‘€๐ถ๐‘ก do
for each value ๐‘€๐ถ๐‘ก๐‘–, ๐‘— do
calculate ๐‘€๐ถ๐‘ก๐‘–, ๐‘— = (๐‘€๐ถ๐‘ก๐‘–, ๐‘— โˆ— ๐‘€๐ถ๐‘ก๐‘–, ๐‘—)/(๐ฟ๐‘ฅ๐ถ)
return ๐‘€๐ถ๐‘ก
Reduce1:
Calculate sqrt(sum(๐‘€๐ถ๐‘ก)) denoted ฯƒt
Map2:
for each line i of image ๐‘€๐ถ๐‘ก do
for each value ๐‘€๐ถ๐‘ก๐‘–, ๐‘— do
calculate ๐‘€๐‘…๐ถ๐‘ก๐‘–๐‘— = ๐‘€๐ถ๐‘ก๐‘–, ๐‘—/๐œŽ๐‘ก
return ๐‘€๐‘…๐ถ
Step 2: Calculate the MRC correlation matrix of size (N, N) denoted: ๐‘€๐ถ๐‘œ๐‘œ๐‘Ÿ
As stated in step 1, the MRC represents an image vector of size N. Every image ๐‘€๐‘…๐ถ๐‘ก corresponds to
a reduced and centered matrix. We will now utilize Spark's distributed parallel computation framework,
MapReduce, to compute the correlation matrix of size (N, N) by performing a matrix product operation between
the MRCT
and MRC vectors.
๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ =
1
๐ฟ๐‘ฅ๐ถ
(๐‘€๐‘…๐ถ๐‘‡
. ๐‘€๐‘…๐ถ) (5)
๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ๐‘ก,๐‘˜ =
1
LxC
( MRCt . MRCk ) for each ๐‘ก = 1 to N and for each ๐‘˜ = 1 to N (6)
๏ฒ ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124
7120
with
๐‘€๐‘…๐ถ๐‘ก . ๐‘€๐‘…๐ถ๐‘˜ = โˆ‘ โˆ‘ ๐‘€๐‘…๐ถ๐‘ก๐‘–๐‘— . ๐‘€๐‘…๐ถ๐‘˜๐‘–๐‘—
๐ถ
๐‘—=1
๐ฟ
๐‘–=1
To determine the value of each ๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ๐‘ก,๐‘˜ in formula (6), the image ๐‘€๐‘…๐ถ๐‘ก is multiplied by the image ๐‘€๐‘…๐ถ๐‘˜
pixel by pixel. Then we calculate the average of result algorithm 4:
Algorithm 4. Calculation of the correlation matrix using Spark
Algorithm Correlation_Images (MRC)
Input: Reduced centered matrix MRC
Output: Correlation matrix Mcorr of size NxN
For each 1 โ‰ค ๐‘ก โ‰ค ๐‘ do
For each 1 โ‰ค ๐‘˜ โ‰ค ๐‘ do
Calculate ๐‘† = ๐‘ƒ๐‘Ÿ๐‘œ๐‘‘๐‘ข๐‘๐‘ก(๐‘€๐‘…๐ถ๐‘ก, ๐‘€๐‘…๐ถ๐‘˜)
๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ๐‘ก,๐‘˜ = ๐‘†/(๐ฟ ร— ๐ถ)
return ๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ
Algorithm Product(๐‘€๐‘…๐ถ๐‘ก, ๐‘€๐‘…๐ถ๐‘˜)
Input: 2 Reduced centered matrix ๐‘€๐‘…๐ถ๐‘ก, ๐‘€๐‘…๐ถ๐‘˜
Output: sum(the product of two images pixel by pixel)
Map1:
for each line ๐‘– of image ๐‘€๐‘…๐ถ๐‘ก do
calculate ๐‘‹๐‘– = (๐‘€๐‘…๐ถ๐‘ก๐‘–, ๐‘€๐‘…๐ถ๐‘˜๐‘–)
return ๐‘‹
Map2:
for each line ๐‘– of image ๐‘‹ do
calculate Xi= scalar product between ๐‘‹๐‘–[0] et ๐‘‹๐‘–[1]
return X
Reduce1:
Calculate ๐‘†๐‘ข๐‘š(๐‘‹) denoted ๐‘†
Return ๐‘†
Step 3: Calculate the eigenvector and eigenvalues of the MCorr matrix: [๐œ†, ๐‘‰]
Step 4: Arrange the eigenvectors in descending order based on their corresponding eigenvalues and select the
first three columns of V (3 < ๐‘)
Step 5: Perform a projection of the matrix M onto the vector ๐‘‰: ๐‘ˆ = ๐‘€. ๐‘‰
Step 6: Utilize the newly obtained matrix U, which has a size of (m, 3), for the purpose of visualizing the
hyperspectral image.
4. EXPERIMENTS AND COMPUTATIONS
To test the proposed algorithm, the free visible air infra-red imaging spectrometer (AVIRIS) Moffett
Field image was used with 224 spectral bands in the 2.5 nanometers to 400 nanometers, which was acquired
on August 20, 1992 [14]. On this hyperspectral image, we took samples of different sizes, see Table 1, and
then on each image obtained, we tested the proposed distributed parallel algorithm and a serial implementation
of classical PCA from the Python library scikit-learn. We collected the three most significant eigenvalues as
shown in Table 2 and the execution time of each algorithm as shown in Figure 2.
Table 1. Datasets
Name of dataset Spatial dimensions Hyperspectral bands
Dataset 1 Moffett Field 500ร—500 3
Dataset 2 Moffett Field 500ร—500 10
Dataset 3 Moffett Field 1924ร—753 3
Dataset 4 Moffett Field 1924ร—753 10
Dataset 5 Moffett Field 1924ร—753 15
Dataset 6 Moffett Field 1924ร—753 20
Dataset 7 Moffett Field 1924ร—753 25
Dataset 8 Moffett Field 1924ร—753 50
Dataset 9 Moffett Field 1924ร—753 75
Dataset 10 Moffett Field 1924ร—753 100
Dataset 11 Moffett Field 1924ร—753 150
Dataset 12 Moffett Field 1924ร—753 224
Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ
Visualization of hyperspectral images on parallel and distributed platform: Apache Spark (Abdelali Zbakh)
7121
Table 2. Example of the top three eigenvalues obtained from PCA
Sklearn PCA Proposed PCA
Dataset 1 1.9371026343
0.913755533084
0.149141832615
1.93710263
0.9137555
0.14914183
Dataset 5 10.06478855
4.01771578
0.5480712
10.06478855,
4.01771578,
0.5480712
Dataset 12 160.63876264
28.00313352
14.56390331
160.63876264,
28.00313352,
14.56390331
Figure 2. The runtime comparison between sklearn and the proposed PCA
The classical PCA of the scikit-learn library is tested on one computer equipped with: CPU: Intelยฎ
Core โ„ข i7-2820QM CPU @ 2.30 GHz ร— 8, RAM: 8G, OS: Ubuntu 16.04 LTS. The proposed distributed
parallel algorithm has been tested on the cloud Databricks [26] of the configuration, as shown in Table 3. Both
algorithms are programmed with the Python language. The runtime comparison of the two algorithms shows
the speed of PCA sklearn for small images, but if the image has a high number of bands, more than 10 spectral
bands our proposed PCA is faster, see Figure 2. Figure 3 illustrates the visualization of a hyperspectral image
dataset. In Figure 3(a), the image is displayed without any PCA applied, presenting the original representation.
In contrast, Figure 3(b) showcases the image after the application of either classical PCA or the newly proposed
PCA distributed method.
Table 3. Configuration parameters of cluster spark in cloud Databricks
Driver Nodes
Driver type: 36 GB memory, 8
Cores
Number of Worker Nodes: 6
For each worker :8.0 GB Memory, 2 Core
๏ฒ ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124
7122
(a)
(b)
Figure 3. Visualization of hyperspectral image (dataset 12) in (a) the image is displayed without PCA, while
on the (b) the image is shown after applying either classical PCA or the proposed PCA
5. CONCLUSION
In this work, a method of visualizing a hyperspectral image has been proposed based on the reduction
of the dimensionality of the image in a parallel distributed environment. The algorithm has been developed
using Python 3, and evaluated on hyperspectral images utilizing the Spark platform. The results obtained align
with those of traditional PCA, and the visualization of the images post-application of our reduction algorithm
confirms the validity of our algorithm. By comparing the execution time of the two algorithms: sklearn PCA
and proposed PCA, we discovered that the proposed PCA algorithm displays faster performance when
processing large images. This observation implies that the proposed PCA algorithm may be more efficient and
effective in handling larger data sets compared to the classic algorithm.
REFERENCES
[1] J. S. Tyo, A. Konsolakis, D. I. Diersen, and R. C. Olsen, โ€œPrincipal-components-based display strategy for spectral imagery,โ€ IEEE
Transactions on Geoscience and Remote Sensing, vol. 41, no. 3, pp. 708โ€“718, Mar. 2003, doi: 10.1109/TGRS.2003.808879.
[2] J. Pontius, M. Martin, L. Plourde, and R. Hallett, โ€œAsh decline assessment in emerald ash borer-infested regions: A test of tree-
level, hyperspectral technologies,โ€ Remote Sensing of Environment, vol. 112, no. 5, pp. 2665โ€“2676, May 2008, doi:
10.1016/j.rse.2007.12.011.
Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ
Visualization of hyperspectral images on parallel and distributed platform: Apache Spark (Abdelali Zbakh)
7123
[3] Y.-T. Chan, S.-J. Wang, and C.-H. Tsai, โ€œReal-time foreground detection approach based on adaptive ensemble learning with
arbitrary algorithms for changing environments,โ€ Information Fusion, vol. 39, pp. 154โ€“167, Jan. 2018, doi:
10.1016/j.inffus.2017.05.001.
[4] G. Cheng, J. Han, and X. Lu, โ€œRemote sensing image scene classification: Benchmark and state of the art,โ€ Proceedings of the
IEEE, vol. 105, no. 10, pp. 1865โ€“1883, Oct. 2017, doi: 10.1109/JPROC.2017.2675998.
[5] P. Duan, X. Kang, S. Li, and P. Ghamisi, โ€œNoise-robust hyperspectral image classification via multi-scale total variation,โ€ IEEE
Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 12, no. 6, pp. 1948โ€“1962, Jun. 2019, doi:
10.1109/JSTARS.2019.2915272.
[6] Y. Khouj, J. Dawson, J. Coad, and L. Vona-Davis, โ€œHyperspectral imaging and K-means classification for histologic evaluation of
ductal carcinoma in situ,โ€ Frontiers in Oncology, vol. 8, Feb. 2018, doi: 10.3389/fonc.2018.00017.
[7] H. Su, Q. Du, and P. Du, โ€œHyperspectral image visualization using band selection,โ€ IEEE Journal of Selected Topics in Applied
Earth Observations and Remote Sensing, vol. 7, no. 6, pp. 2647โ€“2658, Jun. 2014, doi: 10.1109/JSTARS.2013.2272654.
[8] Yuan Yuan, Guokang Zhu, and Qi Wang, โ€œHyperspectral band selection by multitask sparsity pursuit,โ€ IEEE Transactions on
Geoscience and Remote Sensing, vol. 53, no. 2, pp. 631โ€“644, Feb. 2015, doi: 10.1109/TGRS.2014.2326655.
[9] G. Zhu, Y. Huang, J. Lei, Z. Bi, and F. Xu, โ€œUnsupervised hyperspectral band selection by dominant set extraction,โ€ IEEE
Transactions on Geoscience and Remote Sensing, vol. 54, no. 1, pp. 227โ€“239, Jan. 2016, doi: 10.1109/TGRS.2015.2453362.
[10] C. Theoharatos, V. Tsagaris, N. Fragoulis, and G. Economou, โ€œHyperspectral image fusion using 2-D principal component
analysis,โ€ in 2011 2nd International Conference on Space Technology, Sep. 2011, pp. 1โ€“4, doi: 10.1109/ICSpT.2011.6064682.
[11] W. Liu, X. Yang, D. Tao, J. Cheng, and Y. Tang, โ€œMultiview dimension reduction via hessian multiset canonical correlations,โ€
Information Fusion, vol. 41, pp. 119โ€“128, May 2018, doi: 10.1016/j.inffus.2017.09.001.
[12] R. S. Lynch and P. K. Willett, โ€œUse of Bayesian data reduction for the fusion of legacy classifiers,โ€ Information Fusion, vol. 4, no.
1, pp. 23โ€“34, Mar. 2003, doi: 10.1016/S1566-2535(02)00098-2.
[13] S. Salloum, R. Dautov, X. Chen, P. X. Peng, and J. Z. Huang, โ€œBig data analytics on apache spark,โ€ International Journal of Data
Science and Analytics, vol. 1, no. 3โ€“4, pp. 145โ€“164, Nov. 2016, doi: 10.1007/s41060-016-0027-9.
[14] A. Zbakh, Z. Alaoui, A. Benyoussef, A. El, and M. El, โ€œSpectral classification of a set of hyperspectral images using the
convolutional neural network, in a single training,โ€ International Journal of Advanced Computer Science and Applications, vol. 10,
no. 6, 2019, doi: 10.14569/IJACSA.2019.0100634.
[15] K. Kotwal and S. Chaudhuri, โ€œVisualization of hyperspectral images using bilateral filtering,โ€ IEEE Transactions on Geoscience
and Remote Sensing, vol. 48, no. 5, pp. 2308โ€“2316, May 2010, doi: 10.1109/TGRS.2009.2037950.
[16] M. Mignotte, โ€œA bicriteria-optimization-approach-based dimensionality-reduction model for the color display of hyperspectral
images,โ€ IEEE Transactions on Geoscience and Remote Sensing, vol. 50, no. 2, pp. 501โ€“513, Feb. 2012, doi:
10.1109/TGRS.2011.2160646.
[17] Q. Du, N. Raksuntorn, S. Cai, and R. J. Moorhead, โ€œColor display for hyperspectral imagery,โ€ IEEE Transactions on Geoscience
and Remote Sensing, vol. 46, no. 6, pp. 1858โ€“1866, Jun. 2008, doi: 10.1109/TGRS.2008.916203.
[18] B. Zhao, X. Dong, Y. Guo, X. Jia, and Y. Huang, โ€œPCA dimensionality reduction method for image classification,โ€ Neural
Processing Letters, vol. 54, no. 1, pp. 347โ€“368, Feb. 2022, doi: 10.1007/s11063-021-10632-5.
[19] Xiuping Jia and J. A. Richards, โ€œSegmented principal components transformation for efficient hyperspectral remote-sensing image
display and classification,โ€ IEEE Transactions on Geoscience and Remote Sensing, vol. 37, no. 1, pp. 538โ€“542, 1999, doi:
10.1109/36.739109.
[20] H. Zhang, D. W. Messinger, and E. D. Montag, โ€œPerceptual display strategies of hyperspectral imagery based on PCA and ICA,โ€
in Proc. SPIE 6233, Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XI, May 2006, doi:
10.1117/12.665696.
[21] X. Meng et al., โ€œMLlib: Machine learning in apache spark,โ€ Journal of Machine Learning Research, vol. 17, pp. 1โ€“7, 2016.
[22] O. Azeroual and A. Nikiforova, โ€œApache spark and MLlib-based intrusion detection system or how the big data technologies can
secure the data,โ€ Information, vol. 13, no. 2, Jan. 2022, doi: 10.3390/info13020058.
[23] N. S. Sagheer and S. A. Yousif, โ€œA parallel clustering analysis based on hadoop multi-node and apache mahout,โ€ Iraqi Journal of
Science, pp. 2431โ€“2444, Jul. 2021, doi: 10.24996/ijs.2021.62.7.32.
[24] T. Elgamal, M. Yabandeh, A. Aboulnaga, W. Mustafa, and M. Hefeeda, โ€œSPCA: Scalable principal component analysis for big data
on distributed platforms,โ€ in Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, May 2015,
pp. 79โ€“91, doi: 10.1145/2723372.2751520.
[25] Z. Wu, Y. Li, A. Plaza, J. Li, F. Xiao, and Z. Wei, โ€œParallel and distributed dimensionality reduction of hyperspectral data on cloud
computing architectures,โ€ IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 9, no. 6,
pp. 2270โ€“2278, Jun. 2016, doi: 10.1109/JSTARS.2016.2542193.
[26] Y. O. Sayad, H. Mousannif, and H. Al Moatassime, โ€œPredictive modeling of wildfires: A new dataset and machine learning
approach,โ€ Fire Safety Journal, vol. 104, pp. 130โ€“146, Mar. 2019, doi: 10.1016/j.firesaf.2019.01.006.
BIOGRAPHIES OF AUTHORS
Abdelali Zbakh is an assistant professor in Computer Science at National School
of Business and Management-Tangier, Abdelmalek Essaรขdi University Morocco. He is a former
Teacher of computing at preparatory classes for engineering schools โ€“ Tangier. He received his
Ph.D. degree in computer science from the faculty of sciences Rabat - Mohammed V university
of Rabat. His current research interests include information systems, machine learning and deep
learning. He can be contacted at email a.zbakh@uae.ac.ma.
๏ฒ ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124
7124
Mohamed Taj Bennani received his masterโ€™s degree in Computer Science and
Networking from Science Faculty of Tangier, Tangier in 2011. He received his Ph.D. in 2019
(Computing Science and Networking) from Science Faculty of Tangier. At present, he is
working as a prof. at Faculty of Science of Dhar el Mahraz Fez since 2019. He can be contacted
at email Bennani.taj@gmail.com.
Adnan Souri is an assistant professor in Computer Science at Abdelmalek Essaรขdi
University, Faculty of Sciences Tetouan, Morocco. He is a former Teacher of computing at
preparatory classes for engineering schools โ€“ Tangier. He received his Ph.D. degree in computer
science from the Faculty of Sciences Tetouan, Abdelmalek Essaรขdi University Morocco. His
current research interests include artificial intelligence, artificial neural networks and algorithms.
Their current project is โ€œArabic language processingโ€. He can be contacted at email
a.souri@uae.ac.ma.
Outman El Hichami received his Ph.D. in 2017 from the Faculty of Sciences in
Tetouan, Morocco. In 2018, he joined the Higher Normal School in Tetouan as an assistant
professor in Computer Science, where he was promoted to associate professor in 2022. His
research interests are in formal methods and machine learning. He can be contacted at email
oelhichami@uae.ac.ma.

More Related Content

Similar to Visualization of hyperspectral images on parallel and distributed platform: Apache Spark

A Testbed for Image Synthesis
A Testbed for Image SynthesisA Testbed for Image Synthesis
A Testbed for Image SynthesisBen Trumbore
ย 
Image Denoising Based On Sparse Representation In A Probabilistic Framework
Image Denoising Based On Sparse Representation In A Probabilistic FrameworkImage Denoising Based On Sparse Representation In A Probabilistic Framework
Image Denoising Based On Sparse Representation In A Probabilistic FrameworkCSCJournals
ย 
Implementation of Fuzzy Logic for the High-Resolution Remote Sensing Images w...
Implementation of Fuzzy Logic for the High-Resolution Remote Sensing Images w...Implementation of Fuzzy Logic for the High-Resolution Remote Sensing Images w...
Implementation of Fuzzy Logic for the High-Resolution Remote Sensing Images w...IOSR Journals
ย 
MR Image Compression Based on Selection of Mother Wavelet and Lifting Based W...
MR Image Compression Based on Selection of Mother Wavelet and Lifting Based W...MR Image Compression Based on Selection of Mother Wavelet and Lifting Based W...
MR Image Compression Based on Selection of Mother Wavelet and Lifting Based W...ijma
ย 
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...CSCJournals
ย 
A comprehensive study of different image super resolution reconstruction algo...
A comprehensive study of different image super resolution reconstruction algo...A comprehensive study of different image super resolution reconstruction algo...
A comprehensive study of different image super resolution reconstruction algo...IAEME Publication
ย 
A comprehensive study of different image super resolution reconstruction algo...
A comprehensive study of different image super resolution reconstruction algo...A comprehensive study of different image super resolution reconstruction algo...
A comprehensive study of different image super resolution reconstruction algo...IAEME Publication
ย 
A Neural Network Approach to Identify Hyperspectral Image Content
A Neural Network Approach to Identify Hyperspectral  Image Content A Neural Network Approach to Identify Hyperspectral  Image Content
A Neural Network Approach to Identify Hyperspectral Image Content IJECEIAES
ย 
Human Re-identification with Global and Local Siamese Convolution Neural Network
Human Re-identification with Global and Local Siamese Convolution Neural NetworkHuman Re-identification with Global and Local Siamese Convolution Neural Network
Human Re-identification with Global and Local Siamese Convolution Neural NetworkTELKOMNIKA JOURNAL
ย 
Binarization of Degraded Text documents and Palm Leaf Manuscripts
Binarization of Degraded Text documents and Palm Leaf ManuscriptsBinarization of Degraded Text documents and Palm Leaf Manuscripts
Binarization of Degraded Text documents and Palm Leaf ManuscriptsIRJET Journal
ย 
Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...IJECEIAES
ย 
Noise-robust classification with hypergraph neural network
Noise-robust classification with hypergraph neural networkNoise-robust classification with hypergraph neural network
Noise-robust classification with hypergraph neural networknooriasukmaningtyas
ย 
10.1109@tip.2020.2990346
10.1109@tip.2020.299034610.1109@tip.2020.2990346
10.1109@tip.2020.2990346Joseph Franklin
ย 
Asilomar09 compressive superres
Asilomar09 compressive superresAsilomar09 compressive superres
Asilomar09 compressive superresHoร ng Sฦกn
ย 
M.E Computer Science Remote Sensing Projects
M.E Computer Science Remote Sensing ProjectsM.E Computer Science Remote Sensing Projects
M.E Computer Science Remote Sensing ProjectsVijay Karan
ย 
Data mining techniques application for prediction in OLAP cube
Data mining techniques application for prediction in OLAP cubeData mining techniques application for prediction in OLAP cube
Data mining techniques application for prediction in OLAP cubeIJECEIAES
ย 
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...IRJET Journal
ย 
IRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
IRJET - Human Eye Pupil Detection Technique using Center of Gravity MethodIRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
IRJET - Human Eye Pupil Detection Technique using Center of Gravity MethodIRJET Journal
ย 
A Survey of Spiking Neural Networks and Support Vector Machine Performance By...
A Survey of Spiking Neural Networks and Support Vector Machine Performance By...A Survey of Spiking Neural Networks and Support Vector Machine Performance By...
A Survey of Spiking Neural Networks and Support Vector Machine Performance By...ijsc
ย 
A SURVEY OF SPIKING NEURAL NETWORKS AND SUPPORT VECTOR MACHINE PERFORMANCE BY...
A SURVEY OF SPIKING NEURAL NETWORKS AND SUPPORT VECTOR MACHINE PERFORMANCE BY...A SURVEY OF SPIKING NEURAL NETWORKS AND SUPPORT VECTOR MACHINE PERFORMANCE BY...
A SURVEY OF SPIKING NEURAL NETWORKS AND SUPPORT VECTOR MACHINE PERFORMANCE BY...ijdms
ย 

Similar to Visualization of hyperspectral images on parallel and distributed platform: Apache Spark (20)

A Testbed for Image Synthesis
A Testbed for Image SynthesisA Testbed for Image Synthesis
A Testbed for Image Synthesis
ย 
Image Denoising Based On Sparse Representation In A Probabilistic Framework
Image Denoising Based On Sparse Representation In A Probabilistic FrameworkImage Denoising Based On Sparse Representation In A Probabilistic Framework
Image Denoising Based On Sparse Representation In A Probabilistic Framework
ย 
Implementation of Fuzzy Logic for the High-Resolution Remote Sensing Images w...
Implementation of Fuzzy Logic for the High-Resolution Remote Sensing Images w...Implementation of Fuzzy Logic for the High-Resolution Remote Sensing Images w...
Implementation of Fuzzy Logic for the High-Resolution Remote Sensing Images w...
ย 
MR Image Compression Based on Selection of Mother Wavelet and Lifting Based W...
MR Image Compression Based on Selection of Mother Wavelet and Lifting Based W...MR Image Compression Based on Selection of Mother Wavelet and Lifting Based W...
MR Image Compression Based on Selection of Mother Wavelet and Lifting Based W...
ย 
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
ย 
A comprehensive study of different image super resolution reconstruction algo...
A comprehensive study of different image super resolution reconstruction algo...A comprehensive study of different image super resolution reconstruction algo...
A comprehensive study of different image super resolution reconstruction algo...
ย 
A comprehensive study of different image super resolution reconstruction algo...
A comprehensive study of different image super resolution reconstruction algo...A comprehensive study of different image super resolution reconstruction algo...
A comprehensive study of different image super resolution reconstruction algo...
ย 
A Neural Network Approach to Identify Hyperspectral Image Content
A Neural Network Approach to Identify Hyperspectral  Image Content A Neural Network Approach to Identify Hyperspectral  Image Content
A Neural Network Approach to Identify Hyperspectral Image Content
ย 
Human Re-identification with Global and Local Siamese Convolution Neural Network
Human Re-identification with Global and Local Siamese Convolution Neural NetworkHuman Re-identification with Global and Local Siamese Convolution Neural Network
Human Re-identification with Global and Local Siamese Convolution Neural Network
ย 
Binarization of Degraded Text documents and Palm Leaf Manuscripts
Binarization of Degraded Text documents and Palm Leaf ManuscriptsBinarization of Degraded Text documents and Palm Leaf Manuscripts
Binarization of Degraded Text documents and Palm Leaf Manuscripts
ย 
Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...
ย 
Noise-robust classification with hypergraph neural network
Noise-robust classification with hypergraph neural networkNoise-robust classification with hypergraph neural network
Noise-robust classification with hypergraph neural network
ย 
10.1109@tip.2020.2990346
10.1109@tip.2020.299034610.1109@tip.2020.2990346
10.1109@tip.2020.2990346
ย 
Asilomar09 compressive superres
Asilomar09 compressive superresAsilomar09 compressive superres
Asilomar09 compressive superres
ย 
M.E Computer Science Remote Sensing Projects
M.E Computer Science Remote Sensing ProjectsM.E Computer Science Remote Sensing Projects
M.E Computer Science Remote Sensing Projects
ย 
Data mining techniques application for prediction in OLAP cube
Data mining techniques application for prediction in OLAP cubeData mining techniques application for prediction in OLAP cube
Data mining techniques application for prediction in OLAP cube
ย 
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...
ย 
IRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
IRJET - Human Eye Pupil Detection Technique using Center of Gravity MethodIRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
IRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
ย 
A Survey of Spiking Neural Networks and Support Vector Machine Performance By...
A Survey of Spiking Neural Networks and Support Vector Machine Performance By...A Survey of Spiking Neural Networks and Support Vector Machine Performance By...
A Survey of Spiking Neural Networks and Support Vector Machine Performance By...
ย 
A SURVEY OF SPIKING NEURAL NETWORKS AND SUPPORT VECTOR MACHINE PERFORMANCE BY...
A SURVEY OF SPIKING NEURAL NETWORKS AND SUPPORT VECTOR MACHINE PERFORMANCE BY...A SURVEY OF SPIKING NEURAL NETWORKS AND SUPPORT VECTOR MACHINE PERFORMANCE BY...
A SURVEY OF SPIKING NEURAL NETWORKS AND SUPPORT VECTOR MACHINE PERFORMANCE BY...
ย 

More from IJECEIAES

Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...IJECEIAES
ย 
Prediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regressionPrediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regressionIJECEIAES
ย 
Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...IJECEIAES
ย 
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...IJECEIAES
ย 
Improving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learningImproving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learningIJECEIAES
ย 
Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...IJECEIAES
ย 
Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...IJECEIAES
ย 
Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...IJECEIAES
ย 
Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...IJECEIAES
ย 
A systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancyA systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancyIJECEIAES
ย 
Agriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimizationAgriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimizationIJECEIAES
ย 
Three layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performanceThree layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performanceIJECEIAES
ย 
Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...IJECEIAES
ย 
Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...IJECEIAES
ย 
Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...IJECEIAES
ย 
Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...IJECEIAES
ย 
On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...IJECEIAES
ย 
Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...IJECEIAES
ย 
A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...IJECEIAES
ย 
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...IJECEIAES
ย 

More from IJECEIAES (20)

Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...
ย 
Prediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regressionPrediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regression
ย 
Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...
ย 
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...
ย 
Improving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learningImproving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learning
ย 
Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...
ย 
Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...
ย 
Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...
ย 
Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...
ย 
A systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancyA systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancy
ย 
Agriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimizationAgriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimization
ย 
Three layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performanceThree layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performance
ย 
Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...
ย 
Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...
ย 
Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...
ย 
Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...
ย 
On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...
ย 
Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...
ย 
A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...
ย 
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
ย 

Recently uploaded

IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024Mark Billinghurst
ย 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130Suhani Kapoor
ย 
Introduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxIntroduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxupamatechverse
ย 
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
ย 
Study on Air-Water & Water-Water Heat Exchange in a Finned ๏ปฟTube Exchanger
Study on Air-Water & Water-Water Heat Exchange in a Finned ๏ปฟTube ExchangerStudy on Air-Water & Water-Water Heat Exchange in a Finned ๏ปฟTube Exchanger
Study on Air-Water & Water-Water Heat Exchange in a Finned ๏ปฟTube ExchangerAnamika Sarkar
ย 
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...RajaP95
ย 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile servicerehmti665
ย 
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130Suhani Kapoor
ย 
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
ย 
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptxExploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptxnull - The Open Security Community
ย 
Biology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxBiology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxDeepakSakkari2
ย 
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).pptssuser5c9d4b1
ย 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
ย 
Current Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLCurrent Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLDeelipZope
ย 
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”soniya singh
ย 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
ย 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxJoรฃo Esperancinha
ย 
ZXCTN 5804 / ZTE PTN / ZTE POTN / ZTE 5804 PTN / ZTE POTN 5804 ( 100/200 GE Z...
ZXCTN 5804 / ZTE PTN / ZTE POTN / ZTE 5804 PTN / ZTE POTN 5804 ( 100/200 GE Z...ZXCTN 5804 / ZTE PTN / ZTE POTN / ZTE 5804 PTN / ZTE POTN 5804 ( 100/200 GE Z...
ZXCTN 5804 / ZTE PTN / ZTE POTN / ZTE 5804 PTN / ZTE POTN 5804 ( 100/200 GE Z...ZTE
ย 
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSAPPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSKurinjimalarL3
ย 

Recently uploaded (20)

IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024
ย 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
ย 
Introduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxIntroduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptx
ย 
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
ย 
Study on Air-Water & Water-Water Heat Exchange in a Finned ๏ปฟTube Exchanger
Study on Air-Water & Water-Water Heat Exchange in a Finned ๏ปฟTube ExchangerStudy on Air-Water & Water-Water Heat Exchange in a Finned ๏ปฟTube Exchanger
Study on Air-Water & Water-Water Heat Exchange in a Finned ๏ปฟTube Exchanger
ย 
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
ย 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile service
ย 
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
ย 
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
ย 
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptxExploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
ย 
Biology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxBiology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptx
ย 
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
ย 
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
ย 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
ย 
Current Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLCurrent Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCL
ย 
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
ย 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
ย 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
ย 
ZXCTN 5804 / ZTE PTN / ZTE POTN / ZTE 5804 PTN / ZTE POTN 5804 ( 100/200 GE Z...
ZXCTN 5804 / ZTE PTN / ZTE POTN / ZTE 5804 PTN / ZTE POTN 5804 ( 100/200 GE Z...ZXCTN 5804 / ZTE PTN / ZTE POTN / ZTE 5804 PTN / ZTE POTN 5804 ( 100/200 GE Z...
ZXCTN 5804 / ZTE PTN / ZTE POTN / ZTE 5804 PTN / ZTE POTN 5804 ( 100/200 GE Z...
ย 
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICSAPPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
APPLICATIONS-AC/DC DRIVES-OPERATING CHARACTERISTICS
ย 

Visualization of hyperspectral images on parallel and distributed platform: Apache Spark

  • 1. International Journal of Electrical and Computer Engineering (IJECE) Vol. 13, No. 6, December 2023, pp. 7115~7124 ISSN: 2088-8708, DOI: 10.11591/ijece.v13i6.pp7115-7124 ๏ฒ 7115 Journal homepage: http://ijece.iaescore.com Visualization of hyperspectral images on parallel and distributed platform: Apache Spark Abdelali Zbakh1 , Mohamed Taj Bennani2 , Adnan Souri3 , Outman El Hichami4 1 National School of Business and Management Tangier (ENCGT), ER-MSI, Abdelmalek Essaรขdi University, Tetouan, Morocco 2 LPAIS Laboratory, Computing Science Department, Faculty of Sciences Dhar El Mahraz Fez, Sidi Mohamed Ben Abdellah University, Fez, Morocco 3 New Technology Trends for Innovation, Faculty of Sciences Tetouan, Abdelmalek Essaรขdi University, Tetouan, Morocco 4 Applied Mathematics and Computer Sciences Team, Higher Normal School, Abdelmalek Essaadi University, Tetouan, Morocco Article Info ABSTRACT Article history: Received Jan 2, 2023 Revised May 3, 2023 Accepted Jun 4, 2023 The field of hyperspectral image storage and processing has undergone a remarkable evolution in recent years. The visualization of these images represents a challenge as the number of bands exceeds three bands, since direct visualization using the trivial system red, green and blue (RGB) or hue, saturation and lightness (HSL) is not feasible. One potential solution to resolve this problem is the reduction of the dimensionality of the image to three dimensions and thereafter assigning each dimension to a color. Conventional tools and algorithms have become incapable of producing results within a reasonable time. In this paper, we present a new distributed method of visualization of hyperspectral image based on the principal component analysis (PCA) and implemented in a distributed parallel environment (Apache Spark). The visualization of the big hyperspectral images with the proposed method is made in a smaller time and with the same performance as the classical method of visualization. Keywords: Dimension reduction Hyperspectral MapReduce Principal component analysis Spark platform Visualization This is an open access article under the CC BY-SA license. Corresponding Author: Abdelali Zbakh National School of Business and Management Tangier (ENCGT), ER-MSI, Abdelmalek Essaรขdi University Tetouan, Morocco Email: a.zbakh@uae.ac.ma 1. INTRODUCTION Currently, digital display devices produce a color image for the human eye using a combination of three primitive colors. So, a classic red, green and blue (RGB) color image is a combination of three layers (bands): RGB. A hue, saturation and lightness (HSL) color image is a combination of: HSL [1]. On the contrary, we find hyperspectral images composed of hundreds of layers (bands). A hyperspectral image can be described as a three-dimensional data cube consisting of two spatial dimensions and one spectral dimension. In this representation, each pixel contains a spectrum of wavelengths within the visible-near infrared range, spanning from 400 to 1,400 nanometers. Hyperspectral imaging is frequently used in the field of remote sensing, environment monitoring [2], [3], polarimetric imaging, land cover classification [4], [5] and multimodal medical imaging. In astronomy, for example, hyperspectral imagery is used to archive soil and space observations. In medical imaging, hyperspectral imaging is used for the detection of diseases such as cancer [6]. Hyperspectral imaging produces high-dimensional data where each pixel in the image is represented by a spectrum of measurements across many different wavelengths. However, the high dimensionality of this data can make it challenging to analyze and interpret. Now, how to visualize a hyperspectral cube and give the user, not usually specialist, a synthetic view of the data contained in the image with the minimum possible loss,
  • 2. ๏ฒ ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124 7116 and facilitate the interpretation of the image. Among the first solutions proposed is to visualize all the cube in the form of a video sequence, each layer of the cube is represented by an image. However, when we work in the plan and with a lot of hyperspectral images of large spectral dimensions, this solution remains difficult to practice. So, to visualize a hyperspectral image in color and in the plan with the number of spectral bands which exceeds three bands, it is often necessary to reduce the dimensionality of hyperspectral images and obtain, from the original image, a composite image that consists of three bands. Dimension reduction techniques such as principal component analysis (PCA) or t-distributed stochastic neighbor embedding (t-SNE) can be employed to transform the high-dimensional hyperspectral data into a lower-dimensional space while preserving as much of the information as possible. By reducing the number of dimensions, it becomes easier to visualize and interpret the data. By visualizing the reduced-dimensional data, researchers and analysts can gain insights into the underlying patterns and relationships in the data, which can help with tasks such as identifying and classifying different materials or objects in the scene. This, in turn, can have applications in fields such as remote sensing, agriculture, and environmental monitoring. Several methods of visualizing hyperspectral images exist: Methods based on spectral band selection [7]โ€“[9], methods based on weighting [5], methods based on optimization [6] and projection-based methods [10]. To bypass the computational problem posed by the processing of large hyperspectral cube [11], [12]. We will use an open source framework named Apache Spark [13], which distributes data storage in memory random-access memory (RAM) and processes the data in parallel. This choice has given us a considerable gain in the time of visualization of a hyperspectral image. The rest of this paper is structured in the following manner: in section 2, we will present the related work on the hyperspectral image visualization methods. Next, in section 3, we will describe our parallel distributed visualization approach based on the PCA projection method. In section 4, we will experiment our approach on several free hyperspectral images. And we finish the paper with a conclusion and perspectives. 2. RELATED WORKS OF HYPERSPECTRAL IMAGE VISUALIZATION METHODS In the field of hyperspectral imaging, there are several methods used to visualize a hyperspectral image. The literature review revealed that the four main methods used for this purpose are based on band selection, weighting, optimization, and transformation. The first method is based on band selection [7]โ€“[9]. To visualize a hyperspectral image in an RGB representation system, three spectral bands must be selected from the original hyperspectral image composed of hundreds of bands. Then, each band will be assigned to a color: red, green and blue. This type of visualization method is used in the AVIRIS browser [14]. The visualization with this method is fast, but we take, just the existing data in the three selected bands and the data from other bands will be ignored. So, a large amount of existing information in the image is lost. The second method is based on weighting [15]. This method provides an image resulting from a linear combination of the input image bands. In this method there are two types: Method based on stretched color matching functions (CMFs) and Method based on bilateral filtering. The advantage of this method is the use of all the bands of the image, but the problem arises in the choice of the same weight that will be attributed to the pixels of the image by ignoring the variety of pixels. The third method is based on optimization [16]. In this method, some functions are applied to the image according to the optimized criterion. We find: Method based on Markov random field and Method based on multi maximization goals. The big challenge for this method is how to find the right function to apply it to the image. The last method is based on transformation. With this method, we can visualize a hyperspectral image by projecting the original image on a smaller dimension (three for example). Over the past few years, several techniques of dimensionality reduction have emerged to decrease the dimensionality of hyperspectral data to a lower-dimensional space, important examples include: Hessian eigenmap embedding, locally linear embedding (LLE), isometric feature mapping (ISOMAP), Laplacian eigenmap embedding, diffusion maps, conformal maps, independent component analysis (ICA) [17] and PCA [18], [19]. In this paper, we will use the PCA algorithm of the last method to do the visualization. PCA is among the dimension reduction algorithms that can be implemented effectively and which is used successfully in commercial remote sensing applications [20]. Since we are visualizing a large hyperspectral image, PCA does a lot of computation time [11], [12]. So, to solve this problem, we will use a distributed and parallel computing. At present, there exist two widely-used libraries that offer a parallel distributed implementation of the PCA algorithm: MLlib on spark [21], [22] and the Mahout based on MapReduce [23]. Elgamal [24] demonstrated that these two libraries do not allow a flawless analysis of a large mass of data and introduced a novel implementation of PCA called sPCA. This proposed algorithm exhibits superior scalability and
  • 3. Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ Visualization of hyperspectral images on parallel and distributed platform: Apache Spark (Abdelali Zbakh) 7117 accuracy compared to its competitors. Wu et al. [25] proposed a new distributed parallel implementation for the PCA algorithm. The implementation is done using the Spark platform and the results obtained are compared with a serial implementation on MATLAB and a parallel implementation on Hadoop. The comparison demonstrates the effectiveness of the proposed implementation in terms of both precision and computation time. 3. THE PROPOSED VISUALIZATION APPROACH To comprehend the information concealed within the hyperspectral image cube or extract a relevant portion of the image, visualization is often employed. However, due to the limitations of human perception, we can only visualize a limited number of hyperspectral bands (typically up to 3). Before embarking on the visualization of our hyperspectral image, it is necessary to reduce the number of spectral bands to 3 without compromising the quality of information. In the subsequent steps, we will employ PCA, a widely used technique in various domains such as dimensionality reduction, image processing, data visualization, and discovering underlying patterns within the data. 3.1. Classic PCA algorithm PCA [26] is a dimensionality reduction technique employed to reduce the dimensions of a matrix containing quantitative data. This approach enables the extraction of the dominant profiles from the matrix. To utilize the PCA algorithm (refer to Algorithm 1) on the hyperspectral image, we consider the hyperspectral image M as a matrix of size (๐‘š = ๐ฟ ร— ๐ถ, ๐‘), where C represents the number of columns, L represents the number of rows, and N represents the number of bands in the image. It is important to note that ๐‘š >> ๐‘, indicating a significantly higher number of pixels than the number of spectral bands. Every row of the matrix M corresponds to a pixel vector. For example, the first pixel is represented by the vector: [๐‘€11, ๐‘€12, โ€ฆ , ๐‘€1๐‘], with M1j is the value of the pixel 1 taken by the spectrum of number j. Each column of the matrix M represents the values of all pixels in the image captured by a specific spectrum. For example, ๐‘€๐‘–1 = [๐‘€11, ๐‘€21, โ€ฆ , ๐‘€๐‘š1] represents the data of the image taken by the spectrum 1. In the formula (1), ๐‘€๐‘— ฬ…ฬ…ฬ…ฬ… denoted the average of column j and ๐œŽ๐‘— denoted the standard deviation of column j. In the formula (2), ๐‘€๐‘…๐ถ๐‘‡ . ๐‘€๐‘…๐ถ denoted the matrix product between the transpose of the matrix ๐‘€๐‘…๐ถ and the matrix ๐‘€๐‘…๐ถ. Algorithm 1. Classical PCA algorithm Algorithm Classical_PCA(M) Input: matrix M of dimension (m, N) Output: matrix U of dimension (m,3) # Calculate the reduced centered matrix of M denoted: MRC โˆ’ for each ๐‘– = 1. . . ๐‘š and for each ๐‘— = 1. . . ๐‘ ๐‘€๐‘…๐ถ๐‘–๐‘— = Mijโˆ’Mj ฬ…ฬ…ฬ…ฬ… ๐œŽ๐‘— (1) With ๐‘€๐‘— ฬ…ฬ…ฬ…ฬ… = 1 ๐‘š โˆ‘ ๐‘€๐‘–๐‘— ๐‘š ๐‘–=1 and ๐œŽ๐‘—2 = 1 ๐‘š โˆ‘ (๐‘€๐‘–๐‘— โˆ’ ๐‘€๐‘— ฬ…ฬ…ฬ…ฬ…)2 ๐‘š ๐‘–=1 # Calculate the correlation matrix of size (N, N) denoted: MC ๐‘€๐ถ = 1 m (MRCT . MRC) (2) โˆ’ Calculate the eigenvalues and eigenvector of the MC matrix denoted: [๐€, ๐‘ฝ] โˆ’ Sort the eigenvector in descending order of the eigenvalues and take the first k columns of ๐‘ฝ(๐’Œ < ๐‘ต) โˆ’ Project the matrix M on the vector ๐‘ฝ: ๐‘ผ = ๐‘ด. ๐‘ฝ โˆ’ use the new matrix U of size (m, k) for the visualization of the hyperspectral image โˆ’ return U 3.2. Proposed distributed and parallel PCA algorithm Due to the large size of hyperspectral images, the traditional PCA algorithm necessitates computationally intensive processing. In this section, we will introduce a parallel distributed implementation method of the algorithm utilizing the Spark platform. Given that a hyperspectral image captures the same scene across multiple spectral bands, we can decompose the hyperspectral image into individual images,
  • 4. ๏ฒ ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124 7118 each representing a specific spectrum (as depicted in Figure 1). First, we start by transforming the hyperspectral cube of the image into a one-dimensional V vector of size N. Each element of V contains an image of size Lร—C according to a certain band Figure 1. Now, each Vt image, will be stored in the memory RAM as a resilient distributed data set (RDD). To make a parallel distributed implementation of PCA, we will leverage the map-reduce paradigm of Spark. The proposed algorithm operates in the following manner: Figure 1. Descriptive diagram of the proposed PCA algorithm Step 1: Calculate the reduced centered matrix of V: As previously mentioned, the vector V comprises multiple images, with each image Vt represented by a matrix (referred to as a resilient distributed data in Spark notation) of size (L, C), where L represents the number of rows in the image and C represents the number of columns. Hence, in order to compute the reduced centered matrix of V, denoted as MRC, a parallel distributed computation is performed on each image Vt. โˆ’ Calculate the centered matrix of V denoted MC algorithm 2: ๐‘€๐ถ๐‘ก๐‘–๐‘— = ๐‘‰๐‘ก๐‘–๐‘— โˆ’ ๐‘‰๐‘ก ฬ… for each ๐‘– = 1 to L and for each ๐‘— = 1 to ๐ถ (3) with ๐‘‰๐‘ก ฬ… = โˆ‘ โˆ‘ ( 1 ๐ฟ๐‘ฅ๐ถ ๐‘ฅ ๐‘‰๐‘ก๐‘–๐‘—) ๐ถ ๐‘—=1 ๐ฟ ๐‘–=1 Algorithm 2. Calculating the centered matrix with Spark Algorithm Center_Images (V) Input: vector images V Output: vector of centered images MC For each image Vt do
  • 5. Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ Visualization of hyperspectral images on parallel and distributed platform: Apache Spark (Abdelali Zbakh) 7119 Map1: for each line i of image Vt do calculate X[i]=sum (Vti) return X Reduce1: calculate the average of X denoted avg Map2: for each line i of image Vt for each value Vti,j calculate MC tij= Vtij-avg return MC In the formula 3, ๐‘‰๐‘ก ฬ… denoted the average of image ๐‘‰๐‘ก โˆ’ Calculate the reduced centered matrix of M denoted MRC algorithm 3: ๐‘€๐‘…๐ถ๐‘ก๐‘–๐‘— = MCtij ฯƒt for each ๐‘– = 1 to ๐ฟ and for each ๐‘— = 1 to ๐ถ (4) with ๐œŽ๐‘ก 2 = 1 ๐ฟ๐‘ฅ๐ถ โˆ‘ โˆ‘ (๐‘‰๐‘ก๐‘–๐‘— โˆ’ ๐‘‰๐‘ก ฬ… ๐ถ ๐‘—=1 ) ๐ฟ ๐‘–=1 2 or ๐œŽ๐‘ก 2 = 1 ๐ฟ๐‘ฅ๐ถ โˆ‘ โˆ‘ (๐‘€๐ถ๐‘ก๐‘–๐‘— ๐ถ ๐‘—=1 ) ๐ฟ ๐‘–=1 2 In the formula 4, ๐œŽ๐‘ก denoted the standard deviation of image ๐‘‰๐‘ก. Algorithm 3. Calculating the reduced centered matrix with Spark Algorithm Reducing_Images (MC) Input: vector images V centered Output: the reduced centered matrix MRC For each image centered ๐‘€๐ถ๐‘ก do Map1: # Calculate the standard deviation of image Vt denoted ฯƒt for each line ๐‘– of image ๐‘€๐ถ๐‘ก do for each value ๐‘€๐ถ๐‘ก๐‘–, ๐‘— do calculate ๐‘€๐ถ๐‘ก๐‘–, ๐‘— = (๐‘€๐ถ๐‘ก๐‘–, ๐‘— โˆ— ๐‘€๐ถ๐‘ก๐‘–, ๐‘—)/(๐ฟ๐‘ฅ๐ถ) return ๐‘€๐ถ๐‘ก Reduce1: Calculate sqrt(sum(๐‘€๐ถ๐‘ก)) denoted ฯƒt Map2: for each line i of image ๐‘€๐ถ๐‘ก do for each value ๐‘€๐ถ๐‘ก๐‘–, ๐‘— do calculate ๐‘€๐‘…๐ถ๐‘ก๐‘–๐‘— = ๐‘€๐ถ๐‘ก๐‘–, ๐‘—/๐œŽ๐‘ก return ๐‘€๐‘…๐ถ Step 2: Calculate the MRC correlation matrix of size (N, N) denoted: ๐‘€๐ถ๐‘œ๐‘œ๐‘Ÿ As stated in step 1, the MRC represents an image vector of size N. Every image ๐‘€๐‘…๐ถ๐‘ก corresponds to a reduced and centered matrix. We will now utilize Spark's distributed parallel computation framework, MapReduce, to compute the correlation matrix of size (N, N) by performing a matrix product operation between the MRCT and MRC vectors. ๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ = 1 ๐ฟ๐‘ฅ๐ถ (๐‘€๐‘…๐ถ๐‘‡ . ๐‘€๐‘…๐ถ) (5) ๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ๐‘ก,๐‘˜ = 1 LxC ( MRCt . MRCk ) for each ๐‘ก = 1 to N and for each ๐‘˜ = 1 to N (6)
  • 6. ๏ฒ ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124 7120 with ๐‘€๐‘…๐ถ๐‘ก . ๐‘€๐‘…๐ถ๐‘˜ = โˆ‘ โˆ‘ ๐‘€๐‘…๐ถ๐‘ก๐‘–๐‘— . ๐‘€๐‘…๐ถ๐‘˜๐‘–๐‘— ๐ถ ๐‘—=1 ๐ฟ ๐‘–=1 To determine the value of each ๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ๐‘ก,๐‘˜ in formula (6), the image ๐‘€๐‘…๐ถ๐‘ก is multiplied by the image ๐‘€๐‘…๐ถ๐‘˜ pixel by pixel. Then we calculate the average of result algorithm 4: Algorithm 4. Calculation of the correlation matrix using Spark Algorithm Correlation_Images (MRC) Input: Reduced centered matrix MRC Output: Correlation matrix Mcorr of size NxN For each 1 โ‰ค ๐‘ก โ‰ค ๐‘ do For each 1 โ‰ค ๐‘˜ โ‰ค ๐‘ do Calculate ๐‘† = ๐‘ƒ๐‘Ÿ๐‘œ๐‘‘๐‘ข๐‘๐‘ก(๐‘€๐‘…๐ถ๐‘ก, ๐‘€๐‘…๐ถ๐‘˜) ๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ๐‘ก,๐‘˜ = ๐‘†/(๐ฟ ร— ๐ถ) return ๐‘€๐ถ๐‘œ๐‘Ÿ๐‘Ÿ Algorithm Product(๐‘€๐‘…๐ถ๐‘ก, ๐‘€๐‘…๐ถ๐‘˜) Input: 2 Reduced centered matrix ๐‘€๐‘…๐ถ๐‘ก, ๐‘€๐‘…๐ถ๐‘˜ Output: sum(the product of two images pixel by pixel) Map1: for each line ๐‘– of image ๐‘€๐‘…๐ถ๐‘ก do calculate ๐‘‹๐‘– = (๐‘€๐‘…๐ถ๐‘ก๐‘–, ๐‘€๐‘…๐ถ๐‘˜๐‘–) return ๐‘‹ Map2: for each line ๐‘– of image ๐‘‹ do calculate Xi= scalar product between ๐‘‹๐‘–[0] et ๐‘‹๐‘–[1] return X Reduce1: Calculate ๐‘†๐‘ข๐‘š(๐‘‹) denoted ๐‘† Return ๐‘† Step 3: Calculate the eigenvector and eigenvalues of the MCorr matrix: [๐œ†, ๐‘‰] Step 4: Arrange the eigenvectors in descending order based on their corresponding eigenvalues and select the first three columns of V (3 < ๐‘) Step 5: Perform a projection of the matrix M onto the vector ๐‘‰: ๐‘ˆ = ๐‘€. ๐‘‰ Step 6: Utilize the newly obtained matrix U, which has a size of (m, 3), for the purpose of visualizing the hyperspectral image. 4. EXPERIMENTS AND COMPUTATIONS To test the proposed algorithm, the free visible air infra-red imaging spectrometer (AVIRIS) Moffett Field image was used with 224 spectral bands in the 2.5 nanometers to 400 nanometers, which was acquired on August 20, 1992 [14]. On this hyperspectral image, we took samples of different sizes, see Table 1, and then on each image obtained, we tested the proposed distributed parallel algorithm and a serial implementation of classical PCA from the Python library scikit-learn. We collected the three most significant eigenvalues as shown in Table 2 and the execution time of each algorithm as shown in Figure 2. Table 1. Datasets Name of dataset Spatial dimensions Hyperspectral bands Dataset 1 Moffett Field 500ร—500 3 Dataset 2 Moffett Field 500ร—500 10 Dataset 3 Moffett Field 1924ร—753 3 Dataset 4 Moffett Field 1924ร—753 10 Dataset 5 Moffett Field 1924ร—753 15 Dataset 6 Moffett Field 1924ร—753 20 Dataset 7 Moffett Field 1924ร—753 25 Dataset 8 Moffett Field 1924ร—753 50 Dataset 9 Moffett Field 1924ร—753 75 Dataset 10 Moffett Field 1924ร—753 100 Dataset 11 Moffett Field 1924ร—753 150 Dataset 12 Moffett Field 1924ร—753 224
  • 7. Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ Visualization of hyperspectral images on parallel and distributed platform: Apache Spark (Abdelali Zbakh) 7121 Table 2. Example of the top three eigenvalues obtained from PCA Sklearn PCA Proposed PCA Dataset 1 1.9371026343 0.913755533084 0.149141832615 1.93710263 0.9137555 0.14914183 Dataset 5 10.06478855 4.01771578 0.5480712 10.06478855, 4.01771578, 0.5480712 Dataset 12 160.63876264 28.00313352 14.56390331 160.63876264, 28.00313352, 14.56390331 Figure 2. The runtime comparison between sklearn and the proposed PCA The classical PCA of the scikit-learn library is tested on one computer equipped with: CPU: Intelยฎ Core โ„ข i7-2820QM CPU @ 2.30 GHz ร— 8, RAM: 8G, OS: Ubuntu 16.04 LTS. The proposed distributed parallel algorithm has been tested on the cloud Databricks [26] of the configuration, as shown in Table 3. Both algorithms are programmed with the Python language. The runtime comparison of the two algorithms shows the speed of PCA sklearn for small images, but if the image has a high number of bands, more than 10 spectral bands our proposed PCA is faster, see Figure 2. Figure 3 illustrates the visualization of a hyperspectral image dataset. In Figure 3(a), the image is displayed without any PCA applied, presenting the original representation. In contrast, Figure 3(b) showcases the image after the application of either classical PCA or the newly proposed PCA distributed method. Table 3. Configuration parameters of cluster spark in cloud Databricks Driver Nodes Driver type: 36 GB memory, 8 Cores Number of Worker Nodes: 6 For each worker :8.0 GB Memory, 2 Core
  • 8. ๏ฒ ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124 7122 (a) (b) Figure 3. Visualization of hyperspectral image (dataset 12) in (a) the image is displayed without PCA, while on the (b) the image is shown after applying either classical PCA or the proposed PCA 5. CONCLUSION In this work, a method of visualizing a hyperspectral image has been proposed based on the reduction of the dimensionality of the image in a parallel distributed environment. The algorithm has been developed using Python 3, and evaluated on hyperspectral images utilizing the Spark platform. The results obtained align with those of traditional PCA, and the visualization of the images post-application of our reduction algorithm confirms the validity of our algorithm. By comparing the execution time of the two algorithms: sklearn PCA and proposed PCA, we discovered that the proposed PCA algorithm displays faster performance when processing large images. This observation implies that the proposed PCA algorithm may be more efficient and effective in handling larger data sets compared to the classic algorithm. REFERENCES [1] J. S. Tyo, A. Konsolakis, D. I. Diersen, and R. C. Olsen, โ€œPrincipal-components-based display strategy for spectral imagery,โ€ IEEE Transactions on Geoscience and Remote Sensing, vol. 41, no. 3, pp. 708โ€“718, Mar. 2003, doi: 10.1109/TGRS.2003.808879. [2] J. Pontius, M. Martin, L. Plourde, and R. Hallett, โ€œAsh decline assessment in emerald ash borer-infested regions: A test of tree- level, hyperspectral technologies,โ€ Remote Sensing of Environment, vol. 112, no. 5, pp. 2665โ€“2676, May 2008, doi: 10.1016/j.rse.2007.12.011.
  • 9. Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ Visualization of hyperspectral images on parallel and distributed platform: Apache Spark (Abdelali Zbakh) 7123 [3] Y.-T. Chan, S.-J. Wang, and C.-H. Tsai, โ€œReal-time foreground detection approach based on adaptive ensemble learning with arbitrary algorithms for changing environments,โ€ Information Fusion, vol. 39, pp. 154โ€“167, Jan. 2018, doi: 10.1016/j.inffus.2017.05.001. [4] G. Cheng, J. Han, and X. Lu, โ€œRemote sensing image scene classification: Benchmark and state of the art,โ€ Proceedings of the IEEE, vol. 105, no. 10, pp. 1865โ€“1883, Oct. 2017, doi: 10.1109/JPROC.2017.2675998. [5] P. Duan, X. Kang, S. Li, and P. Ghamisi, โ€œNoise-robust hyperspectral image classification via multi-scale total variation,โ€ IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 12, no. 6, pp. 1948โ€“1962, Jun. 2019, doi: 10.1109/JSTARS.2019.2915272. [6] Y. Khouj, J. Dawson, J. Coad, and L. Vona-Davis, โ€œHyperspectral imaging and K-means classification for histologic evaluation of ductal carcinoma in situ,โ€ Frontiers in Oncology, vol. 8, Feb. 2018, doi: 10.3389/fonc.2018.00017. [7] H. Su, Q. Du, and P. Du, โ€œHyperspectral image visualization using band selection,โ€ IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 7, no. 6, pp. 2647โ€“2658, Jun. 2014, doi: 10.1109/JSTARS.2013.2272654. [8] Yuan Yuan, Guokang Zhu, and Qi Wang, โ€œHyperspectral band selection by multitask sparsity pursuit,โ€ IEEE Transactions on Geoscience and Remote Sensing, vol. 53, no. 2, pp. 631โ€“644, Feb. 2015, doi: 10.1109/TGRS.2014.2326655. [9] G. Zhu, Y. Huang, J. Lei, Z. Bi, and F. Xu, โ€œUnsupervised hyperspectral band selection by dominant set extraction,โ€ IEEE Transactions on Geoscience and Remote Sensing, vol. 54, no. 1, pp. 227โ€“239, Jan. 2016, doi: 10.1109/TGRS.2015.2453362. [10] C. Theoharatos, V. Tsagaris, N. Fragoulis, and G. Economou, โ€œHyperspectral image fusion using 2-D principal component analysis,โ€ in 2011 2nd International Conference on Space Technology, Sep. 2011, pp. 1โ€“4, doi: 10.1109/ICSpT.2011.6064682. [11] W. Liu, X. Yang, D. Tao, J. Cheng, and Y. Tang, โ€œMultiview dimension reduction via hessian multiset canonical correlations,โ€ Information Fusion, vol. 41, pp. 119โ€“128, May 2018, doi: 10.1016/j.inffus.2017.09.001. [12] R. S. Lynch and P. K. Willett, โ€œUse of Bayesian data reduction for the fusion of legacy classifiers,โ€ Information Fusion, vol. 4, no. 1, pp. 23โ€“34, Mar. 2003, doi: 10.1016/S1566-2535(02)00098-2. [13] S. Salloum, R. Dautov, X. Chen, P. X. Peng, and J. Z. Huang, โ€œBig data analytics on apache spark,โ€ International Journal of Data Science and Analytics, vol. 1, no. 3โ€“4, pp. 145โ€“164, Nov. 2016, doi: 10.1007/s41060-016-0027-9. [14] A. Zbakh, Z. Alaoui, A. Benyoussef, A. El, and M. El, โ€œSpectral classification of a set of hyperspectral images using the convolutional neural network, in a single training,โ€ International Journal of Advanced Computer Science and Applications, vol. 10, no. 6, 2019, doi: 10.14569/IJACSA.2019.0100634. [15] K. Kotwal and S. Chaudhuri, โ€œVisualization of hyperspectral images using bilateral filtering,โ€ IEEE Transactions on Geoscience and Remote Sensing, vol. 48, no. 5, pp. 2308โ€“2316, May 2010, doi: 10.1109/TGRS.2009.2037950. [16] M. Mignotte, โ€œA bicriteria-optimization-approach-based dimensionality-reduction model for the color display of hyperspectral images,โ€ IEEE Transactions on Geoscience and Remote Sensing, vol. 50, no. 2, pp. 501โ€“513, Feb. 2012, doi: 10.1109/TGRS.2011.2160646. [17] Q. Du, N. Raksuntorn, S. Cai, and R. J. Moorhead, โ€œColor display for hyperspectral imagery,โ€ IEEE Transactions on Geoscience and Remote Sensing, vol. 46, no. 6, pp. 1858โ€“1866, Jun. 2008, doi: 10.1109/TGRS.2008.916203. [18] B. Zhao, X. Dong, Y. Guo, X. Jia, and Y. Huang, โ€œPCA dimensionality reduction method for image classification,โ€ Neural Processing Letters, vol. 54, no. 1, pp. 347โ€“368, Feb. 2022, doi: 10.1007/s11063-021-10632-5. [19] Xiuping Jia and J. A. Richards, โ€œSegmented principal components transformation for efficient hyperspectral remote-sensing image display and classification,โ€ IEEE Transactions on Geoscience and Remote Sensing, vol. 37, no. 1, pp. 538โ€“542, 1999, doi: 10.1109/36.739109. [20] H. Zhang, D. W. Messinger, and E. D. Montag, โ€œPerceptual display strategies of hyperspectral imagery based on PCA and ICA,โ€ in Proc. SPIE 6233, Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XI, May 2006, doi: 10.1117/12.665696. [21] X. Meng et al., โ€œMLlib: Machine learning in apache spark,โ€ Journal of Machine Learning Research, vol. 17, pp. 1โ€“7, 2016. [22] O. Azeroual and A. Nikiforova, โ€œApache spark and MLlib-based intrusion detection system or how the big data technologies can secure the data,โ€ Information, vol. 13, no. 2, Jan. 2022, doi: 10.3390/info13020058. [23] N. S. Sagheer and S. A. Yousif, โ€œA parallel clustering analysis based on hadoop multi-node and apache mahout,โ€ Iraqi Journal of Science, pp. 2431โ€“2444, Jul. 2021, doi: 10.24996/ijs.2021.62.7.32. [24] T. Elgamal, M. Yabandeh, A. Aboulnaga, W. Mustafa, and M. Hefeeda, โ€œSPCA: Scalable principal component analysis for big data on distributed platforms,โ€ in Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, May 2015, pp. 79โ€“91, doi: 10.1145/2723372.2751520. [25] Z. Wu, Y. Li, A. Plaza, J. Li, F. Xiao, and Z. Wei, โ€œParallel and distributed dimensionality reduction of hyperspectral data on cloud computing architectures,โ€ IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 9, no. 6, pp. 2270โ€“2278, Jun. 2016, doi: 10.1109/JSTARS.2016.2542193. [26] Y. O. Sayad, H. Mousannif, and H. Al Moatassime, โ€œPredictive modeling of wildfires: A new dataset and machine learning approach,โ€ Fire Safety Journal, vol. 104, pp. 130โ€“146, Mar. 2019, doi: 10.1016/j.firesaf.2019.01.006. BIOGRAPHIES OF AUTHORS Abdelali Zbakh is an assistant professor in Computer Science at National School of Business and Management-Tangier, Abdelmalek Essaรขdi University Morocco. He is a former Teacher of computing at preparatory classes for engineering schools โ€“ Tangier. He received his Ph.D. degree in computer science from the faculty of sciences Rabat - Mohammed V university of Rabat. His current research interests include information systems, machine learning and deep learning. He can be contacted at email a.zbakh@uae.ac.ma.
  • 10. ๏ฒ ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 13, No. 6, December 2023: 7115-7124 7124 Mohamed Taj Bennani received his masterโ€™s degree in Computer Science and Networking from Science Faculty of Tangier, Tangier in 2011. He received his Ph.D. in 2019 (Computing Science and Networking) from Science Faculty of Tangier. At present, he is working as a prof. at Faculty of Science of Dhar el Mahraz Fez since 2019. He can be contacted at email Bennani.taj@gmail.com. Adnan Souri is an assistant professor in Computer Science at Abdelmalek Essaรขdi University, Faculty of Sciences Tetouan, Morocco. He is a former Teacher of computing at preparatory classes for engineering schools โ€“ Tangier. He received his Ph.D. degree in computer science from the Faculty of Sciences Tetouan, Abdelmalek Essaรขdi University Morocco. His current research interests include artificial intelligence, artificial neural networks and algorithms. Their current project is โ€œArabic language processingโ€. He can be contacted at email a.souri@uae.ac.ma. Outman El Hichami received his Ph.D. in 2017 from the Faculty of Sciences in Tetouan, Morocco. In 2018, he joined the Higher Normal School in Tetouan as an assistant professor in Computer Science, where he was promoted to associate professor in 2022. His research interests are in formal methods and machine learning. He can be contacted at email oelhichami@uae.ac.ma.