SlideShare a Scribd company logo
1 of 34
Download to read offline
Data access and Data extraction
Services within the Land Imagery portal
Jerome Gasperi @ CNES | HAWG - Models for scientific exploitation of EO Data
Frascati, Italy - October 12th, 2012
Land Imagery Portal
Overview
Search service
Download service

What's next
Thematic data extraction
Land Imagery Portal
The

*
PTSC

is the future French "Thematic
Center for Land Imagery"

*

temporary name, subject to change when operational
v0 (end of 2012)
Official launch of the portal
v1 (2013)
additionnal datasets from CNES and partners, SSO
integration, etc.
Search service
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)
Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

OpenSearch

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)

HMA

Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

OpenSearch
INSPIRE

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)

HMA

Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

INSPIRE

V0

OpenSearch

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)

HMA

Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

V1
Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

INSPIRE

V0

OpenSearch

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Download service
Product download url is embeded within
the product metadata returned by the
search service
Two cases :
url content mimeType is "text/html"
No direct download. The url is opened in another browser tab. User follows the instructions on the
corresponding web page to download the product (this is typically the case for a product that required to
explicitely sign an NDA before downloading it)

otherwise product can be downloaded
directly
No common downloading format has been decided yet. The products are downloaded as is.
What's next
Thematic data extraction
Important note - the following slides present a proposal that will be discussed
by the PTSC partners to be integrated (or not) within the Land Imagery portal.
Thematic data extraction
?

How to search within the portal for products
that contains coastal cultivated areas ?
Orthorectified image
Orthorectified image

What we got
Orthorectified image

What we got

Characterized image
This is water
This is urban

This is forest

Orthorectified image

What we got

Characterized image
This is water
This is urban

This is forest

Orthorectified image

What we got

Characterized image

What we need
How to do this ?
SLACkER

SimpLe Automated Characterization of EaRth observation products
SLACkER uses GLC 2000 classification to
perform an automatic and location based
characterization of products
Global Land Cover 2000
World land cover
TIFF file ~ 650 Mo
1 km resolution
1 color = 1 thematic class
22 classes
OpenSearch

PTSC

Metacatalog
Identifier
Description
Copyright
Acquisition date
Acquisition angles
Thumbnail
...
+ Footprint

1. Get footprint bounding box

2. Get GLC2000 area

0. Get metadata
3. Process characterization

4. Store results

SLACkER
Processing result example
Tag table images within database glc2000
>> Add classification columns
>> Processing 10
Crop GLC2000 raster : 24137 6169 156 119
Polygonize extracted raster
Process footprint against Global Land Cover
Store classification
=> 40.89% of Deserts (10 + 14 + 19)
=> 31.89% of Herbaceous (9 + 11 + 12 + 13)
=> 14.71% of Water (20)
=> 9.27% of Cultivated (15 + 16 + 17 + 18)
=> 3.2% of Forests (1 + 2 + 3 + 4 + 5 + 6)
(
(
(
(
(
(
(
(
(
(

INPUT : metadata

OUTPUT : additional thematics info stored
beside the metadata within the Metacatalog

28.65 % of 14 : Sparse Herbaceous or sparse Shrub Cover )
6.1 % of 18 : Mosaic: Cropland / Shrub or Grass Cover )
12.24 % of 19 : Bare Areas )
31.88 % of 12 : Shrub Cover, closed-open, deciduous )
2.5 % of 3 : Tree Cover, broadleaved, deciduous, open )
14.71 % of 20 : Water Bodies (natural & artificial) )
0.13 % of 15 : Regularly flooded Shrub and/or Herbaceous Cover )
2.81 % of 16 : Cultivated and managed areas )
0.69 % of 4 : Tree Cover, needle-leaved, evergreen )
0.21 % of 17 : Mosaic: Cropland / Tree Cover / Other natural vegetation )
Thematic sliders

SPOT cover - 1,300,000 scenes
Search for coastal cultivated area ?
Coastal cultivated area
Search results

(footprints displayed in black over the map)
costal...

...cultivated area
Thematic classification
is displayed within
the result metadata
https://vimeo.com/51045597
Data access and data extraction services within the Land Imagery Portal

More Related Content

What's hot

Semantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12cSemantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12cMartin Toshev
 
GeoServer on steroids
GeoServer on steroidsGeoServer on steroids
GeoServer on steroidsGeoSolutions
 
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...GeoSolutions
 
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...GeoSolutions
 
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigData_Europe
 
Advanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceAdvanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceGeoSolutions
 
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Hajira Jabeen
 
Maps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reiniMaps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reiniOlli Rinne
 
ckan 2.0 Introduction
ckan 2.0 Introductionckan 2.0 Introduction
ckan 2.0 IntroductionChengjen Lee
 
GeoNetwork, The Open Source Solution for the interoperable management of ge...
GeoNetwork, The Open Source Solution  for the interoperable management  of ge...GeoNetwork, The Open Source Solution  for the interoperable management  of ge...
GeoNetwork, The Open Source Solution for the interoperable management of ge...GeoSolutions
 
Advanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServerAdvanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServerGeoSolutions
 
State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016GeoSolutions
 
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...GeoSolutions
 
Ukgovld registry-intro
Ukgovld registry-introUkgovld registry-intro
Ukgovld registry-introDave Reynolds
 

What's hot (20)

Semantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12cSemantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12c
 
GeoServer on steroids
GeoServer on steroidsGeoServer on steroids
GeoServer on steroids
 
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
 
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
 
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal Pilots
 
The DBpedia databus
The DBpedia databusThe DBpedia databus
The DBpedia databus
 
ADO CONTROLS - Database usage
ADO CONTROLS - Database usageADO CONTROLS - Database usage
ADO CONTROLS - Database usage
 
Bridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data ProductsBridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data Products
 
Solr in Drupal
Solr in DrupalSolr in Drupal
Solr in Drupal
 
Advanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceAdvanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFence
 
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
 
Maps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reiniMaps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reini
 
ckan 2.0 Introduction
ckan 2.0 Introductionckan 2.0 Introduction
ckan 2.0 Introduction
 
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
 
GeoNetwork, The Open Source Solution for the interoperable management of ge...
GeoNetwork, The Open Source Solution  for the interoperable management  of ge...GeoNetwork, The Open Source Solution  for the interoperable management  of ge...
GeoNetwork, The Open Source Solution for the interoperable management of ge...
 
Advanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServerAdvanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServer
 
State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016
 
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
 
Ukgovld registry-intro
Ukgovld registry-introUkgovld registry-intro
Ukgovld registry-intro
 
HDF Group Support for NPP/NPOESS/JPSS
HDF Group Support for NPP/NPOESS/JPSSHDF Group Support for NPP/NPOESS/JPSS
HDF Group Support for NPP/NPOESS/JPSS
 

Similar to Data access and data extraction services within the Land Imagery Portal

The new CIARD RING , a machine-readable directory of datasets for agriculture
The new CIARD RING, a machine-readable directory of datasets for agricultureThe new CIARD RING, a machine-readable directory of datasets for agriculture
The new CIARD RING , a machine-readable directory of datasets for agricultureValeria Pesce
 
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkFOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkGoedertier Stijn
 
Thrombus Training Dec. 2013
Thrombus Training Dec. 2013Thrombus Training Dec. 2013
Thrombus Training Dec. 2013CREATIS
 
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical DemonstrationMaximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical DemonstrationDenodo
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshSion Smith
 
Best practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at RenaultBest practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at RenaultDataWorks Summit
 
20100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v120100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v1Gilles Guirand
 
Flagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertierFlagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertierFlagis VZW
 
Micka Manual
Micka ManualMicka Manual
Micka ManualSDIEDU
 
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL Cynthia Saracco
 
Maps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari ReiniMaps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari ReiniApps4Finland
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...Andreas Schreiber
 
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado BlascoDSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado BlascoDeltares
 
Large Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster ReliefLarge Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster ReliefRobert Grossman
 
Intro elasticsearch taswarbhatti
Intro elasticsearch taswarbhattiIntro elasticsearch taswarbhatti
Intro elasticsearch taswarbhattiTaswar Bhatti
 

Similar to Data access and data extraction services within the Land Imagery Portal (20)

Geoportal4everybody
Geoportal4everybodyGeoportal4everybody
Geoportal4everybody
 
The new CIARD RING , a machine-readable directory of datasets for agriculture
The new CIARD RING, a machine-readable directory of datasets for agricultureThe new CIARD RING, a machine-readable directory of datasets for agriculture
The new CIARD RING , a machine-readable directory of datasets for agriculture
 
Geohosting
GeohostingGeohosting
Geohosting
 
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkFOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
 
Data Skipping Technology
Data Skipping TechnologyData Skipping Technology
Data Skipping Technology
 
Data Skipping Technology Yosef Moatti
Data Skipping Technology Yosef MoattiData Skipping Technology Yosef Moatti
Data Skipping Technology Yosef Moatti
 
Thrombus Training Dec. 2013
Thrombus Training Dec. 2013Thrombus Training Dec. 2013
Thrombus Training Dec. 2013
 
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical DemonstrationMaximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
 
Metadata in EOSDIS
Metadata in EOSDISMetadata in EOSDIS
Metadata in EOSDIS
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data Mesh
 
Best practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at RenaultBest practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at Renault
 
20100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v120100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v1
 
Flagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertierFlagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertier
 
Micka Manual
Micka ManualMicka Manual
Micka Manual
 
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
 
Maps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari ReiniMaps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari Reini
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
 
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado BlascoDSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
 
Large Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster ReliefLarge Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster Relief
 
Intro elasticsearch taswarbhatti
Intro elasticsearch taswarbhattiIntro elasticsearch taswarbhatti
Intro elasticsearch taswarbhatti
 

More from Gasperi Jerome

Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017Gasperi Jerome
 
Le Big Data et les données Copernicus
Le Big Data et les données CopernicusLe Big Data et les données Copernicus
Le Big Data et les données CopernicusGasperi Jerome
 
2016.02.18 big data from space toulouse data science
2016.02.18   big data from space    toulouse data science2016.02.18   big data from space    toulouse data science
2016.02.18 big data from space toulouse data scienceGasperi Jerome
 
2015.11.12 big data from space - cusi toulouse
2015.11.12   big data from space - cusi toulouse2015.11.12   big data from space - cusi toulouse
2015.11.12 big data from space - cusi toulouseGasperi Jerome
 
Big Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerreBig Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerreGasperi Jerome
 
Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...Gasperi Jerome
 
2014.09.04 federated ground segments - toulouse
2014.09.04   federated ground segments - toulouse2014.09.04   federated ground segments - toulouse
2014.09.04 federated ground segments - toulouseGasperi Jerome
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing ServiceGasperi Jerome
 
2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution ServerGasperi Jerome
 
Semantic search for Earth Observation products
Semantic search for Earth Observation productsSemantic search for Earth Observation products
Semantic search for Earth Observation productsGasperi Jerome
 
RESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatialRESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatialGasperi Jerome
 
Single Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenIDSingle Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenIDGasperi Jerome
 
CNES OpenSearch implementations
CNES OpenSearch implementationsCNES OpenSearch implementations
CNES OpenSearch implementationsGasperi Jerome
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing ServiceGasperi Jerome
 
Unify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearchUnify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearchGasperi Jerome
 
CNES activities on semantic search
CNES activities on semantic searchCNES activities on semantic search
CNES activities on semantic searchGasperi Jerome
 
Traitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing ServiceTraitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing ServiceGasperi Jerome
 
Semantic search applied to Earth Observation products
Semantic search applied to Earth Observation productsSemantic search applied to Earth Observation products
Semantic search applied to Earth Observation productsGasperi Jerome
 
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...Gasperi Jerome
 

More from Gasperi Jerome (20)

Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017
 
Le Big Data et les données Copernicus
Le Big Data et les données CopernicusLe Big Data et les données Copernicus
Le Big Data et les données Copernicus
 
2016.02.18 big data from space toulouse data science
2016.02.18   big data from space    toulouse data science2016.02.18   big data from space    toulouse data science
2016.02.18 big data from space toulouse data science
 
2015.11.12 big data from space - cusi toulouse
2015.11.12   big data from space - cusi toulouse2015.11.12   big data from space - cusi toulouse
2015.11.12 big data from space - cusi toulouse
 
Big Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerreBig Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerre
 
Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...
 
2014.09.04 federated ground segments - toulouse
2014.09.04   federated ground segments - toulouse2014.09.04   federated ground segments - toulouse
2014.09.04 federated ground segments - toulouse
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing Service
 
2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server
 
Semantic search for Earth Observation products
Semantic search for Earth Observation productsSemantic search for Earth Observation products
Semantic search for Earth Observation products
 
RESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatialRESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatial
 
Single Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenIDSingle Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenID
 
CNES Data Center
CNES Data CenterCNES Data Center
CNES Data Center
 
CNES OpenSearch implementations
CNES OpenSearch implementationsCNES OpenSearch implementations
CNES OpenSearch implementations
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing Service
 
Unify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearchUnify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearch
 
CNES activities on semantic search
CNES activities on semantic searchCNES activities on semantic search
CNES activities on semantic search
 
Traitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing ServiceTraitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing Service
 
Semantic search applied to Earth Observation products
Semantic search applied to Earth Observation productsSemantic search applied to Earth Observation products
Semantic search applied to Earth Observation products
 
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
 

Recently uploaded

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 

Recently uploaded (20)

"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 

Data access and data extraction services within the Land Imagery Portal

  • 1. Data access and Data extraction Services within the Land Imagery portal Jerome Gasperi @ CNES | HAWG - Models for scientific exploitation of EO Data Frascati, Italy - October 12th, 2012
  • 2. Land Imagery Portal Overview Search service Download service What's next Thematic data extraction
  • 4. The * PTSC is the future French "Thematic Center for Land Imagery" * temporary name, subject to change when operational
  • 5. v0 (end of 2012) Official launch of the portal v1 (2013) additionnal datasets from CNES and partners, SSO integration, etc.
  • 7. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO OpenSearch PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 8. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) HMA Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO OpenSearch INSPIRE PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 9. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) HMA Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO INSPIRE V0 OpenSearch PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 10. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) HMA Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) V1 Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO INSPIRE V0 OpenSearch PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 12. Product download url is embeded within the product metadata returned by the search service
  • 13. Two cases : url content mimeType is "text/html" No direct download. The url is opened in another browser tab. User follows the instructions on the corresponding web page to download the product (this is typically the case for a product that required to explicitely sign an NDA before downloading it) otherwise product can be downloaded directly No common downloading format has been decided yet. The products are downloaded as is.
  • 15. Important note - the following slides present a proposal that will be discussed by the PTSC partners to be integrated (or not) within the Land Imagery portal.
  • 17. ? How to search within the portal for products that contains coastal cultivated areas ?
  • 20. Orthorectified image What we got Characterized image
  • 21. This is water This is urban This is forest Orthorectified image What we got Characterized image
  • 22. This is water This is urban This is forest Orthorectified image What we got Characterized image What we need
  • 23. How to do this ?
  • 24. SLACkER SimpLe Automated Characterization of EaRth observation products
  • 25. SLACkER uses GLC 2000 classification to perform an automatic and location based characterization of products
  • 26. Global Land Cover 2000 World land cover TIFF file ~ 650 Mo 1 km resolution 1 color = 1 thematic class 22 classes
  • 27. OpenSearch PTSC Metacatalog Identifier Description Copyright Acquisition date Acquisition angles Thumbnail ... + Footprint 1. Get footprint bounding box 2. Get GLC2000 area 0. Get metadata 3. Process characterization 4. Store results SLACkER
  • 28. Processing result example Tag table images within database glc2000 >> Add classification columns >> Processing 10 Crop GLC2000 raster : 24137 6169 156 119 Polygonize extracted raster Process footprint against Global Land Cover Store classification => 40.89% of Deserts (10 + 14 + 19) => 31.89% of Herbaceous (9 + 11 + 12 + 13) => 14.71% of Water (20) => 9.27% of Cultivated (15 + 16 + 17 + 18) => 3.2% of Forests (1 + 2 + 3 + 4 + 5 + 6) ( ( ( ( ( ( ( ( ( ( INPUT : metadata OUTPUT : additional thematics info stored beside the metadata within the Metacatalog 28.65 % of 14 : Sparse Herbaceous or sparse Shrub Cover ) 6.1 % of 18 : Mosaic: Cropland / Shrub or Grass Cover ) 12.24 % of 19 : Bare Areas ) 31.88 % of 12 : Shrub Cover, closed-open, deciduous ) 2.5 % of 3 : Tree Cover, broadleaved, deciduous, open ) 14.71 % of 20 : Water Bodies (natural & artificial) ) 0.13 % of 15 : Regularly flooded Shrub and/or Herbaceous Cover ) 2.81 % of 16 : Cultivated and managed areas ) 0.69 % of 4 : Tree Cover, needle-leaved, evergreen ) 0.21 % of 17 : Mosaic: Cropland / Tree Cover / Other natural vegetation )
  • 29. Thematic sliders SPOT cover - 1,300,000 scenes
  • 30. Search for coastal cultivated area ?
  • 31. Coastal cultivated area Search results (footprints displayed in black over the map)
  • 32. costal... ...cultivated area Thematic classification is displayed within the result metadata