SlideShare a Scribd company logo
1 of 34
Download to read offline
Data access and Data extraction
Services within the Land Imagery portal
Jerome Gasperi @ CNES | HAWG - Models for scientific exploitation of EO Data
Frascati, Italy - October 12th, 2012
Land Imagery Portal
Overview
Search service
Download service

What's next
Thematic data extraction
Land Imagery Portal
The

*
PTSC

is the future French "Thematic
Center for Land Imagery"

*

temporary name, subject to change when operational
v0 (end of 2012)
Official launch of the portal
v1 (2013)
additionnal datasets from CNES and partners, SSO
integration, etc.
Search service
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)
Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

OpenSearch

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)

HMA

Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

OpenSearch
INSPIRE

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)

HMA

Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

INSPIRE

V0

OpenSearch

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)

HMA

Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

V1
Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

INSPIRE

V0

OpenSearch

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Download service
Product download url is embeded within
the product metadata returned by the
search service
Two cases :
url content mimeType is "text/html"
No direct download. The url is opened in another browser tab. User follows the instructions on the
corresponding web page to download the product (this is typically the case for a product that required to
explicitely sign an NDA before downloading it)

otherwise product can be downloaded
directly
No common downloading format has been decided yet. The products are downloaded as is.
What's next
Thematic data extraction
Important note - the following slides present a proposal that will be discussed
by the PTSC partners to be integrated (or not) within the Land Imagery portal.
Thematic data extraction
?

How to search within the portal for products
that contains coastal cultivated areas ?
Orthorectified image
Orthorectified image

What we got
Orthorectified image

What we got

Characterized image
This is water
This is urban

This is forest

Orthorectified image

What we got

Characterized image
This is water
This is urban

This is forest

Orthorectified image

What we got

Characterized image

What we need
How to do this ?
SLACkER

SimpLe Automated Characterization of EaRth observation products
SLACkER uses GLC 2000 classification to
perform an automatic and location based
characterization of products
Global Land Cover 2000
World land cover
TIFF file ~ 650 Mo
1 km resolution
1 color = 1 thematic class
22 classes
OpenSearch

PTSC

Metacatalog
Identifier
Description
Copyright
Acquisition date
Acquisition angles
Thumbnail
...
+ Footprint

1. Get footprint bounding box

2. Get GLC2000 area

0. Get metadata
3. Process characterization

4. Store results

SLACkER
Processing result example
Tag table images within database glc2000
>> Add classification columns
>> Processing 10
Crop GLC2000 raster : 24137 6169 156 119
Polygonize extracted raster
Process footprint against Global Land Cover
Store classification
=> 40.89% of Deserts (10 + 14 + 19)
=> 31.89% of Herbaceous (9 + 11 + 12 + 13)
=> 14.71% of Water (20)
=> 9.27% of Cultivated (15 + 16 + 17 + 18)
=> 3.2% of Forests (1 + 2 + 3 + 4 + 5 + 6)
(
(
(
(
(
(
(
(
(
(

INPUT : metadata

OUTPUT : additional thematics info stored
beside the metadata within the Metacatalog

28.65 % of 14 : Sparse Herbaceous or sparse Shrub Cover )
6.1 % of 18 : Mosaic: Cropland / Shrub or Grass Cover )
12.24 % of 19 : Bare Areas )
31.88 % of 12 : Shrub Cover, closed-open, deciduous )
2.5 % of 3 : Tree Cover, broadleaved, deciduous, open )
14.71 % of 20 : Water Bodies (natural & artificial) )
0.13 % of 15 : Regularly flooded Shrub and/or Herbaceous Cover )
2.81 % of 16 : Cultivated and managed areas )
0.69 % of 4 : Tree Cover, needle-leaved, evergreen )
0.21 % of 17 : Mosaic: Cropland / Tree Cover / Other natural vegetation )
Thematic sliders

SPOT cover - 1,300,000 scenes
Search for coastal cultivated area ?
Coastal cultivated area
Search results

(footprints displayed in black over the map)
costal...

...cultivated area
Thematic classification
is displayed within
the result metadata
https://vimeo.com/51045597
Data access and data extraction services within the Land Imagery Portal

More Related Content

What's hot

Semantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12cSemantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12cMartin Toshev
 
GeoServer on steroids
GeoServer on steroidsGeoServer on steroids
GeoServer on steroidsGeoSolutions
 
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...GeoSolutions
 
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...GeoSolutions
 
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigData_Europe
 
Advanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceAdvanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceGeoSolutions
 
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Hajira Jabeen
 
Maps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reiniMaps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reiniOlli Rinne
 
ckan 2.0 Introduction
ckan 2.0 Introductionckan 2.0 Introduction
ckan 2.0 IntroductionChengjen Lee
 
GeoNetwork, The Open Source Solution for the interoperable management of ge...
GeoNetwork, The Open Source Solution  for the interoperable management  of ge...GeoNetwork, The Open Source Solution  for the interoperable management  of ge...
GeoNetwork, The Open Source Solution for the interoperable management of ge...GeoSolutions
 
Advanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServerAdvanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServerGeoSolutions
 
State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016GeoSolutions
 
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...GeoSolutions
 
Ukgovld registry-intro
Ukgovld registry-introUkgovld registry-intro
Ukgovld registry-introDave Reynolds
 

What's hot (20)

Semantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12cSemantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12c
 
GeoServer on steroids
GeoServer on steroidsGeoServer on steroids
GeoServer on steroids
 
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
 
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
 
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal Pilots
 
The DBpedia databus
The DBpedia databusThe DBpedia databus
The DBpedia databus
 
ADO CONTROLS - Database usage
ADO CONTROLS - Database usageADO CONTROLS - Database usage
ADO CONTROLS - Database usage
 
Bridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data ProductsBridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data Products
 
Solr in Drupal
Solr in DrupalSolr in Drupal
Solr in Drupal
 
Advanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceAdvanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFence
 
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
 
Maps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reiniMaps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reini
 
ckan 2.0 Introduction
ckan 2.0 Introductionckan 2.0 Introduction
ckan 2.0 Introduction
 
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
 
GeoNetwork, The Open Source Solution for the interoperable management of ge...
GeoNetwork, The Open Source Solution  for the interoperable management  of ge...GeoNetwork, The Open Source Solution  for the interoperable management  of ge...
GeoNetwork, The Open Source Solution for the interoperable management of ge...
 
Advanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServerAdvanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServer
 
State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016
 
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
 
Ukgovld registry-intro
Ukgovld registry-introUkgovld registry-intro
Ukgovld registry-intro
 
HDF Group Support for NPP/NPOESS/JPSS
HDF Group Support for NPP/NPOESS/JPSSHDF Group Support for NPP/NPOESS/JPSS
HDF Group Support for NPP/NPOESS/JPSS
 

Similar to Data access and data extraction services within the Land Imagery Portal

The new CIARD RING , a machine-readable directory of datasets for agriculture
The new CIARD RING, a machine-readable directory of datasets for agricultureThe new CIARD RING, a machine-readable directory of datasets for agriculture
The new CIARD RING , a machine-readable directory of datasets for agricultureValeria Pesce
 
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkFOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkGoedertier Stijn
 
Thrombus Training Dec. 2013
Thrombus Training Dec. 2013Thrombus Training Dec. 2013
Thrombus Training Dec. 2013CREATIS
 
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical DemonstrationMaximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical DemonstrationDenodo
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshSion Smith
 
Best practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at RenaultBest practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at RenaultDataWorks Summit
 
20100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v120100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v1Gilles Guirand
 
Flagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertierFlagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertierFlagis VZW
 
Micka Manual
Micka ManualMicka Manual
Micka ManualSDIEDU
 
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL Cynthia Saracco
 
Maps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari ReiniMaps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari ReiniApps4Finland
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...Andreas Schreiber
 
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado BlascoDSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado BlascoDeltares
 
Large Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster ReliefLarge Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster ReliefRobert Grossman
 
Intro elasticsearch taswarbhatti
Intro elasticsearch taswarbhattiIntro elasticsearch taswarbhatti
Intro elasticsearch taswarbhattiTaswar Bhatti
 

Similar to Data access and data extraction services within the Land Imagery Portal (20)

Geoportal4everybody
Geoportal4everybodyGeoportal4everybody
Geoportal4everybody
 
The new CIARD RING , a machine-readable directory of datasets for agriculture
The new CIARD RING, a machine-readable directory of datasets for agricultureThe new CIARD RING, a machine-readable directory of datasets for agriculture
The new CIARD RING , a machine-readable directory of datasets for agriculture
 
Geohosting
GeohostingGeohosting
Geohosting
 
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkFOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
 
Data Skipping Technology
Data Skipping TechnologyData Skipping Technology
Data Skipping Technology
 
Data Skipping Technology Yosef Moatti
Data Skipping Technology Yosef MoattiData Skipping Technology Yosef Moatti
Data Skipping Technology Yosef Moatti
 
Thrombus Training Dec. 2013
Thrombus Training Dec. 2013Thrombus Training Dec. 2013
Thrombus Training Dec. 2013
 
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical DemonstrationMaximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
 
Metadata in EOSDIS
Metadata in EOSDISMetadata in EOSDIS
Metadata in EOSDIS
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data Mesh
 
Best practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at RenaultBest practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at Renault
 
20100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v120100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v1
 
Flagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertierFlagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertier
 
Micka Manual
Micka ManualMicka Manual
Micka Manual
 
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
 
Maps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari ReiniMaps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari Reini
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
 
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado BlascoDSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
 
Large Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster ReliefLarge Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster Relief
 
Intro elasticsearch taswarbhatti
Intro elasticsearch taswarbhattiIntro elasticsearch taswarbhatti
Intro elasticsearch taswarbhatti
 

More from Gasperi Jerome

Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017Gasperi Jerome
 
Le Big Data et les données Copernicus
Le Big Data et les données CopernicusLe Big Data et les données Copernicus
Le Big Data et les données CopernicusGasperi Jerome
 
2016.02.18 big data from space toulouse data science
2016.02.18   big data from space    toulouse data science2016.02.18   big data from space    toulouse data science
2016.02.18 big data from space toulouse data scienceGasperi Jerome
 
2015.11.12 big data from space - cusi toulouse
2015.11.12   big data from space - cusi toulouse2015.11.12   big data from space - cusi toulouse
2015.11.12 big data from space - cusi toulouseGasperi Jerome
 
Big Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerreBig Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerreGasperi Jerome
 
Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...Gasperi Jerome
 
2014.09.04 federated ground segments - toulouse
2014.09.04   federated ground segments - toulouse2014.09.04   federated ground segments - toulouse
2014.09.04 federated ground segments - toulouseGasperi Jerome
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing ServiceGasperi Jerome
 
2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution ServerGasperi Jerome
 
Semantic search for Earth Observation products
Semantic search for Earth Observation productsSemantic search for Earth Observation products
Semantic search for Earth Observation productsGasperi Jerome
 
RESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatialRESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatialGasperi Jerome
 
Single Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenIDSingle Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenIDGasperi Jerome
 
CNES OpenSearch implementations
CNES OpenSearch implementationsCNES OpenSearch implementations
CNES OpenSearch implementationsGasperi Jerome
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing ServiceGasperi Jerome
 
Unify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearchUnify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearchGasperi Jerome
 
CNES activities on semantic search
CNES activities on semantic searchCNES activities on semantic search
CNES activities on semantic searchGasperi Jerome
 
Traitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing ServiceTraitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing ServiceGasperi Jerome
 
Semantic search applied to Earth Observation products
Semantic search applied to Earth Observation productsSemantic search applied to Earth Observation products
Semantic search applied to Earth Observation productsGasperi Jerome
 
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...Gasperi Jerome
 

More from Gasperi Jerome (20)

Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017
 
Le Big Data et les données Copernicus
Le Big Data et les données CopernicusLe Big Data et les données Copernicus
Le Big Data et les données Copernicus
 
2016.02.18 big data from space toulouse data science
2016.02.18   big data from space    toulouse data science2016.02.18   big data from space    toulouse data science
2016.02.18 big data from space toulouse data science
 
2015.11.12 big data from space - cusi toulouse
2015.11.12   big data from space - cusi toulouse2015.11.12   big data from space - cusi toulouse
2015.11.12 big data from space - cusi toulouse
 
Big Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerreBig Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerre
 
Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...
 
2014.09.04 federated ground segments - toulouse
2014.09.04   federated ground segments - toulouse2014.09.04   federated ground segments - toulouse
2014.09.04 federated ground segments - toulouse
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing Service
 
2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server
 
Semantic search for Earth Observation products
Semantic search for Earth Observation productsSemantic search for Earth Observation products
Semantic search for Earth Observation products
 
RESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatialRESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatial
 
Single Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenIDSingle Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenID
 
CNES Data Center
CNES Data CenterCNES Data Center
CNES Data Center
 
CNES OpenSearch implementations
CNES OpenSearch implementationsCNES OpenSearch implementations
CNES OpenSearch implementations
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing Service
 
Unify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearchUnify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearch
 
CNES activities on semantic search
CNES activities on semantic searchCNES activities on semantic search
CNES activities on semantic search
 
Traitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing ServiceTraitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing Service
 
Semantic search applied to Earth Observation products
Semantic search applied to Earth Observation productsSemantic search applied to Earth Observation products
Semantic search applied to Earth Observation products
 
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
 

Recently uploaded

08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 

Recently uploaded (20)

08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 

Data access and data extraction services within the Land Imagery Portal

  • 1. Data access and Data extraction Services within the Land Imagery portal Jerome Gasperi @ CNES | HAWG - Models for scientific exploitation of EO Data Frascati, Italy - October 12th, 2012
  • 2. Land Imagery Portal Overview Search service Download service What's next Thematic data extraction
  • 4. The * PTSC is the future French "Thematic Center for Land Imagery" * temporary name, subject to change when operational
  • 5. v0 (end of 2012) Official launch of the portal v1 (2013) additionnal datasets from CNES and partners, SSO integration, etc.
  • 7. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO OpenSearch PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 8. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) HMA Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO OpenSearch INSPIRE PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 9. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) HMA Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO INSPIRE V0 OpenSearch PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 10. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) HMA Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) V1 Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO INSPIRE V0 OpenSearch PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 12. Product download url is embeded within the product metadata returned by the search service
  • 13. Two cases : url content mimeType is "text/html" No direct download. The url is opened in another browser tab. User follows the instructions on the corresponding web page to download the product (this is typically the case for a product that required to explicitely sign an NDA before downloading it) otherwise product can be downloaded directly No common downloading format has been decided yet. The products are downloaded as is.
  • 15. Important note - the following slides present a proposal that will be discussed by the PTSC partners to be integrated (or not) within the Land Imagery portal.
  • 17. ? How to search within the portal for products that contains coastal cultivated areas ?
  • 20. Orthorectified image What we got Characterized image
  • 21. This is water This is urban This is forest Orthorectified image What we got Characterized image
  • 22. This is water This is urban This is forest Orthorectified image What we got Characterized image What we need
  • 23. How to do this ?
  • 24. SLACkER SimpLe Automated Characterization of EaRth observation products
  • 25. SLACkER uses GLC 2000 classification to perform an automatic and location based characterization of products
  • 26. Global Land Cover 2000 World land cover TIFF file ~ 650 Mo 1 km resolution 1 color = 1 thematic class 22 classes
  • 27. OpenSearch PTSC Metacatalog Identifier Description Copyright Acquisition date Acquisition angles Thumbnail ... + Footprint 1. Get footprint bounding box 2. Get GLC2000 area 0. Get metadata 3. Process characterization 4. Store results SLACkER
  • 28. Processing result example Tag table images within database glc2000 >> Add classification columns >> Processing 10 Crop GLC2000 raster : 24137 6169 156 119 Polygonize extracted raster Process footprint against Global Land Cover Store classification => 40.89% of Deserts (10 + 14 + 19) => 31.89% of Herbaceous (9 + 11 + 12 + 13) => 14.71% of Water (20) => 9.27% of Cultivated (15 + 16 + 17 + 18) => 3.2% of Forests (1 + 2 + 3 + 4 + 5 + 6) ( ( ( ( ( ( ( ( ( ( INPUT : metadata OUTPUT : additional thematics info stored beside the metadata within the Metacatalog 28.65 % of 14 : Sparse Herbaceous or sparse Shrub Cover ) 6.1 % of 18 : Mosaic: Cropland / Shrub or Grass Cover ) 12.24 % of 19 : Bare Areas ) 31.88 % of 12 : Shrub Cover, closed-open, deciduous ) 2.5 % of 3 : Tree Cover, broadleaved, deciduous, open ) 14.71 % of 20 : Water Bodies (natural & artificial) ) 0.13 % of 15 : Regularly flooded Shrub and/or Herbaceous Cover ) 2.81 % of 16 : Cultivated and managed areas ) 0.69 % of 4 : Tree Cover, needle-leaved, evergreen ) 0.21 % of 17 : Mosaic: Cropland / Tree Cover / Other natural vegetation )
  • 29. Thematic sliders SPOT cover - 1,300,000 scenes
  • 30. Search for coastal cultivated area ?
  • 31. Coastal cultivated area Search results (footprints displayed in black over the map)
  • 32. costal... ...cultivated area Thematic classification is displayed within the result metadata