NextGEOSS has a number of pilots running in production on EGI.eu cloud resources. Furthermore, the NextGEOSS core services (e.g. user management, DataHub) are also hosted in the EGI cloud.
Terradue presents the foreseen key benefits about using the new EGI Marketplace as part of the NextGEOSS project, emphasizing one of the pilots as an example use case.
NextGEOSS Cloud Computing needs managed by Terradue: key benefits of the new EGI Marketplace
1. NextGEOSS Cloud Computing
needs managed by Terradue:
key benefits of the new
EGI Marketplace
Webinar, December 6th
, 2018
Hervé Caumont
Platform Operations, Terradue
2. Copernicus Sentinels as the next generation
Earth Observation satellites
Typical EO data volumes
500MB (S-2) < a single product < 8GB (S-1)
4. ▪ EO data is a unique source of global
measurements over decades
▪ When calibrated and combined with other sources, it
empowers validation & interpolation models
▪ Our users: Earth sciences practitioners
▪ Create, share and reuse software assets & data products
▪ Collaboration process: a feedback loop of
providers & consumers
▪ More providers of pre-processed data layers
▪ New demands for structured information
The growth model is pulled by the
communities
Earth Observation Platform
Producers
Consumers
by
5. Cloud APIs, Hybrid Cloud
Openstack API -
powered by jclouds
Poznań Supercomputing
and Networking Center
EC2 - powered by jclouds
Amazon Web Services
Opennebula partner
Terradue
Openstack API -
powered by libcloud
OCCI,
native cloud APIs
EGI Federated Cloud
CreoDIAS
AWS
DIAS
PSNC
EGIT2
Openstack API -
powered by libcloud
ONDA
INFN
BELNET
100%IT
IISAS
CESNET
...
6. Cloud APIs, Hybrid Cloud
Openstack API -
powered by jclouds
Poznań Supercomputing
and Networking Center
EC2 - powered by jclouds
Amazon Web Services
OCCI,
native cloud APIs
EGI Federated Cloud
Opennebula partner
Terradue
Openstack API -
powered by libcloud
CreoDIAS
AWS
EGI
DIAS
PSNC
T2
Openstack API -
powered by libcloud
ONDA
8. A long lasting partnership
2016/09 - 1st MoU
2015 2016 2017 2018
Feasibility
Setup
Dev
Acceptance
Pilots(cntd)
Monitor
(cntd)
Monitor
Pilots
Acceptance
(cntd)
2018/09 - 2nd MoU
9. EGI.eu & Terradue Partnership
M2M communications realised initially via OCCI and then via
, ensuring integration, portability, and interoperability.
Use of standard interfaces
We can rely on well-defined , having the
EGI Foundation acting as single point of contact of the EGI Federated Cloud.
Reliable operations
We use Cloud resources within the European boundaries. In fact, it is
mandatory for certain processing services due to their organisations’ policies.
European cloud resources
The partnership with EGI Foundation enhances the sustainability of the
involved projects, via helping to sustain operational lifetimes.
Project(s) sustainability
Oct. 2018
https://www.egi.eu/about/newsletters/egi-terradue-a-long-lasting-partnership/
Nov. 2015
13. Ellip Solutions in a nutshell
I want to build and maintain a processing service
Interactively
prototype
Integrate for
scalability
Run at scale
Monitor and
collaborate
18. Run at scale
I want to build and maintain a processing service
Interactively
prototype
Integrate for
scalability
Run at scale
Monitor and
collaborate
19.
20.
21.
22.
23.
24.
25. Monitor and collaborate
I want to build and maintain a processing service
Interactively
prototype
Integrate for
scalability
Run at scale
Monitor and
collaborate
26. www.terradue.com
Scheduled Data Processing
29
24 processing nodes provided by
EGI.eu (NextGEOSS partner)
Growing season
2016-2018
Biopar
products
Data Inputs
Data Outputs
Deploy
Terradue Cloud APIs
Biopar Application burst to EGI.eu
New
observations
27. All of it: an Open Cloud strategy
▪ The Ellip subscribers remain the owners of
their created assets, and decide how to
share these on the platform, for other users
to find and reuse these assets.
▪ They are also empowered to decide on the
target production environment of their
packaged applications (no lock in with
Cloud provider)
Producers
Consumers
29. www.terradue.com
Scheduled Data Processing
32
It’s a data driven systematic processing
■ EU Tectonic area
■ World tectonic area (40%)
■ World tectonic area (70%)
It currently processes 150+ Sentinel-1 SLC
pairs per day.
DLR InSAR Browse Medium
Resolution Service
Supported by
BELNET-BEGRID (Belgium)