SlideShare a Scribd company logo
1 of 30
Download to read offline
CERN clouds and culture at GigaOm London 2013
Tim Bell
tim.bell@cern.ch
@noggin143
19/09/2013 CERN Infrastructure Evolution 2
19/09/2013 CERN Infrastructure Evolution 3
CERN was founded 1954:CERN was founded 1954: 12 European States12 European States
““Science for Peace”Science for Peace”
Today: 20 Member StatesToday: 20 Member States
Member States:Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark,Austria, Belgium, Bulgaria, the Czech Republic, Denmark,
Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway,Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway,
Poland, Portugal, Slovakia, Spain, Sweden, Switzerland andPoland, Portugal, Slovakia, Spain, Sweden, Switzerland and
the United Kingdomthe United Kingdom
Candidate for Accession:Candidate for Accession: RomaniaRomania
Associate Members in Pre-Stage to Membership:Associate Members in Pre-Stage to Membership: Israel, SerbiaIsrael, Serbia
Applicant States for Membership or Associate Membership:Applicant States for Membership or Associate Membership:
Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, UkraineBrazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine
Observers to Council:Observers to Council: India, Japan, Russia, Turkey, United States of America;India, Japan, Russia, Turkey, United States of America;
European Commission and UNESCOEuropean Commission and UNESCO
Member States:Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark,Austria, Belgium, Bulgaria, the Czech Republic, Denmark,
Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway,Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway,
Poland, Portugal, Slovakia, Spain, Sweden, Switzerland andPoland, Portugal, Slovakia, Spain, Sweden, Switzerland and
the United Kingdomthe United Kingdom
Candidate for Accession:Candidate for Accession: RomaniaRomania
Associate Members in Pre-Stage to Membership:Associate Members in Pre-Stage to Membership: Israel, SerbiaIsrael, Serbia
Applicant States for Membership or Associate Membership:Applicant States for Membership or Associate Membership:
Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, UkraineBrazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine
Observers to Council:Observers to Council: India, Japan, Russia, Turkey, United States of America;India, Japan, Russia, Turkey, United States of America;
European Commission and UNESCOEuropean Commission and UNESCO
~ 2,300 staff~ 2,300 staff
~ 1,000 other paid personnel~ 1,000 other paid personnel
> 11,000 users> 11,000 users
Budget (2013) ~1,000 MCHFBudget (2013) ~1,000 MCHF
~ 2,300 staff~ 2,300 staff
~ 1,000 other paid personnel~ 1,000 other paid personnel
> 11,000 users> 11,000 users
Budget (2013) ~1,000 MCHFBudget (2013) ~1,000 MCHF
What are the Origins of Mass ?
19/09/2013 CERN Infrastructure Evolution 4
Matter/Anti Matter Symmetric?
19/09/2013 CERN Infrastructure Evolution 5
Where is 95% of the Universe?
19/09/2013 CERN Infrastructure Evolution 6
19/09/2013 CERN Infrastructure Evolution 7
19/09/2013 CERN Infrastructure Evolution 8
19/09/2013 CERN Infrastructure Evolution 9
Collisions
19/09/2013 CERN Infrastructure Evolution 10
A Big Data Challenge
19/09/2013 CERN Infrastructure Evolution 11
The CERN Meyrin Data Centre
19/09/2013 CERN Infrastructure Evolution 12
New Data Centre in Budapest
19/09/2013 CERN Infrastructure Evolution 13
Good News, Bad News
19/09/2013 CERN Infrastructure Evolution 14
We’re Not Special
19/09/2013 CERN Infrastructure Evolution 15
19/09/2013
Bamboo
Koji, Mock
AIMS/PXE
Foreman
Yum repo
Pulp
Puppet-DB
mcollective, yum
JIRA
Lemon /
Hadoop /
LogStash /
Kibana
OpenStack
Nova
Hardware
database
Puppet
Active Directory /
LDAP
CERN Infrastructure Evolution 16
The Agile Experience
19/09/2013 CERN Infrastructure Evolution 17
Cultural Barriers
19/09/2013 CERN Infrastructure Evolution 18
Status
• Toolchain implemented in 18 months with
enhancements and bug fixes submitted back to
the community
• Now in production in 3 OpenStack clouds (over
50,000 cores in total) in Geneva and Budapest
managed by Puppet
• Target is more than 300,000 cores by 2015 and
90% compute resources in the private cloud
19/09/2013 CERN Infrastructure Evolution 19
Summary
• Constraints on resources have led to major
technology transformations at CERN
• Open source community participation helps
drive cultural change and motivates staff
• CERN benefits and contributes back through
code and outreach
19/09/2013 CERN Infrastructure Evolution 20
Questions ?
19/09/2013 CERN Infrastructure Evolution 21
19/09/2013 CERN Infrastructure Evolution 22
Service Models
19/09/2013 CERN Infrastructure Evolution 23
• Pets are given names like pussinboots.cern.ch
• They are unique, lovingly hand raised and cared for
• When they get ill, you nurse them back to health
• Cattle are given numbers like vm0042.cern.ch
• They are almost identical to other cattle
• When they get ill, you get another one
19/09/2013 CERN Infrastructure Evolution 24
19/09/2013 CERN Infrastructure Evolution 25
http://www.eucalyptus.com/blog/2013/04/02/cy13-q1-community-analysis-%E2%80%94-openstack-vs-opennebula-vs-eucalyptus-vs-clo
19/09/2013 CERN Infrastructure Evolution 26
19/09/2013 CERN Infrastructure Evolution 27
Tier-1 (11 centres):
•Permanent storage
•Re-processing
•Analysis
Tier-0 (CERN):
•Data recording
•Initial data reconstruction
•Data distribution
Tier-2 (~200 centres):
• Simulation
• End-user analysis
• Data is recorded at CERN and Tier-1s and analysed in the Worldwide LHC
Computing Grid
• In a normal day, the grid provides 100,000 CPU days executing over 2 million jobs
19/09/2013 CERN Infrastructure Evolution 28
19/09/2013 CERN Infrastructure Evolution 29
Microsoft Active
Directory
CERN DB
on Demand
CERN Network
Database
Account mgmt
system
Horizon
Keystone
Network
Compute
Glance
Scheduler
Cinder
Nova
Block Storage
Provider
Training for Newcomers
19/09/2013 CERN Infrastructure Evolution 30
Buy the book rather than guru mentoring

More Related Content

Similar to CERN clouds and culture at GigaOm London 2013

20130529 openstack cee_day_v6
20130529 openstack cee_day_v620130529 openstack cee_day_v6
20130529 openstack cee_day_v6Tim Bell
 
EURAXESS Presentation
EURAXESS PresentationEURAXESS Presentation
EURAXESS PresentationRajeev Soni
 
EU and US providers exchanging patient summaries: The case of Martha a US cit...
EU and US providers exchanging patient summaries: The case of Martha a US cit...EU and US providers exchanging patient summaries: The case of Martha a US cit...
EU and US providers exchanging patient summaries: The case of Martha a US cit...chronaki
 
Case Study: Developing and Integrating a Cloud Sourcing Strategy at CERN
Case Study: Developing and Integrating a Cloud Sourcing Strategy at CERNCase Study: Developing and Integrating a Cloud Sourcing Strategy at CERN
Case Study: Developing and Integrating a Cloud Sourcing Strategy at CERNHelix Nebula The Science Cloud
 
changes Open Science in High-Energy Physics - Salvatore Mele at OpenCon
changes Open Science in High-Energy Physics - Salvatore Mele at OpenConchanges Open Science in High-Energy Physics - Salvatore Mele at OpenCon
changes Open Science in High-Energy Physics - Salvatore Mele at OpenConRight to Research
 
TCI2012 The European Cluster Observatory
TCI2012 The European Cluster ObservatoryTCI2012 The European Cluster Observatory
TCI2012 The European Cluster ObservatoryTCI Network
 
Minerals4EU - European Intelligence Network on the Supply of Raw Materials
Minerals4EU - European Intelligence Network on the Supply of Raw MaterialsMinerals4EU - European Intelligence Network on the Supply of Raw Materials
Minerals4EU - European Intelligence Network on the Supply of Raw MaterialsMinerals4EU
 
Report from the International Confederation of Countries Advisory Council - M...
Report from the International Confederation of Countries Advisory Council - M...Report from the International Confederation of Countries Advisory Council - M...
Report from the International Confederation of Countries Advisory Council - M...Human Variome Project
 
ORCID: Jisc&ARMA progress meeting update by Josh Brown
ORCID: Jisc&ARMA progress meeting update by Josh Brown ORCID: Jisc&ARMA progress meeting update by Josh Brown
ORCID: Jisc&ARMA progress meeting update by Josh Brown Verena139
 
Rüdiger Voss "CERN: from a European towards a global project"
Rüdiger Voss "CERN: from a European towards a global project"Rüdiger Voss "CERN: from a European towards a global project"
Rüdiger Voss "CERN: from a European towards a global project"SEENET-MTP
 
NSFC and Funding opportunities
NSFC and Funding opportunities NSFC and Funding opportunities
NSFC and Funding opportunities Dragonstarproject
 
Regulations, privacy, security for data bridges - Kuchinke
Regulations, privacy, security for data bridges - KuchinkeRegulations, privacy, security for data bridges - Kuchinke
Regulations, privacy, security for data bridges - KuchinkeWolfgang Kuchinke
 
Gridforum Juergen Knobloch Grids For Science 20080402
Gridforum Juergen Knobloch Grids For Science 20080402Gridforum Juergen Knobloch Grids For Science 20080402
Gridforum Juergen Knobloch Grids For Science 20080402vrij
 
Innovative Internet for research and education
Innovative Internet for research and educationInnovative Internet for research and education
Innovative Internet for research and educationInternet Society
 
Global Cyberinfrastructure to Support e-Research
Global Cyberinfrastructure to Support e-ResearchGlobal Cyberinfrastructure to Support e-Research
Global Cyberinfrastructure to Support e-ResearchLarry Smarr
 
An introduction to ViBRANT: Virtual Biodiversity Research and Access Network ...
An introduction to ViBRANT: Virtual Biodiversity Research and Access Network ...An introduction to ViBRANT: Virtual Biodiversity Research and Access Network ...
An introduction to ViBRANT: Virtual Biodiversity Research and Access Network ...Vince Smith
 

Similar to CERN clouds and culture at GigaOm London 2013 (20)

20130529 openstack cee_day_v6
20130529 openstack cee_day_v620130529 openstack cee_day_v6
20130529 openstack cee_day_v6
 
EURAXESS Presentation
EURAXESS PresentationEURAXESS Presentation
EURAXESS Presentation
 
EU and US providers exchanging patient summaries: The case of Martha a US cit...
EU and US providers exchanging patient summaries: The case of Martha a US cit...EU and US providers exchanging patient summaries: The case of Martha a US cit...
EU and US providers exchanging patient summaries: The case of Martha a US cit...
 
Case Study: Developing and Integrating a Cloud Sourcing Strategy at CERN
Case Study: Developing and Integrating a Cloud Sourcing Strategy at CERNCase Study: Developing and Integrating a Cloud Sourcing Strategy at CERN
Case Study: Developing and Integrating a Cloud Sourcing Strategy at CERN
 
changes Open Science in High-Energy Physics - Salvatore Mele at OpenCon
changes Open Science in High-Energy Physics - Salvatore Mele at OpenConchanges Open Science in High-Energy Physics - Salvatore Mele at OpenCon
changes Open Science in High-Energy Physics - Salvatore Mele at OpenCon
 
TCI2012 The European Cluster Observatory
TCI2012 The European Cluster ObservatoryTCI2012 The European Cluster Observatory
TCI2012 The European Cluster Observatory
 
EMBL-ABR_ AGRF2016
EMBL-ABR_ AGRF2016EMBL-ABR_ AGRF2016
EMBL-ABR_ AGRF2016
 
Minerals4EU - European Intelligence Network on the Supply of Raw Materials
Minerals4EU - European Intelligence Network on the Supply of Raw MaterialsMinerals4EU - European Intelligence Network on the Supply of Raw Materials
Minerals4EU - European Intelligence Network on the Supply of Raw Materials
 
Report from the International Confederation of Countries Advisory Council - M...
Report from the International Confederation of Countries Advisory Council - M...Report from the International Confederation of Countries Advisory Council - M...
Report from the International Confederation of Countries Advisory Council - M...
 
Cern general information
Cern general informationCern general information
Cern general information
 
ORCID: Jisc&ARMA progress meeting update by Josh Brown
ORCID: Jisc&ARMA progress meeting update by Josh Brown ORCID: Jisc&ARMA progress meeting update by Josh Brown
ORCID: Jisc&ARMA progress meeting update by Josh Brown
 
Rüdiger Voss "CERN: from a European towards a global project"
Rüdiger Voss "CERN: from a European towards a global project"Rüdiger Voss "CERN: from a European towards a global project"
Rüdiger Voss "CERN: from a European towards a global project"
 
NSFC and Funding opportunities
NSFC and Funding opportunities NSFC and Funding opportunities
NSFC and Funding opportunities
 
Regulations, privacy, security for data bridges - Kuchinke
Regulations, privacy, security for data bridges - KuchinkeRegulations, privacy, security for data bridges - Kuchinke
Regulations, privacy, security for data bridges - Kuchinke
 
Gridforum Juergen Knobloch Grids For Science 20080402
Gridforum Juergen Knobloch Grids For Science 20080402Gridforum Juergen Knobloch Grids For Science 20080402
Gridforum Juergen Knobloch Grids For Science 20080402
 
Innovative Internet for research and education
Innovative Internet for research and educationInnovative Internet for research and education
Innovative Internet for research and education
 
Observing the Earth
Observing the EarthObserving the Earth
Observing the Earth
 
Global Cyberinfrastructure to Support e-Research
Global Cyberinfrastructure to Support e-ResearchGlobal Cyberinfrastructure to Support e-Research
Global Cyberinfrastructure to Support e-Research
 
An introduction to ViBRANT: Virtual Biodiversity Research and Access Network ...
An introduction to ViBRANT: Virtual Biodiversity Research and Access Network ...An introduction to ViBRANT: Virtual Biodiversity Research and Access Network ...
An introduction to ViBRANT: Virtual Biodiversity Research and Access Network ...
 
09.30 15.15 nasawwec2015c
09.30 15.15 nasawwec2015c09.30 15.15 nasawwec2015c
09.30 15.15 nasawwec2015c
 

More from Tim Bell

CERN IT Monitoring
CERN IT Monitoring CERN IT Monitoring
CERN IT Monitoring Tim Bell
 
CERN Status at OpenStack Shanghai Summit November 2019
CERN Status at OpenStack Shanghai Summit November 2019CERN Status at OpenStack Shanghai Summit November 2019
CERN Status at OpenStack Shanghai Summit November 2019Tim Bell
 
20190620 accelerating containers v3
20190620 accelerating containers v320190620 accelerating containers v3
20190620 accelerating containers v3Tim Bell
 
20181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v320181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v3Tim Bell
 
20181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v320181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v3Tim Bell
 
OpenStack at CERN : A 5 year perspective
OpenStack at CERN : A 5 year perspectiveOpenStack at CERN : A 5 year perspective
OpenStack at CERN : A 5 year perspectiveTim Bell
 
20170926 cern cloud v4
20170926 cern cloud v420170926 cern cloud v4
20170926 cern cloud v4Tim Bell
 
The OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack NordicThe OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack NordicTim Bell
 
20161025 OpenStack at CERN Barcelona
20161025 OpenStack at CERN Barcelona20161025 OpenStack at CERN Barcelona
20161025 OpenStack at CERN BarcelonaTim Bell
 
20150924 rda federation_v1
20150924 rda federation_v120150924 rda federation_v1
20150924 rda federation_v1Tim Bell
 
OpenStack Paris 2014 - Federation, are we there yet ?
OpenStack Paris 2014 - Federation, are we there yet ?OpenStack Paris 2014 - Federation, are we there yet ?
OpenStack Paris 2014 - Federation, are we there yet ?Tim Bell
 
20141103 cern open_stack_paris_v3
20141103 cern open_stack_paris_v320141103 cern open_stack_paris_v3
20141103 cern open_stack_paris_v3Tim Bell
 
CERN Mass and Agility talk at OSCON 2014
CERN Mass and Agility talk at OSCON 2014CERN Mass and Agility talk at OSCON 2014
CERN Mass and Agility talk at OSCON 2014Tim Bell
 
20140509 cern open_stack_linuxtag_v3
20140509 cern open_stack_linuxtag_v320140509 cern open_stack_linuxtag_v3
20140509 cern open_stack_linuxtag_v3Tim Bell
 
Open stack operations feedback loop v1.4
Open stack operations feedback loop v1.4Open stack operations feedback loop v1.4
Open stack operations feedback loop v1.4Tim Bell
 
Ceilometer lsf-intergration-openstack-summit
Ceilometer lsf-intergration-openstack-summitCeilometer lsf-intergration-openstack-summit
Ceilometer lsf-intergration-openstack-summitTim Bell
 
Havana survey results-final-v2
Havana survey results-final-v2Havana survey results-final-v2
Havana survey results-final-v2Tim Bell
 
Havana survey results-final
Havana survey results-finalHavana survey results-final
Havana survey results-finalTim Bell
 
20121205 open stack_accelerating_science_v3
20121205 open stack_accelerating_science_v320121205 open stack_accelerating_science_v3
20121205 open stack_accelerating_science_v3Tim Bell
 
20121115 open stack_ch_user_group_v1.2
20121115 open stack_ch_user_group_v1.220121115 open stack_ch_user_group_v1.2
20121115 open stack_ch_user_group_v1.2Tim Bell
 

More from Tim Bell (20)

CERN IT Monitoring
CERN IT Monitoring CERN IT Monitoring
CERN IT Monitoring
 
CERN Status at OpenStack Shanghai Summit November 2019
CERN Status at OpenStack Shanghai Summit November 2019CERN Status at OpenStack Shanghai Summit November 2019
CERN Status at OpenStack Shanghai Summit November 2019
 
20190620 accelerating containers v3
20190620 accelerating containers v320190620 accelerating containers v3
20190620 accelerating containers v3
 
20181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v320181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v3
 
20181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v320181219 ucc open stack 5 years v3
20181219 ucc open stack 5 years v3
 
OpenStack at CERN : A 5 year perspective
OpenStack at CERN : A 5 year perspectiveOpenStack at CERN : A 5 year perspective
OpenStack at CERN : A 5 year perspective
 
20170926 cern cloud v4
20170926 cern cloud v420170926 cern cloud v4
20170926 cern cloud v4
 
The OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack NordicThe OpenStack Cloud at CERN - OpenStack Nordic
The OpenStack Cloud at CERN - OpenStack Nordic
 
20161025 OpenStack at CERN Barcelona
20161025 OpenStack at CERN Barcelona20161025 OpenStack at CERN Barcelona
20161025 OpenStack at CERN Barcelona
 
20150924 rda federation_v1
20150924 rda federation_v120150924 rda federation_v1
20150924 rda federation_v1
 
OpenStack Paris 2014 - Federation, are we there yet ?
OpenStack Paris 2014 - Federation, are we there yet ?OpenStack Paris 2014 - Federation, are we there yet ?
OpenStack Paris 2014 - Federation, are we there yet ?
 
20141103 cern open_stack_paris_v3
20141103 cern open_stack_paris_v320141103 cern open_stack_paris_v3
20141103 cern open_stack_paris_v3
 
CERN Mass and Agility talk at OSCON 2014
CERN Mass and Agility talk at OSCON 2014CERN Mass and Agility talk at OSCON 2014
CERN Mass and Agility talk at OSCON 2014
 
20140509 cern open_stack_linuxtag_v3
20140509 cern open_stack_linuxtag_v320140509 cern open_stack_linuxtag_v3
20140509 cern open_stack_linuxtag_v3
 
Open stack operations feedback loop v1.4
Open stack operations feedback loop v1.4Open stack operations feedback loop v1.4
Open stack operations feedback loop v1.4
 
Ceilometer lsf-intergration-openstack-summit
Ceilometer lsf-intergration-openstack-summitCeilometer lsf-intergration-openstack-summit
Ceilometer lsf-intergration-openstack-summit
 
Havana survey results-final-v2
Havana survey results-final-v2Havana survey results-final-v2
Havana survey results-final-v2
 
Havana survey results-final
Havana survey results-finalHavana survey results-final
Havana survey results-final
 
20121205 open stack_accelerating_science_v3
20121205 open stack_accelerating_science_v320121205 open stack_accelerating_science_v3
20121205 open stack_accelerating_science_v3
 
20121115 open stack_ch_user_group_v1.2
20121115 open stack_ch_user_group_v1.220121115 open stack_ch_user_group_v1.2
20121115 open stack_ch_user_group_v1.2
 

Recently uploaded

The_Chronological_Life_of_Christ_Part_93_Fear God
The_Chronological_Life_of_Christ_Part_93_Fear GodThe_Chronological_Life_of_Christ_Part_93_Fear God
The_Chronological_Life_of_Christ_Part_93_Fear GodNetwork Bible Fellowship
 
365 Days of Thanking God_ Cultivating a Heart of Thanksgiving Everyday (Revis...
365 Days of Thanking God_ Cultivating a Heart of Thanksgiving Everyday (Revis...365 Days of Thanking God_ Cultivating a Heart of Thanksgiving Everyday (Revis...
365 Days of Thanking God_ Cultivating a Heart of Thanksgiving Everyday (Revis...Eizijesu Obahaiye
 
Islamic Finance 101 - Dr. Main Alqudah [https://www.guidancecollege.org/]
Islamic Finance 101 - Dr. Main Alqudah [https://www.guidancecollege.org/]Islamic Finance 101 - Dr. Main Alqudah [https://www.guidancecollege.org/]
Islamic Finance 101 - Dr. Main Alqudah [https://www.guidancecollege.org/]iqra tube
 
All About Zakah for Muslim Americans - Dr. Main Alqudah [https://www.guidance...
All About Zakah for Muslim Americans - Dr. Main Alqudah [https://www.guidance...All About Zakah for Muslim Americans - Dr. Main Alqudah [https://www.guidance...
All About Zakah for Muslim Americans - Dr. Main Alqudah [https://www.guidance...iqra tube
 
DP & Jesus Marriage - 2 potential candidates
DP & Jesus Marriage - 2 potential candidatesDP & Jesus Marriage - 2 potential candidates
DP & Jesus Marriage - 2 potential candidatesBengt & Maarit de Paulis
 
Old Age but fruitful and meaningful.pptx
Old Age but fruitful and meaningful.pptxOld Age but fruitful and meaningful.pptx
Old Age but fruitful and meaningful.pptxInnovator Marbun
 
SERPENT COIL: THE AWAKENING OF KUNDALINI
SERPENT COIL: THE AWAKENING OF KUNDALINISERPENT COIL: THE AWAKENING OF KUNDALINI
SERPENT COIL: THE AWAKENING OF KUNDALINISantanu Das
 
Free eBook ~Short Inspirational Stories - The Benefits.pdf
Free eBook ~Short Inspirational Stories - The Benefits.pdfFree eBook ~Short Inspirational Stories - The Benefits.pdf
Free eBook ~Short Inspirational Stories - The Benefits.pdfOH TEIK BIN
 
Deerfoot Church of Christ Bulletin 3 24 24
Deerfoot Church of Christ Bulletin 3 24 24Deerfoot Church of Christ Bulletin 3 24 24
Deerfoot Church of Christ Bulletin 3 24 24deerfootcoc
 
The Mormon & Quaker Moons of Lancashire: Stories of Religious Conversion & Mi...
The Mormon & Quaker Moons of Lancashire: Stories of Religious Conversion & Mi...The Mormon & Quaker Moons of Lancashire: Stories of Religious Conversion & Mi...
The Mormon & Quaker Moons of Lancashire: Stories of Religious Conversion & Mi...Cometan
 
Easter Apocalypse_Palm Sunday_Rev. 7.pptx
Easter Apocalypse_Palm Sunday_Rev. 7.pptxEaster Apocalypse_Palm Sunday_Rev. 7.pptx
Easter Apocalypse_Palm Sunday_Rev. 7.pptxStephen Palm
 
DP & Nostradamus-Fatima-Bailey-Branham-Ford - Short vers
DP & Nostradamus-Fatima-Bailey-Branham-Ford - Short versDP & Nostradamus-Fatima-Bailey-Branham-Ford - Short vers
DP & Nostradamus-Fatima-Bailey-Branham-Ford - Short versBengt & Maarit de Paulis
 

Recently uploaded (13)

The_Chronological_Life_of_Christ_Part_93_Fear God
The_Chronological_Life_of_Christ_Part_93_Fear GodThe_Chronological_Life_of_Christ_Part_93_Fear God
The_Chronological_Life_of_Christ_Part_93_Fear God
 
365 Days of Thanking God_ Cultivating a Heart of Thanksgiving Everyday (Revis...
365 Days of Thanking God_ Cultivating a Heart of Thanksgiving Everyday (Revis...365 Days of Thanking God_ Cultivating a Heart of Thanksgiving Everyday (Revis...
365 Days of Thanking God_ Cultivating a Heart of Thanksgiving Everyday (Revis...
 
Islamic Finance 101 - Dr. Main Alqudah [https://www.guidancecollege.org/]
Islamic Finance 101 - Dr. Main Alqudah [https://www.guidancecollege.org/]Islamic Finance 101 - Dr. Main Alqudah [https://www.guidancecollege.org/]
Islamic Finance 101 - Dr. Main Alqudah [https://www.guidancecollege.org/]
 
All About Zakah for Muslim Americans - Dr. Main Alqudah [https://www.guidance...
All About Zakah for Muslim Americans - Dr. Main Alqudah [https://www.guidance...All About Zakah for Muslim Americans - Dr. Main Alqudah [https://www.guidance...
All About Zakah for Muslim Americans - Dr. Main Alqudah [https://www.guidance...
 
English - The 1st Book of Adam and Eve.pdf
English - The 1st Book of Adam and Eve.pdfEnglish - The 1st Book of Adam and Eve.pdf
English - The 1st Book of Adam and Eve.pdf
 
DP & Jesus Marriage - 2 potential candidates
DP & Jesus Marriage - 2 potential candidatesDP & Jesus Marriage - 2 potential candidates
DP & Jesus Marriage - 2 potential candidates
 
Old Age but fruitful and meaningful.pptx
Old Age but fruitful and meaningful.pptxOld Age but fruitful and meaningful.pptx
Old Age but fruitful and meaningful.pptx
 
SERPENT COIL: THE AWAKENING OF KUNDALINI
SERPENT COIL: THE AWAKENING OF KUNDALINISERPENT COIL: THE AWAKENING OF KUNDALINI
SERPENT COIL: THE AWAKENING OF KUNDALINI
 
Free eBook ~Short Inspirational Stories - The Benefits.pdf
Free eBook ~Short Inspirational Stories - The Benefits.pdfFree eBook ~Short Inspirational Stories - The Benefits.pdf
Free eBook ~Short Inspirational Stories - The Benefits.pdf
 
Deerfoot Church of Christ Bulletin 3 24 24
Deerfoot Church of Christ Bulletin 3 24 24Deerfoot Church of Christ Bulletin 3 24 24
Deerfoot Church of Christ Bulletin 3 24 24
 
The Mormon & Quaker Moons of Lancashire: Stories of Religious Conversion & Mi...
The Mormon & Quaker Moons of Lancashire: Stories of Religious Conversion & Mi...The Mormon & Quaker Moons of Lancashire: Stories of Religious Conversion & Mi...
The Mormon & Quaker Moons of Lancashire: Stories of Religious Conversion & Mi...
 
Easter Apocalypse_Palm Sunday_Rev. 7.pptx
Easter Apocalypse_Palm Sunday_Rev. 7.pptxEaster Apocalypse_Palm Sunday_Rev. 7.pptx
Easter Apocalypse_Palm Sunday_Rev. 7.pptx
 
DP & Nostradamus-Fatima-Bailey-Branham-Ford - Short vers
DP & Nostradamus-Fatima-Bailey-Branham-Ford - Short versDP & Nostradamus-Fatima-Bailey-Branham-Ford - Short vers
DP & Nostradamus-Fatima-Bailey-Branham-Ford - Short vers
 

CERN clouds and culture at GigaOm London 2013

  • 3. 19/09/2013 CERN Infrastructure Evolution 3 CERN was founded 1954:CERN was founded 1954: 12 European States12 European States ““Science for Peace”Science for Peace” Today: 20 Member StatesToday: 20 Member States Member States:Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark,Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway,Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland andPoland, Portugal, Slovakia, Spain, Sweden, Switzerland and the United Kingdomthe United Kingdom Candidate for Accession:Candidate for Accession: RomaniaRomania Associate Members in Pre-Stage to Membership:Associate Members in Pre-Stage to Membership: Israel, SerbiaIsrael, Serbia Applicant States for Membership or Associate Membership:Applicant States for Membership or Associate Membership: Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, UkraineBrazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine Observers to Council:Observers to Council: India, Japan, Russia, Turkey, United States of America;India, Japan, Russia, Turkey, United States of America; European Commission and UNESCOEuropean Commission and UNESCO Member States:Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark,Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway,Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland andPoland, Portugal, Slovakia, Spain, Sweden, Switzerland and the United Kingdomthe United Kingdom Candidate for Accession:Candidate for Accession: RomaniaRomania Associate Members in Pre-Stage to Membership:Associate Members in Pre-Stage to Membership: Israel, SerbiaIsrael, Serbia Applicant States for Membership or Associate Membership:Applicant States for Membership or Associate Membership: Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, UkraineBrazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine Observers to Council:Observers to Council: India, Japan, Russia, Turkey, United States of America;India, Japan, Russia, Turkey, United States of America; European Commission and UNESCOEuropean Commission and UNESCO ~ 2,300 staff~ 2,300 staff ~ 1,000 other paid personnel~ 1,000 other paid personnel > 11,000 users> 11,000 users Budget (2013) ~1,000 MCHFBudget (2013) ~1,000 MCHF ~ 2,300 staff~ 2,300 staff ~ 1,000 other paid personnel~ 1,000 other paid personnel > 11,000 users> 11,000 users Budget (2013) ~1,000 MCHFBudget (2013) ~1,000 MCHF
  • 4. What are the Origins of Mass ? 19/09/2013 CERN Infrastructure Evolution 4
  • 5. Matter/Anti Matter Symmetric? 19/09/2013 CERN Infrastructure Evolution 5
  • 6. Where is 95% of the Universe? 19/09/2013 CERN Infrastructure Evolution 6
  • 11. A Big Data Challenge 19/09/2013 CERN Infrastructure Evolution 11
  • 12. The CERN Meyrin Data Centre 19/09/2013 CERN Infrastructure Evolution 12
  • 13. New Data Centre in Budapest 19/09/2013 CERN Infrastructure Evolution 13
  • 14. Good News, Bad News 19/09/2013 CERN Infrastructure Evolution 14
  • 15. We’re Not Special 19/09/2013 CERN Infrastructure Evolution 15
  • 16. 19/09/2013 Bamboo Koji, Mock AIMS/PXE Foreman Yum repo Pulp Puppet-DB mcollective, yum JIRA Lemon / Hadoop / LogStash / Kibana OpenStack Nova Hardware database Puppet Active Directory / LDAP CERN Infrastructure Evolution 16
  • 17. The Agile Experience 19/09/2013 CERN Infrastructure Evolution 17
  • 18. Cultural Barriers 19/09/2013 CERN Infrastructure Evolution 18
  • 19. Status • Toolchain implemented in 18 months with enhancements and bug fixes submitted back to the community • Now in production in 3 OpenStack clouds (over 50,000 cores in total) in Geneva and Budapest managed by Puppet • Target is more than 300,000 cores by 2015 and 90% compute resources in the private cloud 19/09/2013 CERN Infrastructure Evolution 19
  • 20. Summary • Constraints on resources have led to major technology transformations at CERN • Open source community participation helps drive cultural change and motivates staff • CERN benefits and contributes back through code and outreach 19/09/2013 CERN Infrastructure Evolution 20
  • 21. Questions ? 19/09/2013 CERN Infrastructure Evolution 21
  • 23. Service Models 19/09/2013 CERN Infrastructure Evolution 23 • Pets are given names like pussinboots.cern.ch • They are unique, lovingly hand raised and cared for • When they get ill, you nurse them back to health • Cattle are given numbers like vm0042.cern.ch • They are almost identical to other cattle • When they get ill, you get another one
  • 25. 19/09/2013 CERN Infrastructure Evolution 25 http://www.eucalyptus.com/blog/2013/04/02/cy13-q1-community-analysis-%E2%80%94-openstack-vs-opennebula-vs-eucalyptus-vs-clo
  • 27. 19/09/2013 CERN Infrastructure Evolution 27 Tier-1 (11 centres): •Permanent storage •Re-processing •Analysis Tier-0 (CERN): •Data recording •Initial data reconstruction •Data distribution Tier-2 (~200 centres): • Simulation • End-user analysis • Data is recorded at CERN and Tier-1s and analysed in the Worldwide LHC Computing Grid • In a normal day, the grid provides 100,000 CPU days executing over 2 million jobs
  • 29. 19/09/2013 CERN Infrastructure Evolution 29 Microsoft Active Directory CERN DB on Demand CERN Network Database Account mgmt system Horizon Keystone Network Compute Glance Scheduler Cinder Nova Block Storage Provider
  • 30. Training for Newcomers 19/09/2013 CERN Infrastructure Evolution 30 Buy the book rather than guru mentoring

Editor's Notes

  1. Over 1,600 magnets lowered down shafts and cooled to -271 C to become superconducting. Two beam pipes, vacuum 10 times less than the moon
  2. These collisions produce data, lots of it. Over 100PB currently 45,000 tapes… data rates of up to 35 PB/year currently and expected to significantly increase in the next run in 2015. The data must be kept at least 20 years so we’re expecting exabytes….
  3. Recording and analysing the data takes a lot of computing power. The CERN computer centre was built in the 1970s for mainframes and crays. Now running at 3.5MW of power, it houses 11,000 servers but is at the limit of cooling and electrical power. It is also a tourist attraction with over 80,000 visitors last year! As you can see, racks are only partially empty in view of the limits on cooling.
  4. We asked our 20 member states to make us an offer for server hosting using public procurement. 27 proposals and Wigner centre in Budapest, Hungary was chosen. This allows us to envisage sufficient computing and online storage for the run from 2015.
  5. While it was great news to be allocated the budget for a new data centre, there was bad news associated with this. No additional budget for staff would be made available… we needed to find a way for the IT department to manage twice the number of servers with the same personnel The current toolset would not scale to the additional DC The tools needed significant maintenance effort, IPv6, new linux versions, … were using up valuable engineering resource Users were asking for faster response times to resource requests and more dynamic configurations
  6. So, we looked around at how others were solving these problems and found we were not special. While CERN has a research culture, there is a need to understand that not all our services are pioneering. It is not always necessary to start from a blank sheet of paper but instead build on the work of others rather than lead. The world wide web invention at CERN reflected a need which was original but not all of our work is new. Companies such as Yahoo, Rackspace, Zynga, eBay, Paypal are facing scalability and management issues far beyond ours. Thus, we need to try to not innovate but to follow
  7. We adopted a Google toolchain approach. The majority of home written software was replaced by open source projects. Commercial tools which were already working well such as JIRA and Active Directory were maintained. The approach was to select a tool, prototype, fail early and then refine requirements (following the we are not special approach) Key technologies were Puppet for configuration management and OpenStack for the private cloud.
  8. So, we assembled a team made up of experienced service managers and new students. By freezing developments on legacy projects, we were able to make resources available but only as long as we could rapidly implement new functions. Many of the staff had to do their ‘day’ jobs as well as work on the new implementations. Several effects - Newcomers often had experience of the tools from university People learnt very rapidly by following mailing lists, going to conferences and interacting with the community. Contributions such as contributing to the governance, use cases and testing in addition to standard development contributions. Short term staff saw major improvements in their post-CERN job prospects as they left with very relevant skills
  9. The agile approach is a major cultural change which is an ongoing process. To illustrate this, there are some characteristics which I show extreme examples of to watch out from Tolkein…. Luckily, we never had characters like this at CERN: Don’t be hasty, let’s go slowly… transformations such as this cannot be done in a reasonable time by incremental change Move away from silos… top to bottom from application to hardware managed by a single team to a layered model with shared budget and resources. Knowledge management responsibilities change. The guru who wrote the tool and trains others on how to use it is replaced by the outside community in which people participate. Everything can appear to be research if you start with a blank piece of paper. The server or application manager of ‘precious’ applications that need special handling and care has to be understood… some cases are inevitable but many reflect non-technical aspects of the application or server management and may justify changes of process
  10. Already 3 independent clouds – federation is now being studied Rackspace inside CERN openlab Helix Nebula as discussed later
  11. The Worldwide LHC Computing grid is used to record and analyse this data. The grid currently runs over 2 million jobs/day, less than 10% of the work is done at CERN. There is an agreed set of protocols for running jobs, data distribution and accounting between all the sites which co-operate in order to support the physicists across the globe.