This document discusses Hudl's transition to a microservices architecture from a monolithic architecture to enable rapid development. Some key points:
- Hudl has over 4.5 million active users and needed an architecture that supported rapid development for its many customers and use cases.
- It moved to a microservices architecture with many small, independent services to allow for independent deployments and faster development cycles.
- This enabled over 800 deploys per week across environments and much faster delivery of new features compared to the monolithic architecture.
Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business.
Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset.
This talk gives a high level overview of our cultural changes, our strategic goals and our architectural principles. That includes our approach, where autonomous, empowered teams continuously deliver services into AWS and are responsible to operate them.
Borrowed some slides from Simon Hohenadl (http://www.slideshare.net/SimonHohenadl) and Matthias Patzak (http://www.slideshare.net/MatthiasPatzak)
stackconf 2021 | Why you should take care of infrastructure driftNETWAYS
As infrastructure as code (IaC) becomes widely adopted by users with heterogenous skillsets, and as IaC codebases become larger and larger, it becomes harder to track drift. Drift is a deviation between the actual infrastructure state and the IaC codebase. It causes issues for security posture management, collaborative work, and maintenance. There are a lot of juicy stories from the trenches to be told on infrastructure drift. Sure enough, we all do GitOps by the book! Or we all have the right processes in place. But we also have to interact with other teams. We also have to grant some level of access to our infrastructures to some services or tools that may eventually generate uncontrolled changes. You can’t efficiently improve what you don’t track. We track coverage for unit tests, why not infrastructure as code coverage? How can we make sure our infrastructure code matches our actual infrastructure state? In this talk, using Terraform with AWS resources, I will show how infrastructure drift can go undetected despite our best efforts or tooling and cause issues and end the talk by showing our own free and open source tool driftctl, (just released under Apache-2.0 licence) that tracks IaC coverage and warns of infrastructure drift.
stackconf 2021 | Stretching the Service Mesh Beyond the CloudsNETWAYS
We hear a lot about using service mesh with Kubernetes and public clouds, but what about outside the clouds? In this talk, you’ll learn creative ways to apply a service mesh across different platforms and environments to automate canary deployments, facilitate cloud migrations, and more. By combining HashiCorp Consul’s service mesh and Terraform’s infrastructure as code, you can build a more seamless operational experience across multiple environments.
Building Microservices in the cloud at AutoScout24Christian Deger
http://continuouslifecycle.de/veranstaltung-4846-building-microservices-in-the-cloud-at-autoscout24.html?id=4846
Fed up with stop and go in your data center? Why not shift into overdrive and pull into the fast lane? Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business. Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset. While the current stack keeps running, ever more microservices will go live as you listen to stories from the trenches.
Fed up with stop and go in your data center? Why not shift into overdrive and pull into the fast lane? Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business.
Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset.
While the current stack keeps running, ever more microservices will go live as you listen to stories from the trenches.
Key takeaways from this talk includes: How to...
… become cloud native
… evolve the architecture
… create “you build it you run it” teams
… involve business people in the transformation
Created and presented together with Wolf Schleger (ThoughtWorks)
Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business.
Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset.
This talk gives a high level overview of our cultural changes, our strategic goals and our architectural principles. That includes our approach, where autonomous, empowered teams continuously deliver services into AWS and are responsible to operate them.
Borrowed some slides from Simon Hohenadl (http://www.slideshare.net/SimonHohenadl) and Matthias Patzak (http://www.slideshare.net/MatthiasPatzak)
stackconf 2021 | Why you should take care of infrastructure driftNETWAYS
As infrastructure as code (IaC) becomes widely adopted by users with heterogenous skillsets, and as IaC codebases become larger and larger, it becomes harder to track drift. Drift is a deviation between the actual infrastructure state and the IaC codebase. It causes issues for security posture management, collaborative work, and maintenance. There are a lot of juicy stories from the trenches to be told on infrastructure drift. Sure enough, we all do GitOps by the book! Or we all have the right processes in place. But we also have to interact with other teams. We also have to grant some level of access to our infrastructures to some services or tools that may eventually generate uncontrolled changes. You can’t efficiently improve what you don’t track. We track coverage for unit tests, why not infrastructure as code coverage? How can we make sure our infrastructure code matches our actual infrastructure state? In this talk, using Terraform with AWS resources, I will show how infrastructure drift can go undetected despite our best efforts or tooling and cause issues and end the talk by showing our own free and open source tool driftctl, (just released under Apache-2.0 licence) that tracks IaC coverage and warns of infrastructure drift.
stackconf 2021 | Stretching the Service Mesh Beyond the CloudsNETWAYS
We hear a lot about using service mesh with Kubernetes and public clouds, but what about outside the clouds? In this talk, you’ll learn creative ways to apply a service mesh across different platforms and environments to automate canary deployments, facilitate cloud migrations, and more. By combining HashiCorp Consul’s service mesh and Terraform’s infrastructure as code, you can build a more seamless operational experience across multiple environments.
Building Microservices in the cloud at AutoScout24Christian Deger
http://continuouslifecycle.de/veranstaltung-4846-building-microservices-in-the-cloud-at-autoscout24.html?id=4846
Fed up with stop and go in your data center? Why not shift into overdrive and pull into the fast lane? Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business. Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset. While the current stack keeps running, ever more microservices will go live as you listen to stories from the trenches.
Fed up with stop and go in your data center? Why not shift into overdrive and pull into the fast lane? Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business.
Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset.
While the current stack keeps running, ever more microservices will go live as you listen to stories from the trenches.
Key takeaways from this talk includes: How to...
… become cloud native
… evolve the architecture
… create “you build it you run it” teams
… involve business people in the transformation
Created and presented together with Wolf Schleger (ThoughtWorks)
Cloud Foundry: Cloud Native, Community, and MomentumVMware Tanzu
SpringOne Platform 2016
Speaker: Jared Wray; Jared Wray, Builder, Founder, Investor, CFF
Jared Wray is an early cloud pioneer and a visionary entrepreneur with a passion for building platforms and robotics.
As founder and CTO of Tier 3, Wray created the Tier 3 cloud and built it into an industry-recognized cloud innovation and performance leader. CenturyLink acquired Tier 3 in 2013 to form the foundation of CenturyLink Cloud.
Wray is a respected thought-leader in the enterprise cloud services space. He created the Iron Foundry open source project to enable .NET on the Cloud Foundry.
At CenturyLink, Wray reinvigorated the engineering core to create a future-proofed platform and engine. The team's’ velocity doubled under Wray’s leadership and this velocity outpaced 75% of the Gartner MQ in new services and features.
Focusing on building teams at scale, Wray introduced an agile / lean manufacturing process over the standard waterfall process. This reduced the company’s average ship time from 18 months to just 21 days or less. This process was integrated into the engineering core for all hosting / cloud products at CenturyLink and has supported substantial growth as the company scaled from six core teams on the cloud to more than 30+ teams.
A serial entrepreneur and advocate for founders, Wray builds and invests in companies. He works hard to enable companies and further the tech industry. Wray is an advisor and investor to companies including Promoter.io and Fons.
stackconf 2021 | Building the first European open source Edge Computing platf...NETWAYS
Edge Computing is becoming increasingly popular nowadays thanks to the growing availability of cloud, bare-metal and 5G providers offering flexible and affordable access to edge resources around the globe. The idea is based on moving core computational processes and storage to distant locations that are closer to the entities they interact with, like end-users and IoT devices. The benefits come from improving network latency and user experience, reducing security risks, and minimizing data transfers to central cloud locations. Thanks to the €2.1M awarded in 2019 by the European Commission as part of the Horizon 2020 SME Instrument Program, OpenNebula has developed the first open source Edge Computing platform in Europe. This talk analyses the benefits and challenges associated with Edge Computing, introduces the “True Hybrid Cloud” concept, and explores how this new EU-funded Edge Computing platform contributes to consolidate Europe’s digital sovereignty by integrating other relevant European open source technologies and by providing future access to the GAIA-X federated infrastructure.
Highway to heaven - Microservices Meetup MunichChristian Deger
Fed up with stop and go in your data center? Why not shift into overdrive and pull into the fast lane? Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business.
Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset.
While the current stack keeps running, ever more microservices will go live as you listen to stories from the trenches.
Key takeaways from this talk includes: How to...
… become cloud native
… evolve the architecture
… create “you build it you run it” teams
… involve business people in the transformation
Created and presented together with Wolf Schleger (ThoughtWorks)
Optimizing DevOps in the Enterprise, Eyal Edri & Oded Ramraz, Red HatDevOpsDays Tel Aviv
Large enterprises today are pacing a flood of multiple devops tools to choose from for their infrastructure.
The problem intensifies when you have dozens of devops teams across the world, each with his own background
of devops tools and knowledge and each with his own agenda of pushing to use his tools.
How would you leverage this distributed, disconnected knowledge into a single working devops knowledge source,
and common infrastructure to leverage the whole enterprise?
Come and hear about Red Hat Global CI initiative to hear on one possible approach for taking on the battle.
CakePHP in a containerized CI/CD environment | Cakefest 2017Stefan van Gastel
A short talk about putting CakePHP in a (Docker) container environment for CI and CD purposes, what obstacles we have encountered doing that and what advantages it has provided us.
Kubernetes and lastminute.com: our course towards better scalability and proc...Michele Orsi
Kubernetes adoption is straight forward when starting from scratch or in public clouds, but what the journey looks like when your starting point is a legacy infrastructure with high-traffic?
In this talk we present our experience that begun almost 1 year ago and challenged everything inside our organisation. Developer teams changed the way they work, product owners benefit from the new speed achieved and the need of new roles emerged in IT department.
We will explain our lessons learnt and the way to get the best out of this solution.
The Evolution of SpeedyCloud Resources Scheduling SystemSpeedyCloud
Massive Scale Public Cloud manages massive physical devices and supports several product lines. Facing the challenges of different types of customers' demand on global distributed cloud nodes, how to schedule the cloud resources and assign to users effectively and solidly? An useful and productive Cloud resources scheduling system will manage those. CTO of SpeedyCloud, Dong Wei, shared his precious experiences on this topic. Visit http://www.speedycloud.cn to find out more.
Highway to heaven - Microservices Meetup DublinChristian Deger
Fed up with stop and go in your data center? Why not shift into overdrive and pull into the fast lane? Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business.
Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset.
While the current stack keeps running, ever more microservices will go live as you listen to stories from the trenches.
Key takeaways from this talk includes: How to...
… become cloud native
… evolve the architecture
… create “you build it you run it” teams
… involve business people in the transformation
[Konveyor] roles & processes that make application modernization projects...Konveyor Community
Digital Transformation engagements are definitely the most complex projects you can work on.
And even though we stated many times that it’s possible to minimize the risks through tools for automated analysis and strong skills, it’s still important to keep in mind that collaboration is the key to succeed.
Usually the success of a digital transformation project derives from the collaboration of some actors:
- Technology vendors
- Consulting companies
- Customer
Let’s discuss the complexity and the methodology for teaming properly and successfully.
Presenter: Andrea Battaglia, Technical Partner Development Manager EMEA
Webinar [16 Oct, 1 PM EDT]: Modernize and Simplify IT Operations Management ...IBM DevOps
Register here: http://ibm.biz/webinar-Oct16
Join this webinar to explore the common operational challenges many DevOps teams are facing today and how modern operations management tools can help you to meet your goals.
Migrating Java JBoss EAP Applications to Kubernetes With S2IKonveyor Community
Watch presentation: https://youtu.be/9hDdg_Beui4
Despite the incredible pace of adoption of container orchestration platforms, the vast majority of EAP workloads are still running on VMs or bare metal. In a lot of cases enterprise operation teams are mandated to modernize and move these workloads to the cloud, and containerization and migration to Kubernetes is the natural destination. When talking about this migration path, we're often asked questions like:
What's involved?
How easy is it to move these workloads?
How can you be sure of no code changes?
What tools are there to assist with this effort?
What are the benefits of moving workloads to Kubernetes?
In this meetup, Philip Hayes, Runtimes Practice Lead at Red Hat, will provide answers to these questions and also include a step-by-step guide to migrating an EAP 7 application to Kubernetes.
Kubernetes and lastminute.com: our course towards better scalability and proc...Michele Orsi
In one year we migrated a full set of micro-services into a new infrastructure based on Kubernetes and Docker.
I will present how we get there describing real-life challenges, problems faced and solutions found
Deploy Magnolia CMS in the Cloud with OpenShiftMagnolia
This webinar explains how to use Magnolia CMS with OpenShift, Red Hat's open source, polyglot and scalable Platform as a Service (Paas). It explains the basics of OpenShift and walks attendees through the process of getting a Magnolia CMS instance up and running on OpenShift. It also covers best practices for creating standardized Magnolia CMS deployments on OpenShift.
This webinar will be most useful to CMS developers and system administrators concerned with standardized, scalable and automated CMS deployment in the cloud.
About the presenters:
Shekhar Gulati is the Principal OpenShift Developer Evangelist working at Red Hat. He has 8 years of software web development experience. He regularly speaks at various conference and user groups around the world. Shekhar is an active writer and has written many technical articles for IBM DeveloperWorks, Developer.com and JavaLobby. His current interests are NoSQL databases, cloud computing, mainly Platform-as-a-Service (PaaS), mobile development, javascript frameworks, and new things happening in the Java community. When he is not traveling, he loves to write code and read technology books. You can follow him on twitter @ shekhargulati.
Trained as a physicist and with a professional background in Smalltalk, Daniel Lipp has been developing with Java since 1997. After being a Software Architect for several IT service providers and financial industry companies, he joined Magnolia’s Product Development team in 2010.
There he focuses on server side development, quality assurance and software architecture.
These are the slides from the <a>Magnolia on Jelastic presentation</a> done by Jelastic and Info.nl during the Magnolia 2014 conference.
The managed services department of Info.nl offers Jelastic Cloud hosting since 2013. The general angle of this presentation is to explain how Magnolia works in combination with Jelastic.
The presentation includes:
- An overview of the Jelastic cloud hosting platform
- A demo on our Info Jelastic cloud; how to install Magnolia 5 on Jelastic
- Lessons learned with Magnolia Jelastic hosting
- What's next
Cloud Foundry: Cloud Native, Community, and MomentumVMware Tanzu
SpringOne Platform 2016
Speaker: Jared Wray; Jared Wray, Builder, Founder, Investor, CFF
Jared Wray is an early cloud pioneer and a visionary entrepreneur with a passion for building platforms and robotics.
As founder and CTO of Tier 3, Wray created the Tier 3 cloud and built it into an industry-recognized cloud innovation and performance leader. CenturyLink acquired Tier 3 in 2013 to form the foundation of CenturyLink Cloud.
Wray is a respected thought-leader in the enterprise cloud services space. He created the Iron Foundry open source project to enable .NET on the Cloud Foundry.
At CenturyLink, Wray reinvigorated the engineering core to create a future-proofed platform and engine. The team's’ velocity doubled under Wray’s leadership and this velocity outpaced 75% of the Gartner MQ in new services and features.
Focusing on building teams at scale, Wray introduced an agile / lean manufacturing process over the standard waterfall process. This reduced the company’s average ship time from 18 months to just 21 days or less. This process was integrated into the engineering core for all hosting / cloud products at CenturyLink and has supported substantial growth as the company scaled from six core teams on the cloud to more than 30+ teams.
A serial entrepreneur and advocate for founders, Wray builds and invests in companies. He works hard to enable companies and further the tech industry. Wray is an advisor and investor to companies including Promoter.io and Fons.
stackconf 2021 | Building the first European open source Edge Computing platf...NETWAYS
Edge Computing is becoming increasingly popular nowadays thanks to the growing availability of cloud, bare-metal and 5G providers offering flexible and affordable access to edge resources around the globe. The idea is based on moving core computational processes and storage to distant locations that are closer to the entities they interact with, like end-users and IoT devices. The benefits come from improving network latency and user experience, reducing security risks, and minimizing data transfers to central cloud locations. Thanks to the €2.1M awarded in 2019 by the European Commission as part of the Horizon 2020 SME Instrument Program, OpenNebula has developed the first open source Edge Computing platform in Europe. This talk analyses the benefits and challenges associated with Edge Computing, introduces the “True Hybrid Cloud” concept, and explores how this new EU-funded Edge Computing platform contributes to consolidate Europe’s digital sovereignty by integrating other relevant European open source technologies and by providing future access to the GAIA-X federated infrastructure.
Highway to heaven - Microservices Meetup MunichChristian Deger
Fed up with stop and go in your data center? Why not shift into overdrive and pull into the fast lane? Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business.
Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset.
While the current stack keeps running, ever more microservices will go live as you listen to stories from the trenches.
Key takeaways from this talk includes: How to...
… become cloud native
… evolve the architecture
… create “you build it you run it” teams
… involve business people in the transformation
Created and presented together with Wolf Schleger (ThoughtWorks)
Optimizing DevOps in the Enterprise, Eyal Edri & Oded Ramraz, Red HatDevOpsDays Tel Aviv
Large enterprises today are pacing a flood of multiple devops tools to choose from for their infrastructure.
The problem intensifies when you have dozens of devops teams across the world, each with his own background
of devops tools and knowledge and each with his own agenda of pushing to use his tools.
How would you leverage this distributed, disconnected knowledge into a single working devops knowledge source,
and common infrastructure to leverage the whole enterprise?
Come and hear about Red Hat Global CI initiative to hear on one possible approach for taking on the battle.
CakePHP in a containerized CI/CD environment | Cakefest 2017Stefan van Gastel
A short talk about putting CakePHP in a (Docker) container environment for CI and CD purposes, what obstacles we have encountered doing that and what advantages it has provided us.
Kubernetes and lastminute.com: our course towards better scalability and proc...Michele Orsi
Kubernetes adoption is straight forward when starting from scratch or in public clouds, but what the journey looks like when your starting point is a legacy infrastructure with high-traffic?
In this talk we present our experience that begun almost 1 year ago and challenged everything inside our organisation. Developer teams changed the way they work, product owners benefit from the new speed achieved and the need of new roles emerged in IT department.
We will explain our lessons learnt and the way to get the best out of this solution.
The Evolution of SpeedyCloud Resources Scheduling SystemSpeedyCloud
Massive Scale Public Cloud manages massive physical devices and supports several product lines. Facing the challenges of different types of customers' demand on global distributed cloud nodes, how to schedule the cloud resources and assign to users effectively and solidly? An useful and productive Cloud resources scheduling system will manage those. CTO of SpeedyCloud, Dong Wei, shared his precious experiences on this topic. Visit http://www.speedycloud.cn to find out more.
Highway to heaven - Microservices Meetup DublinChristian Deger
Fed up with stop and go in your data center? Why not shift into overdrive and pull into the fast lane? Learn how AutoScout24 are building their Autobahn in the cloud to become the market leader in Europe's vehicle classified business.
Reinventing themselves by making a radical transition from monoliths to microservices, from .NET on Windows to Scala on Linux, from data center to AWS and from built by devs and run by ops to a devops mindset.
While the current stack keeps running, ever more microservices will go live as you listen to stories from the trenches.
Key takeaways from this talk includes: How to...
… become cloud native
… evolve the architecture
… create “you build it you run it” teams
… involve business people in the transformation
[Konveyor] roles & processes that make application modernization projects...Konveyor Community
Digital Transformation engagements are definitely the most complex projects you can work on.
And even though we stated many times that it’s possible to minimize the risks through tools for automated analysis and strong skills, it’s still important to keep in mind that collaboration is the key to succeed.
Usually the success of a digital transformation project derives from the collaboration of some actors:
- Technology vendors
- Consulting companies
- Customer
Let’s discuss the complexity and the methodology for teaming properly and successfully.
Presenter: Andrea Battaglia, Technical Partner Development Manager EMEA
Webinar [16 Oct, 1 PM EDT]: Modernize and Simplify IT Operations Management ...IBM DevOps
Register here: http://ibm.biz/webinar-Oct16
Join this webinar to explore the common operational challenges many DevOps teams are facing today and how modern operations management tools can help you to meet your goals.
Migrating Java JBoss EAP Applications to Kubernetes With S2IKonveyor Community
Watch presentation: https://youtu.be/9hDdg_Beui4
Despite the incredible pace of adoption of container orchestration platforms, the vast majority of EAP workloads are still running on VMs or bare metal. In a lot of cases enterprise operation teams are mandated to modernize and move these workloads to the cloud, and containerization and migration to Kubernetes is the natural destination. When talking about this migration path, we're often asked questions like:
What's involved?
How easy is it to move these workloads?
How can you be sure of no code changes?
What tools are there to assist with this effort?
What are the benefits of moving workloads to Kubernetes?
In this meetup, Philip Hayes, Runtimes Practice Lead at Red Hat, will provide answers to these questions and also include a step-by-step guide to migrating an EAP 7 application to Kubernetes.
Kubernetes and lastminute.com: our course towards better scalability and proc...Michele Orsi
In one year we migrated a full set of micro-services into a new infrastructure based on Kubernetes and Docker.
I will present how we get there describing real-life challenges, problems faced and solutions found
Deploy Magnolia CMS in the Cloud with OpenShiftMagnolia
This webinar explains how to use Magnolia CMS with OpenShift, Red Hat's open source, polyglot and scalable Platform as a Service (Paas). It explains the basics of OpenShift and walks attendees through the process of getting a Magnolia CMS instance up and running on OpenShift. It also covers best practices for creating standardized Magnolia CMS deployments on OpenShift.
This webinar will be most useful to CMS developers and system administrators concerned with standardized, scalable and automated CMS deployment in the cloud.
About the presenters:
Shekhar Gulati is the Principal OpenShift Developer Evangelist working at Red Hat. He has 8 years of software web development experience. He regularly speaks at various conference and user groups around the world. Shekhar is an active writer and has written many technical articles for IBM DeveloperWorks, Developer.com and JavaLobby. His current interests are NoSQL databases, cloud computing, mainly Platform-as-a-Service (PaaS), mobile development, javascript frameworks, and new things happening in the Java community. When he is not traveling, he loves to write code and read technology books. You can follow him on twitter @ shekhargulati.
Trained as a physicist and with a professional background in Smalltalk, Daniel Lipp has been developing with Java since 1997. After being a Software Architect for several IT service providers and financial industry companies, he joined Magnolia’s Product Development team in 2010.
There he focuses on server side development, quality assurance and software architecture.
These are the slides from the <a>Magnolia on Jelastic presentation</a> done by Jelastic and Info.nl during the Magnolia 2014 conference.
The managed services department of Info.nl offers Jelastic Cloud hosting since 2013. The general angle of this presentation is to explain how Magnolia works in combination with Jelastic.
The presentation includes:
- An overview of the Jelastic cloud hosting platform
- A demo on our Info Jelastic cloud; how to install Magnolia 5 on Jelastic
- Lessons learned with Magnolia Jelastic hosting
- What's next
Apps can take advantage of Magnolia CMS' built-in best-practice framework, reducing development time and improving end-user experience. They're also faster to develop, easier to maintain and more secure on account of Magnolia CMS' sophisticated, documented Apps API and encapsulated environment.
ITARC15 Workshop - Architecting a Large Software Project - Lessons LearnedJoão Pedro Martins
Improving on a previous version of this session delivered in Lisbon, this deck describes the real experiences in architecting and developing a large software project that took 3 years to go live. It was presented at a 3,5hr ITARC2015 workshop in Stockholm, Sweden.
Deploying your apps in the cloud - the options: an overviewCisco DevNet
A session in the DevNet Zone at Cisco Live, Berlin. There are numerous ways to deploy applications within the cloud. The current rage is deploying within containers, but many applications continue to be deployed on VMs as well as on bare metal. In this session we will discuss the pros and cons and each approach and how to determine which method of deployment is best for your needs. While there is not one way to rule them all, OpenStack provides common APIs that can be used to orchestrate all your workloads regardless of the deployment options you need. OpenStack components and options covered include Heat, Murano, Kolla, and Magnum. Finally, we touch briefly on why you might want to consider building your application using microservices and how Shipped can help.
Cloud & OSGi - The Dawn of Composite Clouds (Now with demo videos)mfrancis
Presentation by Richard Nicholson (Paremus) from OSGi DevCon / EclipseCon 2011.
Now with demo videos.
Despite the element of novelty and fashion, there is little doubt that Cloud Computing will have a fundamental and long lasting influence on the technology landscape. Yet virtual machine based Cloud Compute offerings, which attempt to maximise resource utilisation and minimise operational management of those resources, have nothing to say about the dominant contributor to an organisations IT OPEX. Application maintainability accounts for approximately 70% of an applications TCO. To increase application maintainability, one must modularise and preferably modularise using an industry standard. Hence, for organisations with large in-house development teams, it is predicted that OSGi will have equivalent or greater impact than Cloud Computing! This presentation will look at the intersect of Cloud Computing and OSGi based Composite Applications. Areas explored will include the importance of dynamic dependency management, the anatomy of cloud enabled composite applications and the role of the PaaS in an OSGi enabled Cloud. Relevant OSGi standards will be reviewed along with how these may be used to address the configuration and management of distributed Cloud hosted composite applications. The presentation will conclude by demonstrating a distributed Cloud / OSGi runtime that demonstrates the concepts discussed
Creating an all-purpose REST API for Cloud services using OSGi and Sling - C ...mfrancis
OSGi Community Event 2014
Abstract:
Let's say you need to provide an internet service to your users. Chances are that your service should be available via REST. Let's say your service should both provide data to users as well as accept data posted by users, and possibly some logic. Now let's assume your service turns out to become incredibly popular, with lots and lots of users. Sounds like you need Sling and OSGi in the cloud.
In this talk Carsten and David will go through the OSGi and Sling architecture to achieve this. The talk outlines how the OSGi Cloud Ecosystems RFC is used in combination with Apache jclouds to achieve vendor independence. It also discusses how automatic scaling depending on measured load is achieved to ensure responsiveness. The resulting system is a dynamic cloud application handling any REST API, which can scale up and down depending on the need.
Speaker Bios:
David Bosschaert
David Bosschaert works for Adobe Research and Development. He spends the much of his time on technology relating to OSGi in Apache and other open source projects. He is also co-chair of the OSGi Enterprise Expert Group and an active participant in the OSGi Cloud efforts.
Before joining Adobe, David worked for Red Hat/JBoss and IONA Technologies in Dublin, Ireland.
Carsten Ziegeler
Carsten Ziegeler is senior developer at Adobe Research Switzerland and spends most of his time on architectural and infrastructure topics. Working for over 25 years in open source projects, Carsten is a member of the Apache Software Foundation and heavily participates in several Apache communities including Sling, Felix and ACE. He is a frequent speaker on technology and open source conferences and participates in the OSGi Core Platform and Enterprise expert groups.
Presentation on OSGi Cloud Ecosystems as presented during EclipseCon Europe 2012 (http://www.eclipsecon.org/europe2012/sessions/osgi-and-cloud-computing)
Lessons learned from a large scale OSGii web app - P Bakker & J de Vreedemfrancis
Building a large scale, cloud hosted, multi device product that changes the way students are taught in high schools, turns out to be not entirely trivial. We have been building PulseOn for the last two years. We faced many technical challenges, and have tried many different technologies. Some ideas turned out to be extremely helpful, some other ideas that looked promising turned out to be bad practices. In this talk we will discuss what we have learned about building modular, scalable web applications. We will go into different areas of the technology stack, from storage and (nosql) databases to a modular RESTful backend and a multi device HTML5 based frontend. We will also go into the cloud, and discuss topics such as auto scaling and failover. We will discuss what works and what doesn’t, and hopefully help other to make the right decisions.
Some topics that we will touch upon:
- Modular architecture with OSGi
- Failing at linked data and semantic databases
- Using MongoDB from OSGi
- Release process and semantic versioning
- Continuous deployment
- JavaScript frameworks
Bios:
Paul Bakker
Paul is a software architect for Luminis Technologies and the author of “Building Modular Cloud Apps With OSGi”. He believes that modularity and the cloud are the two main challenges we have to deal with to bring technology to the next level, and is working on making this possible for mainstream software development. Today he is working on educational software focussed on personalised learning for high school students in the Netherlands. Paul is an active contributor on open source projects such as Amdatu, Apache ACE and BndTools.
He has a background as a trainer on Java related technology and is a regular speaker on conferences such as JavaOne, Devoxx and JFokus.
Jago de Vreede
Jago is a software engineer at Luminis Technologies, as a software engineer he has seen a broad-spectrum of projects and he has been working on a large OSGi project for the last year. His work is not exclusive to java development but also does front-end development, and the integration between these. Performance tuning and optimizations are also part of his work.
Stay productive while slicing up the monolithMarkus Eisele
Microservices-based architectures are in vogue. Over the last couple of years, we have learned how thought leaders implement them, and it seems like every other week we hear about how containers and platform-as-a-service offerings make them ultimately happen.
Tech Talent Night Copenhagen 11/22/17
https://greenticket.dk/techtalentnightcph
A presentation to explain the microservices architecture, the pro and the cons, with a view on how to migrate from a monolith to a SOA architecture. Also, we'll show the benefits of the microservices architecture also for the frontend side with the microfrontend architecture.
Kubernetes Native Java and Eclipse MicroProfile | EclipseCon Europe 2019Jakarta_EE
In this presentation we will cover some of those challenges, discuss how one of those standards efforts (Eclipse MicroProfile) has helped move the Java community forward, and give an hint at some changes happening in the Java language and frameworks with the Quarkus project as an example.
Speaker: Mark Little, Red Hat
Kubernetes Native Java and Eclipse MicroProfile | EclipseCon Europe 2019The Eclipse Foundation
In this presentation we will cover some of those challenges, discuss how one of those standards efforts (Eclipse MicroProfile) has helped move the Java community forward, and give an hint at some changes happening in the Java language and frameworks with the Quarkus project as an example.
Speaker: Mark Little, Red Hat
CNCF Webinar Series: "Creating an Effective Developer Experience on Kubernetes"Daniel Bryant
In a productive cloud-native development workflow, individual teams can build and ship software independently from each other. But with a rapidly evolving Cloud Native Landscape, creating an effective developer workflow on Kubernetes can be challenging. We are all creating software to support the delivery of value to our customers and to the business, and therefore, the developer experience from idea generation to running (and observing) in production must be fast, reliable, and provide good feedback.
In this webinar, we’ll discuss:
- Why an efficient development workflow is so important
- The role of Kubernetes, Envoy, Prometheus, and other popular cloud-native tools in your workflow
- Key considerations in implementing a cloud-native workflow
Dyn delivers exceptional Internet Performance. Enabling high quality services requires data centers around the globe. In order to manage services, customers need timely insight collected from all over the world. Dyn uses DataStax Enterprise (DSE) to deploy complex clusters across multiple datacenters to enable sub 50 ms query responses for hundreds of billions of data points. From granular DNS traffic data, to aggregated counts for a variety of report dimensions, DSE at Dyn has been up since 2013 and has shined through upgrades, data center migrations, DDoS attacks and hardware failures. In this webinar, Principal Engineers Tim Chadwick and Rick Bross cover the requirements which led them to choose DSE as their go-to Big Data solution, the path which led to SPARK, and the lessons that we’ve learned in the process.
muCon 2019: "Creating an Effective Developer Experience for Cloud-Native Apps"Daniel Bryant
Many organizations are embracing cloud-native technologies, such as microservices, containers, and Kubernetes, but are struggling to adapt their developer experience (DevEx or DX) and continuous delivery processes. Failure to adapt leads to longer lead times for delivery, frustration for developers, and stability issues in production. Architects and technical leaders need to drive this change.
The developer experience with modern cloud-native technologies is very different than the classic enterprise experience of the 1990s or even the early cloud experiences of the 2000s. For example, it’s often no longer possible to spin up an entire application or system on local hardware, and the extra layers of abstract of containers and VMs make debugging and observing systems more challenging.
Daniel Bryant explores the core concepts of the cloud-native developer experience, introduces and compares several useful tools, and shares lessons learned from the trenches.
OpenStack Control Plane Architectures - Design SolutionsShane Gibson
Building an OpenStack private cloud can be very complex. Underpinning the entire operational capabilities of your cloud is the Control Plane. It's common knowledge you should treat your cloud resources "like cattle" and not "pets", yet most clouds treat the control plane like a favored pet.
How should the modern cloud architect choose to design the control plane aspect of your private cloud?
Attendees of this presentaion should walk away with a grasp of various architectures for managing the design and build out of your Control Plane, and know where each architecture would best fit depending on your needs and cloud scale.
We will discuss designs for building and managing your Control Plane:
* standalone single server
* active/passive
* multi-node active/active
* distributed
Each has their own trade off and relevance depending on your goals. This presentation will help guide you in considering the models available and help you to make a decision for your cloud platform.
Triangle Devops Meetup covering Netflix open source, cloud architecture, and what Andrew did in his first year working as a senior software engineer in the cloud platform group.
Workday "Creating an Effective Developer Experience on Kubernetes"Daniel Bryant
In a productive cloud-native development workflow, individual teams can build and ship software independently from each other. But with a rapidly evolving Cloud Native Landscape, creating an effective developer workflow on Kubernetes can be challenging. We are all creating software to support the delivery of value to our customers and to the business, and therefore, the developer experience from idea generation to running (and observing) in production must be fast, reliable, and provide good feedback.
Following simple patterns of good application design can allow you to scale your application for your customers easily. This presentation dives into the 12 factor application design and demo how this applies to containers and deployments on Amazon ECS and Fargate. We'll take a look at tooling that can be used to simplify your workflow and help you adopt the principles of the 12 factor application.
Adrian Cockcroft on his top predictions for the cloud computing industry in 2015 and beyond, as well as how cloud-native applications, continuous-delivery and DevOps techniques, will speed the pace of innovation and disruption.
For more about Adrian be sure to check out his page on Battery Ventures:
https://www.battery.com/our-team/member/adrian-cockcroft/
Follow Adrian on Twitter: @adrianco
Containerizing couchbase with microservice architecture on mesosphere.pptxRavi Yadav
Ravi Yadav, Mesosphere
Anil Kumar, Couchbase
Organizations focused on delivering exceptional customer experiences are building applications using microservice architectures because of the flexibility, speed of delivery, and maintainability that they provide. In this session, you will learn how Couchbase can fit into a microservice architecture using containers and orchestration. We will explore how Couchbase and Mesosphere work together to simplify application development and delivery. Additionally, you will see a demonstration of exactly how to create a Couchbase cluster on Mesosphere DC/OS Enterprise.
Learn about different digital transformation cases around ZALORA eCommerce, Amazon.com Omni channel offerings, 17 Live Streaming platform’s cloud journey and Capital One reinvent their mobile banking service with Amazon Echo and Alexa Skills Kit (ASK). Discover how the Amazon Web Services platform help you innovate faster and speed up time to market with true reference scenarios.
Similar to A Microservices Architecture That Emphasizes Rapid Development (That Conference) (20)
Cyaniclab : Software Development Agency Portfolio.pdfCyanic lab
CyanicLab, an offshore custom software development company based in Sweden,India, Finland, is your go-to partner for startup development and innovative web design solutions. Our expert team specializes in crafting cutting-edge software tailored to meet the unique needs of startups and established enterprises alike. From conceptualization to execution, we offer comprehensive services including web and mobile app development, UI/UX design, and ongoing software maintenance. Ready to elevate your business? Contact CyanicLab today and let us propel your vision to success with our top-notch IT solutions.
Check out the webinar slides to learn more about how XfilesPro transforms Salesforce document management by leveraging its world-class applications. For more details, please connect with sales@xfilespro.com
If you want to watch the on-demand webinar, please click here: https://www.xfilespro.com/webinars/salesforce-document-management-2-0-smarter-faster-better/
Advanced Flow Concepts Every Developer Should KnowPeter Caitens
Tim Combridge from Sensible Giraffe and Salesforce Ben presents some important tips that all developers should know when dealing with Flows in Salesforce.
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
Code reviews are vital for ensuring good code quality. They serve as one of our last lines of defense against bugs and subpar code reaching production.
Yet, they often turn into annoying tasks riddled with frustration, hostility, unclear feedback and lack of standards. How can we improve this crucial process?
In this session we will cover:
- The Art of Effective Code Reviews
- Streamlining the Review Process
- Elevating Reviews with Automated Tools
By the end of this presentation, you'll have the knowledge on how to organize and improve your code review proces
A Comprehensive Look at Generative AI in Retail App Testing.pdfkalichargn70th171
Traditional software testing methods are being challenged in retail, where customer expectations and technological advancements continually shape the landscape. Enter generative AI—a transformative subset of artificial intelligence technologies poised to revolutionize software testing.
How Recreation Management Software Can Streamline Your Operations.pptxwottaspaceseo
Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.
How Does XfilesPro Ensure Security While Sharing Documents in Salesforce?XfilesPro
Worried about document security while sharing them in Salesforce? Fret no more! Here are the top-notch security standards XfilesPro upholds to ensure strong security for your Salesforce documents while sharing with internal or external people.
To learn more, read the blog: https://www.xfilespro.com/how-does-xfilespro-make-document-sharing-secure-and-seamless-in-salesforce/
Accelerate Enterprise Software Engineering with PlatformlessWSO2
Key takeaways:
Challenges of building platforms and the benefits of platformless.
Key principles of platformless, including API-first, cloud-native middleware, platform engineering, and developer experience.
How Choreo enables the platformless experience.
How key concepts like application architecture, domain-driven design, zero trust, and cell-based architecture are inherently a part of Choreo.
Demo of an end-to-end app built and deployed on Choreo.
top nidhi software solution freedownloadvrstrong314
This presentation emphasizes the importance of data security and legal compliance for Nidhi companies in India. It highlights how online Nidhi software solutions, like Vector Nidhi Software, offer advanced features tailored to these needs. Key aspects include encryption, access controls, and audit trails to ensure data security. The software complies with regulatory guidelines from the MCA and RBI and adheres to Nidhi Rules, 2014. With customizable, user-friendly interfaces and real-time features, these Nidhi software solutions enhance efficiency, support growth, and provide exceptional member services. The presentation concludes with contact information for further inquiries.
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus
As part of the DOE Integrated Research Infrastructure (IRI) program, NERSC at Lawrence Berkeley National Lab and ALCF at Argonne National Lab are working closely with General Atomics on accelerating the computing requirements of the DIII-D experiment. As part of the work the team is investigating ways to speedup the time to solution for many different parts of the DIII-D workflow including how they run jobs on HPC systems. One of these routes is looking at Globus Compute as a way to replace the current method for managing tasks and we describe a brief proof of concept showing how Globus Compute could help to schedule jobs and be a tool to connect compute at different facilities.
Designing for Privacy in Amazon Web ServicesKrzysztofKkol1
Data privacy is one of the most critical issues that businesses face. This presentation shares insights on the principles and best practices for ensuring the resilience and security of your workload.
Drawing on a real-life project from the HR industry, the various challenges will be demonstrated: data protection, self-healing, business continuity, security, and transparency of data processing. This systematized approach allowed to create a secure AWS cloud infrastructure that not only met strict compliance rules but also exceeded the client's expectations.
SOCRadar Research Team: Latest Activities of IntelBrokerSOCRadar
The European Union Agency for Law Enforcement Cooperation (Europol) has suffered an alleged data breach after a notorious threat actor claimed to have exfiltrated data from its systems. Infamous data leaker IntelBroker posted on the even more infamous BreachForums hacking forum, saying that Europol suffered a data breach this month.
The alleged breach affected Europol agencies CCSE, EC3, Europol Platform for Experts, Law Enforcement Forum, and SIRIUS. Infiltration of these entities can disrupt ongoing investigations and compromise sensitive intelligence shared among international law enforcement agencies.
However, this is neither the first nor the last activity of IntekBroker. We have compiled for you what happened in the last few days. To track such hacker activities on dark web sources like hacker forums, private Telegram channels, and other hidden platforms where cyber threats often originate, you can check SOCRadar’s Dark Web News.
Stay Informed on Threat Actors’ Activity on the Dark Web with SOCRadar!
Quarkus Hidden and Forbidden ExtensionsMax Andersen
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
Unlocking Business Potential: Tailored Technology Solutions by Prosigns
Discover how Prosigns, a leading technology solutions provider, partners with businesses to drive innovation and success. Our presentation showcases our comprehensive range of services, including custom software development, web and mobile app development, AI & ML solutions, blockchain integration, DevOps services, and Microsoft Dynamics 365 support.
Custom Software Development: Prosigns specializes in creating bespoke software solutions that cater to your unique business needs. Our team of experts works closely with you to understand your requirements and deliver tailor-made software that enhances efficiency and drives growth.
Web and Mobile App Development: From responsive websites to intuitive mobile applications, Prosigns develops cutting-edge solutions that engage users and deliver seamless experiences across devices.
AI & ML Solutions: Harnessing the power of Artificial Intelligence and Machine Learning, Prosigns provides smart solutions that automate processes, provide valuable insights, and drive informed decision-making.
Blockchain Integration: Prosigns offers comprehensive blockchain solutions, including development, integration, and consulting services, enabling businesses to leverage blockchain technology for enhanced security, transparency, and efficiency.
DevOps Services: Prosigns' DevOps services streamline development and operations processes, ensuring faster and more reliable software delivery through automation and continuous integration.
Microsoft Dynamics 365 Support: Prosigns provides comprehensive support and maintenance services for Microsoft Dynamics 365, ensuring your system is always up-to-date, secure, and running smoothly.
Learn how our collaborative approach and dedication to excellence help businesses achieve their goals and stay ahead in today's digital landscape. From concept to deployment, Prosigns is your trusted partner for transforming ideas into reality and unlocking the full potential of your business.
Join us on a journey of innovation and growth. Let's partner for success with Prosigns.
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
Listen to the keynote address and hear about the latest developments from Rachana Ananthakrishnan and Ian Foster who review the updates to the Globus Platform and Service, and the relevance of Globus to the scientific community as an automation platform to accelerate scientific discovery.
14. Culturally Fast / Rapid
○Small cross-cutting squads
○Ship early, ship often; MVP
○Anyone can deploy, anytime
○Deploys, rollbacks are fast and easy
○Low friction for service operation
29. organizations which design systems ... are constrained to produce
designs which are copies of the communication structures of
these organizations
Melvin Conway
“
30.
31.
32.
33.
34.
35.
36.
37.
38. public class RouteConfig : IRouteConfig
{
public IEnumerable<string> GetApplicationRoutes()
{
return new List<string>
{
"speedtest.*",
"api/v2/speedtest/.*",
"bifrost/speedtest/.*",
"scripts/speedtest/.*",
"bundles/speedtest/.*",
"css/speedtest/speedtest.css",
};
}
5-10 mins for Q at end. Ask via link. Vote.
Context = important. This presentation is descriptive, not prescriptive.
Netflix, a huge, global video streaming service, is going to do things differently than a government contract shop; a 1000-person development team will approach problems differently from a 10-person team.
How many users do we have? What kind of users are they? What are their needs for availability, performance, etc.?
Don’t get caught up in what’s right and wrong; it’s trade-offs, and those trade-offs depend on who you, what you do, and why you do it.
Background up front to establish, and talk about things like org structure / team size throughout to help frame how we thought about our problems in our situations at the time.
My name’s Rob, engineer at Hudl on our Foundation tribe.
Build the platform and lifecycle that helps squads across the rest of the company ship code and products quickly and safely.
On microservices transition team about 2.5 years ago.
At hudl, we build sports software that helps teams and athletes win.
Teams record video at their games and practices.
They upload that video to hudl.com,
we provide tools to help them break down and analyze the video they record.
share it with coaches, athletes, and analysts…
who use it to better understand their game,
build reports to identify tendencies and areas to improve in the future.
Highlights for athletes and teams to showcase and share.
Notification and event feeds for team communication...
Playbooks that integrate with video
Significant number of other features.
Our customers. These are the people we solve problems for.
4.5MM active users in dozens of sports in over 70 countries
130k teams from small, local basketball league teams all the way up to elite teams in leagues like the NFL, EPL
10k reqs/second during american football season
Mainly C# / JS / MongoDB - Running on IIS on windows server, a number of frameworks (ASP.NET MVC, React). A lot of supplementary tech as well for cache, queue, etc.
All cloud, AWS. No on-premises hosting or datacenters.
Small, cross-cutting teams that focus on a particular domain.
Developers, designers, QA, Product Manager pave their own way and ship at their own speed.
Volleyball squad that figures out what they need to do to solve customers’ problems.
Most squads ship early and often. MVP: playbook @ 400 deploys and counting
Anyone can deploy; in fact, most often our QA or PMs are the ones pushing code to production
Deploys: zero downtime, fast and easy; moving fast comes with some risk, and the ability to react to that quickly is important
No gatekeepers or throwing-over-the-wall; squads operate their services;
If memory leak, they’re the ones remoting on and digging into it
We measure something called Branch Lifecycle. Branch is the atomic unit of “shipping” for us, want to know how long it takes a branch to get from creation to production.
Histogram breaking down that lifecycle duration for all the branches our teams have shipped in the last 30 days.
The blue bars are histogram buckets for the first 24 hours, and the green bars are buckets for each day afterward.
Example: Just over 60 branches have gone from created to shipped in less than one hour
Median lifecycle 32 hours; half of the team’s branches go out in < 1.5 days
My goal is to make sure we have platform that enables a wide spectrum here. Don’t force the fast iterations, but enable them.
TRANSITION: For us, arch/plat/lifecycle is a means to keep us nimble as a product team so we can deliver fixes and features to our coaches and athletes quickly. Transition to microservices was one thing that helped us achieve that as we’ve grown our team.
Ask question
Interested in talking specifics about your architecture and how you think about microservices, find me afterward and I’d love to chat more about it
Transition: don’t take microservices lightly
Architectural Complexity
Need teams to build these and support them if they break. You need test and local development environments that can work with this model.
Your company’s business is probably not to “build a microservices architecture.” Time spent away from building products for your customers, and doing the things that actually make your business money.
Runtime complexity, also. Change the way you think about writing code to be more tolerant of individual service failures. Build your application differently.
The universe you have to invent and live in for microservices is much more complex. Don’t take it lightly.
There are existing tools. Buy or OSS. There are smaller pieces that you can build with, or complete PaaS offerings. Read, read, read.
I will be prescriptive here. You shouldn’t try to invent the universe yourself. Don’t go writing a strongly-consistent service registry yourself. Solved problems, leverage them.
C# + Windows made this challenging for us, which is why we hand-rolled some.
Custom deployment was one of those; IIS + Windows, and Windows servers are slower to start, so rolling deploys made our deploy process slower; swap out deployment payloads on existing instances
Know the trade-offs. How much control do you need over the pieces? How complex is it to operate?
TRANSITION: Tons of advantages and disadvantage between. Highlight a couple that are important to us relative to dev speed.
We do this a lot. Anyone can make changes to others’ codebases.
I’ve done a lot of development on our users service (manages users and authentication) but team mgmt may want to make a change to our role management.
Awesome! Work I don’t have to do. No work order, wait for backlog, hope it was to spec.
Code reviews. Probably different from some orgs that have more rigid ownership.
Monolith Advantage
Recruit - Athletes play at the next level of their career, college recruiting programs
Profiles - Public athlete pages, showcase highlights and other strengths
Profiles squad new feature, show colleges an athlete is being recruited to on their profile.
Add some data and query it a bit differently on the Recruit side.
Example: recruiting college, display on athlete profile page
Today, these two domains are microservices for us.
Data layer changes on recruit
Expose via API. Contract, versioning, backwards compatibility
Get that code pushed first
Make changes on profiles, now it’s an API call over the network. Data transport, service discovery. Have to consider failure, set timeouts.
Render to view.
If bug found during testing, especially on the recruit changes, do that dance all over again.
Monoliths have advantage, much simpler, much faster to code.
Describe old monolith deploy lifecycle
For us, 30m each. If problems or rollback, longer. Blocks everyone.
Loosely coupled and independently deployable, many queues
Also “Blast radius”, problem with deployment or code is limited.
TRANSITION: These two concepts (cross-domain dev, deploy orchestration) are both important to us.
Want to allow teams to have the flexibility to quickly make changes across domains
Want to be able to get code out to production quickly when it’s ready to go
Second one, having to queue up for deploys, was one of the biggest catalysts for our transition
Code deploys / week since 2012
Test deploys, prod deploys
Orange line, max @ 90/week (18/day)
Vertical line, first micro in Jan 2014
Why was that becoming more of a problem for us at that time?
Had been slowly growing our development team. Blue line is product team size.
From a small team of maybe a dozen developers or so to a slightly larger team 46 contributors to the same code base. 6-7 squads, each working on a different domain
Knew we were going to hire a lot in the coming years, so it was only going to get worse.
Monolith for 6-7 years. Had reorganized our teams to the point where the underlying arch was fighting organizational structure.
Remnant of a smaller company with a single team split among tasks in the same website. Narrower customer focus (US HS FB coaches and athletes).
To follow Conway, we’d need something like this.
Break it up, let teams create and work on their services.
Pause, transition.
Go into some detail on these blue boxes, these microservices that our teams work on today. Describe the architecture, and a couple things we do to let team work on them quickly.
Describe speedtest, coach runs, we persist, load in admin.
Support asks where uploading from, suggests alternatives
Full-stack microservices, everything a squad needs to build an application end-to-end and deliver it as a service.
ASP.NET MVC
Serves static resources for client-side apps, views, APIs, and inter-service endpoints.
Data layer
Stateless at runtime, nothing that can’t be reconstructed quickly on startup. State and data is stored in databases like MongoDB, caches, external queueing systems, etc.
Easier to manage lifecycle in production.
NGINX in front. Takes incoming web requests and does routing and load balancing.
Can autoscale clusters independently based on load or seasonality
35 different clusters, each covering a domain. One of these is still our monolith, still co-existing alongside all of the newer microservices we create.
Run several NGINX nodes for capacity and fault tolerance.
Amazon’s Elastic Load Balancer in front
In triplicate, one in each of three amazon AZs
NGINX for both load balancing and smart routing
It looks at the requested path (/speedtest) and needs to figure out where to send it, because only a few servers specific to that application can field the route.
Routes coded into service itself
Easy for devs to add new routes, it’s coded right into their app
Isolated mongo, admin page doesn’t reach into speedtest mongodb. Contract.
Describe diagram
Mitigate the pain that’s introduced into the cross-domain development workflows.
For us, important to make this easy for developers, so they don’t have to re-invent service discovery, serialization, and load balancing.
On the Speedtest side, publish an interface with service methods.
Automatically build a Nuget package that contains the interfaces and types - lightweight contract package
If our admin service wants to make this call, they import the client package
Use it as a Type passed to a ServiceLocator that we’ve written.
ServiceLocator intercepts the call
uses attributes on the interface to help locate the service with its internal route table built from Eureka
inject an HTTP call and make it over to speedtest
deserializes the result back into the DTO
Looks RPC-like, but the interceptor does JSON over HTTP.
Lets us solve a lot of problems for the caller: Retries, Load Balancing, Health Checks; patterns like Circuit Breaker
Abstracted away the complexity and lets teams get to work on the important stuff: solving problems for our users and not solving problems specific to the architecture they’re building on.
Transition Microservices have been pretty helpful for us in terms of scalability - I mentioned earlier how we can scale services independently, which is really convenient.
However, when it comes to scalability, in our experience, microservices have been much more beneficial for scaling our organization and teams, and not as much about scaling the application itself..
Not downplaying other adv. of microservices. In terms of scalability, app scalability (# users, amount of data) is a solvable problem in most all archs. SO as example. Code optimization, hardware, tuning.
670MM pageviews / month on a small, powerful setup. 9 webservers, a few different code bases
9 webservers, 1/1 HAproxy, 2/2 SQL,
http://stackexchange.com/performance
Microservices let us add more teams or restructure the teams we have, and allows our architecture flow with that restructuring
Inspired by Spotify. Organized into tribes; 4 primary tribes, about 50 people average per.
Tribes are a large business unit. Have a tribe focused on media and fan-facing content. Another focused on Coaching Tools for all sports.
Tribe is composed of squads, cross-cutting teams with dev/QA/PM/design. CT tribe has Football, Basketball, Volleyball
We re-organize fairly frequently. New business opportunities, or shifting business focus. Solve different problems or build new products.
In practice, because re-org squads frequently, services don’t really line up 1:1. Temporal ownership.
Squads tend to own their services while they’re devving and releasing on them. Inevitable that we shift squads.
Tribes own ops duty and alerting. Each has an on-call rotation they manage.
Responsible for making sure they’re staying up to date with new library versions
Organizational restructuring loosely-coupled relationship between squads and services,
and is also one of the primary reasons that new microservices are introduced
A few other reasons that new services get created.
What causes introduction of new services?
Structural/Direction:
Reorganization (basketball -> split)
Often implies new product development by existing squad (conversion -> getpaid [new signup])
Shifting project focus on a squad (platform -> users)
Adding/replacing new functionality to an existing service (recruit + recruitsearch)
Reactionary, often because of service getting too large:
Deploy queue
Build times
Not wanting to work in the monolith (10k files, 2MM lines)
Targeted migration; still have monolith that handles a good number of domains; if we feel like that’s a risk as our product changes, we’ll migrate code/data out.
Great example that combines several of those reasons, both reorganization and reactionary,
can be seen in the way we’ve built our basketball product over the last couple years.
Deploys/week, basketball. Introduce video, reports, library, record.
That service grew quite large. Jokinly a “minilith” or “microlith”.
If we had known at the start that we’d have split off several services, would we have started? I don’t think we woudl have.
Architecting multiple services up front wouldn’t have let us prove or disprove that product as quickly as we were able to.
Letting it grow larger let the team leverage faster cross-domain development
Basketball, not “micro” for sure, and that’s okay with us.
Loose - independent and isolated
Service - communicate by contract
Bounded - understood, intentionally scoped domain
We don’t prescribe a max size for services, and have a range of differently-sized services.
Speedtest / Users / Recruit
Mega services, still an intentional scope or domain.
“Monolith” gets a bad rap, and the word “micro” doesn’t need to be the emphasis when talking microservices;
services can grow large and still adhere to these principles.
That lets leverage the benefits of microservices while getting some of the development speed strengths of the monolith when it comes to MVPing, experimentation, and cross-domain development.
Parity
Differences between the way our prod and test/dev environments are set up. Pulsar + local NGINX, co-locate apps on test servers to save cost.
A lot of maintenance and operational overhead in test, and bringing closer parity with production will be part of our next architectural iteration.
Currently planning out the next evolution:
.NET Core
Containers
Cross-Platform - devs with macs, parallels
.NET Core should be a game-changer for us. Simplify deployment and let us run apps on Linux, which will be cheaper and let us run them more easily in containers.
Conclusion
To wrap up, what’s helped us the most has been having a microservices platform that’s flexible enough to follow our organizational structure, without getting too caught up on the “micro” prefix. It enables a fast development lifecycle and has helped us effectively scale our team from 50 to 200 product team, and should sets us up to grow our team even more moving forward.