Giles Sirett, Chairman CSEUG, PMC member, Apache CloudStack shared in-depth insight about the new features and functionalities in CloudStack 4.15. He also provided info on when 4.16 is expected, presented the new VP of Apache CloudStack, latest integrations of CloudStack, improvements in the UI, new OS supported, advanced capabilities of vSphere, OVF support, dynamic roles enhancements and more. Find out more for Giles Sirett: https://www.shapeblue.com/shapeblue-leadership-team/ ------------------------------------------ CloudStack European User Group Virtual happened on May 27th. The first CSEUG Virtual proved to be a huge success. It collected people from 23 countries – Germany, the United Kingdom, Switzerland, India, Bulgaria, Greece, Poland, Serbia, Brazil, Chile, Russia, USA, Canada, Japan, France, Uruguay, Korea … We also had a record number of registrations and attendees for a CloudStack User Group Event. The physical distance was not a stopper for our speakers, who joined the event from 6 different countries. ------------------------------------------ About CloudStack: https://cloudstack.apache.org/

1. Title
Subtitle
SPONSORED BY:

2. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
About Me
• PMC member & Committer -
Apache CloudStack
• Chair –CloudStack European
user group
• CEO - ShapeBlue
Giles.Sirett@shapeblue.com
Giles@Apache.org
@GilesSirett

3. #CSEUGvirtual
@Cloudstack
• Collaborative environment for:
• all things Apache CloudStack
• Related tech: ecosystem products, hypervisors, storage, etc
• Technical deep-dives, issues & best practice
• Case studies & user stories
• To showcase complementary technologies
• To share ideas & problems with other users
• Meet Quarterly.
The aims of the CloudStack
EUG

4. #CSEUGvirtual
@Cloudstack
13:00 – 13:40 - Welcome + What’s New in CloudStack 4.15 - Giles Sirett
13:50 – 14:20 - Customising the New CloudStack UI - Abhishek Kumar
14:30 – 15:00 - KVM High Availability regardless of storage - Gabriel
Brascher
15:10 – 15:40 - From metal to service 100% automation with Apache
CloudStack and Ansible - Rafael del Valle
15:50 – 16:20 - CloudStack and Tungsten Fabric SDN Integration Update -
Rado Todirica and Simon Weller
16:30 – 17:00 – Building lean CloudStack environments for the Edge,
Rudraksh Kulshreshtha
17:00 – 18:00 – Virtual Beers and Talks
ALL TIMES IN CEST
Todays Agenda - CEST

5. #CSEUGvirtual
@Cloudstack
Virtual Pub 17:00-18:00 CEST
http://bit.ly/CSEUGvirtual

6. #CSEUGvirtual
@Cloudstack
For questions:
• Use zoom group chat. Or
• Use Zoom Question function
To win one of 5 x EUR 500
Amazon Gift cards:
• Tweet something about this event
• include Hashtag
• Best 5 tweets win
• Ivet will decide the winners
Questions, Chat and Prizes

7. #CSEUGvirtual
@Cloudstack
Thanks to today’s sponsors
Thanks to Our Sponsors

8. #CSEUGvirtual
@Cloudstack
• CloudStack European User Group
• CloudStack User Group Germany
• Geneva CloudStack User Group
• CloudStack - Romania
• Australian CloudStack User Group
• CloudStack Brazil User Group
• Vancouver CloudStack Meetup
• Japan CloudStack User Group
• CloudStack India Bangalore Chapter
• CloudStack India Hyderabad Chapter
• CloudStack Pune Meetup
• CloudStack SF Bay Area Users Group
• CloudStack NYC User Group
• CloudStack Boston User Group
• CloudStack DC and NoVA User Group
This group is one of many…

9. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
CloudStack Collaboration
Conferences
http://Cloudstackcollab.org

10. #CSEUGvirtual
@Cloudstack
Cloudstack Collaboration
Conference-2021
• Q3 2021
• Will be an online event
• Format currently being
discussed

11. #CSEUGvirtual
@Cloudstack
Development
community
EUUG
User
Group
User
Group
User
Group
User
Group
User
Group
Cloudstack
collaboration
conference

12. #CSEUGvirtual
@Cloudstack
CloudStack News
Since we last met …..

13. #CSEUGvirtual
@Cloudstack
• 4.14 released May 2020
• 4.15 released Jan 2021
• 4.15.1 – RC about to be cut
• 4.16 expected Q3/4 2021
Releases

14. #CSEUGvirtual
@Cloudstack
Community Activity

15. #CSEUGvirtual
@Cloudstack
Community Activity

16. #CSEUGvirtual
@Cloudstack
GSoC projects
Bikram Biswasi Multiple SSH key
holding on CloudStack
Sang Woo Bae synchronization of
network devices on
newly added hosts for
Persistent Networks
Apurv Gupta UX Enhancements
Junxuan Wu cloning a VM

17. #CSEUGvirtual
@Cloudstack
• Gabriel Bräscher is the
new VP CloudStack
• Thanks to Sven Vogel
for his work
• “Meet the Community”
video
https://www.youtube.com/watch?v=Q7trWbxZNmo
New VP Apache CloudStack

18. #CSEUGvirtual
@Cloudstack
Current Term/Word New
Term/Word
master main or leader
slave worker or
member
whitelist allowlist
blacklist denylist
he/she, him/her they/them/we
/us or gender-
neutral
Inclusivity Work

19. #CSEUGvirtual
@Cloudstack
• Demand for
Terraform/ Cloudstack
integration
• Provider in process of
being migrated into
CloudStack project
Terraform Provider

20. #CSEUGvirtual
@Cloudstack
New Storage Integrations
Coming

21. #CSEUGvirtual
@Cloudstack
What’s new in
CloudStack 4.15

22. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
4.15 Release Information
• 13 new features
• 59 enhancements
• 128 bug fixes
• 4.15 is an LTS release
• Released 19 January 2021
• EOL Feb 2023

23. #CSEUGvirtual
@Cloudstack
New UI at GA

24. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
New UI at GA
• New UI now at General Availability
• Complete feature parity with old
UI
• 4.15 still ships with old UI
• But, no new (4.15) functionality

25. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Old UI Deprecation
• CloudStack 4.15 is the last version to ship
with old UI
• Old UI does not contain 4.15 functionality
• Ships with formal deprecation notice
• Old UI code will be removed at 4.16 release
• “Project Primate” codename being dropped

26. #CSEUGvirtual
@Cloudstack
New OS Support

27. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
New Added O.S. Support
O.S. Management
Server
Hypervisor Hosts
Centos 8   (KVM)
Ubuntu 20.4   (KVM)
XCP-ng 8.1 n/a 

28. #CSEUGvirtual
@Cloudstack
Secondary Storage
Management

29. #CSEUGvirtual
@Cloudstack
 Balance data among data stores (secondary storage pools)
 Complete migration of data
 Set a secondary storage unit to ‘read-only’
 Allocation algorithm to automatically balance secondary
storage pools –image.store.allocation.algorithm
firstfitleastconsumed (was random)
 view download progress of templates across datastores
Secondary Storage
Management

30. #CSEUGvirtual
@Cloudstack
Migrate secondarystoragedata srcpool=<src_sec_stg>
destpools=<array of dest stgs>
migrationtype=<balance/complete>
Complete migration
Checks to see if destination
is below threshold of 90%
Balanced migration
Evenly distributes objects between given data
stores
Global setting: image.store.imbalance.threshold –
sets the ideal mean standarddeviation of the
image stores. Default =0.3, defines “balanced”
Linked Snapshots kept together
Migrating Pools

31. #CSEUGvirtual
@Cloudstack
 secstorage.max.migrate.sessions – indicates the number of concurrent file transfer operations
that can take place on an SSVM (defaults to 2)
“max.data.migration.wait.time” (which defaults to 15 minutes), i.e., if a migrate job has been
taking place for more than 15 mins then, a new SSVM is spawned and when it becomes active, then
jobs begin to be scheduled on it.
 max.ssvm.count – maximum number of additional SSVMs that can be spawned up to handle
the load. (defaults to 5). However, if the number of hosts is lesser than the max count set, then
the count of the number of hosts takes precedence
Performance and
Scalability Controls

32. #CSEUGvirtual
@Cloudstack
Setting stores to read only
update imagestore
id=<uuid_of_imagestore>
readonly=<true/false>
• Secondary storage allocation
algorithm improvements
“image.store.allocation.algorithm” =
firstfitleastconsumed or random
Read Only Secondary
Storage

33. #CSEUGvirtual
@Cloudstack
vSphere Advanced
Capabilities

34. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Vsphere Advanced
Capabilities
 Datastores support
o vSAN
o VMFS6
o vVols
o Datastore clusters
 vSphere storage policies support
 Allow inter cluster VM and volume migrations
o Running VMs are now able to migrate along with disks using API
migrateVirtualMachineWithVolume

35. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
How it does it?
CloudStack VM/Volume actions use the high-level native APIs of vSphere (instead of
low-level operations)
 create volume
 attach volume
 create snapshot from volume
 create template from volume
 clone VM

36. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
New Datastore Types
• Use of native APIs gives support for
additional types of vCenter
datastore: VMFS6, vSAN and vVols
• Protocol remains “presetup” when
using the new non-NFS primary
storage types.
• CloudStack’s presentation of
Datastore clusters abstracts the
underlying datastores – in the same
way as vCenter

37. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
vSphere Storage Policy
Support
• New APIs importVsphereStoragePolicies and
listVsphereStoragePolicies are introduced to
manage vSphere storage policies
• Storage Policies are fetched and updated a new
vSphere datacenter is added or on demand
• Existing APIs “createDiskOffering” and
“createServiceOffering” are modified to bind the
“storagepolicy” to the offerings
• On deploying VM, vCenter returns datastores
matching the policy, which CloudStack uses a filter
before applying its own algorithms

38. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Inter-cluster VM and
Volume Migrations
• Running VMs can be live migrated with all of their volumes to another
other cluster. Without the need for zone-wide storage.
• Stopped VMs migrated with all of their volumes to another other cluster.
Without the need for zone-wide storage, and with passing through
secondary storage.
• Inter-cluster migrations continues to Use the existing
migrateVirtualMachineWithVolume API, giving a seamless upgrade in
capability.

39. #CSEUGvirtual
@Cloudstack
Full OVF Support

40. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Full OVF Support
• Allows easy deployment of vendor appliances based on OVA
containing:
• Disc image(s)
• Initial configuration parameters for the virtual appliance
• Licensing / EULA acceptance
• VMware only feature
• Import an OVA with custom properties, as if the VM had
been deployed directly through vCenter

41. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
vSphere Template
Registration
• ‘deploy-as-is’ option added to ‘RegisterTemplate’ API
• Cloudstack reads & stores custom properties from the
OVF descriptor before completing registration
• Properties are stored as JSON in the
'template_deploy_as_is_details’ table:
• configurations
• network requirements & interfaces
• properties
• end-user license agreements
• The user is no longer required to specify the guest OS
type, root disk controller, etc; Which they may not know
or if wrong, may ‘break’ the deployed VM. The OVF is
the canonical ‘source of truth’

42. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Changes to Deploy VM
Wizard
• VM deployment wizard identifies when a “deploy-as-is” template is
selected.
• The required inputs (and sections) from the OVF descriptor are
displayed in the UI wizard
• For example; Hardware configurations mapped to compute offerings

43. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Changes to Deploy VM
Wizard
Where defined,
networking information is
pre- populated from the
OVF
And vNIC positions in the
VM are maintained

44. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Changes to Deploy VM
Wizard
(Single VM) vApp custom
properties presentation:

45. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Changes to Deploy VM
Wizard
License Agreement /
EULA presentation

46. #CSEUGvirtual
@Cloudstack
Dynamic Roles
Enhancements

47. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Dynamic Roles
Improvements
• Import/export roles
CSV format
• Create a new role from an
existing role
• Additional default Roles
•Read Only Admin
•Read Only User
•Support Admin
•Support User

48. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
New Default Roles
• Read-Only Admin : an admin role in which an account is only allowed to perform any
list/get/find APIs but not perform any other operation or changes to the
infrastructure, configuration or user resources.
• Read-Only User: a user role in which an account is only allowed to perform
list/get/find APIs who may only be interested in monitoring and usage for instance.
• Admin-Support: an admin role in which an admin account is limited to perform day-
to-day tasks, such as creating offerings, but cannot change physical networks,
add/remove hosts (but can put them in maintenance).
• User-Support: a user role in which an account cannot create or destroy resources
(any create*, delete* etc. APIs are disallowed) but can view resources and perform
operations such as to start/stop VMs and attach/detach volumes,ISOs etc.

49. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Users and Dynamic Roles in
Projects
• Users & accounts can now be added into projects
• Users can be in multiple projects, and have different
roles in each project
• Projects can be created by any user with permissions to
do so
• Project owners can now create new
project-specific roles
• As before, each role defines the APIs available to users
associated with that role
• Users & accounts can still be added by the project admin
or invited to join the project. The global setting to allow
the use of invitations only, still applies.
• Projects now allow multiple users to be project admins.
Used in conjunction with dynamic roles, a group of users
who can only administer the project but not its
resources, can be created

50. #CSEUGvirtual
@Cloudstack
Redfish Support

51. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Redfish Support
• Used in
• Cloudstack Out of band management
• KVM host HA
• IPMI is not being further developed by
Dell, HP, etc
• Redfish standard from DMTF seen as goto
modern replacement
• Restful, vendor agonistic, API
• supported by - Dell, HP, Lenovo,
Supermicro, IBM, etc
• New Redfish OOBM driver for CloudStack

52. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Redfish Support
Redfish
Driver

53. #CSEUGvirtual
@Cloudstack
Boot into Hardware
Setup

54. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Boot Into Hardware Setup
• Forces VM to boot into UEFI/BIOS setup
• Overcomes “console race”

55. #CSEUGvirtual
@Cloudstack
Human Readable Logs

56. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Human Readable Logs

57. #CSEUGvirtual
@Cloudstack
Configure Root Disk
via Service Offering

58. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Specify Root Disk Size
• Optional pre-set/ enforced
root disc size on service
offering
• Admin only feature
• If set:
•Users cannot specify root
disk size on VM create
•Users cannot resize root
disk (would have to change
service offering)

59. #CSEUGvirtual
@Cloudstack
NoVNC console

60. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
NoVNC Console
• Old console architecture renders console images via API
calls
• has performance limitations
• noVNC is a widely used opensource javascript library
• https://github.com/novnc/noVNC
• uses WebSockets to connect to VM console

61. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
NoVNC Cnsole
• Global setting ‘novnc.console.default’
• Dramatic performance increase
• Greatly reduced lag
• No more “missing tiles”
• Supports any keyboard layout
configured in the VM
• Supports pasting into console
• Full screen mode

62. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Further Reading
• 4.15 Release Notes & documentation
http://docs.cloudstack.apache.org/en/latest/releasenotes/
• Check out “Feature First Look” articles on ShapeBlue.com
blog

63. C l i c k t o e d i t
#CSEUGvirtual
@Cloudstack
Questions
Giles.Sirett@shapeblue.com
Giles@Apache.org
@GilesSirett

64. Next Talk:
Customising the New CloudStack UI
SPONSORED BY:
Abhishek Kumar
ShapeBlue
SESSION STARTS AT:
13:50 CEST – 14:20 CEST
06:50 CDT 12:50 BST 13:50 CEST 17:20 IST
#CSEUGvirtual

65. Next Talk:
KVM High Availability regardless of storage
SPONSORED BY:
Gabriel Brascher
VP, Apache
CloudStack
SESSION STARTS AT:
14:30 CEST – 15:00 CEST
07:30 CDT 13:30 BST 14:30 CEST 18:00 IST
#CSEUGvirtual

66. Next Talk:
From Metal to Service 100% Automation
with Apache CloudStack and Ansible
SPONSORED BY:
Rafael del Valle
Celpax
SESSION STARTS AT:
15:10 CEST – 15:40 CEST
08:10 CDT 14:10 BST 15:10 CEST 18:40 IST
#CSEUGvirtual

67. Next Talk:
CloudStack and Tungsten Fabric SDN
Integration Update
SPONSORED BY:
SESSION STARTS AT:
15:50 CEST – 16:20 CEST
08:50 CDT 14:50 BST 15:50 CEST 19:20 IST
#CSEUGvirtual
Simon Weller
ENA
Radu Todirica
ENA

68. Next Talk:
Building lean CloudStack environments
for the Edge
SPONSORED BY:
Rudraksh
Kulshreshtha
Indiqus
SESSION STARTS AT:
16:30 CEST – 17:00 CEST
09:30 CDT 15:30 BST 16:30 CEST 20:00 IST
#CSEUGvirtual
@Cloudstack

69. #CSEUGvirtual
@Cloudstack
Simon Weller
ENA
Radu Todirica
ENA
Rudraksh
Kulshreshtha
IndiQus
Abhishek
Kumar
ShapeBlue
Gabriel
Brascher
VP, Apache
CloudStack
Rafael del
Valle
Celpax
Thanks to our speakers

70. #CSEUGvirtual
@Cloudstack
Thanks to today’s sponsors
Thanks to Our Sponsors

71. #CSEUGvirtual
@Cloudstack
Thanks to Ivet for organizing
Ivet Petrova
Event
organizing
superhero

72. #CSEUGvirtual
@Cloudstack
Virtual Pub 17:00-18:00 CEST
http://bit.ly/CSEUGvirtual

73. #CSEUGvirtual
@CloudStack
http://bit.ly/CSEUGvirtual