SlideShare a Scribd company logo
1 of 62
Download to read offline
IOUG Presentation
1
With Flex Clusters and Flex ASM
Flex your Database (12c)
Maaz Anjum
• Marietta, Georgia
• Solutions Architect at BIAS Corporation
• EM12c
• Golden Gate
• Engineered Systems
• Member of IOUG, GOUG, RMOUG
RAC SIG, EM SIG,
BIG DATA SIG
• Using Oracle products since 2001
Blog: maazanjum.com
Email: maazanjum@gmail.com
Twitter: @maaz_anjum
About Me
2
!
• Flex Cluster
• Flex ASM
• Your Database on a Flex Architecture
• Conclusion
Agenda
3
Standard Cluster
4
• What is an Oracle Cluster today?
– Set of hosts that have direct access to
storage
– All (typically) run
• Grid Infrastructure
• ASM
• Listener(s)
• Database(s)
• What is a Flex Cluster?
• Is Oracle Grid Infrastructure installed in an Oracle Flex Cluster configuration
– Scalable
– Dynamic
– Robust network of node
• Offers a platform for a variety of applications including Real Application Clusters,
with large number of nodes
Flex Cluster
5
• All nodes in an Oracle Flex Cluster belong to a single Oracle Grid Infrastructure cluster.
!
• This architecture was designed to centralize
– Policy decisions for deployment of resources based on application needs
– Account for various service levels, loads, failure responses, and recovery
6
Flex Cluster
• Arranged in a Hub and Spoke Architecture
• The hub-and-spoke model is most
frequently compared to the point-to-point
transit model.
Flex Cluster
7
A
D
B
F
E
C
• For a network of n' nodes
• only n - 1 routes are necessary to connect
all nodes
• the upper bound is n - 1
• and the complexity is O(n).
A
D
B
F
E
C
• This compares favorably to the routes, or O(n2), that would be required to
connect each node to every other node in a point-to-point network.
!
• An airline example: in a system with 10 destinations, the spoke-hub system requires
only 9 routes to connect all destinations, while a true point-to-point system would
require 45 routes.
Flex Cluster
8
Point-to-Point
Hub-Spoke
• Contains two types of nodes
– Hub
• Hub Nodes are similar to Oracle Grid Infrastructure nodes in an Oracle
Clusterware standard Cluster configuration.
– Leaf
• Leaf Nodes are different from standard Oracle Grid Infrastructure nodes, in that
they do not require direct access to shared storage, but instead request data
through Hub Nodes.
Flex Cluster
9
Flex Cluster
10
• Will be the basis for more uses cases in future releases (for resource
management)
!
• If a Leaf-node has access to shared storage, it can perform a role change to a
HUB-node
!
• A Standard Cluster can be converted to a Flex Cluster at any time after the
installation
!
• Once a cluster is configured as a Flex Cluster this configuration is irreversible
without a re-configuration of the cluster.
Flex Cluster
11
• An Example Setup
Flex Cluster
12
Host: flex1
Role: Hub
Storage
Host: flex2
Role: Hub
• RACAttack.org/12c
• Setup
– Either configured during installation
Flex Cluster
13
• Setup
– Can be configured (converted) from crsctl
– First you need GNS Setup
!
#	
  cluvfy	
  stage	
  –pre	
  crsinst	
  –n	
  nodelist	
  
#	
  srvctl	
  add	
  gns	
  -­‐domain	
  domain_name	
  -­‐vip	
  vip_name	
  
#	
  srvctl	
  start	
  gns	
  
#	
  cluvfy	
  comp	
  gns	
  -­‐precrsinst	
  -­‐domain	
  domain	
  -­‐vip	
  gns_vip	
  
#	
  srvctl	
  modify	
  network	
  -­‐nettype	
  MIXED	
  
#	
  srvctl	
  update	
  scan_listener	
  
#	
  srvctl	
  update	
  listener	
  
#	
  srvctl	
  update	
  database	
  -­‐db	
  db_unique_name	
  
SQL>	
  alter	
  database	
  set	
  remote_listener=["scan_name:scan_port"];	
  
#	
  cluvfy	
  stage	
  -­‐post	
  crsinst	
  -­‐n	
  all	
  
#	
  srvctl	
  modify	
  network	
  -­‐nettype	
  DHCP	
  
#	
  srvctl	
  update	
  database	
  -­‐db	
  db_unique_name	
  
#	
  srvctl	
  update	
  scan_listener	
  
#	
  srvctl	
  update	
  listener	
  
#	
  srvctl	
  modify	
  scan	
  -­‐scanname	
  scan_name
Flex Cluster
14
– See RACAttack’s Lab on Flex Cluster and Flex ASM Conversion!
• Setup
– Can be configured (converted) from crsctl
– Flex ASM must be enabled	
  
!
[root@flex2	
  ~]#	
  crsctl	
  set	
  cluster	
  mode	
  flex	
  
Cluster	
  is	
  configured	
  for	
  ”flex"	
  mode	
  
!
[root@flex2	
  ~]#	
  crsctl	
  stop	
  crs	
  
!
[root@flex2	
  ~]#	
  crsctl	
  start	
  crs	
  -­‐wait	
  
!
[root@flex2	
  ~]#	
  crsctl	
  set	
  cluster	
  mode	
  flex	
  
Cluster	
  is	
  already	
  configured	
  in	
  "flex"	
  mode
15
Flex Cluster
• Node Roles
• Resources Prior to role change
16
oracle@flex2:~ (+ASM2) $ crsctl stat res -t -n flex2
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ACFS.SHARED.advm
ONLINE OFFLINE flex2 Unable to connect to
ASM,STABLE
ora.ACFS.dg
ONLINE OFFLINE flex2 STABLE
ora.ASMNET1LSNR_ASM.lsnr
ONLINE ONLINE flex2 STABLE
ora.DATA.dg
ONLINE OFFLINE flex2 STABLE
ora.FRA.dg
ONLINE OFFLINE flex2 STABLE
ora.LISTENER.lsnr
ONLINE ONLINE flex2 STABLE
ora.acfs.shared.acfs
ONLINE OFFLINE flex2 (2) volume /shared o
ffline,STABLE
ora.net1.network
ONLINE ONLINE flex2 STABLE
ora.ons
ONLINE ONLINE flex2 STABLE
ora.proxy_advm
ONLINE OFFLINE flex2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE flex2 STABLE
ora.asm
1 ONLINE INTERMEDIATE flex2 STABLE
ora.flex2.vip
1 ONLINE ONLINE flex2 STABLE
ora.house.db
1 ONLINE ONLINE flex2 Open,STABLE
ora.scan1.vip
1 ONLINE ONLINE flex2 STABLE
--------------------------------------------------------------------------------
Flex Cluster
• Node Roles
• Change Role
!
[root@flex2	
  ~]#	
  ./crsctl	
  get	
  node	
  role	
  config	
  
Node	
  'flex2'	
  configured	
  role	
  is	
  'hub’	
  
!
[root@flex2	
  ~]#	
  ./crsctl	
  set	
  node	
  role	
  leaf	
  
CRS-­‐4408:	
  Node	
  'flex2'	
  configured	
  role	
  successfully	
  changed;	
  restart	
  Oracle	
  High	
  Availability	
  Services	
  for	
  new	
  role	
  
to	
  take	
  effect.	
  
!
[root@flex2	
  ~]#	
  ./crsctl	
  stop	
  crs	
  
!
[root@flex2	
  ~]#	
  ./crsctl	
  start	
  crs	
  -­‐wait
17
Flex Cluster
• Node Roles
• Resources after role change
• Listener
Once the node is converted to a leaf node, it has a local listener.
ora.LISTENER_LEAF.lsnr	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  OFFLINE	
  OFFLINE	
  	
  	
  	
  	
  	
  flex2	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  STABLE	
  
• # of ASM Instances also reduces
ora.asm	
  
	
  	
  	
  	
  	
  	
  1	
  	
  	
  	
  	
  	
  	
  	
  ONLINE	
  	
  ONLINE	
  	
  	
  	
  	
  	
  	
  flex1	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  STABLE	
  
	
  	
  	
  	
  	
  	
  2	
  	
  	
  	
  	
  	
  	
  	
  ONLINE	
  	
  OFFLINE	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  STABLE	
  
	
  	
  	
  	
  	
  	
  3	
  	
  	
  	
  	
  	
  	
  	
  ONLINE	
  	
  OFFLINE	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  STABLE	
  
• VIP Fails over to available node
ora.flex2.vip	
  
	
  	
  	
  	
  	
  	
  1	
  	
  	
  	
  	
  	
  	
  	
  ONLINE	
  	
  INTERMEDIATE	
  flex1	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  FAILED	
  OVER,STABLE
18
Flex Cluster
• Bits and Pieces
– ASM Network
• By default, it will share the interconnect NIC
• Can be changed during install, or later
– Grid Naming Services (GNS)
• If you didn’t like it before, you’d better start liking it now.
• You can install GI in Standard Mode and reconfigure it with GNS prior to conversion to Flex
Mode.
– Optionally, prompted to install Cluster Health Monitor (CHM) Database
• -MGMTDB
– The Cluster Health Monitor (CHM) detects and analyzes operating system and cluster resource-related degradation
and failures.
– Initially allocates and uses approximately 4GB
19
Flex Cluster
• Cluster Health Monitor (CHM)
– Consists of three services
• System Monitor Service (osysmond)
• Cluster Logger Service (OLOGGERD)
• GI Management Repository (MGMTDB)
– Another Database resource?
– Stores Real-Time Operating System Metrics collected by CHM
– It will only run on a single node in the cluster
– Communicates with other Services via the Private Network
– Data files are on the same disk group as the OCR and Voting files.
– Cluster Troubleshooting
• OCLUMON
– Query the CHM repository to display node-specific metrics for a specified time period
• Leverage CHM to produce reports
[root@flex1	
  tmp]#	
  /u01/app/12.1.0.1/grid/bin/diagcollection.pl	
  –collect	
  
[root@flex1	
  tmp]#	
  /u01/app/12.1.0.1/grid/bin/oclumon	
  dumpnodeview	
  -­‐n	
  flex1	
  flex2	
  last	
  "12:00:00”	
  
• Manage
[root@flex1	
  tmp]#	
  oclumon	
  manage	
  -­‐get	
  alllogger	
  -­‐details	
  
Logger	
  =	
  flex1	
  
Nodes	
  =	
  flex1,flex2
20
Flex Cluster
• Adding a new node is no different than with previous releases
– Specify the kernel parameters
– Configure block devices for Oracle Clusterware devices
– Ensure that you have set the block device permissions correctly
– Use short, nondomain-qualified names for all of the names in the /etc/hosts file
– Test whether the interconnect interfaces are reachable using the ping command
– Verify that the VIP addresses are not active at the start of the cloning process by using the ping
command
– Run CVU to verify your hardware and operating system environment
Flex Cluster
21
• Consider Oracle’s strive towards consolidation
!
• Experienced technology sprawl from acquisitions
!
• Attempting to enable ease of resource management
!
• Flex Clusters encompass not only databases, but applications as well
Flex Cluster
22
!
• Flex Cluster
• Flex ASM
• Your Database on a Flex Architecture
• Conclusion
Agenda
23
• The Next generation Automatic Storage Management (ASM) has a new name.
!
• Traditionally, we know ASM as another type of instance in a RAC/Single Instance
configuration.
!
• One ASM instance per node in a cluster
Flex ASM
24
• Flex ASM is
• Your ASM configured to run on fewer nodes in a cluster
• Allows for seamless client connection failover
25
Flex ASM
• Network
• Public Network
• Private Network
• Storage FC/ISCI
• ASM Network
26
Flex ASM
• With Oracle Flex ASM you can
– Consolidate all the storage requirements into a single set of disk groups.
!
– All these disk groups are mounted by and managed by a small set of Oracle ASM instances running
in a single cluster.
!
– You can specify the number of Oracle ASM instances with a cardinality setting. The default is three
instances.
!
– When using Oracle Flex ASM, you can configure Oracle ASM clients with direct access to storage or
the I/Os can be sent through a pool of I/O servers.
27
Flex ASM
• Configurations
• Oracle Flex ASM enables Oracle ASM instances to run on a separate physical server
from the database servers.
• An Oracle ASM instance can operate in several configurations in Oracle Flex ASM
Flex ASM
28
• Configurations
1. Local Oracle ASM clients with direct access to Oracle ASM disks
2. Oracle Flex ASM clients with direct access to Oracle ASM disks
3. Oracle ACFS access through the Oracle ASM proxy instance
• An Oracle ASM proxy instance is an Oracle instance running on a Hub node with a direct Oracle ASM client. Oracle
Automatic Storage Management Cluster File System (Oracle ACFS) and Oracle ASM Dynamic Volume Manager (Oracle
ADVM) are supported with an Oracle ASM proxy instance.
• Names start with +APX[1-9]
• Runs with limited processes
29
Flex ASM
30
Flex ASM
• Setup
– During the installation process with Oracle Universal Installer (OUI), you can choose the
type of the Oracle Clusterware that should be installed. The Oracle Clusterware can be an
Oracle Flex ASM deployment that manages its own storage or a regular Oracle ASM
cluster.
Flex ASM
31
• Setup
– If you choose to install an Oracle Flex Cluster, Oracle Flex ASM is enabled by default because
an Oracle Flex Cluster requires Oracle Flex ASM.
– Check current mode
[oracle@flex2	
  ~]$	
  asmcmd	
  showclustermode	
  
ASM	
  cluster	
  :	
  Flex	
  mode	
  enabled
32
Flex ASM
• To install an Oracle Flex ASM deployment, note the following:
– Categorize the networks and choose the list of networks for use as Oracle ASM
Networks.
!
!
!
!
!
!
!
!
!
!
33
Flex ASM
• Convert to Flex ASM
– Invoke ASMCA
34
Flex ASM
• Convert to Flex ASM
– Invoke asmcmd
asmca	
  -­‐silent	
  
	
  	
  	
  	
  	
  -­‐convertToFlexASM	
  
	
  	
  	
  	
  	
  	
  	
  -­‐asmNetworks	
  eth1,	
  interface_name/10.10.10.0	
  
	
  	
  	
  	
  	
  	
  	
  -­‐asmListenerPort	
  1521
35
Flex ASM
• Connectivity
• Connections from a database instance to an ASM instance are based on SQLnet
using listeners.
– The listener directs the connection to the least loaded ASM instance based on the load metric it maintains.
– The connection details are fetched from CSS global data
– The ASM instance to which the database instance connects to is listed in the database alert log:
• NOTE: ASMBconnectedtoASMinstance +ASM1 (Flex mode; client id 0x10004)
– The userid and password supplied are also managed automatically. They are supplied while establishing
the session, not while connecting.
Flex ASM
36
• Administration
– ASM Proxy Instance
[oracle@flex2	
  asmca]$	
  oifcfg	
  getif	
  
eth0	
  	
  192.168.78.0	
  	
  global	
  	
  public	
  
eth1	
  	
  172.16.100.0	
  	
  global	
  	
  cluster_interconnect,asm	
  
– ASM Listener
[oracle@flex1	
  asmca]$	
  srvctl	
  config	
  asm	
  
ASM	
  home:	
  /u01/app/12.1.0.1/grid	
  
Password	
  file:	
  +DATA/orapwASM	
  
ASM	
  listener:	
  LISTENER	
  
ASM	
  instance	
  count:	
  3	
  
Cluster	
  ASM	
  listener:	
  ASMNET1LSNR_ASM
– Check Configuration
[oracle@flex2	
  ~]$	
  srvctl	
  status	
  asm	
  -­‐detail	
  
	
   ASM	
  is	
  running	
  on	
  flex2,flex1	
  
	
   ASM	
  is	
  enabled.	
  
	
   [oracle@flex2	
  ~]$	
  srvctl	
  config	
  asm	
  
	
   ASM	
  instance	
  count:	
  3	
  
– Modify ASM Cardinality
[oracle@flex2	
  ~]$	
  srvctl	
  modify	
  asm	
  -­‐count	
  4	
  
	
   [oracle@flex2	
  ~]$	
  srvctl	
  modify	
  asm	
  -­‐count	
  ALL
37
Flex ASM
• Administration
– Client Connections
[oracle@flex2	
  ~]$	
  asmcmd	
  lsct	
  data	
  
DB_Name	
  	
  Status	
  	
  	
  	
  	
  Software_Version	
  	
  Compatible_version	
  	
  Instance_Name	
  	
  Disk_Group	
  
+ASM	
  	
  	
  	
  	
  CONNECTED	
  	
  	
  	
  	
  	
  	
  	
  12.1.0.1.0	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  12.1.0.1.0	
  	
  +ASM2	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  DATA	
  	
  	
  	
  	
  	
  	
  
_mgmtdb	
  	
  CONNECTED	
  	
  	
  	
  	
  	
  	
  	
  12.1.0.1.0	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  12.1.0.0.0	
  	
  -­‐MGMTDB	
  	
  	
  	
  	
  	
  	
  	
  DATA	
  	
  	
  	
  	
  	
  	
  
steel	
  	
  	
  	
  CONNECTED	
  	
  	
  	
  	
  	
  	
  	
  12.1.0.1.0	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  12.1.0.0.0	
  	
  steel_1	
  	
  	
  	
  	
  	
  	
  	
  DATA	
  	
  
– Relocate Clients: Clients are automatically relocated to another instance if an Oracle ASM instance fails. If
necessary, clients can be manually relocated using the ALTER SYSTEM RELOCATE CLIENT command. For
example:
SQL>	
  ALTER	
  SYSTEM	
  RELOCATE	
  CLIENT	
  'client-­‐id';
38
Flex ASM
SQL>	
  @clients	
  
!
INSTANCE_NAME	
   DB_NAME	
  	
  	
  	
  	
  STATUS	
  
-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐	
  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐	
  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐	
  
+ASM1	
   	
   +ASM	
   	
  	
  CONNECTED	
  
sport	
   	
   sport	
   	
  	
  CONNECTED	
  
+APX1	
   	
   +APX	
   	
  	
  CONNECTED	
  
+APX2	
   	
   +APX	
   	
  	
  CONNECTED	
  
-­‐MGMTDB	
  	
   	
   _mgmtdb	
  	
  	
  	
  	
  CONNECTED	
  
!
SQL>	
  alter	
  system	
  relocate	
  client	
  'sport:sport';	
  
!
System	
  altered.	
  
!
SQL>	
  @clients	
  
!
INSTANCE_NAME	
   DB_NAME	
  	
  	
  	
  	
  STATUS	
  
-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐	
  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐	
  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐	
  
+ASM1	
   	
   +ASM	
   	
  	
  CONNECTED	
  
+APX1	
   	
   +APX	
   	
  	
  CONNECTED	
  
+APX2	
   	
   +APX	
   	
  	
  CONNECTED	
  
-­‐MGMTDB	
  	
   	
   _mgmtdb	
  	
  	
  	
  	
  	
  	
  CONNECTED
39
Flex ASM
• Should the ASM instance die, it will be restarted automatically
SQL>	
  shutdown	
  abort	
  
ASM	
  instance	
  shutdown	
  
SQL>	
  startup	
  
ORA-­‐10997:	
  another	
  startup/shutdown	
  operation	
  of	
  this	
  instance	
  inprogress	
  
ORA-­‐09968:	
  unable	
  to	
  lock	
  file	
  
Linux-­‐x86_64	
  Error:	
  11:	
  Resource	
  temporarily	
  unavailable	
  
Additional	
  information:	
  23943	
  
SQL>	
  exit	
  
Disconnected	
  from	
  Oracle	
  Database	
  12c	
  Enterprise	
  Edition	
  Release	
  12.1.0.1.0	
  -­‐	
  64bit	
  Production	
  
With	
  the	
  Real	
  Application	
  Clusters	
  and	
  Automatic	
  Storage	
  Management	
  options	
  
[oracle@flex1	
  ~]$	
  sqlplus	
  /	
  as	
  sysasm	
  
!
SQL*Plus:	
  Release	
  12.1.0.1.0	
  Production	
  on	
  Tue	
  Feb	
  4	
  16:04:17	
  2014	
  
!
Copyright	
  (c)	
  1982,	
  2013,	
  Oracle.	
  	
  All	
  rights	
  reserved.	
  
!
Connected	
  to:	
  
Oracle	
  Database	
  12c	
  Enterprise	
  Edition	
  Release	
  12.1.0.1.0	
  -­‐	
  64bit	
  Production	
  
With	
  the	
  Real	
  Application	
  Clusters	
  and	
  Automatic	
  Storage	
  Management	
  options	
  
!
SQL>	
  
40
Flex ASM
• Flex ASM in Action
– If an ASM instance crashes, it will be automatically restarted if ASM COUNT is set to ALL
– If an ASM instance crashes, and ASM COUNT is not set to ALL, it will be restarted on the first available hub node
41
Flex ASM
42
Flex ASM
• ASM Restart
– Since ASM is a clusterware resource, it’s configured to restart automatically (if killed)
[oracle@flex2	
  asmca]$	
  crsctl	
  stat	
  res	
  ora.asm	
  -­‐v
NAME=ora.asm	
  
TYPE=ora.asm.type	
  
LAST_SERVER=flex1
STATE=ONLINE	
  on	
  flex1
TARGET=ONLINE
CARDINALITY_ID=1
CREATION_SEED=79
RESTART_COUNT=0
FAILURE_COUNT=0
FAILURE_HISTORY=
ID=ora.asm	
  1	
  1
INCARNATION=0
LAST_RESTART=NEVER
LAST_STATE_CHANGE=NEVER
STATE_DETAILS=
INTERNAL_STATE=STABLE
INSTANCE_COUNT=3
LAST_SERVER=
STATE=OFFLINE
TARGET=ONLINE
CARDINALITY_ID=2
CREATION_SEED=79
RESTART_COUNT=0
FAILURE_COUNT=0
FAILURE_HISTORY=
ID=ora.asm	
  2	
  1
INCARNATION=0
LAST_RESTART=NEVER
LAST_STATE_CHANGE=NEVER
STATE_DETAILS=
INTERNAL_STATE=STABLE
INSTANCE_COUNT=3
LAST_SERVER=flex2
STATE=ONLINE	
  on	
  flex2
TARGET=ONLINE
CARDINALITY_ID=3
CREATION_SEED=79
RESTART_COUNT=0
FAILURE_COUNT=0
FAILURE_HISTORY=
ID=ora.asm	
  3	
  1
INCARNATION=1
LAST_RESTART=NEVER
LAST_STATE_CHANGE=02/07/2014	
  11:56:33
STATE_DETAILS=
INTERNAL_STATE=STABLE
INSTANCE_COUNT=3
43
Flex ASM
• ASM Restart
– Post Restart
[oracle@flex2	
  asmca]$	
  crsctl	
  stat	
  res	
  ora.asm	
  -­‐v
NAME=ora.asm	
  
TYPE=ora.asm.type	
  
LAST_SERVER=flex1
STATE=ONLINE	
  on	
  flex1
TARGET=ONLINE
CARDINALITY_ID=1
CREATION_SEED=79
RESTART_COUNT=0
FAILURE_COUNT=0
FAILURE_HISTORY=
ID=ora.asm	
  1	
  1
INCARNATION=0
LAST_RESTART=NEVER
LAST_STATE_CHANGE=NEVER
STATE_DETAILS=
INTERNAL_STATE=STABLE
INSTANCE_COUNT=3
LAST_SERVER=
STATE=OFFLINE
TARGET=ONLINE
CARDINALITY_ID=2
CREATION_SEED=79
RESTART_COUNT=0
FAILURE_COUNT=0
FAILURE_HISTORY=
ID=ora.asm	
  2	
  1
INCARNATION=0
LAST_RESTART=NEVER
LAST_STATE_CHANGE=NEVER
STATE_DETAILS=
INTERNAL_STATE=STABLE
INSTANCE_COUNT=3
LAST_SERVER=flex2
STATE=ONLINE	
  on	
  flex2
TARGET=ONLINE
CARDINALITY_ID=3
CREATION_SEED=79
RESTART_COUNT=1	
  
FAILURE_COUNT=0
FAILURE_HISTORY=
ID=ora.asm	
  3	
  1
INCARNATION=1
LAST_RESTART=NEVER
LAST_STATE_CHANGE=02/07/2014	
  11:56:33
STATE_DETAILS=
INTERNAL_STATE=STABLE
INSTANCE_COUNT=3
44
Flex ASM
• Proxy ASM Instance
!
– The INSTANCE_TYPE initialization parameter has an additional value ASMPROXY, in addition to ASM and
RDBMS, to identify Oracle ASM proxy instances. An Oracle ASM proxy instance has its parameter set to
ASMPROXY.
!
– An Oracle ASM proxy instance is an Oracle instance running on a Hub node with a direct Oracle ASM client.
Oracle Automatic Storage Management Cluster File System (Oracle ACFS) and Oracle ASM Dynamic Volume
Manager (Oracle ADVM) are supported with an Oracle ASM proxy instance.
45
Flex ASM
• Instance startup alert.log shows connection to local ASM1 Instance
Thu	
  Feb	
  06	
  11:13:29	
  2014	
  
NOTE:	
  ASMB	
  registering	
  with	
  ASM	
  instance	
  as	
  client	
  0xffffffffffffffff	
  (reg:822507052)	
  
NOTE:	
  ASMB	
  connected	
  to	
  ASM	
  instance	
  +ASM1	
  (Flex	
  mode;	
  client	
  id	
  0x10001)	
  
• Instance startup alert.log shows connection to local ASM2 Instance since ASM1 is
down
Thu	
  Feb	
  06	
  20:18:53	
  2014	
  
NOTE:	
  ASMB	
  registering	
  with	
  ASM	
  instance	
  as	
  client	
  0xffffffffffffffff	
  (reg:2675147253)	
  
NOTE:	
  ASMB	
  connected	
  to	
  ASM	
  instance	
  +ASM2	
  (Flex	
  mode;	
  client	
  id	
  0x10004)
46
Flex ASM
• Instance startup alert.log shows connection to local ASM1 Instance
Thu	
  Feb	
  06	
  11:13:29	
  2014	
  
NOTE:	
  ASMB	
  registering	
  with	
  ASM	
  instance	
  as	
  client	
  0xffffffffffffffff	
  (reg:822507052)	
  
NOTE:	
  ASMB	
  connected	
  to	
  ASM	
  instance	
  +ASM1	
  (Flex	
  mode;	
  client	
  id	
  0x10001)	
  
• Instance startup alert.log shows connection to local ASM2 Instance since ASM1 is
down
Thu	
  Feb	
  06	
  20:18:53	
  2014	
  
NOTE:	
  ASMB	
  registering	
  with	
  ASM	
  instance	
  as	
  client	
  0xffffffffffffffff	
  (reg:2675147253)	
  
NOTE:	
  ASMB	
  connected	
  to	
  ASM	
  instance	
  +ASM2	
  (Flex	
  mode;	
  client	
  id	
  0x10004)	
  
• In the ASM2 alert.log, we can see the connection establishing
Thu	
  Feb	
  06	
  20:18:53	
  2014	
  
NOTE:	
  Flex	
  client	
  id	
  0x0	
  [sport:sport]	
  attempting	
  to	
  connect	
  
NOTE:	
  registered	
  owner	
  id	
  0x10004	
  for	
  sport:sport	
  
NOTE:	
  Flex	
  client	
  sport:sport	
  registered,	
  osid	
  15584,	
  mbr	
  0x0	
  (reg:2675147253)	
  
Thu	
  Feb	
  06	
  20:18:59	
  2014	
  
Reconfiguration	
  started	
  (old	
  inc	
  6,	
  new	
  inc	
  8)	
  
List	
  of	
  instances:	
  
	
  1	
  2	
  (myinst:	
  2)	
  	
  
	
  Global	
  Resource	
  Directory	
  frozen	
  
	
  Communication	
  channels	
  reestablished
47
Flex ASM
• New Parameters for Flexing ASM?
– Nope
– The only parameters to consider for review are when performing an upgrade
– Parameter Documentation located here
+ASM1.__oracle_base='/u01/app/oracle'#ORACLE_BASE	
  set	
  from	
  in	
  memory	
  value
+ASM2.__oracle_base='/u01/app/oracle'#ORACLE_BASE	
  set	
  from	
  in	
  memory	
  value
*.asm_diskstring='/dev/asm*'
*.asm_power_limit=1
*.large_pool_size=12M
*.remote_login_passwordfile='EXCLUSIVE'
48
Flex ASM
• Monitoring
– My personal favorite tool is Enterprise Manager
– Allows for monitoring as well as administration of Flex ASM
49
Flex ASM
• Monitoring
– View Flex ASM Components
50
Flex ASM
• Monitoring
– View Flex ASM Topology (slick!!)
51
Flex ASM
!
• Flex Cluster
• Flex ASM
• Your Database on a Flex Architecture
• Conclusion
Agenda
52
• The database is oblivious to the chaotic symphony underneath the
covers
– Clients are automatically relocated if an ASM Instance goes down
– Adding a new node to a cluster (which currently exists as a standalone) and
migration to ASM is easier
– Even though with previous releases, there is very little over-head of ASM
• Fewer resources on a Hub nodes without ASM to manage
– The database is not the super-star in the cluster!
Flex your Database
Flex
53
• Test Scenario #1
– Database“sport”is connected to“+ASM1”
– Database“sport”is running a transaction – a silly little loop to insert some rows
– Kill“+ASM1”SMON process
– “sport”database’s connection will be terminated and relocated to the first available ASM instance
• In some cases, you might receive an ORA-03114 or ORA-03113 error message
• In my testing, the fail-over was seamless
NOTE:	
  ASMB	
  registering	
  with	
  ASM	
  instance	
  as	
  client	
  0x10002	
  (reg:3110852683)	
  
NOTE:	
  ASMB	
  connected	
  to	
  ASM	
  instance	
  +ASM2	
  (Flex	
  mode;	
  client	
  id	
  0x10002)	
  
NOTE:	
  ASMB	
  rebuilding	
  ASM	
  server	
  state	
  
NOTE:	
  ASMB	
  rebuilt	
  1	
  (of	
  1)	
  groups	
  
NOTE:	
  ASMB	
  rebuilt	
  9	
  (of	
  9)	
  allocated	
  files	
  
NOTE:	
  fetching	
  new	
  locked	
  extents	
  from	
  server	
  
NOTE:	
  0	
  locks	
  established;	
  0	
  pending	
  writes	
  sent	
  to	
  server	
  
SUCCESS:	
  ASMB	
  reconnected	
  &	
  completed	
  ASM	
  server	
  state	
  
– No lost rows observed
– This fail-over feature doesn’t necessarily replace RAC Services
54
Flex your Database
flex1 flex2
+ASM1 +ASM2
sport
+APX1
55
Flex your Database
• Test Scenario #2
– Database Instance“sport”running on hub node“flex1”
– “flex1”is converted to a“leaf”node
– Upon“sport”startup, we receive an error
SQL>	
  startup	
  
ORA-­‐01078:	
  failure	
  in	
  processing	
  system	
  parameters	
  
ORA-­‐01565:	
  error	
  in	
  identifying	
  file	
  '+DATA/sport/spfilesport.ora'	
  
ORA-­‐17503:	
  ksfdopn:2	
  Failed	
  to	
  open	
  file	
  +DATA/sport/spfilesport.ora	
  
ORA-­‐12514:	
  TNS:listener	
  does	
  not	
  currently	
  know	
  of	
  service	
  requested	
  in	
  connect	
  descriptor	
  
ORA-­‐15077:	
  could	
  not	
  locate	
  ASM	
  instance	
  serving	
  a	
  required	
  diskgroup	
  
– Ah, but there is no local“+ASM1”instance anymore
– If“sport”originally had no dependency on“+ASM1”it would startup successfully
56
Flex your Database
• Node Maintenance
– Since ASM Clients can be relocated
– Database Instances may not need to be shut down
• Database Migrations from Non-ASM to ASM?
Use-Cases
Flex
57
!
• Flex Cluster
• Flex ASM
• Your Database on a Flex Architecture
• Conclusion
58
Agenda
• First phase of Flex Clusters is targeted for
– Better consolidation of resources
• Future phases of Flex Clusters are aimed to tackle resource management
– Next project would involve configuring a Hub-Leaf configuration with middle tier
• Maybe Enterprise Manager 12c?
• Flex ASM allows for
– Detached Storage Management
– Automatic ASM Instance Restarts
– ASM Proxy Instances allow for remote connections to Storage from Remote Databases
• Databases Running on Flex ASM are just as happy!
Conclusion
59
• Oracle Docs on Flex Cluster and Flex ASM
• Flex ASM Whitepaper
• RACAttack: 12c Setup Guide
• Martin Bach’s Blog
– Flex ASM in Action
• Ask Mcleans post on Flex Clusters
• Bertrand Drouvot’s Blog – Flex ASM Gotchas
– Findings 1 & 2
• My Noggin!
Mentionable References
60
Questions
61
Blog: maazanjum.com
Email: maaz.anjum@biascorp.com
Twitter: @maaz_anjum
62
Reminder: Complete evaluation
Session: #104
Title: DB12c Flex Your Database with Flex ASM and Flex Clusters

More Related Content

What's hot

Oracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAsOracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAsZohar Elkayam
 
Troubleshooting Tips and Tricks for Database 19c - EMEA Tour Oct 2019
Troubleshooting Tips and Tricks for Database 19c - EMEA Tour  Oct 2019Troubleshooting Tips and Tricks for Database 19c - EMEA Tour  Oct 2019
Troubleshooting Tips and Tricks for Database 19c - EMEA Tour Oct 2019Sandesh Rao
 
Smart monitoring how does oracle rac manage resource, state ukoug19
Smart monitoring how does oracle rac manage resource, state ukoug19Smart monitoring how does oracle rac manage resource, state ukoug19
Smart monitoring how does oracle rac manage resource, state ukoug19Anil Nair
 
AIOUG : OTNYathra - Troubleshooting and Diagnosing Oracle Database 12.2 and O...
AIOUG : OTNYathra - Troubleshooting and Diagnosing Oracle Database 12.2 and O...AIOUG : OTNYathra - Troubleshooting and Diagnosing Oracle Database 12.2 and O...
AIOUG : OTNYathra - Troubleshooting and Diagnosing Oracle Database 12.2 and O...Sandesh Rao
 
Understanding oracle rac internals part 1 - slides
Understanding oracle rac internals   part 1 - slidesUnderstanding oracle rac internals   part 1 - slides
Understanding oracle rac internals part 1 - slidesMohamed Farouk
 
Less05 asm instance
Less05 asm instanceLess05 asm instance
Less05 asm instanceAmit Bhalla
 
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]Markus Michalewicz
 
Oracle 10g Performance: chapter 02 aas
Oracle 10g Performance: chapter 02 aasOracle 10g Performance: chapter 02 aas
Oracle 10g Performance: chapter 02 aasKyle Hailey
 
Chasing the optimizer
Chasing the optimizerChasing the optimizer
Chasing the optimizerMauro Pagano
 
Flink Forward Berlin 2017: Aris Kyriakos Koliopoulos - Drivetribe's Kappa Arc...
Flink Forward Berlin 2017: Aris Kyriakos Koliopoulos - Drivetribe's Kappa Arc...Flink Forward Berlin 2017: Aris Kyriakos Koliopoulos - Drivetribe's Kappa Arc...
Flink Forward Berlin 2017: Aris Kyriakos Koliopoulos - Drivetribe's Kappa Arc...Flink Forward
 
The Top 5 Reasons to Deploy Your Applications on Oracle RAC
The Top 5 Reasons to Deploy Your Applications on Oracle RACThe Top 5 Reasons to Deploy Your Applications on Oracle RAC
The Top 5 Reasons to Deploy Your Applications on Oracle RACMarkus Michalewicz
 
RAC - The Savior of DBA
RAC - The Savior of DBARAC - The Savior of DBA
RAC - The Savior of DBANikhil Kumar
 
Awr + 12c performance tuning
Awr + 12c performance tuningAwr + 12c performance tuning
Awr + 12c performance tuningAiougVizagChapter
 
Apache Spark in Depth: Core Concepts, Architecture & Internals
Apache Spark in Depth: Core Concepts, Architecture & InternalsApache Spark in Depth: Core Concepts, Architecture & Internals
Apache Spark in Depth: Core Concepts, Architecture & InternalsAnton Kirillov
 
A deep dive about VIP,HAIP, and SCAN
A deep dive about VIP,HAIP, and SCAN A deep dive about VIP,HAIP, and SCAN
A deep dive about VIP,HAIP, and SCAN Riyaj Shamsudeen
 
Oracle statistics by example
Oracle statistics by exampleOracle statistics by example
Oracle statistics by exampleMauro Pagano
 
Part1 of SQL Tuning Workshop - Understanding the Optimizer
Part1 of SQL Tuning Workshop - Understanding the OptimizerPart1 of SQL Tuning Workshop - Understanding the Optimizer
Part1 of SQL Tuning Workshop - Understanding the OptimizerMaria Colgan
 
Deep review of LMS process
Deep review of LMS processDeep review of LMS process
Deep review of LMS processRiyaj Shamsudeen
 
Oracle Performance Tuning Fundamentals
Oracle Performance Tuning FundamentalsOracle Performance Tuning Fundamentals
Oracle Performance Tuning FundamentalsEnkitec
 

What's hot (20)

AWR and ASH Deep Dive
AWR and ASH Deep DiveAWR and ASH Deep Dive
AWR and ASH Deep Dive
 
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAsOracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAs
 
Troubleshooting Tips and Tricks for Database 19c - EMEA Tour Oct 2019
Troubleshooting Tips and Tricks for Database 19c - EMEA Tour  Oct 2019Troubleshooting Tips and Tricks for Database 19c - EMEA Tour  Oct 2019
Troubleshooting Tips and Tricks for Database 19c - EMEA Tour Oct 2019
 
Smart monitoring how does oracle rac manage resource, state ukoug19
Smart monitoring how does oracle rac manage resource, state ukoug19Smart monitoring how does oracle rac manage resource, state ukoug19
Smart monitoring how does oracle rac manage resource, state ukoug19
 
AIOUG : OTNYathra - Troubleshooting and Diagnosing Oracle Database 12.2 and O...
AIOUG : OTNYathra - Troubleshooting and Diagnosing Oracle Database 12.2 and O...AIOUG : OTNYathra - Troubleshooting and Diagnosing Oracle Database 12.2 and O...
AIOUG : OTNYathra - Troubleshooting and Diagnosing Oracle Database 12.2 and O...
 
Understanding oracle rac internals part 1 - slides
Understanding oracle rac internals   part 1 - slidesUnderstanding oracle rac internals   part 1 - slides
Understanding oracle rac internals part 1 - slides
 
Less05 asm instance
Less05 asm instanceLess05 asm instance
Less05 asm instance
 
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]
 
Oracle 10g Performance: chapter 02 aas
Oracle 10g Performance: chapter 02 aasOracle 10g Performance: chapter 02 aas
Oracle 10g Performance: chapter 02 aas
 
Chasing the optimizer
Chasing the optimizerChasing the optimizer
Chasing the optimizer
 
Flink Forward Berlin 2017: Aris Kyriakos Koliopoulos - Drivetribe's Kappa Arc...
Flink Forward Berlin 2017: Aris Kyriakos Koliopoulos - Drivetribe's Kappa Arc...Flink Forward Berlin 2017: Aris Kyriakos Koliopoulos - Drivetribe's Kappa Arc...
Flink Forward Berlin 2017: Aris Kyriakos Koliopoulos - Drivetribe's Kappa Arc...
 
The Top 5 Reasons to Deploy Your Applications on Oracle RAC
The Top 5 Reasons to Deploy Your Applications on Oracle RACThe Top 5 Reasons to Deploy Your Applications on Oracle RAC
The Top 5 Reasons to Deploy Your Applications on Oracle RAC
 
RAC - The Savior of DBA
RAC - The Savior of DBARAC - The Savior of DBA
RAC - The Savior of DBA
 
Awr + 12c performance tuning
Awr + 12c performance tuningAwr + 12c performance tuning
Awr + 12c performance tuning
 
Apache Spark in Depth: Core Concepts, Architecture & Internals
Apache Spark in Depth: Core Concepts, Architecture & InternalsApache Spark in Depth: Core Concepts, Architecture & Internals
Apache Spark in Depth: Core Concepts, Architecture & Internals
 
A deep dive about VIP,HAIP, and SCAN
A deep dive about VIP,HAIP, and SCAN A deep dive about VIP,HAIP, and SCAN
A deep dive about VIP,HAIP, and SCAN
 
Oracle statistics by example
Oracle statistics by exampleOracle statistics by example
Oracle statistics by example
 
Part1 of SQL Tuning Workshop - Understanding the Optimizer
Part1 of SQL Tuning Workshop - Understanding the OptimizerPart1 of SQL Tuning Workshop - Understanding the Optimizer
Part1 of SQL Tuning Workshop - Understanding the Optimizer
 
Deep review of LMS process
Deep review of LMS processDeep review of LMS process
Deep review of LMS process
 
Oracle Performance Tuning Fundamentals
Oracle Performance Tuning FundamentalsOracle Performance Tuning Fundamentals
Oracle Performance Tuning Fundamentals
 

Viewers also liked

Leidos Capabilities Lite Brochure
Leidos Capabilities Lite BrochureLeidos Capabilities Lite Brochure
Leidos Capabilities Lite BrochureScott Conte
 
Cyber Security: Differences between Industrial Control Systems and ICT Approach
Cyber Security: Differences between Industrial Control Systems and ICT ApproachCyber Security: Differences between Industrial Control Systems and ICT Approach
Cyber Security: Differences between Industrial Control Systems and ICT ApproachCommunity Protection Forum
 
ICS Cybersecurity: How to Protect the Proprietary Cyber Assets That Hackers C...
ICS Cybersecurity: How to Protect the Proprietary Cyber Assets That Hackers C...ICS Cybersecurity: How to Protect the Proprietary Cyber Assets That Hackers C...
ICS Cybersecurity: How to Protect the Proprietary Cyber Assets That Hackers C...EnergySec
 
Cisco Internet of Things
Cisco Internet of ThingsCisco Internet of Things
Cisco Internet of ThingsPanduit
 
Tripwire IP360 Vulnerability Management Scanning Best Practices
Tripwire IP360 Vulnerability Management Scanning Best PracticesTripwire IP360 Vulnerability Management Scanning Best Practices
Tripwire IP360 Vulnerability Management Scanning Best PracticesTripwire
 
MASTERS OF THE UNIVERSE
MASTERS OF THE UNIVERSEMASTERS OF THE UNIVERSE
MASTERS OF THE UNIVERSEHealthegy
 

Viewers also liked (6)

Leidos Capabilities Lite Brochure
Leidos Capabilities Lite BrochureLeidos Capabilities Lite Brochure
Leidos Capabilities Lite Brochure
 
Cyber Security: Differences between Industrial Control Systems and ICT Approach
Cyber Security: Differences between Industrial Control Systems and ICT ApproachCyber Security: Differences between Industrial Control Systems and ICT Approach
Cyber Security: Differences between Industrial Control Systems and ICT Approach
 
ICS Cybersecurity: How to Protect the Proprietary Cyber Assets That Hackers C...
ICS Cybersecurity: How to Protect the Proprietary Cyber Assets That Hackers C...ICS Cybersecurity: How to Protect the Proprietary Cyber Assets That Hackers C...
ICS Cybersecurity: How to Protect the Proprietary Cyber Assets That Hackers C...
 
Cisco Internet of Things
Cisco Internet of ThingsCisco Internet of Things
Cisco Internet of Things
 
Tripwire IP360 Vulnerability Management Scanning Best Practices
Tripwire IP360 Vulnerability Management Scanning Best PracticesTripwire IP360 Vulnerability Management Scanning Best Practices
Tripwire IP360 Vulnerability Management Scanning Best Practices
 
MASTERS OF THE UNIVERSE
MASTERS OF THE UNIVERSEMASTERS OF THE UNIVERSE
MASTERS OF THE UNIVERSE
 

Similar to Flex Your Database on 12c's Flex ASM and Flex Cluster

SAOUG - Connect 2014 - Flex Cluster and Flex ASM
SAOUG - Connect 2014 - Flex Cluster and Flex ASMSAOUG - Connect 2014 - Flex Cluster and Flex ASM
SAOUG - Connect 2014 - Flex Cluster and Flex ASMAlex Zaballa
 
Training Slides: Basics 104: Simple Tungsten Clustering Deployments
Training Slides: Basics 104: Simple Tungsten Clustering DeploymentsTraining Slides: Basics 104: Simple Tungsten Clustering Deployments
Training Slides: Basics 104: Simple Tungsten Clustering DeploymentsContinuent
 
D108636GC10_les01.pptx
D108636GC10_les01.pptxD108636GC10_les01.pptx
D108636GC10_les01.pptxSuresh569521
 
My First 100 days with an Exadata (PPT)
My First 100 days with an Exadata (PPT)My First 100 days with an Exadata (PPT)
My First 100 days with an Exadata (PPT)Gustavo Rene Antunez
 
PCA_Admin_Presentation-1.pptx
PCA_Admin_Presentation-1.pptxPCA_Admin_Presentation-1.pptx
PCA_Admin_Presentation-1.pptxssuser21ded1
 
Understand oracle real application cluster
Understand oracle real application clusterUnderstand oracle real application cluster
Understand oracle real application clusterSatishbabu Gunukula
 
Training Slides: Advanced 301: Multi-Site/Multi-Master Tungsten Clustering De...
Training Slides: Advanced 301: Multi-Site/Multi-Master Tungsten Clustering De...Training Slides: Advanced 301: Multi-Site/Multi-Master Tungsten Clustering De...
Training Slides: Advanced 301: Multi-Site/Multi-Master Tungsten Clustering De...Continuent
 
Training Slides: Basics 102: Introduction to Tungsten Clustering
Training Slides: Basics 102: Introduction to Tungsten ClusteringTraining Slides: Basics 102: Introduction to Tungsten Clustering
Training Slides: Basics 102: Introduction to Tungsten ClusteringContinuent
 
Racsig rac internals
Racsig rac internalsRacsig rac internals
Racsig rac internalspv_narayanan
 
[발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community)
[발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community) [발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community)
[발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community) 동현 김
 
Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...
Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...
Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...Continuent
 
Migrating to XtraDB Cluster
Migrating to XtraDB ClusterMigrating to XtraDB Cluster
Migrating to XtraDB Clusterpercona2013
 
Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...
Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...
Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...Continuent
 
Training Slides: Advanced 302: Performing Schema Changes in a Multi-Site/Mult...
Training Slides: Advanced 302: Performing Schema Changes in a Multi-Site/Mult...Training Slides: Advanced 302: Performing Schema Changes in a Multi-Site/Mult...
Training Slides: Advanced 302: Performing Schema Changes in a Multi-Site/Mult...Continuent
 
SUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-Device
SUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-DeviceSUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-Device
SUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-DeviceSUSE
 
Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extra...
Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extra...Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extra...
Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extra...Continuent
 

Similar to Flex Your Database on 12c's Flex ASM and Flex Cluster (20)

SAOUG - Connect 2014 - Flex Cluster and Flex ASM
SAOUG - Connect 2014 - Flex Cluster and Flex ASMSAOUG - Connect 2014 - Flex Cluster and Flex ASM
SAOUG - Connect 2014 - Flex Cluster and Flex ASM
 
Training Slides: Basics 104: Simple Tungsten Clustering Deployments
Training Slides: Basics 104: Simple Tungsten Clustering DeploymentsTraining Slides: Basics 104: Simple Tungsten Clustering Deployments
Training Slides: Basics 104: Simple Tungsten Clustering Deployments
 
D108636GC10_les01.pptx
D108636GC10_les01.pptxD108636GC10_les01.pptx
D108636GC10_les01.pptx
 
My First 100 days with an Exadata (PPT)
My First 100 days with an Exadata (PPT)My First 100 days with an Exadata (PPT)
My First 100 days with an Exadata (PPT)
 
final_rac
final_racfinal_rac
final_rac
 
PCA_Admin_Presentation-1.pptx
PCA_Admin_Presentation-1.pptxPCA_Admin_Presentation-1.pptx
PCA_Admin_Presentation-1.pptx
 
Understand oracle real application cluster
Understand oracle real application clusterUnderstand oracle real application cluster
Understand oracle real application cluster
 
Training Slides: Advanced 301: Multi-Site/Multi-Master Tungsten Clustering De...
Training Slides: Advanced 301: Multi-Site/Multi-Master Tungsten Clustering De...Training Slides: Advanced 301: Multi-Site/Multi-Master Tungsten Clustering De...
Training Slides: Advanced 301: Multi-Site/Multi-Master Tungsten Clustering De...
 
GDPS and System Complex
GDPS and System ComplexGDPS and System Complex
GDPS and System Complex
 
Training Slides: Basics 102: Introduction to Tungsten Clustering
Training Slides: Basics 102: Introduction to Tungsten ClusteringTraining Slides: Basics 102: Introduction to Tungsten Clustering
Training Slides: Basics 102: Introduction to Tungsten Clustering
 
Racsig rac internals
Racsig rac internalsRacsig rac internals
Racsig rac internals
 
[발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community)
[발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community) [발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community)
[발표자료] 오픈소스 Pacemaker 활용한 zabbix 이중화 방안(w/ Zabbix Korea Community)
 
Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...
Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...
Training Slides: Intermediate 202: Performing Cluster Maintenance with Zero-D...
 
Migrating to XtraDB Cluster
Migrating to XtraDB ClusterMigrating to XtraDB Cluster
Migrating to XtraDB Cluster
 
Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...
Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...
Training Slides: Advanced 304: Upgrading From Native MySQL Replication To Tun...
 
Training Slides: Advanced 302: Performing Schema Changes in a Multi-Site/Mult...
Training Slides: Advanced 302: Performing Schema Changes in a Multi-Site/Mult...Training Slides: Advanced 302: Performing Schema Changes in a Multi-Site/Mult...
Training Slides: Advanced 302: Performing Schema Changes in a Multi-Site/Mult...
 
SUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-Device
SUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-DeviceSUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-Device
SUSE Expert Days Paris 2018 - SUSE HA Cluster Multi-Device
 
Os
OsOs
Os
 
Embedded system - embedded system programming
Embedded system - embedded system programmingEmbedded system - embedded system programming
Embedded system - embedded system programming
 
Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extra...
Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extra...Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extra...
Training Slides: Basics 107: Simple Tungsten Replicator Installation to Extra...
 

Recently uploaded

Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 

Recently uploaded (20)

Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 

Flex Your Database on 12c's Flex ASM and Flex Cluster

  • 1. IOUG Presentation 1 With Flex Clusters and Flex ASM Flex your Database (12c)
  • 2. Maaz Anjum • Marietta, Georgia • Solutions Architect at BIAS Corporation • EM12c • Golden Gate • Engineered Systems • Member of IOUG, GOUG, RMOUG RAC SIG, EM SIG, BIG DATA SIG • Using Oracle products since 2001 Blog: maazanjum.com Email: maazanjum@gmail.com Twitter: @maaz_anjum About Me 2
  • 3. ! • Flex Cluster • Flex ASM • Your Database on a Flex Architecture • Conclusion Agenda 3
  • 4. Standard Cluster 4 • What is an Oracle Cluster today? – Set of hosts that have direct access to storage – All (typically) run • Grid Infrastructure • ASM • Listener(s) • Database(s)
  • 5. • What is a Flex Cluster? • Is Oracle Grid Infrastructure installed in an Oracle Flex Cluster configuration – Scalable – Dynamic – Robust network of node • Offers a platform for a variety of applications including Real Application Clusters, with large number of nodes Flex Cluster 5
  • 6. • All nodes in an Oracle Flex Cluster belong to a single Oracle Grid Infrastructure cluster. ! • This architecture was designed to centralize – Policy decisions for deployment of resources based on application needs – Account for various service levels, loads, failure responses, and recovery 6 Flex Cluster
  • 7. • Arranged in a Hub and Spoke Architecture • The hub-and-spoke model is most frequently compared to the point-to-point transit model. Flex Cluster 7 A D B F E C • For a network of n' nodes • only n - 1 routes are necessary to connect all nodes • the upper bound is n - 1 • and the complexity is O(n). A D B F E C
  • 8. • This compares favorably to the routes, or O(n2), that would be required to connect each node to every other node in a point-to-point network. ! • An airline example: in a system with 10 destinations, the spoke-hub system requires only 9 routes to connect all destinations, while a true point-to-point system would require 45 routes. Flex Cluster 8 Point-to-Point Hub-Spoke
  • 9. • Contains two types of nodes – Hub • Hub Nodes are similar to Oracle Grid Infrastructure nodes in an Oracle Clusterware standard Cluster configuration. – Leaf • Leaf Nodes are different from standard Oracle Grid Infrastructure nodes, in that they do not require direct access to shared storage, but instead request data through Hub Nodes. Flex Cluster 9
  • 11. • Will be the basis for more uses cases in future releases (for resource management) ! • If a Leaf-node has access to shared storage, it can perform a role change to a HUB-node ! • A Standard Cluster can be converted to a Flex Cluster at any time after the installation ! • Once a cluster is configured as a Flex Cluster this configuration is irreversible without a re-configuration of the cluster. Flex Cluster 11
  • 12. • An Example Setup Flex Cluster 12 Host: flex1 Role: Hub Storage Host: flex2 Role: Hub • RACAttack.org/12c
  • 13. • Setup – Either configured during installation Flex Cluster 13
  • 14. • Setup – Can be configured (converted) from crsctl – First you need GNS Setup ! #  cluvfy  stage  –pre  crsinst  –n  nodelist   #  srvctl  add  gns  -­‐domain  domain_name  -­‐vip  vip_name   #  srvctl  start  gns   #  cluvfy  comp  gns  -­‐precrsinst  -­‐domain  domain  -­‐vip  gns_vip   #  srvctl  modify  network  -­‐nettype  MIXED   #  srvctl  update  scan_listener   #  srvctl  update  listener   #  srvctl  update  database  -­‐db  db_unique_name   SQL>  alter  database  set  remote_listener=["scan_name:scan_port"];   #  cluvfy  stage  -­‐post  crsinst  -­‐n  all   #  srvctl  modify  network  -­‐nettype  DHCP   #  srvctl  update  database  -­‐db  db_unique_name   #  srvctl  update  scan_listener   #  srvctl  update  listener   #  srvctl  modify  scan  -­‐scanname  scan_name Flex Cluster 14 – See RACAttack’s Lab on Flex Cluster and Flex ASM Conversion!
  • 15. • Setup – Can be configured (converted) from crsctl – Flex ASM must be enabled   ! [root@flex2  ~]#  crsctl  set  cluster  mode  flex   Cluster  is  configured  for  ”flex"  mode   ! [root@flex2  ~]#  crsctl  stop  crs   ! [root@flex2  ~]#  crsctl  start  crs  -­‐wait   ! [root@flex2  ~]#  crsctl  set  cluster  mode  flex   Cluster  is  already  configured  in  "flex"  mode 15 Flex Cluster
  • 16. • Node Roles • Resources Prior to role change 16 oracle@flex2:~ (+ASM2) $ crsctl stat res -t -n flex2 -------------------------------------------------------------------------------- Name Target State Server State details -------------------------------------------------------------------------------- Local Resources -------------------------------------------------------------------------------- ora.ACFS.SHARED.advm ONLINE OFFLINE flex2 Unable to connect to ASM,STABLE ora.ACFS.dg ONLINE OFFLINE flex2 STABLE ora.ASMNET1LSNR_ASM.lsnr ONLINE ONLINE flex2 STABLE ora.DATA.dg ONLINE OFFLINE flex2 STABLE ora.FRA.dg ONLINE OFFLINE flex2 STABLE ora.LISTENER.lsnr ONLINE ONLINE flex2 STABLE ora.acfs.shared.acfs ONLINE OFFLINE flex2 (2) volume /shared o ffline,STABLE ora.net1.network ONLINE ONLINE flex2 STABLE ora.ons ONLINE ONLINE flex2 STABLE ora.proxy_advm ONLINE OFFLINE flex2 STABLE -------------------------------------------------------------------------------- Cluster Resources -------------------------------------------------------------------------------- ora.LISTENER_SCAN1.lsnr 1 ONLINE ONLINE flex2 STABLE ora.asm 1 ONLINE INTERMEDIATE flex2 STABLE ora.flex2.vip 1 ONLINE ONLINE flex2 STABLE ora.house.db 1 ONLINE ONLINE flex2 Open,STABLE ora.scan1.vip 1 ONLINE ONLINE flex2 STABLE -------------------------------------------------------------------------------- Flex Cluster
  • 17. • Node Roles • Change Role ! [root@flex2  ~]#  ./crsctl  get  node  role  config   Node  'flex2'  configured  role  is  'hub’   ! [root@flex2  ~]#  ./crsctl  set  node  role  leaf   CRS-­‐4408:  Node  'flex2'  configured  role  successfully  changed;  restart  Oracle  High  Availability  Services  for  new  role   to  take  effect.   ! [root@flex2  ~]#  ./crsctl  stop  crs   ! [root@flex2  ~]#  ./crsctl  start  crs  -­‐wait 17 Flex Cluster
  • 18. • Node Roles • Resources after role change • Listener Once the node is converted to a leaf node, it has a local listener. ora.LISTENER_LEAF.lsnr                                OFFLINE  OFFLINE            flex2                                        STABLE   • # of ASM Instances also reduces ora.asm              1                ONLINE    ONLINE              flex1                                        STABLE              2                ONLINE    OFFLINE                                                              STABLE              3                ONLINE    OFFLINE                                                              STABLE   • VIP Fails over to available node ora.flex2.vip              1                ONLINE    INTERMEDIATE  flex1                                        FAILED  OVER,STABLE 18 Flex Cluster
  • 19. • Bits and Pieces – ASM Network • By default, it will share the interconnect NIC • Can be changed during install, or later – Grid Naming Services (GNS) • If you didn’t like it before, you’d better start liking it now. • You can install GI in Standard Mode and reconfigure it with GNS prior to conversion to Flex Mode. – Optionally, prompted to install Cluster Health Monitor (CHM) Database • -MGMTDB – The Cluster Health Monitor (CHM) detects and analyzes operating system and cluster resource-related degradation and failures. – Initially allocates and uses approximately 4GB 19 Flex Cluster
  • 20. • Cluster Health Monitor (CHM) – Consists of three services • System Monitor Service (osysmond) • Cluster Logger Service (OLOGGERD) • GI Management Repository (MGMTDB) – Another Database resource? – Stores Real-Time Operating System Metrics collected by CHM – It will only run on a single node in the cluster – Communicates with other Services via the Private Network – Data files are on the same disk group as the OCR and Voting files. – Cluster Troubleshooting • OCLUMON – Query the CHM repository to display node-specific metrics for a specified time period • Leverage CHM to produce reports [root@flex1  tmp]#  /u01/app/12.1.0.1/grid/bin/diagcollection.pl  –collect   [root@flex1  tmp]#  /u01/app/12.1.0.1/grid/bin/oclumon  dumpnodeview  -­‐n  flex1  flex2  last  "12:00:00”   • Manage [root@flex1  tmp]#  oclumon  manage  -­‐get  alllogger  -­‐details   Logger  =  flex1   Nodes  =  flex1,flex2 20 Flex Cluster
  • 21. • Adding a new node is no different than with previous releases – Specify the kernel parameters – Configure block devices for Oracle Clusterware devices – Ensure that you have set the block device permissions correctly – Use short, nondomain-qualified names for all of the names in the /etc/hosts file – Test whether the interconnect interfaces are reachable using the ping command – Verify that the VIP addresses are not active at the start of the cloning process by using the ping command – Run CVU to verify your hardware and operating system environment Flex Cluster 21
  • 22. • Consider Oracle’s strive towards consolidation ! • Experienced technology sprawl from acquisitions ! • Attempting to enable ease of resource management ! • Flex Clusters encompass not only databases, but applications as well Flex Cluster 22
  • 23. ! • Flex Cluster • Flex ASM • Your Database on a Flex Architecture • Conclusion Agenda 23
  • 24. • The Next generation Automatic Storage Management (ASM) has a new name. ! • Traditionally, we know ASM as another type of instance in a RAC/Single Instance configuration. ! • One ASM instance per node in a cluster Flex ASM 24
  • 25. • Flex ASM is • Your ASM configured to run on fewer nodes in a cluster • Allows for seamless client connection failover 25 Flex ASM
  • 26. • Network • Public Network • Private Network • Storage FC/ISCI • ASM Network 26 Flex ASM
  • 27. • With Oracle Flex ASM you can – Consolidate all the storage requirements into a single set of disk groups. ! – All these disk groups are mounted by and managed by a small set of Oracle ASM instances running in a single cluster. ! – You can specify the number of Oracle ASM instances with a cardinality setting. The default is three instances. ! – When using Oracle Flex ASM, you can configure Oracle ASM clients with direct access to storage or the I/Os can be sent through a pool of I/O servers. 27 Flex ASM
  • 28. • Configurations • Oracle Flex ASM enables Oracle ASM instances to run on a separate physical server from the database servers. • An Oracle ASM instance can operate in several configurations in Oracle Flex ASM Flex ASM 28
  • 29. • Configurations 1. Local Oracle ASM clients with direct access to Oracle ASM disks 2. Oracle Flex ASM clients with direct access to Oracle ASM disks 3. Oracle ACFS access through the Oracle ASM proxy instance • An Oracle ASM proxy instance is an Oracle instance running on a Hub node with a direct Oracle ASM client. Oracle Automatic Storage Management Cluster File System (Oracle ACFS) and Oracle ASM Dynamic Volume Manager (Oracle ADVM) are supported with an Oracle ASM proxy instance. • Names start with +APX[1-9] • Runs with limited processes 29 Flex ASM
  • 31. • Setup – During the installation process with Oracle Universal Installer (OUI), you can choose the type of the Oracle Clusterware that should be installed. The Oracle Clusterware can be an Oracle Flex ASM deployment that manages its own storage or a regular Oracle ASM cluster. Flex ASM 31
  • 32. • Setup – If you choose to install an Oracle Flex Cluster, Oracle Flex ASM is enabled by default because an Oracle Flex Cluster requires Oracle Flex ASM. – Check current mode [oracle@flex2  ~]$  asmcmd  showclustermode   ASM  cluster  :  Flex  mode  enabled 32 Flex ASM
  • 33. • To install an Oracle Flex ASM deployment, note the following: – Categorize the networks and choose the list of networks for use as Oracle ASM Networks. ! ! ! ! ! ! ! ! ! ! 33 Flex ASM
  • 34. • Convert to Flex ASM – Invoke ASMCA 34 Flex ASM
  • 35. • Convert to Flex ASM – Invoke asmcmd asmca  -­‐silent            -­‐convertToFlexASM                -­‐asmNetworks  eth1,  interface_name/10.10.10.0                -­‐asmListenerPort  1521 35 Flex ASM
  • 36. • Connectivity • Connections from a database instance to an ASM instance are based on SQLnet using listeners. – The listener directs the connection to the least loaded ASM instance based on the load metric it maintains. – The connection details are fetched from CSS global data – The ASM instance to which the database instance connects to is listed in the database alert log: • NOTE: ASMBconnectedtoASMinstance +ASM1 (Flex mode; client id 0x10004) – The userid and password supplied are also managed automatically. They are supplied while establishing the session, not while connecting. Flex ASM 36
  • 37. • Administration – ASM Proxy Instance [oracle@flex2  asmca]$  oifcfg  getif   eth0    192.168.78.0    global    public   eth1    172.16.100.0    global    cluster_interconnect,asm   – ASM Listener [oracle@flex1  asmca]$  srvctl  config  asm   ASM  home:  /u01/app/12.1.0.1/grid   Password  file:  +DATA/orapwASM   ASM  listener:  LISTENER   ASM  instance  count:  3   Cluster  ASM  listener:  ASMNET1LSNR_ASM – Check Configuration [oracle@flex2  ~]$  srvctl  status  asm  -­‐detail     ASM  is  running  on  flex2,flex1     ASM  is  enabled.     [oracle@flex2  ~]$  srvctl  config  asm     ASM  instance  count:  3   – Modify ASM Cardinality [oracle@flex2  ~]$  srvctl  modify  asm  -­‐count  4     [oracle@flex2  ~]$  srvctl  modify  asm  -­‐count  ALL 37 Flex ASM
  • 38. • Administration – Client Connections [oracle@flex2  ~]$  asmcmd  lsct  data   DB_Name    Status          Software_Version    Compatible_version    Instance_Name    Disk_Group   +ASM          CONNECTED                12.1.0.1.0                    12.1.0.1.0    +ASM2                    DATA               _mgmtdb    CONNECTED                12.1.0.1.0                    12.1.0.0.0    -­‐MGMTDB                DATA               steel        CONNECTED                12.1.0.1.0                    12.1.0.0.0    steel_1                DATA     – Relocate Clients: Clients are automatically relocated to another instance if an Oracle ASM instance fails. If necessary, clients can be manually relocated using the ALTER SYSTEM RELOCATE CLIENT command. For example: SQL>  ALTER  SYSTEM  RELOCATE  CLIENT  'client-­‐id'; 38 Flex ASM
  • 39. SQL>  @clients   ! INSTANCE_NAME   DB_NAME          STATUS   -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐   +ASM1     +ASM      CONNECTED   sport     sport      CONNECTED   +APX1     +APX      CONNECTED   +APX2     +APX      CONNECTED   -­‐MGMTDB       _mgmtdb          CONNECTED   ! SQL>  alter  system  relocate  client  'sport:sport';   ! System  altered.   ! SQL>  @clients   ! INSTANCE_NAME   DB_NAME          STATUS   -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐  -­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐   +ASM1     +ASM      CONNECTED   +APX1     +APX      CONNECTED   +APX2     +APX      CONNECTED   -­‐MGMTDB       _mgmtdb              CONNECTED 39 Flex ASM
  • 40. • Should the ASM instance die, it will be restarted automatically SQL>  shutdown  abort   ASM  instance  shutdown   SQL>  startup   ORA-­‐10997:  another  startup/shutdown  operation  of  this  instance  inprogress   ORA-­‐09968:  unable  to  lock  file   Linux-­‐x86_64  Error:  11:  Resource  temporarily  unavailable   Additional  information:  23943   SQL>  exit   Disconnected  from  Oracle  Database  12c  Enterprise  Edition  Release  12.1.0.1.0  -­‐  64bit  Production   With  the  Real  Application  Clusters  and  Automatic  Storage  Management  options   [oracle@flex1  ~]$  sqlplus  /  as  sysasm   ! SQL*Plus:  Release  12.1.0.1.0  Production  on  Tue  Feb  4  16:04:17  2014   ! Copyright  (c)  1982,  2013,  Oracle.    All  rights  reserved.   ! Connected  to:   Oracle  Database  12c  Enterprise  Edition  Release  12.1.0.1.0  -­‐  64bit  Production   With  the  Real  Application  Clusters  and  Automatic  Storage  Management  options   ! SQL>   40 Flex ASM
  • 41. • Flex ASM in Action – If an ASM instance crashes, it will be automatically restarted if ASM COUNT is set to ALL – If an ASM instance crashes, and ASM COUNT is not set to ALL, it will be restarted on the first available hub node 41 Flex ASM
  • 43. • ASM Restart – Since ASM is a clusterware resource, it’s configured to restart automatically (if killed) [oracle@flex2  asmca]$  crsctl  stat  res  ora.asm  -­‐v NAME=ora.asm   TYPE=ora.asm.type   LAST_SERVER=flex1 STATE=ONLINE  on  flex1 TARGET=ONLINE CARDINALITY_ID=1 CREATION_SEED=79 RESTART_COUNT=0 FAILURE_COUNT=0 FAILURE_HISTORY= ID=ora.asm  1  1 INCARNATION=0 LAST_RESTART=NEVER LAST_STATE_CHANGE=NEVER STATE_DETAILS= INTERNAL_STATE=STABLE INSTANCE_COUNT=3 LAST_SERVER= STATE=OFFLINE TARGET=ONLINE CARDINALITY_ID=2 CREATION_SEED=79 RESTART_COUNT=0 FAILURE_COUNT=0 FAILURE_HISTORY= ID=ora.asm  2  1 INCARNATION=0 LAST_RESTART=NEVER LAST_STATE_CHANGE=NEVER STATE_DETAILS= INTERNAL_STATE=STABLE INSTANCE_COUNT=3 LAST_SERVER=flex2 STATE=ONLINE  on  flex2 TARGET=ONLINE CARDINALITY_ID=3 CREATION_SEED=79 RESTART_COUNT=0 FAILURE_COUNT=0 FAILURE_HISTORY= ID=ora.asm  3  1 INCARNATION=1 LAST_RESTART=NEVER LAST_STATE_CHANGE=02/07/2014  11:56:33 STATE_DETAILS= INTERNAL_STATE=STABLE INSTANCE_COUNT=3 43 Flex ASM
  • 44. • ASM Restart – Post Restart [oracle@flex2  asmca]$  crsctl  stat  res  ora.asm  -­‐v NAME=ora.asm   TYPE=ora.asm.type   LAST_SERVER=flex1 STATE=ONLINE  on  flex1 TARGET=ONLINE CARDINALITY_ID=1 CREATION_SEED=79 RESTART_COUNT=0 FAILURE_COUNT=0 FAILURE_HISTORY= ID=ora.asm  1  1 INCARNATION=0 LAST_RESTART=NEVER LAST_STATE_CHANGE=NEVER STATE_DETAILS= INTERNAL_STATE=STABLE INSTANCE_COUNT=3 LAST_SERVER= STATE=OFFLINE TARGET=ONLINE CARDINALITY_ID=2 CREATION_SEED=79 RESTART_COUNT=0 FAILURE_COUNT=0 FAILURE_HISTORY= ID=ora.asm  2  1 INCARNATION=0 LAST_RESTART=NEVER LAST_STATE_CHANGE=NEVER STATE_DETAILS= INTERNAL_STATE=STABLE INSTANCE_COUNT=3 LAST_SERVER=flex2 STATE=ONLINE  on  flex2 TARGET=ONLINE CARDINALITY_ID=3 CREATION_SEED=79 RESTART_COUNT=1   FAILURE_COUNT=0 FAILURE_HISTORY= ID=ora.asm  3  1 INCARNATION=1 LAST_RESTART=NEVER LAST_STATE_CHANGE=02/07/2014  11:56:33 STATE_DETAILS= INTERNAL_STATE=STABLE INSTANCE_COUNT=3 44 Flex ASM
  • 45. • Proxy ASM Instance ! – The INSTANCE_TYPE initialization parameter has an additional value ASMPROXY, in addition to ASM and RDBMS, to identify Oracle ASM proxy instances. An Oracle ASM proxy instance has its parameter set to ASMPROXY. ! – An Oracle ASM proxy instance is an Oracle instance running on a Hub node with a direct Oracle ASM client. Oracle Automatic Storage Management Cluster File System (Oracle ACFS) and Oracle ASM Dynamic Volume Manager (Oracle ADVM) are supported with an Oracle ASM proxy instance. 45 Flex ASM
  • 46. • Instance startup alert.log shows connection to local ASM1 Instance Thu  Feb  06  11:13:29  2014   NOTE:  ASMB  registering  with  ASM  instance  as  client  0xffffffffffffffff  (reg:822507052)   NOTE:  ASMB  connected  to  ASM  instance  +ASM1  (Flex  mode;  client  id  0x10001)   • Instance startup alert.log shows connection to local ASM2 Instance since ASM1 is down Thu  Feb  06  20:18:53  2014   NOTE:  ASMB  registering  with  ASM  instance  as  client  0xffffffffffffffff  (reg:2675147253)   NOTE:  ASMB  connected  to  ASM  instance  +ASM2  (Flex  mode;  client  id  0x10004) 46 Flex ASM
  • 47. • Instance startup alert.log shows connection to local ASM1 Instance Thu  Feb  06  11:13:29  2014   NOTE:  ASMB  registering  with  ASM  instance  as  client  0xffffffffffffffff  (reg:822507052)   NOTE:  ASMB  connected  to  ASM  instance  +ASM1  (Flex  mode;  client  id  0x10001)   • Instance startup alert.log shows connection to local ASM2 Instance since ASM1 is down Thu  Feb  06  20:18:53  2014   NOTE:  ASMB  registering  with  ASM  instance  as  client  0xffffffffffffffff  (reg:2675147253)   NOTE:  ASMB  connected  to  ASM  instance  +ASM2  (Flex  mode;  client  id  0x10004)   • In the ASM2 alert.log, we can see the connection establishing Thu  Feb  06  20:18:53  2014   NOTE:  Flex  client  id  0x0  [sport:sport]  attempting  to  connect   NOTE:  registered  owner  id  0x10004  for  sport:sport   NOTE:  Flex  client  sport:sport  registered,  osid  15584,  mbr  0x0  (reg:2675147253)   Thu  Feb  06  20:18:59  2014   Reconfiguration  started  (old  inc  6,  new  inc  8)   List  of  instances:    1  2  (myinst:  2)      Global  Resource  Directory  frozen    Communication  channels  reestablished 47 Flex ASM
  • 48. • New Parameters for Flexing ASM? – Nope – The only parameters to consider for review are when performing an upgrade – Parameter Documentation located here +ASM1.__oracle_base='/u01/app/oracle'#ORACLE_BASE  set  from  in  memory  value +ASM2.__oracle_base='/u01/app/oracle'#ORACLE_BASE  set  from  in  memory  value *.asm_diskstring='/dev/asm*' *.asm_power_limit=1 *.large_pool_size=12M *.remote_login_passwordfile='EXCLUSIVE' 48 Flex ASM
  • 49. • Monitoring – My personal favorite tool is Enterprise Manager – Allows for monitoring as well as administration of Flex ASM 49 Flex ASM
  • 50. • Monitoring – View Flex ASM Components 50 Flex ASM
  • 51. • Monitoring – View Flex ASM Topology (slick!!) 51 Flex ASM
  • 52. ! • Flex Cluster • Flex ASM • Your Database on a Flex Architecture • Conclusion Agenda 52
  • 53. • The database is oblivious to the chaotic symphony underneath the covers – Clients are automatically relocated if an ASM Instance goes down – Adding a new node to a cluster (which currently exists as a standalone) and migration to ASM is easier – Even though with previous releases, there is very little over-head of ASM • Fewer resources on a Hub nodes without ASM to manage – The database is not the super-star in the cluster! Flex your Database Flex 53
  • 54. • Test Scenario #1 – Database“sport”is connected to“+ASM1” – Database“sport”is running a transaction – a silly little loop to insert some rows – Kill“+ASM1”SMON process – “sport”database’s connection will be terminated and relocated to the first available ASM instance • In some cases, you might receive an ORA-03114 or ORA-03113 error message • In my testing, the fail-over was seamless NOTE:  ASMB  registering  with  ASM  instance  as  client  0x10002  (reg:3110852683)   NOTE:  ASMB  connected  to  ASM  instance  +ASM2  (Flex  mode;  client  id  0x10002)   NOTE:  ASMB  rebuilding  ASM  server  state   NOTE:  ASMB  rebuilt  1  (of  1)  groups   NOTE:  ASMB  rebuilt  9  (of  9)  allocated  files   NOTE:  fetching  new  locked  extents  from  server   NOTE:  0  locks  established;  0  pending  writes  sent  to  server   SUCCESS:  ASMB  reconnected  &  completed  ASM  server  state   – No lost rows observed – This fail-over feature doesn’t necessarily replace RAC Services 54 Flex your Database
  • 56. • Test Scenario #2 – Database Instance“sport”running on hub node“flex1” – “flex1”is converted to a“leaf”node – Upon“sport”startup, we receive an error SQL>  startup   ORA-­‐01078:  failure  in  processing  system  parameters   ORA-­‐01565:  error  in  identifying  file  '+DATA/sport/spfilesport.ora'   ORA-­‐17503:  ksfdopn:2  Failed  to  open  file  +DATA/sport/spfilesport.ora   ORA-­‐12514:  TNS:listener  does  not  currently  know  of  service  requested  in  connect  descriptor   ORA-­‐15077:  could  not  locate  ASM  instance  serving  a  required  diskgroup   – Ah, but there is no local“+ASM1”instance anymore – If“sport”originally had no dependency on“+ASM1”it would startup successfully 56 Flex your Database
  • 57. • Node Maintenance – Since ASM Clients can be relocated – Database Instances may not need to be shut down • Database Migrations from Non-ASM to ASM? Use-Cases Flex 57
  • 58. ! • Flex Cluster • Flex ASM • Your Database on a Flex Architecture • Conclusion 58 Agenda
  • 59. • First phase of Flex Clusters is targeted for – Better consolidation of resources • Future phases of Flex Clusters are aimed to tackle resource management – Next project would involve configuring a Hub-Leaf configuration with middle tier • Maybe Enterprise Manager 12c? • Flex ASM allows for – Detached Storage Management – Automatic ASM Instance Restarts – ASM Proxy Instances allow for remote connections to Storage from Remote Databases • Databases Running on Flex ASM are just as happy! Conclusion 59
  • 60. • Oracle Docs on Flex Cluster and Flex ASM • Flex ASM Whitepaper • RACAttack: 12c Setup Guide • Martin Bach’s Blog – Flex ASM in Action • Ask Mcleans post on Flex Clusters • Bertrand Drouvot’s Blog – Flex ASM Gotchas – Findings 1 & 2 • My Noggin! Mentionable References 60
  • 62. Blog: maazanjum.com Email: maaz.anjum@biascorp.com Twitter: @maaz_anjum 62 Reminder: Complete evaluation Session: #104 Title: DB12c Flex Your Database with Flex ASM and Flex Clusters

Editor's Notes

  1. Hub:They are tightly connected, and have direct access to shared storage. In an Oracle Flex Cluster configuration, shared storage can be provisioned to leaf nodes independent of the Oracle Grid Infrastructure.Leaf:Hub Nodes can run in an Oracle Flex Cluster configuration without having any Leaf Nodes as cluster member nodes, but Leaf Nodes must be members of a cluster that includes at least one Hub Node.
  2. Imagine a system maintenance window when all activity needs to be offloaded to a different cluster.
  3. Imagine a system maintenance window when all activity needs to be offloaded to a different cluster.You could effectively keep relocating a client. It will essentially kill the connection and force a failover to occur.
  4. Imagine a system maintenance window when all activity needs to be offloaded to a different cluster.You could effectively keep relocating a client. It will essentially kill the connection and force a failover to occur.
  5. Imagine a system maintenance window when all activity needs to be offloaded to a different cluster.You could effectively keep relocating a client. It will essentially kill the connection and force a failover to occur.