SlideShare a Scribd company logo
1 of 59
Download to read offline
Maaz Anjum - IOUG Collaborate 2013 - An Insight into Space Realization on ODA and Exadata
About Maaz
Maaz Anjum
• Marietta, Georgia
• Solutions Architect:
• OEM12c
• Golden Gate
• Engineered Systems
• Member of IOUG
• Using Oracle products SINCE 2001

Blog: http://blogspot.maazanjum.com
Email: maaz.anjum@biascorp.com
•
•

•
•
•
•
•

Founded in 2000
Distinguished Oracle Leader
– Technology Momentum
– Portal Blazer Award
– Titan Award – Red Stack + HW Momentum
– Excellence in Innovation
Management Team is Ex-Oracle
Location(s): Headquartered in Atlanta; Regional office in
Washington D.C.; Offshore – Hyderabad and Chennai, India
200+ with 10+ yrs of Oracle experience avg (75 openings
today…)
Inc.500 fastest growing private company in the U.S. for the
3rd Time
Voted Best Place to work in Atlanta for 2nd year
• Oracle Platinum Certified Systems Integrator & Oracle GSA
Software Reseller
• Consulting expertise and past performance across the entire
Oracle Stack
• One stop shop for all things Oracle including Hardware, Software,
Consulting, Managed Services, and Staff Augmentation
• 350 customers across Federal Civilian Agencies, Department
of Defense, State and Local Government, and Fortune 500
• 1500 successful implementations since 2000
• Certified across the entire Oracle Stack (1 of 8 partners out of
10,000)
• Top 5 Oracle reseller in the United States
• Business Intelligence Pillar Partner for Public Sector and
Commercial
Oracle’s Advanced
Compression

An Insight into
Space Realization
on ODA and
Exadata
#523
AGENDA
• Overview
• A Brief History
• Pre-11g
• 11g: New Features
• Case Study - Story
VERVIEW
• Combined with Oracle Database 11g helps businesses manage more
data in a cost effective manner while providing for storing and auditing of
historical data.
• Delivers compression rates of 2-4x across all types of data and
applications improving query performance.
• Includes compression for structured data (numbers, characters, etc.),
unstructured data (documents, images, etc.), backups (RMAN and Data
Pump) and network transport (redo log transport during Data Guard gap
resolution).

7
VERVIEW
• Reduces database storage requirements and associated
costs
• Compresses transaction processing and data warehousing
application tables
• Compresses structured, unstructured, backup and Data
Guard Redo Log network transport data
• Includes Total Recall for storing and auditing historical
data
• Cascades storage savings throughout the data center

8
AGENDA
• Overview
• A Brief History
• Pre-11g
• 11g: New Features
• Case study - Story
A Brief
History

• Given many names

• Data Compression
• Source Coding
• Bit-Rate Compression
AGENDA
• Overview
• A Brief History
• Pre-11g
• 11g: New Features
• Case Study - Story
Pre-11G
• First introduced in Oracle 9.2.0.1
• WITH COMPRESS
• A trade-off between CPU and Disk I/O
• The use of spare CPU cycles to decrease the bytes written and
read
• Transparent to applications, SQL, and PL/SQL
• May improve performance by requiring the transfer of fewer bytes
from disk through the network, into the CPU, to be stored in the
buffer cache
• Increase the amount of data stored on existing disk

12
AGENDA

• Overview
• A Brief History
• Pre-11g
• 11g: New Features
• Case Study - Story
11G New
Features

The Advanced Compression Option includes:
• Data Guard Network Compression
• Data Pump Compression
• Fast RMAN Compression
• OLTP Table Compression
• SecureFile Compression and Deduplication
• Leveraged in 11gR2 DBFS
(DataBase File System)

14
11G New
Features

• Compressed Tablespaces
• Segment Compression
• COMPRESS
• COMPRESS FOR BASIC
• COMPRESS FOR OLTP

column
• Hybrid Columnar Compression
• Warehouse Compression (Query)
• Archival Compression (Archive)
• user_tablespaces.compress_for

15
11G New
Features
Fully supported with…
•
•
•
•
•
•
•
•

B-Tree, Bitmap Indexes, Text indexes
Materialized Views
Exadata Server and Cells
Partitioning
Parallel Query, PDML, PDDL
Schema Evolution support, online, metadata-only
add/drop columns
Data Guard Physical Standby

16
11.2 Table segment
Compress for OLTP
compression
CREATE TABLE ct1
COMPRESS FOR OLTP
AS
SELECT * FROM dba_objects;

Compress for Query
CREATE TABLE ct2
COMPRESS FOR QUERY HIGH
AS
SELECT * FROM dba_objects;

Compress for Archive
CREATE TABLE ct3
COMPRESS FOR ARCHIVE LOW
AS
SELECT * FROM dba_objects;

17
11.2 Table segment
compression

18
Types of
Compression

19
Compression
Characteristics

20
What Can Be
• Tablespaces
Compressed?
• Tables
• Partitions
• Indexes
• SecureFiles
• RMAN Backups
• Data Pump Backups
21
What Can Be
Compressed?

Tablespaces

CREATE TABLESPACE test_ts
DATAFILE '/u01/app/oracle/oradata/DB11G/test_ts01.dbf'
SIZE 1M
DEFAULT COMPRESS FOR ALL OPERATIONS;
SELECT def_tab_compression, compress_for
FROM
dba_tablespaces
WHERE tablespace_name = 'TEST_TS';
DEF_TAB_ COMPRESS_FOR
-------- -----------------ENABLED FOR ALL OPERATIONS

22
What Can Be
Compressed?

Partitions

CREATE TABLE test_tab_2 (
id
NUMBER(10)
NOT NULL,
description
VARCHAR2(50) NOT NULL,
created_date DATE
NOT NULL
)
PARTITION BY RANGE (created_date) (
PARTITION test_tab_q1 VALUES
LESS THAN (TO_DATE('01/01/2008', 'DD/MM/YYYY')) COMPRESS,
PARTITION test_tab_q2 VALUES
LESS THAN (TO_DATE('01/04/2008', 'DD/MM/YYYY')) COMPRESS FOR OLTP,
PARTITION test_tab_q3 VALUES
LESS THAN (TO_DATE('01/07/2008', 'DD/MM/YYYY')) COMPRESS FOR OLTP,
PARTITION test_tab_q4 VALUES
LESS THAN (MAXVALUE) NOCOMPRESS
);

23
What Can Be
Compressed?

Key-Compressed Indexes
•Creating an index using key compression enables you
to eliminate repeated occurrences of key column prefix
values.
•Key compression breaks an index key into a prefix and
a suffix entry.
•Compression is achieved by sharing the prefix entries
among all the suffix entries in an index block.
•This sharing can lead to huge savings in space,
allowing you to store more keys for each index block
while improving performance.
CREATE INDEX emp_ename ON emp(ename) TABLESPACE users
COMPRESS 1;
What Can Be
Compressed?

SecureFiles

•SecureFile compression does not entail table or index
compression and vice-versa.
•A server-wide default SecureFile compression algorithm is
used.
•MEDIUM and HIGH options provide varying degrees of
compression. The higher the degree of compression, the
higher the latency incurred. HIGH setting incurs more work,
but will compress the data better. The default is MEDIUM.
What Can Be
Compressed?

SecureFiles

•Compression can be specified at a partition level.
The lob_storage_clause enables specification for partitioned tables
on a per-partition basis.
•SecureFile compression is performed on the server-side and
enables random reads and writes to LOB data. Client side
compression utilities like utl_compress cannot provide random
access.
•DBMS_LOB.SETOPTIONS can be used to enable and disable
compression on individual LOBs.
•LOB compression is applicable only to SECUREFILE LOBs.
What Can Be
Compressed?

RMAN Backups

CONFIGURE DEVICE TYPE DISK BACKUP TYPE TO COMPRESSED
BACKUPSET;
CONFIGURE DEVICE TYPE TAPE BACKUP TYPE TO COMPRESSED
BACKUPSET;
CONFIGURE
CONFIGURE
CONFIGURE
CONFIGURE
CONFIGURE

COMPRESSION
COMPRESSION
COMPRESSION
COMPRESSION
COMPRESSION

ALGORITHM
ALGORITHM
ALGORITHM
ALGORITHM
ALGORITHM

'BASIC';
'NONE';
'LOW';
'MEDIUM';
'HIGH';
What Can Be
Compressed?

RMAN Backups
What Can Be
Compressed?

RMAN Backups
Sample “Medium” Algorithm compression results
What Can Be
Compressed?

Data Pump Backups

•The ability to compress the metadata associated
with a Data Pump job was first provided in Oracle
Database 10g Release 2.
•In Oracle database 11g, this compression
capability has been extended so that table data
can be compressed on export.
What Can Be
Compressed?

Data Pump Backups

Full Data Pump functionality is available using a compressed
file. Any command that is used on a regular file will also
work on a compressed file. Users have the following options
to determine which parts of a dump file set should be
compressed:
•ALL enables compression for the entire export operation.
•DATA-ONLY results in all data being written to the dump
file in compressed format.
•METADATA-ONLY results in all metadata being written to
the dump file in compressed format. This is the default.
•NONE disables compression for the entire export operation.
CONSIDERATIO
NS
• When compression is specified at multiple levels, the most specific
setting is always used

• As such, partition settings always override table settings, which
always override tablespace settings
Compression
Object

Type

Tablespace

Table

Index

OLTP

OLTP

Partition 1

ARCHIVE
LOW

Partition 2

ARCHIVE
HIGH
Hybrid Columnar
Two Types
Compression
• Warehouse Compression
• Archive Compression

Works with Exadata and now ZFS Storage
ZFS Storage can be attached with an ODA as NAS Storage
Hybrid Columnar
Compression
MYTHS
• Data is decompressed while being read
• Oracle Database does not need to decompress table
blocks when reading data. Oracle can keep blocks
compressed in memory and read them directly.
Hence, more data can be packed in memory which
results in improved cache hit ratio and reduced I/O.
• Data needs to be recompressed once update
• Not true with 11gR2 – COMPRESS WITH OLTP
algorithm compresses newer data without
uncompressing updated rows.
CONSIDERATIO
NS
• When should I compress?
• What should I compress?
Compression &
Partitioning
OLTP Applications

• Table Partitioning
• Heavily accessed data
• Partitions using OLTP Table Compression
• Cold or historical data
• Partitions using Online Archival Compression
• Data Warehouses
New Compression
Advisors
DBMS_COMPRESSION built-in package
• GET_COMPRESSION_RATIO

• Returns the possible compression ratio for an
uncompressed table or materialized view and estimates
achievable compression

•

GET_COMPRESSION_TYPE

• Inspects data and reports what compression type is in use
by row

Enterprise Manager Segment Advisor
• Estimates OLTP Table Compression automatically
• Advises tables that will benefit from OLTP Compression
Compression Ratio
Estimate
GET_COMPRESSION_RATIO
CREATE TABLE comp_test1 AS
SELECT * FROM dba_objects;

set serveroutput on
DECLARE
blkcnt_comp PLS_INTEGER;
blkcnt_uncm PLS_INTEGER;
row_comp PLS_INTEGER;
row_uncm PLS_INTEGER;
comp_ratio PLS_INTEGER;
comp_type VARCHAR2(30);
BEGIN
dbms_compression.get_compression_ratio('UWDATA', 'UWCLASS', 'COMP_TEST1', NULL,
dbms_compression.comp_for_oltp, blkcnt_cmp, blkcnt_uncmp, row_comp, row_uncm,
dbms_compression.comp_for_oltp, blkcnt_cmp, blkcnt_uncmp, row_comp, row_uncm,
comp_ratio, comp_type);
dbms_output.put_line('Block Count Compressed:
' || TO_CHAR(blkcnt_comp));
dbms_output.put_line('Block Count UnCompressed: ' || TO_CHAR(blkcnt_uncm));
dbms_output.put_line('Row Count Compressed:
' || TO_CHAR(row_comp));
dbms_output.put_line('Row Count UnCompressed:
' || TO_CHAR(row_uncm));
dbms_output.put_line('Block Count Compressed:
' || TO_CHAR(comp_ratio));
dbms_output.put_line('Compression Type:
' || comp_type;
END;
/
AGENDA
•
•
•
•

Overview
A Brief History
Pre-11g
11g: New Features

• Case study of BIAS' implementation for
a customer.
• Background
• requirements
• Storage savings achieved; tablespaces
and tables
CASE STUDY
Challenge
– 8TB Database Uncompressed and Unpartitioned
– ODA had only 2.3TB of usable space.

Goals
– Compress customer data and achieve similar (if not
better) performance
– Use Database Replay to simulate workload
– Perform Detailed Analysis of Performance Statistics
CASE STUDY
Hardware

– Platform: ODA 2.1.0.3.0 – 2 Nodes running Oracle
Enterprise Linux 5.7 64bit
– CPU: 24 cores per node
– RAM: 96GB per node

Database Version
– 11.2.0.2 64bit

Instance parameters
– SGA: 48GB
– PGA: 10GB
– Block Size: 8K
CASE STUDY
Data Characteristics
Billions of Rows
Across Several Tables
VARCHAR2 and NUMBER data types
Repeating Patterns within each table
CASE STUDY
Steps
– Create a compressed export dump of a
schema.
– Create compressed tablespaces – in our case
for OLTP.
– Import Meta data only; users, grants, objects
(excluding indexes and constraints).
– Alter tables for compression.
ALTER TABLE CARBON COMPRESS FOR OLTP;
CASE STUDY
Steps
– Import only table data – with appropriate parallel
degree.
– Import index creation scripts from export dump.
– Alter relevant indexes to add compression factor
of 1.
– Create indexes with appropriate parallel option.
– Import only constraints.
– For good measure, generate statistics on the
schema.
CHALLENGES
•
•
•
•

What should I compress first?
Multiple iterations with import
Tweaked level of compression
Time is the biggest enemy
RESULTS
What’s that?
You want to see proof of
compression??
8 TB Database,
compressed to less than
1.5TB on an Oracle
Database Appliance
RESULTS
RESULTS
RESULTS
RESULTS
RESULTS
Database Replay Results
Capture: 3 ½ Hours
Replay: Nearly 10
RESULTS
Database Replay Results
•Database was CPU bound
•Presumably because indexes were compressed
RESULTS
Database Replay Results
Two INSERT statements are the top consumers (over
75%) of the total sql statements
RESULTS
Database Replay Results
Average Active Sessions show database was CPU bound
What Did We
Learn?
• Compression Ratio’s vary but are mainly dependent on
Block redundancy
• Choose appropriate compression type
• Database Replay (conditions need to be perfect)
• Ensure workload capture is done with a consistent
backup
• Ensure same number of clients can be spawned
• Spend adequate time analyzing the results
• Patience is golden virtue!
QUESTIONS
Blog: http://blogspot.maazanjum.com
Email: maaz.anjum@biascorp.com
Twitter: @maaz_anjum
Session: 523
collaborate13.ioug.org/eval
Maaz Anjum - IOUG Collaborate 2013 - An Insight into Space Realization on ODA and Exadata

More Related Content

What's hot

SQL Explore 2012: P&T Part 3
SQL Explore 2012: P&T Part 3SQL Explore 2012: P&T Part 3
SQL Explore 2012: P&T Part 3sqlserver.co.il
 
Presentation db2 best practices for optimal performance
Presentation   db2 best practices for optimal performancePresentation   db2 best practices for optimal performance
Presentation db2 best practices for optimal performancesolarisyougood
 
The InnoDB Storage Engine for MySQL
The InnoDB Storage Engine for MySQLThe InnoDB Storage Engine for MySQL
The InnoDB Storage Engine for MySQLMorgan Tocker
 
Windows Server 2012 R2 Software-Defined Storage
Windows Server 2012 R2 Software-Defined StorageWindows Server 2012 R2 Software-Defined Storage
Windows Server 2012 R2 Software-Defined StorageAidan Finn
 
Colvin exadata mistakes_ioug_2014
Colvin exadata mistakes_ioug_2014Colvin exadata mistakes_ioug_2014
Colvin exadata mistakes_ioug_2014marvin herrera
 
Geek Sync I Need for Speed: In-Memory Databases in Oracle and SQL Server
Geek Sync I Need for Speed: In-Memory Databases in Oracle and SQL ServerGeek Sync I Need for Speed: In-Memory Databases in Oracle and SQL Server
Geek Sync I Need for Speed: In-Memory Databases in Oracle and SQL ServerIDERA Software
 
Efficient Monitoring & Tuning of Dynamic SQL in DB2 for z/OS by Namik Hrle ...
Efficient Monitoring & Tuning of Dynamic SQL in DB2 for z/OS  by  Namik Hrle ...Efficient Monitoring & Tuning of Dynamic SQL in DB2 for z/OS  by  Namik Hrle ...
Efficient Monitoring & Tuning of Dynamic SQL in DB2 for z/OS by Namik Hrle ...Surekha Parekh
 
MySQL Storage Engines Landscape
MySQL Storage Engines LandscapeMySQL Storage Engines Landscape
MySQL Storage Engines LandscapeColin Charles
 
Understanding DB2 Optimizer
Understanding DB2 OptimizerUnderstanding DB2 Optimizer
Understanding DB2 Optimizerterraborealis
 
IDUG NA 2014 / 11 tips for DB2 11 for z/OS
IDUG NA 2014 / 11 tips for DB2 11 for z/OSIDUG NA 2014 / 11 tips for DB2 11 for z/OS
IDUG NA 2014 / 11 tips for DB2 11 for z/OSCuneyt Goksu
 
DB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer ExperiencesDB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer ExperiencesJohn Campbell
 
Hardware planning & sizing for sql server
Hardware planning & sizing for sql serverHardware planning & sizing for sql server
Hardware planning & sizing for sql serverDavide Mauri
 
Understanding and controlling transaction logs
Understanding and controlling transaction logsUnderstanding and controlling transaction logs
Understanding and controlling transaction logsRed Gate Software
 
Reduce planned database down time with Oracle technology
Reduce planned database down time with Oracle technologyReduce planned database down time with Oracle technology
Reduce planned database down time with Oracle technologyKirill Loifman
 
IBM DB2 LUW/UDB DBA Training by www.etraining.guru
IBM DB2 LUW/UDB DBA Training by www.etraining.guruIBM DB2 LUW/UDB DBA Training by www.etraining.guru
IBM DB2 LUW/UDB DBA Training by www.etraining.guruRavikumar Nandigam
 
InnoDB Architecture and Performance Optimization, Peter Zaitsev
InnoDB Architecture and Performance Optimization, Peter ZaitsevInnoDB Architecture and Performance Optimization, Peter Zaitsev
InnoDB Architecture and Performance Optimization, Peter ZaitsevFuenteovejuna
 
Introduction to TokuDB v7.5 and Read Free Replication
Introduction to TokuDB v7.5 and Read Free ReplicationIntroduction to TokuDB v7.5 and Read Free Replication
Introduction to TokuDB v7.5 and Read Free ReplicationTim Callaghan
 
db2dart and inspect
db2dart and inspectdb2dart and inspect
db2dart and inspectdbawork
 
MySQL Server Settings Tuning
MySQL Server Settings TuningMySQL Server Settings Tuning
MySQL Server Settings Tuningguest5ca94b
 
Exadata
ExadataExadata
Exadatatalek
 

What's hot (20)

SQL Explore 2012: P&T Part 3
SQL Explore 2012: P&T Part 3SQL Explore 2012: P&T Part 3
SQL Explore 2012: P&T Part 3
 
Presentation db2 best practices for optimal performance
Presentation   db2 best practices for optimal performancePresentation   db2 best practices for optimal performance
Presentation db2 best practices for optimal performance
 
The InnoDB Storage Engine for MySQL
The InnoDB Storage Engine for MySQLThe InnoDB Storage Engine for MySQL
The InnoDB Storage Engine for MySQL
 
Windows Server 2012 R2 Software-Defined Storage
Windows Server 2012 R2 Software-Defined StorageWindows Server 2012 R2 Software-Defined Storage
Windows Server 2012 R2 Software-Defined Storage
 
Colvin exadata mistakes_ioug_2014
Colvin exadata mistakes_ioug_2014Colvin exadata mistakes_ioug_2014
Colvin exadata mistakes_ioug_2014
 
Geek Sync I Need for Speed: In-Memory Databases in Oracle and SQL Server
Geek Sync I Need for Speed: In-Memory Databases in Oracle and SQL ServerGeek Sync I Need for Speed: In-Memory Databases in Oracle and SQL Server
Geek Sync I Need for Speed: In-Memory Databases in Oracle and SQL Server
 
Efficient Monitoring & Tuning of Dynamic SQL in DB2 for z/OS by Namik Hrle ...
Efficient Monitoring & Tuning of Dynamic SQL in DB2 for z/OS  by  Namik Hrle ...Efficient Monitoring & Tuning of Dynamic SQL in DB2 for z/OS  by  Namik Hrle ...
Efficient Monitoring & Tuning of Dynamic SQL in DB2 for z/OS by Namik Hrle ...
 
MySQL Storage Engines Landscape
MySQL Storage Engines LandscapeMySQL Storage Engines Landscape
MySQL Storage Engines Landscape
 
Understanding DB2 Optimizer
Understanding DB2 OptimizerUnderstanding DB2 Optimizer
Understanding DB2 Optimizer
 
IDUG NA 2014 / 11 tips for DB2 11 for z/OS
IDUG NA 2014 / 11 tips for DB2 11 for z/OSIDUG NA 2014 / 11 tips for DB2 11 for z/OS
IDUG NA 2014 / 11 tips for DB2 11 for z/OS
 
DB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer ExperiencesDB2 11 for z/OS Migration Planning and Early Customer Experiences
DB2 11 for z/OS Migration Planning and Early Customer Experiences
 
Hardware planning & sizing for sql server
Hardware planning & sizing for sql serverHardware planning & sizing for sql server
Hardware planning & sizing for sql server
 
Understanding and controlling transaction logs
Understanding and controlling transaction logsUnderstanding and controlling transaction logs
Understanding and controlling transaction logs
 
Reduce planned database down time with Oracle technology
Reduce planned database down time with Oracle technologyReduce planned database down time with Oracle technology
Reduce planned database down time with Oracle technology
 
IBM DB2 LUW/UDB DBA Training by www.etraining.guru
IBM DB2 LUW/UDB DBA Training by www.etraining.guruIBM DB2 LUW/UDB DBA Training by www.etraining.guru
IBM DB2 LUW/UDB DBA Training by www.etraining.guru
 
InnoDB Architecture and Performance Optimization, Peter Zaitsev
InnoDB Architecture and Performance Optimization, Peter ZaitsevInnoDB Architecture and Performance Optimization, Peter Zaitsev
InnoDB Architecture and Performance Optimization, Peter Zaitsev
 
Introduction to TokuDB v7.5 and Read Free Replication
Introduction to TokuDB v7.5 and Read Free ReplicationIntroduction to TokuDB v7.5 and Read Free Replication
Introduction to TokuDB v7.5 and Read Free Replication
 
db2dart and inspect
db2dart and inspectdb2dart and inspect
db2dart and inspect
 
MySQL Server Settings Tuning
MySQL Server Settings TuningMySQL Server Settings Tuning
MySQL Server Settings Tuning
 
Exadata
ExadataExadata
Exadata
 

Viewers also liked

Education in 50 Years: A Futurist’s Perspective
Education in 50 Years: A Futurist’s PerspectiveEducation in 50 Years: A Futurist’s Perspective
Education in 50 Years: A Futurist’s PerspectiveBid4Papers
 
Database Provisioning in EM12c: Provision me a Database Now!
Database Provisioning in EM12c: Provision me a Database Now!Database Provisioning in EM12c: Provision me a Database Now!
Database Provisioning in EM12c: Provision me a Database Now!Maaz Anjum
 
A School of Humanity
A School of Humanity   A School of Humanity
A School of Humanity Bid4Papers
 
Samples of official and fake novelizations
Samples of official and fake novelizationsSamples of official and fake novelizations
Samples of official and fake novelizationsBid4Papers
 
Overview of iso 9001
Overview of iso 9001Overview of iso 9001
Overview of iso 9001Nur Islam
 
Flex Your Database on 12c's Flex ASM and Flex Cluster
Flex Your Database on 12c's Flex ASM and Flex ClusterFlex Your Database on 12c's Flex ASM and Flex Cluster
Flex Your Database on 12c's Flex ASM and Flex ClusterMaaz Anjum
 
Literature Review: Application of Artificial Neural Network in Civil Engineering
Literature Review: Application of Artificial Neural Network in Civil EngineeringLiterature Review: Application of Artificial Neural Network in Civil Engineering
Literature Review: Application of Artificial Neural Network in Civil EngineeringBid4Papers
 
Essay Sample on Meditation
Essay Sample on MeditationEssay Sample on Meditation
Essay Sample on MeditationBid4Papers
 
Essay on Sociology: Chinese Traditional Family Ritual
Essay on Sociology: Chinese Traditional Family RitualEssay on Sociology: Chinese Traditional Family Ritual
Essay on Sociology: Chinese Traditional Family RitualBid4Papers
 
RACATTACK Lab Handbook - Enable Flex Cluster and Flex ASM
RACATTACK Lab Handbook - Enable Flex Cluster and Flex ASMRACATTACK Lab Handbook - Enable Flex Cluster and Flex ASM
RACATTACK Lab Handbook - Enable Flex Cluster and Flex ASMMaaz Anjum
 
EM12c: Capacity Planning with OEM Metrics
EM12c: Capacity Planning with OEM MetricsEM12c: Capacity Planning with OEM Metrics
EM12c: Capacity Planning with OEM MetricsMaaz Anjum
 
Halsted’s Software Science-An analytical technique
Halsted’s Software Science-An analytical techniqueHalsted’s Software Science-An analytical technique
Halsted’s Software Science-An analytical techniqueNur Islam
 
Essay on school family partnerships bid4papers
Essay on school family partnerships bid4papersEssay on school family partnerships bid4papers
Essay on school family partnerships bid4papersBid4Papers
 
The Setting of John Cheever's "The Swimmer"
The Setting of John Cheever's "The Swimmer"The Setting of John Cheever's "The Swimmer"
The Setting of John Cheever's "The Swimmer"Bid4Papers
 

Viewers also liked (16)

Education in 50 Years: A Futurist’s Perspective
Education in 50 Years: A Futurist’s PerspectiveEducation in 50 Years: A Futurist’s Perspective
Education in 50 Years: A Futurist’s Perspective
 
Database Provisioning in EM12c: Provision me a Database Now!
Database Provisioning in EM12c: Provision me a Database Now!Database Provisioning in EM12c: Provision me a Database Now!
Database Provisioning in EM12c: Provision me a Database Now!
 
A School of Humanity
A School of Humanity   A School of Humanity
A School of Humanity
 
Samples of official and fake novelizations
Samples of official and fake novelizationsSamples of official and fake novelizations
Samples of official and fake novelizations
 
Overview of iso 9001
Overview of iso 9001Overview of iso 9001
Overview of iso 9001
 
Flex Your Database on 12c's Flex ASM and Flex Cluster
Flex Your Database on 12c's Flex ASM and Flex ClusterFlex Your Database on 12c's Flex ASM and Flex Cluster
Flex Your Database on 12c's Flex ASM and Flex Cluster
 
Literature Review: Application of Artificial Neural Network in Civil Engineering
Literature Review: Application of Artificial Neural Network in Civil EngineeringLiterature Review: Application of Artificial Neural Network in Civil Engineering
Literature Review: Application of Artificial Neural Network in Civil Engineering
 
Gsm
GsmGsm
Gsm
 
Essay Sample on Meditation
Essay Sample on MeditationEssay Sample on Meditation
Essay Sample on Meditation
 
Essay on Sociology: Chinese Traditional Family Ritual
Essay on Sociology: Chinese Traditional Family RitualEssay on Sociology: Chinese Traditional Family Ritual
Essay on Sociology: Chinese Traditional Family Ritual
 
RACATTACK Lab Handbook - Enable Flex Cluster and Flex ASM
RACATTACK Lab Handbook - Enable Flex Cluster and Flex ASMRACATTACK Lab Handbook - Enable Flex Cluster and Flex ASM
RACATTACK Lab Handbook - Enable Flex Cluster and Flex ASM
 
Lan wan
Lan wanLan wan
Lan wan
 
EM12c: Capacity Planning with OEM Metrics
EM12c: Capacity Planning with OEM MetricsEM12c: Capacity Planning with OEM Metrics
EM12c: Capacity Planning with OEM Metrics
 
Halsted’s Software Science-An analytical technique
Halsted’s Software Science-An analytical techniqueHalsted’s Software Science-An analytical technique
Halsted’s Software Science-An analytical technique
 
Essay on school family partnerships bid4papers
Essay on school family partnerships bid4papersEssay on school family partnerships bid4papers
Essay on school family partnerships bid4papers
 
The Setting of John Cheever's "The Swimmer"
The Setting of John Cheever's "The Swimmer"The Setting of John Cheever's "The Swimmer"
The Setting of John Cheever's "The Swimmer"
 

Similar to Maaz Anjum - IOUG Collaborate 2013 - An Insight into Space Realization on ODA and Exadata

Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle
Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle
Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle Ashnikbiz
 
Technical Introduction to PostgreSQL and PPAS
Technical Introduction to PostgreSQL and PPASTechnical Introduction to PostgreSQL and PPAS
Technical Introduction to PostgreSQL and PPASAshnikbiz
 
COUG_AAbate_Oracle_Database_12c_New_Features
COUG_AAbate_Oracle_Database_12c_New_FeaturesCOUG_AAbate_Oracle_Database_12c_New_Features
COUG_AAbate_Oracle_Database_12c_New_FeaturesAlfredo Abate
 
Aioug vizag oracle12c_new_features
Aioug vizag oracle12c_new_featuresAioug vizag oracle12c_new_features
Aioug vizag oracle12c_new_featuresAiougVizagChapter
 
VLDB Administration Strategies
VLDB Administration StrategiesVLDB Administration Strategies
VLDB Administration StrategiesMurilo Miranda
 
30334823 my sql-cluster-performance-tuning-best-practices
30334823 my sql-cluster-performance-tuning-best-practices30334823 my sql-cluster-performance-tuning-best-practices
30334823 my sql-cluster-performance-tuning-best-practicesDavid Dhavan
 
Pre and post tips to installing sql server correctly
Pre and post tips to installing sql server correctlyPre and post tips to installing sql server correctly
Pre and post tips to installing sql server correctlyAntonios Chatzipavlis
 
Oracle db architecture
Oracle db architectureOracle db architecture
Oracle db architectureSimon Huang
 
Healthcare Claim Reimbursement using Apache Spark
Healthcare Claim Reimbursement using Apache SparkHealthcare Claim Reimbursement using Apache Spark
Healthcare Claim Reimbursement using Apache SparkDatabricks
 
Migrate from Oracle to Aurora PostgreSQL: Best Practices, Design Patterns, & ...
Migrate from Oracle to Aurora PostgreSQL: Best Practices, Design Patterns, & ...Migrate from Oracle to Aurora PostgreSQL: Best Practices, Design Patterns, & ...
Migrate from Oracle to Aurora PostgreSQL: Best Practices, Design Patterns, & ...Amazon Web Services
 
DBAM-01.pdf
DBAM-01.pdfDBAM-01.pdf
DBAM-01.pdfhania80
 
Database Administration & Management - 01
Database Administration & Management - 01Database Administration & Management - 01
Database Administration & Management - 01FaisalMashood
 
45 ways to speed up firebird database
45 ways to speed up firebird database45 ways to speed up firebird database
45 ways to speed up firebird databaseFabio Codebue
 
Getting Started with Managed Database Services on AWS - September 2016 Webina...
Getting Started with Managed Database Services on AWS - September 2016 Webina...Getting Started with Managed Database Services on AWS - September 2016 Webina...
Getting Started with Managed Database Services on AWS - September 2016 Webina...Amazon Web Services
 

Similar to Maaz Anjum - IOUG Collaborate 2013 - An Insight into Space Realization on ODA and Exadata (20)

Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle
Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle
Ashnik EnterpriseDB PostgreSQL - A real alternative to Oracle
 
IaaS for DBAs in Azure
IaaS for DBAs in AzureIaaS for DBAs in Azure
IaaS for DBAs in Azure
 
Azure Databases with IaaS
Azure Databases with IaaSAzure Databases with IaaS
Azure Databases with IaaS
 
Technical Introduction to PostgreSQL and PPAS
Technical Introduction to PostgreSQL and PPASTechnical Introduction to PostgreSQL and PPAS
Technical Introduction to PostgreSQL and PPAS
 
Deep Dive on Amazon Redshift
Deep Dive on Amazon RedshiftDeep Dive on Amazon Redshift
Deep Dive on Amazon Redshift
 
Deep Dive on Amazon Redshift
Deep Dive on Amazon RedshiftDeep Dive on Amazon Redshift
Deep Dive on Amazon Redshift
 
Azure DBA with IaaS
Azure DBA with IaaSAzure DBA with IaaS
Azure DBA with IaaS
 
COUG_AAbate_Oracle_Database_12c_New_Features
COUG_AAbate_Oracle_Database_12c_New_FeaturesCOUG_AAbate_Oracle_Database_12c_New_Features
COUG_AAbate_Oracle_Database_12c_New_Features
 
Aioug vizag oracle12c_new_features
Aioug vizag oracle12c_new_featuresAioug vizag oracle12c_new_features
Aioug vizag oracle12c_new_features
 
Redshift overview
Redshift overviewRedshift overview
Redshift overview
 
VLDB Administration Strategies
VLDB Administration StrategiesVLDB Administration Strategies
VLDB Administration Strategies
 
30334823 my sql-cluster-performance-tuning-best-practices
30334823 my sql-cluster-performance-tuning-best-practices30334823 my sql-cluster-performance-tuning-best-practices
30334823 my sql-cluster-performance-tuning-best-practices
 
Pre and post tips to installing sql server correctly
Pre and post tips to installing sql server correctlyPre and post tips to installing sql server correctly
Pre and post tips to installing sql server correctly
 
Oracle db architecture
Oracle db architectureOracle db architecture
Oracle db architecture
 
Healthcare Claim Reimbursement using Apache Spark
Healthcare Claim Reimbursement using Apache SparkHealthcare Claim Reimbursement using Apache Spark
Healthcare Claim Reimbursement using Apache Spark
 
Migrate from Oracle to Aurora PostgreSQL: Best Practices, Design Patterns, & ...
Migrate from Oracle to Aurora PostgreSQL: Best Practices, Design Patterns, & ...Migrate from Oracle to Aurora PostgreSQL: Best Practices, Design Patterns, & ...
Migrate from Oracle to Aurora PostgreSQL: Best Practices, Design Patterns, & ...
 
DBAM-01.pdf
DBAM-01.pdfDBAM-01.pdf
DBAM-01.pdf
 
Database Administration & Management - 01
Database Administration & Management - 01Database Administration & Management - 01
Database Administration & Management - 01
 
45 ways to speed up firebird database
45 ways to speed up firebird database45 ways to speed up firebird database
45 ways to speed up firebird database
 
Getting Started with Managed Database Services on AWS - September 2016 Webina...
Getting Started with Managed Database Services on AWS - September 2016 Webina...Getting Started with Managed Database Services on AWS - September 2016 Webina...
Getting Started with Managed Database Services on AWS - September 2016 Webina...
 

Recently uploaded

UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 

Recently uploaded (20)

UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 

Maaz Anjum - IOUG Collaborate 2013 - An Insight into Space Realization on ODA and Exadata

  • 2. About Maaz Maaz Anjum • Marietta, Georgia • Solutions Architect: • OEM12c • Golden Gate • Engineered Systems • Member of IOUG • Using Oracle products SINCE 2001 Blog: http://blogspot.maazanjum.com Email: maaz.anjum@biascorp.com
  • 3. • • • • • • • Founded in 2000 Distinguished Oracle Leader – Technology Momentum – Portal Blazer Award – Titan Award – Red Stack + HW Momentum – Excellence in Innovation Management Team is Ex-Oracle Location(s): Headquartered in Atlanta; Regional office in Washington D.C.; Offshore – Hyderabad and Chennai, India 200+ with 10+ yrs of Oracle experience avg (75 openings today…) Inc.500 fastest growing private company in the U.S. for the 3rd Time Voted Best Place to work in Atlanta for 2nd year
  • 4. • Oracle Platinum Certified Systems Integrator & Oracle GSA Software Reseller • Consulting expertise and past performance across the entire Oracle Stack • One stop shop for all things Oracle including Hardware, Software, Consulting, Managed Services, and Staff Augmentation • 350 customers across Federal Civilian Agencies, Department of Defense, State and Local Government, and Fortune 500 • 1500 successful implementations since 2000 • Certified across the entire Oracle Stack (1 of 8 partners out of 10,000) • Top 5 Oracle reseller in the United States • Business Intelligence Pillar Partner for Public Sector and Commercial
  • 5. Oracle’s Advanced Compression An Insight into Space Realization on ODA and Exadata #523
  • 6. AGENDA • Overview • A Brief History • Pre-11g • 11g: New Features • Case Study - Story
  • 7. VERVIEW • Combined with Oracle Database 11g helps businesses manage more data in a cost effective manner while providing for storing and auditing of historical data. • Delivers compression rates of 2-4x across all types of data and applications improving query performance. • Includes compression for structured data (numbers, characters, etc.), unstructured data (documents, images, etc.), backups (RMAN and Data Pump) and network transport (redo log transport during Data Guard gap resolution). 7
  • 8. VERVIEW • Reduces database storage requirements and associated costs • Compresses transaction processing and data warehousing application tables • Compresses structured, unstructured, backup and Data Guard Redo Log network transport data • Includes Total Recall for storing and auditing historical data • Cascades storage savings throughout the data center 8
  • 9. AGENDA • Overview • A Brief History • Pre-11g • 11g: New Features • Case study - Story
  • 10. A Brief History • Given many names • Data Compression • Source Coding • Bit-Rate Compression
  • 11. AGENDA • Overview • A Brief History • Pre-11g • 11g: New Features • Case Study - Story
  • 12. Pre-11G • First introduced in Oracle 9.2.0.1 • WITH COMPRESS • A trade-off between CPU and Disk I/O • The use of spare CPU cycles to decrease the bytes written and read • Transparent to applications, SQL, and PL/SQL • May improve performance by requiring the transfer of fewer bytes from disk through the network, into the CPU, to be stored in the buffer cache • Increase the amount of data stored on existing disk 12
  • 13. AGENDA • Overview • A Brief History • Pre-11g • 11g: New Features • Case Study - Story
  • 14. 11G New Features The Advanced Compression Option includes: • Data Guard Network Compression • Data Pump Compression • Fast RMAN Compression • OLTP Table Compression • SecureFile Compression and Deduplication • Leveraged in 11gR2 DBFS (DataBase File System) 14
  • 15. 11G New Features • Compressed Tablespaces • Segment Compression • COMPRESS • COMPRESS FOR BASIC • COMPRESS FOR OLTP column • Hybrid Columnar Compression • Warehouse Compression (Query) • Archival Compression (Archive) • user_tablespaces.compress_for 15
  • 16. 11G New Features Fully supported with… • • • • • • • • B-Tree, Bitmap Indexes, Text indexes Materialized Views Exadata Server and Cells Partitioning Parallel Query, PDML, PDDL Schema Evolution support, online, metadata-only add/drop columns Data Guard Physical Standby 16
  • 17. 11.2 Table segment Compress for OLTP compression CREATE TABLE ct1 COMPRESS FOR OLTP AS SELECT * FROM dba_objects; Compress for Query CREATE TABLE ct2 COMPRESS FOR QUERY HIGH AS SELECT * FROM dba_objects; Compress for Archive CREATE TABLE ct3 COMPRESS FOR ARCHIVE LOW AS SELECT * FROM dba_objects; 17
  • 21. What Can Be • Tablespaces Compressed? • Tables • Partitions • Indexes • SecureFiles • RMAN Backups • Data Pump Backups 21
  • 22. What Can Be Compressed? Tablespaces CREATE TABLESPACE test_ts DATAFILE '/u01/app/oracle/oradata/DB11G/test_ts01.dbf' SIZE 1M DEFAULT COMPRESS FOR ALL OPERATIONS; SELECT def_tab_compression, compress_for FROM dba_tablespaces WHERE tablespace_name = 'TEST_TS'; DEF_TAB_ COMPRESS_FOR -------- -----------------ENABLED FOR ALL OPERATIONS 22
  • 23. What Can Be Compressed? Partitions CREATE TABLE test_tab_2 ( id NUMBER(10) NOT NULL, description VARCHAR2(50) NOT NULL, created_date DATE NOT NULL ) PARTITION BY RANGE (created_date) ( PARTITION test_tab_q1 VALUES LESS THAN (TO_DATE('01/01/2008', 'DD/MM/YYYY')) COMPRESS, PARTITION test_tab_q2 VALUES LESS THAN (TO_DATE('01/04/2008', 'DD/MM/YYYY')) COMPRESS FOR OLTP, PARTITION test_tab_q3 VALUES LESS THAN (TO_DATE('01/07/2008', 'DD/MM/YYYY')) COMPRESS FOR OLTP, PARTITION test_tab_q4 VALUES LESS THAN (MAXVALUE) NOCOMPRESS ); 23
  • 24. What Can Be Compressed? Key-Compressed Indexes •Creating an index using key compression enables you to eliminate repeated occurrences of key column prefix values. •Key compression breaks an index key into a prefix and a suffix entry. •Compression is achieved by sharing the prefix entries among all the suffix entries in an index block. •This sharing can lead to huge savings in space, allowing you to store more keys for each index block while improving performance. CREATE INDEX emp_ename ON emp(ename) TABLESPACE users COMPRESS 1;
  • 25. What Can Be Compressed? SecureFiles •SecureFile compression does not entail table or index compression and vice-versa. •A server-wide default SecureFile compression algorithm is used. •MEDIUM and HIGH options provide varying degrees of compression. The higher the degree of compression, the higher the latency incurred. HIGH setting incurs more work, but will compress the data better. The default is MEDIUM.
  • 26. What Can Be Compressed? SecureFiles •Compression can be specified at a partition level. The lob_storage_clause enables specification for partitioned tables on a per-partition basis. •SecureFile compression is performed on the server-side and enables random reads and writes to LOB data. Client side compression utilities like utl_compress cannot provide random access. •DBMS_LOB.SETOPTIONS can be used to enable and disable compression on individual LOBs. •LOB compression is applicable only to SECUREFILE LOBs.
  • 27. What Can Be Compressed? RMAN Backups CONFIGURE DEVICE TYPE DISK BACKUP TYPE TO COMPRESSED BACKUPSET; CONFIGURE DEVICE TYPE TAPE BACKUP TYPE TO COMPRESSED BACKUPSET; CONFIGURE CONFIGURE CONFIGURE CONFIGURE CONFIGURE COMPRESSION COMPRESSION COMPRESSION COMPRESSION COMPRESSION ALGORITHM ALGORITHM ALGORITHM ALGORITHM ALGORITHM 'BASIC'; 'NONE'; 'LOW'; 'MEDIUM'; 'HIGH';
  • 29. What Can Be Compressed? RMAN Backups Sample “Medium” Algorithm compression results
  • 30. What Can Be Compressed? Data Pump Backups •The ability to compress the metadata associated with a Data Pump job was first provided in Oracle Database 10g Release 2. •In Oracle database 11g, this compression capability has been extended so that table data can be compressed on export.
  • 31. What Can Be Compressed? Data Pump Backups Full Data Pump functionality is available using a compressed file. Any command that is used on a regular file will also work on a compressed file. Users have the following options to determine which parts of a dump file set should be compressed: •ALL enables compression for the entire export operation. •DATA-ONLY results in all data being written to the dump file in compressed format. •METADATA-ONLY results in all metadata being written to the dump file in compressed format. This is the default. •NONE disables compression for the entire export operation.
  • 32. CONSIDERATIO NS • When compression is specified at multiple levels, the most specific setting is always used • As such, partition settings always override table settings, which always override tablespace settings Compression Object Type Tablespace Table Index OLTP OLTP Partition 1 ARCHIVE LOW Partition 2 ARCHIVE HIGH
  • 33. Hybrid Columnar Two Types Compression • Warehouse Compression • Archive Compression Works with Exadata and now ZFS Storage ZFS Storage can be attached with an ODA as NAS Storage
  • 35. MYTHS • Data is decompressed while being read • Oracle Database does not need to decompress table blocks when reading data. Oracle can keep blocks compressed in memory and read them directly. Hence, more data can be packed in memory which results in improved cache hit ratio and reduced I/O. • Data needs to be recompressed once update • Not true with 11gR2 – COMPRESS WITH OLTP algorithm compresses newer data without uncompressing updated rows.
  • 36. CONSIDERATIO NS • When should I compress? • What should I compress?
  • 37. Compression & Partitioning OLTP Applications • Table Partitioning • Heavily accessed data • Partitions using OLTP Table Compression • Cold or historical data • Partitions using Online Archival Compression • Data Warehouses
  • 38. New Compression Advisors DBMS_COMPRESSION built-in package • GET_COMPRESSION_RATIO • Returns the possible compression ratio for an uncompressed table or materialized view and estimates achievable compression • GET_COMPRESSION_TYPE • Inspects data and reports what compression type is in use by row Enterprise Manager Segment Advisor • Estimates OLTP Table Compression automatically • Advises tables that will benefit from OLTP Compression
  • 39. Compression Ratio Estimate GET_COMPRESSION_RATIO CREATE TABLE comp_test1 AS SELECT * FROM dba_objects; set serveroutput on DECLARE blkcnt_comp PLS_INTEGER; blkcnt_uncm PLS_INTEGER; row_comp PLS_INTEGER; row_uncm PLS_INTEGER; comp_ratio PLS_INTEGER; comp_type VARCHAR2(30); BEGIN dbms_compression.get_compression_ratio('UWDATA', 'UWCLASS', 'COMP_TEST1', NULL, dbms_compression.comp_for_oltp, blkcnt_cmp, blkcnt_uncmp, row_comp, row_uncm, dbms_compression.comp_for_oltp, blkcnt_cmp, blkcnt_uncmp, row_comp, row_uncm, comp_ratio, comp_type); dbms_output.put_line('Block Count Compressed: ' || TO_CHAR(blkcnt_comp)); dbms_output.put_line('Block Count UnCompressed: ' || TO_CHAR(blkcnt_uncm)); dbms_output.put_line('Row Count Compressed: ' || TO_CHAR(row_comp)); dbms_output.put_line('Row Count UnCompressed: ' || TO_CHAR(row_uncm)); dbms_output.put_line('Block Count Compressed: ' || TO_CHAR(comp_ratio)); dbms_output.put_line('Compression Type: ' || comp_type; END; /
  • 40. AGENDA • • • • Overview A Brief History Pre-11g 11g: New Features • Case study of BIAS' implementation for a customer. • Background • requirements • Storage savings achieved; tablespaces and tables
  • 41. CASE STUDY Challenge – 8TB Database Uncompressed and Unpartitioned – ODA had only 2.3TB of usable space. Goals – Compress customer data and achieve similar (if not better) performance – Use Database Replay to simulate workload – Perform Detailed Analysis of Performance Statistics
  • 42. CASE STUDY Hardware – Platform: ODA 2.1.0.3.0 – 2 Nodes running Oracle Enterprise Linux 5.7 64bit – CPU: 24 cores per node – RAM: 96GB per node Database Version – 11.2.0.2 64bit Instance parameters – SGA: 48GB – PGA: 10GB – Block Size: 8K
  • 43. CASE STUDY Data Characteristics Billions of Rows Across Several Tables VARCHAR2 and NUMBER data types Repeating Patterns within each table
  • 44. CASE STUDY Steps – Create a compressed export dump of a schema. – Create compressed tablespaces – in our case for OLTP. – Import Meta data only; users, grants, objects (excluding indexes and constraints). – Alter tables for compression. ALTER TABLE CARBON COMPRESS FOR OLTP;
  • 45. CASE STUDY Steps – Import only table data – with appropriate parallel degree. – Import index creation scripts from export dump. – Alter relevant indexes to add compression factor of 1. – Create indexes with appropriate parallel option. – Import only constraints. – For good measure, generate statistics on the schema.
  • 46. CHALLENGES • • • • What should I compress first? Multiple iterations with import Tweaked level of compression Time is the biggest enemy
  • 47. RESULTS What’s that? You want to see proof of compression?? 8 TB Database, compressed to less than 1.5TB on an Oracle Database Appliance
  • 52. RESULTS Database Replay Results Capture: 3 ½ Hours Replay: Nearly 10
  • 53. RESULTS Database Replay Results •Database was CPU bound •Presumably because indexes were compressed
  • 54. RESULTS Database Replay Results Two INSERT statements are the top consumers (over 75%) of the total sql statements
  • 55. RESULTS Database Replay Results Average Active Sessions show database was CPU bound
  • 56. What Did We Learn? • Compression Ratio’s vary but are mainly dependent on Block redundancy • Choose appropriate compression type • Database Replay (conditions need to be perfect) • Ensure workload capture is done with a consistent backup • Ensure same number of clients can be spawned • Spend adequate time analyzing the results • Patience is golden virtue!
  • 58. Blog: http://blogspot.maazanjum.com Email: maaz.anjum@biascorp.com Twitter: @maaz_anjum Session: 523 collaborate13.ioug.org/eval

Editor's Notes

  1. ----- Meeting Notes (4/10/13 01:06) ----- Stop. Ask the group the following question: Have you implemented or experimented with AC? Yes, keep an eye out for who said yes. ----- Meeting Notes (4/10/13 20:20) ----- The format i'd like to follow today is to go over some of the basic concepts in advanced compression and how i leveraged them to compress the clients data.
  2. ----- Meeting Notes (4/10/13 01:06) ----- Stop. Ask the group the following question: Have you implemented or experimented with AC? Yes, keep an eye out for who said yes. ----- Meeting Notes (4/10/13 20:20) ----- The format i'd like to follow today is to go over some of the basic concepts in advanced compression and how i leveraged them to compress the clients data.
  3. Data compression algorithms have been around for decades, but only today are they being put to use within mainstream information systems processing.  All of the industrial strength database offer some for of data compression (Oracle, DB2, CA-IDMS), while they are unknown within simple data engines such as Microsoft Access and SQL Server. There are several places where data can be compressed, either external to the database, or internally, within the DBMS software Physical database compression Hardware assisted compression - IMS, the first commercially available database offers Hardware Assisted Data Compression (HDC) which interfaces with the 3380 DASD to compress IMS blocks at the hardware level, completely transparent to the database engine.
  Block/page level compression Historical database compression uses external mechanisms that are invisible to the database.  As block are written from the database, user exits invoke compression routines to store the compressed block on disk. Logical database compression Table/Segment, Row level
  4. 9i offered basic compression which was uncompressed if the row was updated. 10g – offered compress with direct load which worked with INSERT INTO APPEND
  5. ----- Meeting Notes (4/10/13 20:20) ----- data pump: with 10g, only meta_data could be compressed with 11g, there is a compression algorithm which compresses the backup file as its written How many of you have used DBFS?
  6. Basic compression is inherited from 10g. Updated rows are uncompressed and would need to be recompressed at a later time – requires downtime, outage etc. This was a good option while using partitioning because, if older compressed partitions were updated, they would need to be recompressed. OLTP compression, new with 11g, is the newer version of BASIC compression. Updated rows are compressed. The last two used with HCC.
  7. ----- Meeting Notes (4/10/13 20:20) ----- lookup or journal table how many in the room actually have a table which is smaller than its index?
  8. ----- Meeting Notes (4/10/13 20:39) ----- tiered approach