This is the detailed description of what's new in Apache ShardingSphere 5.x

1. New Feature of Apache
ShardingSphere 5.x
Liang Zhang, jddglobal.com,
ShardingSphere VP
APACHECON @HOME
Spt, 29th – Oct. 1st 2020

2. • 京东数科数字技术中心架构专家
• Apache ShardingSphere PMC Chair
• Founder of ElasticJob
Liang Zhang 张亮

3. 1 Data Sharding
2 Distributed Transaction
核心功能
Features
3 Distributed Governance

4. Runtime
Administration

5. Customized Sharding Algorithm
 Inline Expression：t_order_$->{order_id % 8}
 Java Class：xxx.xxx. XXXShardingAlgorithm

6. 1 Data Sharding
2 Distributed Transaction
核心功能
Features
3 Distributed Governance

7. Sharding Transaction
Manager
ShardingSphere-Transaction
Sharding XA
Transaction Manager
Sharding BASE
Transaction Manager
Atomikos
XA Manager
Narayana
XA Manager
Bitronix
XA Manager
XA Transaction SPI
Servicecomb
Manager
BASE Transaction SPI
ShardingSphere
DataSource
Local Transaction API
Seata
Manager
Integrate Distributed Transaction

8. 1 Data Sharding
2 Distributed Transaction
核心功能
Features
3 Distributed Governance

9. 02
01
03
• Dynamic Configuration
• Circuit Breaker
• Highly Available
Service Governance
• Authority
• Data Encryption
• Shadow Database
• SQL Audit
• SQL Firewall
Data Governance
• APM
• Application Topography
• Metrics
• Monitor & Notification
Observability
Features

10. 1 RDL
2 Extensible Kernel
5.x 新功能
New Features
3 Data Scaling（Dev）

11. Automatic Sharding Algorithm
HASH
RANGE
TAGDATETIME
MOD
Example：
 Sharding By Mod
type: MOD
props:
sharding-count: n
 Sharding By Datetime
type: AUTO_INTERVAL
props:
datetime-lower: xxxx-xx-xx
datetime-upper: xxxx-xx-xx
sharding-seconds: n

12. RDL（Rule Definition Language）
 Create Data Sources
CREATE datasources (
ds0=${ip_0}:${port_0}:${schema_0}:${username}:${password},
ds1=${ip_1}:${port_1}:${schema_1}:${username}:${password}
);
 Create Sharding Rules
CREATE shardingrules (
t_user=hash_mod(user_id, 4), t_order=mod(order_id, 16)
);

13. 1 RDL
2 Extensible Kernel
5.x 新功能
New Features
3 Data Scaling（Dev）

15. 1 RDL
2 Extensible Kernel
5.x 新功能
New Features
3 Data Scaling（Dev）

16. Data Migration
Origin
DB_0
New
DB_0
New
DB_1
Origin
DB_1
New
DB_2
New
DB_3
Increment
Inventory

17. ElasticJob

18. Inline Scheduler
Notify
Sharding & Schedule
Sharding & Schedule
Migrate
Execute RDL

19. Middleware: Sharding + Primary Replica + XA + Admin Console
Sharding + Primary Replica Engine
Database protocol
Parser Router Rewriter Executor Merger
Connectors
Native C API, JDBC, ODBC, .NET, PHP, Python, Perl, Ruby, VB
Transaction Engine
Executor XA BASE Other
Control Panel
Config HA & Gov Schedule ObservabilityAdmin
Console
Register Center

20. Middleware -> Database
Distributed Storage
Compute Storage Separation
Distributed Transaction
Elastic Scaling
Consensus Replica

21. Database: RDL + Sharding + Consensus Replica + New Transaction
StorageEngine
Raft Server
ComputeEngine
Database protocol
Connectors
Native C API, JDBC, ODBC, .NET, PHP, Python, Perl, Ruby, VB
Control Panel
Config
LSN
Authority Observability
Schedule
Metadata
HA & Gov
UI
Extensible
Query Compute Transaction
Raft Client Scaling

23. THANK YOU
APACHECON @HOME
Spt, 29th – Oct. 1st 2020
Liang Zhang,
ShardingSphere VP