Introduce JVM chaos to ShardingSphere

[mlycore]

Apache ShardingSphere

Apache ShardingSphere is positioned as a Database Plus, and aims at building a standard layer and ecosystem above heterogeneous databases. It focuses on how to reuse existing databases and their respective upper layer, rather than creating a new database. The goal is to minimize or eliminate the challenges caused by underlying databases fragmentation.

Page: https://shardingsphere.apache.org/
Github: https://github.com/apache/shardingsphere 

Background

There is a proposal about the background of ChaosEngineering as belows:

• Introduce ChaosEngineering for ShardingSphere #32

And we also proposed a generic controller for ShardingSphereChaos as belows:

• [GSoC 2023] Introduce New CRD ShardingSphereChaos #272

The ShardingSphereChaos controller is aiming at different chaos tests. This JVMChaos is an important one.

Task

Write several scripts to implement different JVMChaos for main features of ShardingSphere. The specific case list is as follows.

• Add scripts injecting chaos to DataSharding
• Add scripts injecting chaos to ReadWritingSplitting
• Add scripts injecting chaos to DatabaseDiscovery
• Add scripts injecting chaos to Encryption
• Add scripts injecting chaos to Mask
• Add scripts injecting chaos to Shadow

Basically, these scripts will cause unexpected behaviour while executing the related. DistSQL.

Relevant Skills

1. Master Go language, Ginkgo test framework
2. Have a deep understanding of Apache ShardingSphere concepts and practices.
3. JVM byte mechanisms like ByteMan, ByteBuddy.

Targets files

JVMChaos Scripts - https://github.com/apache/shardingsphere-on-cloud/chaos/jvmchaos/scripts/

[wbtlb]

Please assign this issue to me ,thanks.

[mlycore]

Thanks @wbtlb

[wbtlb]

In the native chaos mesh, the injection and chaos testing of the basic jvm are realized by writing byteman scripts. In order to realize the chaos test unique to ShardingSphere, there are some basic prerequisite tasks to do:

• confirm ShardingSphere hook point and the architecture of ShardingSphere.
• Write Byteman scripts for ShardingSphere.
• Use ASM can implement complex dynamic pile load test.

[Jacob953]

I'd like to help on this issue, assign it to me too, plz ;)

[mlycore]

I'd like to help on this issue, assign it to me too, plz ;)

Thanks. This issue could be decomposed into smaller one. Please file a new issue and attach to this one.

[mlycore]

I think we should prepare not only the Chaos test itself, but also the load generator. Such as a Golang program which can continuously doing some DistSQL Job to ShardingSphere.

[mlycore]

#32 (comment)