Story: Integration Testing: Cluster

[tock-ibm]

This story describes the subjects we need to test during integration testing of the cluster. These may translate into multiple issues connected to this story.

Static cluster

• 3 node cluster
• normal tx submission
• redirection from follower to leader
• node recovery:
  • stop/start follower
  • stop/start leader
  • stop/start all nodes such that all have leadership at one point
  • stop entire cluster, restart
  • decrease size of cluster until no leadership, while submitting TXs, and then start a peer to regain quorum
• check point and catchup
  • configure frequent snapshots
  • stop a node for along time
  • recover such that it requires to catchup

Cluster config

• Admins
• CAs
• Consensus - not membership (Raft params etc)
• Nodes and Peers - non membership (ip, address, cert)
• make sure that only an admin user can get the cluster config and change the cluster config

Dynamic cluster with restart

• expand cluster
• shrink cluster

Dynamic cluster without restart

• expand cluster
• shrink cluster

Intra-cluster security

• check TLS server-to-server
• check mutual TLS server-to-server
• check mutual TLS with authorization