TiDB Weekly

News & blog post

The fast advancement of AI and machine learning (ML) technologies are reshaping the way people manage and tune databases. Inspired by the pioneering breakthroughs of automatic tuning, we developed AutoTiKV, a machine-learning-based tuning tool that automatically recommends optimal knobs for TiKV. So far, our exploration of automatic tuning has been rewarding.

Last week, we published a post that discusses AutoTiKV's design, its machine learning model, and the automatic tuning workflow. The post also shares the results of experiments we ran to verify whether the tuning results are optimal and as expected, with some interesting and unexpected findings.

The full post is here:

AutoTiKV: TiKV Tuning Made Easy by Machine Learning

Community

New contributors

tidb:

• waynexia
• Icemap

tikv:

• fky2015

docs-cn:

• 20100507

parser:

• githubFZX

Call for participation

• Coprocessor SIG:

  • Improve the performance of Chunk Encoder
  • Port BinaryJSON
  • Tracing
  • The maximum execution time of Per-request

• More issues to solve for TiDB

• More issues to solve for TiKV

Updates of the week

Progress

Last week, we landed 70 PRs in the TiDB repository, 7 PRs in the TiSpark repository, and 46 PRs in the TiKV and PD repositories.

Critical PRs

TiDB:

• Support the show extended columns statement
• Add the rollback in releaseSysSession
• Add the ClusterEventsStatementsSummary table
• Add the PushTopNDownTiKVSingleGather transformation rule in the cascades planner
• Fix the row count estimation for the unique composite IndexScan of IndexJoin
• Support the read consistency isolation level in the pessimistic transactions
• Support the certificate-based authentication

TiSpark:

• Remove the unexpected Spark version output in release 2.1
• Fix the issue that the prefix index might be incorrect when the charset is not UTF8

TiKV and PD:

• Upgrade etcd to v3.4.3
• Use Commit to clean up the pessimistic locks
• Support split check in the online change configuration
• Support the lock manager in the online change configuration
• Fix the error handling about the RocksDB iterator
• Support deleting the store label by setting it to empty
• Skip the notification for synchronous destroy
• Add ApplySnapshotObserver
• Add the keyvisual service