Weekly update in TiDB

Last two weeks, we landed 87 PRs in the TiDB repositories.

Added

• Support statistic on index data

• Support file sort operator

• Add key prefix length limitation on index

• Support the TIMESTAMPDIFF built-in function.

• Support the CONV built-in function.

• Support the SUBSTR built-in function.

• Support the SIGN built-in function.

• Support the FROM_DAYS built-in function.

• Support the FIELD built-in function.

• Support the FLOOR built-in function.

• Support the SQRT built-in function.

• Add some metrics: #2417, #2419, #2435, #2451, #2460, [#2477])(https://github.com/pingcap/tidb/pull/2477)

• Set a limitation about the key-value count and size in a single transaction.

• Support Rename Table and Alter Table Rename Table statement.

Fixed

• Add a length limitation for logging sql statement when meet sytax error.

• Fix a bug when binary literal has charset prefix.

• Fix a few bugs about optimizer: #2439, #2440, #2452

• Fix a bug about parsing aggragate function.

• Fix a bug about two phrase commit.

• Fix a bug about round function.

• Fix a bug occurs when subquery contains a aggragetion.

• Fix a memory leak in Join Executor.

Improved

• Use cache to store privilege info.

• Refactor correlated subquery optimization.

• Speed up delete statement executor.

• Handle raft entry too large error.

• Change the argument name for displaying version from v to V: keep consistent with pd/tikv.

• Convert distinct to aggragate.

New contributor

• zhexuany

Weekly update in TiKV

Last two weeks, We landed 50 PRs in the TiKV repositories.

Added

• Add -V flag for PD and TiKV.

• Set a limitation for the max size of the raft entry.

• Make disabling manual compaction configurable.

• Add fail reason tag in raft request and coprocessor metrics.

• Add snapshot KV count and size metrics.

• Add count of written keys metric.

• Add raft log lag metric.

• Add thread CPU collector.

• Support compaction_readahead_size for spinning disk.

• Support getting region with key in pd-ctl .

• Statistic region write key-value count and bytes.

Fixed

• Fix a pitfall when use different context package.

• Count KV count in other CF when check splitting.

• Avoid submitting secondary key if primary key is locked.

• Use disk size as storage capacity when capacity is set to 0.

• Check locked for ResolveLock in latch.

Improved

• Keep large integer precision and check integer overflow.

• Check promotable when handle raft MsgTimeoutNow.

• Unify logger.

• Resume paused follower when receive MsgHeartbeatResp message.

• Reset the pending state when add node.

• Allow running one GC command at the same time.

• Guarantee replicas are safe if possible.

• Keep leader alive before initialization.

• Log slow request for scheduler.

• Record scan efficiency for coprocessor.

• Make raft log GC not depend on PeerStorage.

• Accelerate ticks for new split region leader.