PingCAP
  • Docs
  • Success Stories
  • Blog
  • About
  • Free Consultation
PingCAP
  • Docs
  • Success Stories
  • Blog
  • About
  • Free Consultation

Contact

中文
Weekly
  • 2018(38)
    • 2018-09(4)
      • Weekly update (September 17 ~ September 23, 2018)
      • Weekly update (September 10 ~ September 16, 2018)
      • Weekly update (September 03 ~ September 09, 2018)
      • Weekly update (August 27 ~ September 02, 2018)
    • 2018-08(4)
      • Weekly update (August 20 ~ August 26, 2018)
      • Weekly update (August 13 ~ August 19, 2018)
      • Weekly update (August 06 ~ August 12, 2018)
      • Weekly update (July 30 ~ August 05, 2018)
    • 2018-07(5)
      • Weekly update (July 23 ~ July 29, 2018)
      • Weekly update (July 16 ~ July 22, 2018)
      • Weekly update (July 09 ~ July 15, 2018)
      • Weekly update (July 02 ~ July 08, 2018)
      • Weekly update (June 25 ~ July 01, 2018)
    • 2018-06(4)
      • Weekly update (June 18 ~ June 24, 2018)
      • Weekly update (June 11 ~ June 17, 2018)
      • Weekly update (June 04 ~ June 10, 2018)
      • Weekly update (May 28 ~ June 03, 2018)
    • 2018-05(5)
      • Weekly update (May 21 ~ May 27, 2018)
      • Weekly update (May 14 ~ May 20, 2018)
      • Weekly update (May 07 ~ May 13, 2018)
      • Weekly update (April 30 ~ May 06, 2018)
      • Weekly update (April 23 ~ April 29, 2018)
    • 2018-04(4)
      • Weekly update (April 16 ~ April 22, 2018)
      • Weekly update (April 09 ~ April 15, 2018)
      • Weekly update (April 02 ~ April 08, 2018)
      • Weekly update (March 26 ~ April 01, 2018)
    • 2018-03(4)
      • Weekly update (March 19 ~ March 25, 2018)
      • Weekly update (March 12 ~ March 18, 2018)
      • Weekly update (March 05 ~ March 11, 2018)
      • Weekly update (February 26 ~ March 04, 2018)
    • 2018-02(3)
      • Weekly update (February 12 ~ February 25, 2018)
      • Weekly update (February 05 ~ February 11, 2018)
      • Weekly update (January 29 ~ February 04, 2018)
    • 2018-01(5)
      • Weekly update (January 22 ~ January 28, 2018)
      • Weekly update (January 15 ~ January 21, 2018)
      • Weekly update (January 08 ~ January 14, 2018)
      • Weekly update (January 01 ~ January 07, 2018)
      • Weekly update (December 25 ~ December 31, 2017)
  • 2017(43)
    • 2017-12(4)
      • Weekly update (December 18 ~ December 24, 2017)
      • Weekly update (December 11 ~ December 17, 2017)
      • Weekly update (December 04 ~ December 10, 2017)
      • Weekly update (November 27 ~ December 03, 2017)
    • 2017-11(4)
      • Weekly update (November 20 ~ November 26, 2017)
      • Weekly update (November 13 ~ November 19, 2017)
      • Weekly update (November 06 ~ November 12, 2017)
      • Weekly update (October 30 ~ November 05, 2017)
    • 2017-10(3)
      • Weekly update (October 23 ~ October 29, 2017)
      • Weekly update (October 9 ~ October 22, 2017)
      • Weekly update (September 25 ~ October 08, 2017)
    • 2017-09(4)
      • Weekly update (September 18 ~ September 24, 2017)
      • Weekly update (September 11 ~ September 17, 2017)
      • Weekly update (September 04 ~ September 10, 2017)
      • Weekly update (August 28 ~ September 03, 2017)
    • 2017-08(4)
      • Weekly update (August 21 ~ August 27, 2017)
      • Weekly update (August 14 ~ August 20, 2017)
      • Weekly update (August 07 ~ August 13, 2017)
      • Weekly update (July 31 ~ August 06, 2017)
    • 2017-07(4)
      • Weekly update (July 24 ~ July 30, 2017)
      • Weekly update (July 17 ~ July 23, 2017)
      • Weekly update (July 10 ~ July 16, 2017)
      • Weekly update (June 26 ~ July 02, 2017)
    • 2017-06(4)
      • Weekly update (June 19 ~ June 25, 2017)
      • Weekly update (June 12 ~ June 18, 2017)
      • Weekly update (June 06 ~ June 11, 2017)
      • Weekly update (May 22 ~ June 05, 2017)
    • 2017-05(4)
      • Weekly update (May 15 ~ May 21, 2017)
      • Weekly update (May 08 ~ May 14, 2017)
      • Weekly update (May 01 ~ May 07, 2017)
      • Weekly update (April 24 ~ April 30, 2017)
    • 2017-04(2)
      • Weekly update (April 10 ~ April 16, 2017)
      • Weekly update (March 27 ~ April 09, 2017)
    • 2017-03(4)
      • Weekly update (March 20 ~ March 26, 2017)
      • Weekly update (March 13 ~ March 19, 2017)
      • Weekly update (March 06 ~ March 12, 2017)
      • Weekly update (February 27 ~ March 05, 2017)
    • 2017-02(3)
      • Weekly update (February 19 ~ February 26, 2017)
      • Weekly update (February 06 ~ February 12, 2017)
      • Weekly update (January 23 ~ February 05, 2017)
    • 2017-01(3)
      • Weekly update (January 09 ~ January 22, 2017)
      • Weekly update (January 02 ~ January 08, 2017)
      • Weekly update (December 26 ~ January 01, 2017)
  • 2016(22)
    • 2016-12(4)
      • Weekly update (December 19 ~ December 25, 2016)
      • Weekly update (December 12 ~ December 18, 2016)
      • Weekly update (December 05 ~ December 11, 2016)
      • Weekly update (November 28 ~ December 04, 2016)
    • 2016-11(4)
      • Weekly update (November 21 ~ November 27, 2016)
      • Weekly update (November 14 ~ November 20, 2016)
      • Weekly update (November 07 ~ November 13, 2016)
      • Weekly update (October 31 ~ November 06, 2016)
    • 2016-10(3)
      • Weekly update (October 24 ~ October 30, 2016)
      • Weekly update (October 17 ~ October 23, 2016)
      • Weekly update (October 01 ~ October 16, 2016)
    • 2016-09(5)
      • Weekly update (September 26 ~ September 30, 2016)
      • Weekly update (September 19 ~ September 25, 2016)
      • Weekly update (September 12 ~ September 18, 2016)
      • Weekly update (September 05 ~ September 11, 2016)
      • Weekly update (August 29 ~ September 04, 2016)
    • 2016-08(4)
      • Weekly update (August 22 ~ August 28, 2016)
      • Weekly update (August 13 ~ August 21, 2016)
      • Weekly update (August 05 ~ August 12, 2016)
      • Weekly update (July 30 ~ August 05, 2016)
    • 2016-07(2)
      • Weekly update (July 23 ~ July 29, 2016)
      • Weekly update (July 17 ~ July 22, 2016)
  • Mon, Aug 22, 2016

Weekly update (August 13 ~ August 21, 2016)

Last week, we landed 26 PRs in the TiDB repositories and 15 PRs in the TiKV repositories.

Notable changes to TiDB

  • Upgrade the query optimizer.
  • Upgrade the lexer.
  • Replace golang protobuf with gogo protobuf.
  • Optimize the distributed executor.
  • Repair the Time and Decimal types to improve the compatibility with MySQL.
  • Support the Set names binary statement.
  • Support Covering Index.
  • Optimize the table scanning when the condition is false constant.
  • Fix several bugs.

Notable changes to TiKV

  • Add the leader lease read support for better performance, see benchmark.
  • Use delete_file_in_range from RocksDB to destroy Regions quickly to avoid blocking Raft storage threads.
  • Support GC for obsolete data versions.
  • Coprocessor supports covering index for Select Where and the aggregation operations.
  • Check whether the key is already rolled back when prewrite to fix a transaction bug.
  • Support the --log-file flag to redirect log to the log file.

Notable changes to Placement Driver

  • Refine the join flag to support multiple join scenarios.
  • Use unix socket in test to avoid the “Address Already in Use” error.
  • Redirect requests to the Leader if the current member is a Follower.

Benchmark

Use sysbench to benchmark leader lease read and previous Raft quorum read in 3-node TiKV.

Insert

# Prepare data
sysbench --test=./lua-tests/db/oltp.lua --mysql-host=${host} --mysql-port=${port} \
 --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=$1 \
 --oltp-table-size=5120000 --rand-init=on prepare

# Run benchmark
sysbench --test=./lua-tests/db/insert.lua --mysql-host=${host} --mysql-port=${port} \
 --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=1 \
 --oltp-table-size= 5120000 --num-threads=${threads} --report-interval=60 \
 --max-requests=1280000 --percentile=99 run

|Threads|Leader lease read qps|Leader lease read avg/.99 latency|Raft quorum read qps|Raft quorum read/.99 latency| |—|—|—|—|—|—| |32|2296|13.93⁄15.28|1315|24.33⁄94| |64|2199|29.1⁄145|1325|48.29⁄473| |128|1854|69⁄931|1290|99⁄697|

As we can see, the qps is increased by about 70%, and the latency is decreased by about 40%.

Select

# Prepare data
sysbench --test=./lua-tests/db/oltp.lua --mysql-host=${host} --mysql-port=${port} \
 --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=1 \
 --oltp-table-size=5120000 --rand-init=on prepare

# Run benchmark
sysbench --test=./lua-tests/db/select.lua --mysql-host=${host} --mysql-port=${port} \
 --mysql-user=${user} --mysql-password=${password} --oltp-tables-count=1 \
 --oltp-table-size=5120000 --num-threads=${threads} --report-interval=60 \
 --max-requests=1280000 --percentile=99 run

|Threads|Leader lease read qps|Leader lease read avg/.99 latency|Raft quorum read qps|Raft quorum read/.99 latency| |—|—|—|—|—|—| |32|21010|1.52⁄7.53|12221|2.62⁄6.69| |64|25948|2.47⁄10.20|12637|5.06/11.62| |128|27283|4.69⁄13.68|11069|11.56⁄35.88|

As we can see, the qps is increased by about 130%, and the latency is decreased by about 50%.

New contributors

  • hhkbp2

Product

  • TiDB
  • TiSpark
  • Roadmap
  • TiDB Cloud

Docs

  • Quick Start
  • Best Practices
  • FAQ
  • TiDB Utilities
  • Release Notes

Resources

  • Blog
  • Weekly
  • GitHub
  • TiDB Academy
  • TiDB Community

Company

  • About
  • Careers
  • News
  • Contact Us
  • Privacy Policy
  • Terms of Service

Connect

  • Twitter
  • LinkedIn
  • Reddit
  • Google Group
  • Stack Overflow

© 2018 PingCAP. All Rights Reserved.

中文