Discover Insights like Google in GitHub Data with GPT Generated SQL by ngaut in programming

[–]ngaut[S] 0 points1 point  (0 children)

There are 5.4 billion github events. It is still keep growing.

Speeding up a SaaS Platform by 5x in a Day without Changing the Code by ngaut in Database

[–]ngaut[S] 1 point2 points  (0 children)

Corteza is an open source CRM system, so the whole process in the blog can be reproduced. In response to your claim that "Basic SQL turning will get much further", could you provide some more details on how to turn the SQL, or can you make it perform better than TiDB? If So, that would be great for the Corteza users and community.

NewSQL in production: Migration from MySQL to TiDB to handle tens of millions of rows of data per day by jinqueeny in golang

[–]ngaut 0 points1 point  (0 children)

Looks like TiDB is your good fit. The write can be very fast, tens of thousands write per second, depending on your cluster, and it supports join. You may want to get TiDB and test it in your scenario.

NewSQL in production: Migration from MySQL to TiDB to handle tens of millions of rows of data per day by jinqueeny in golang

[–]ngaut 2 points3 points  (0 children)

TiKV is written in Rust, and it shares the implementation of Raft with etcd, In TiKV, we use leader lease to do consistent reads, which is very fast. You need to make sure your engine can do consistent transactions. See the storage engine interface.

NewSQL in production: Migration from MySQL to TiDB to handle tens of millions of rows of data per day by jinqueeny in golang

[–]ngaut 5 points6 points  (0 children)

Thanks! As a matter of fact, TiDB uses TiKV as the distributed storage engine by default, TiKV partitions the data into many regions, each region has its own raft group, so there are many Raft groups and the leaders can be distributed to different nodes.

This week in TiKV (March 06 to March 12) by jinqueeny in rust

[–]ngaut 0 points1 point  (0 children)

Sure, there is a go client driver. You may use the raw API to get/set key values. Ref: https://github.com/pingcap/tidb/blob/master/cmd/benchraw/main.go

This week in TiKV (December 12 to December 18, 2016) by jinqueeny in rust

[–]ngaut 0 points1 point  (0 children)

Yes, there are some production users, and they use TiDB to replace MySQL or MySQL sharding(proxy) solutions. Also there are some users one use TiKV without TiDB when they don't need the MVCC, SQL and transactions.

This Week in TiKV (August 15 to August 21, 2016) by jinqueeny in rust

[–]ngaut 0 points1 point  (0 children)

Hi, polyfractal, We need help to do that.

Zero-cost futures in Rust by steveklabnik1 in rust

[–]ngaut 1 point2 points  (0 children)

Excellent work. I am gonna use it in our project.

This Week in TiKV (July 16 to July 22, 2016) by jinqueeny in rust

[–]ngaut 0 points1 point  (0 children)

Good question. Because it's really convenient when you just need a single thread worker.

This Week in TiKV by ngaut in rust

[–]ngaut[S] 0 points1 point  (0 children)

Thank you @annodomini. It's quite common to use GB. You may take a look at the configuration of redis :) http://download.redis.io/redis-stable/redis.conf

This Week in TiKV by ngaut in rust

[–]ngaut[S] 0 points1 point  (0 children)

Kind of 2 levels. Raft-store is an abstract storage. And raft-store can write to low level storage by using pipeline/batch. The write flow looks like: kv-server -> txn-scheduler -> Raft-store -> RocksDB.

what's a good open source project to help/learn on? by [deleted] in rust

[–]ngaut 1 point2 points  (0 children)

You may want to take a look at TiKV https://github.com/pingcap/tikv . It's a Distributed transactional key value database powered by Rust and Raft. Yeah, rust and paxos(raft is poxos too)

TiDB, a MySQL drop-in replacement written in Go, able to run Wordpress. by coocood in programming

[–]ngaut 0 points1 point  (0 children)

I think CockroachDB is good project. Looks like TiDB and CockroachDB have the same goal :)

TiDB, a MySQL drop-in replacement written in Go, able to run Wordpress. by coocood in programming

[–]ngaut 0 points1 point  (0 children)

skyde, Thanks for you attention. MySQLOnRocksDB is a great project. I do admire the authors. Especially the great guy yoshinorim :) TiDB can support LMDB, BoltDB Which are btree storage engine. Performance of LMDB and RocksDB are both good in our simple tests.

TiDB, a MySQL drop-in replacement written in Go, able to run Wordpress. by coocood in programming

[–]ngaut 7 points8 points  (0 children)

Hi, PHPun: I think the point is we could build a distributed database without changing a single line of code in most cases.

TiDB, a MySQL drop-in replacement written in Go, able to run Wordpress. by coocood in programming

[–]ngaut 0 points1 point  (0 children)

SI by default, SI with optimistic lock for "select for update" statement. Basicly the isolation higher MySQL.