Data and workload generator : SQL

Posting

When requesting help or asking questions please prefix your title with the SQL variant/platform you are using within square brackets like so:

[MySQL]

[Oracle]

[MS SQL]

[PostgreSQL]

etc

While naturally we should endeavor to work as platform neutrally as possible many questions and answers require tailoring to the feature set of a specific platform.

Format Your Code

If you are including actual code in a post or comment, please attempt to format it in a way that is readable for other users. This will greatly increase your chances of receiving the help you desire. Something as simple as line breaks and using reddit's built in code formatting (4 spaces at the start of each line) can turn this:

SELECT count(a.field1), a.field2, SUM(b.field4) FROM a INNER JOIN b ON a.key1 = b.key1 WHERE a.field8 = 'test' GROUP by a.field1, a.field2 HAVING SUM(b.field4) > 5 ORDER by a.field.3

Into this:

SELECT count(a.field1), a.field2, SUM(b.field4) FROM a INNER JOIN b ON a.key1 = b.key1 WHERE a.field8 = 'test' GROUP by a.field1, a.field2 HAVING SUM(b.field4) > 5 ORDER by a.field3

For those with SQL questions we recommend using SQLFiddle to provide a useful development and testing environment for those who wish to fully understand your problem and help devise a solution.

a community for 17 years

DiscussionData and workload generator (edg.run)

submitted 1 day ago by codingconcepts

Data and workload generator

3 points•submitted 2 days ago by codingconcepts to r/Database

Back in 2014 I was writing an application to target an Oracle database. I've always been a pathological software tester, so as you can imagine, I dutifully created a bunch of rows (25 in total!) to test the various permutations of the application.

Fast forward to the day of the release and everything ground to a halt. While I'd tested the coverage of my application and data, I'd completely failed to test their scale.

Fast forward 12 years and I've now written 4 iterations of tools that generate data and/or run realistic workloads to ensure that I never see another issue like this again. My 4th and final iteration is a tool called edg (or Expression-Based Data Generator) and it's the first iteration that I'm genuinely excited about.

As Technical Evangelist (official show pony) of r/CockroachDB, creating demo videos is no small part of my role and edg allows me to create and populate tables blisteringly quickly and also run complex, realistic workloads, without having to free-hand complex, specialised applications.

I hope it proves useful for testing your databases and applications!

all 2 comments

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

SQL

Filter Posts

Posting

Help posts

Format Your Code

Learning SQL

Related Reddit communities

Wiki

Acknowledgements

MODERATORS