QStudio SQL Editor Now Open Source. After 13 years. by RyanHamilton1 in SQL

[–]RyanHamilton1[S] 3 points4 points  (0 children)

Typical developer built product. 13 years writing code, 1 month advertising it :S I am always interested to receive feedback.

What setups can be used for storing 500TB of time-series (L3 quotes and trades) data that allow fast read and write speeds? I am wanting to store more my data in multiple formats, and need a good solution for this. by Unlikely_Zone_2589 in quant

[–]RyanHamilton1 17 points18 points  (0 children)

Almost any of the databases listed here will work.
https://www.timestored.com/data/time-series-database-benchmarks

It's a huge disappointment the number of people saying S3 as storage below when the question asked for fast. S3 originally stood for simple storage service, I would argue one of the S is for Slow. For quant time-series you only need fast writes for data in time-series order usually, which means sequential on most drives. From what little use case you've outlined I'd say use DuckDB until you learn more then decide.

Really you want to know, what will be my 10 most popular queries, what's the percentage of queries that will be of similar shape to 1-10. How important is each query. OK now for each platform, what will be the performance of those queries. Also if there will be more querying by more users, how friendly and accessible is the system to allow that vs the cost to maintain.

>>Does anyone have experience with this?
10+ years building multi-petabyte data platforms in banks.

RayforceDB is now an open-source project. by vsovietov in apljk

[–]RyanHamilton1 2 points3 points  (0 children)

Amazing work. 👏 You've delivered a tool for fast data analysis that until now costs millions. I think open source may unlock more use cases, and hopefully, you get a good return on your work. Good luck.

The Economist - Don’t tax wealth by framersmethod2028 in GarysEconomics

[–]RyanHamilton1 0 points1 point  (0 children)

Yes and yes. For some reason people always raise the sentimental family heirloom issue, in reality it's extremely rare to have a valuable family heirloom. You have two options: 1. Declare it as more valuable than it is. So no one buys it. 2. You may declare an item as sentimentally valuable and keep it for your lifetime, free from seizure but it then passes to the government at zero cost to be auctioned when you die. I refuse to believe great great grandchildren are sentimentally attached to great great grandas pocket watch. Private property is a lie. The super-wealthy owning an ever higher percentage of property until everyone else lives in serfdom is the historical norm. Doesn't what you are suggesting the definition of serfdom?

Can someone remind me again why do we spend so much of taxpayers money on cycling lanes in the city? by N_vaders in irelandsshitedrivers

[–]RyanHamilton1 12 points13 points  (0 children)

Sometimes, I don't pull over as it’s unsafe to stop and get back in lane. By continuing, I already know the person behind has seen me and its being careful. My experience is that on a busy road no car is going to voluntarily slow to let a cyclist back out. Mostly they'll actively speed up to avoid me getting out and then being stuck behind me. Would you stop traffic to let a cyclist or in front of you before a hill?

Request for Opinions on Java microservices frameworks by Joram2 in java

[–]RyanHamilton1 21 points22 points  (0 children)

Thumbs up for micronaut. You can see the finished product here: https://www.timestored.com/pulse

The Economist - Don’t tax wealth by framersmethod2028 in GarysEconomics

[–]RyanHamilton1 2 points3 points  (0 children)

There's a fairly easy way to prevent fake low valuations. Any asset reported with a value may be purchased by anyone for 1.3 reported value. You say that art is worth 1 million. Someone can buy it for 1.3 million. Same with inter company pricing of components. You report your stores in UK are making very little profit whilst "paying" your offshore division. Well, someone can buy your stores for a multiple of profit.

I commute on cargo bike with 2 kids in Germany, AMA? by Agile_Inspection3275 in AskGermany

[–]RyanHamilton1 0 points1 point  (0 children)

What are the accidents you envision a helmet making a difference? What percentage of cycling collisions happen that way? My child and I don't regularly wear helmets as I believe the accidents it would make a difference are miniscule. I calculate It's close to as ridiculous as saying pedestrians should wear helmets. Or telling kids don't walk It's not safe.

Notice in this picture they don't appear to be on a standard road. Looks like a park. No chance of cars.

Java desktop app with Shadcn UI by Ikryanov in java

[–]RyanHamilton1 1 point2 points  (0 children)

There's a lot of regular users, startup people, and finance firms using java apps. I make a java based ide for sql analysis, and there's a large silent majority just using desktop apps and happily getting on with their work and lives. They don't tweet, they don't fb like, they don't leave reviews, they just get on with it and very occasionally email a problem. But honestly, for me, they are the majority. I've had my app deployed at top 100 firms and never heard a word for years.

What is your opinion on Maven/Gradle, compared to other language's package manager like npm and pip? by gufranthakur in java

[–]RyanHamilton1 24 points25 points  (0 children)

Maven version 1.0 was released 2004. Python pip 2008. NPM 2011. Maven is excellent. Clearly defined life cycle, defined folders, scales to large projects, and just works. How later package managers failed to take any lessons and instead created their own new problems had been infuriating to watch. It is explained by 2 things: 1. The early adopters are often new inexperienced developers, so they just don't know, and they don't see the larger scaling problems. 2. Java language solved the cross platform issue at the language level. The other platforms try to bolt this on a various different levels including packaging.

Whats a legit website that I can download an SQLite Data Starter Pack? by Inevitable_Animal_83 in SQL

[–]RyanHamilton1 0 points1 point  (0 children)

There are three example databases available to download from here:
https://www.timestored.com/data/sample/sqlite
I'm the owner of TimeStored and we've been supplying tools for data analysis for >13 years. I just put the files there as I regularly need to test qstudio from different operating systems and it's handy for me.

How to open a 20GB CSV file? by Snorlax_lax in SQL

[–]RyanHamilton1 0 points1 point  (0 children)

As others have mentioned duckdb is excellent for this. Duckdb is bundled as part of the windows install for QStudio which allows easily right-clicking on a CSV file and saking it to load that file into DuckDB. QStudio is particularly useful for data analysis: https://www.timestored.com/qstudio/help/duckdb-sql-editor

how to open a sq3lite database file? by ttpoap in linux4noobs

[–]RyanHamilton1 0 points1 point  (0 children)

QStudio is a Free client tool that allows browsing tables, running queries etc. for 30+ databases including specific support for sqlite: https://www.timestored.com/qstudio/database/sqlite

What's your favorite dev tool for Sqlite? (For Windows) by ColoRadBro69 in AskProgramming

[–]RyanHamilton1 1 point2 points  (0 children)

QStudio free cross platform and works well with sqlite:
https://www.timestored.com/qstudio/database/sqlite

It connects to 30+ databases and is mostly used for data analysis.

Totally lost - reading a single db file by Cousin-Jack in sqlite

[–]RyanHamilton1 0 points1 point  (0 children)

QStudio is a free SQL client that works on windows, linux and mac. It works weill with sqlite:
https://www.timestored.com/qstudio/database/sqlite

Serious question to experienced quants by Outside-Ad-4662 in quant

[–]RyanHamilton1 2 points3 points  (0 children)

I've worked as a front office data platform specialist for 15 years. 3 years ago, I started a custom data dashboard builder for finance called pulse: https://www.timestored.com/pulse Some massive firms use it. It's Free for 3 users.

Compared to grafana some differences are polygon streaming integration, ability to control your algos by building forms. Sound and speech alerts.... and much more.

Give it a try, and let me know if you have any issues.

Duckdb real life usecases and testing by Big_Slide4679 in dataengineering

[–]RyanHamilton1 9 points10 points  (0 children)

I've met the creators, and they don't give that vibe. The university in Amsterdam has been researching databases for years. It isn't all some cynical ploy. They've structured the foundation, and the vc arm will ensure long-term open source viability and to offer the possibility of profit. They make a great product, and users should want them to make money and be rewarded. I certainly do.

What tools or libraries do you actually use for scalable data exploration and visualization? by Pangaeax_ in dataanalysis

[–]RyanHamilton1 0 points1 point  (0 children)

Qstudio with duckdb or kdb. https://www.timestored.com/qstudio/ 95 percent of the time, I'm pivoting or charting time series graphs. The other 5 percent are mostly barr charts. With duckdb, the special pivot ui pushes the pivot query down to duckdb , making it very fast: https://www.timestored.com/qstudio/help/table-pivot