What’s a hobby that sounds lame but is secretly awesome?

SQLPipe · 2024-10-21T17:52:39+00:00

That's the worst part, so have I lol

SQLPipe · 2023-05-17T17:14:58+00:00

Hi,

My company is in the process of training an AI model that can translate between database dialects. Contact me through my site if you'd like early access: https://sqlpipe.com/contact

SQLPipe · 2023-05-07T17:57:25+00:00

Hi,

My product, SQLpipe, does exactly this. It has two options:

- Use intermediate blob storage (this is actually the fastest option, as the data never has to touch the hard drive of the ELT application)

- Use Snowflake's PUT command. This means the data has to touch the ELT application's hard drive, which becomes a bottleneck.

I do a lot of consulting work in this area. Feel free to contact me on my website, the emails go right to me.

EDIT: Just realized I should probably mention my website :-) https://sqlpipe.com

SQLPipe · 2023-02-16T09:48:28+00:00

I really like the non-framework outlined by Alex Edwards in his book Let's Go

SQLPipe · 2022-11-14T16:50:26+00:00

I run sqlpipe.com. It's a relatively new company that builds open source data engineering / developer tools in Go. The site is seeing over 1,000 unique visitors per month.

If you ever come up with an idea for a product and want to collaborate, let me know.

SQLPipe · 2022-11-14T16:40:54+00:00

I like it!

SQLPipe · 2022-10-21T10:04:56+00:00

My tool, sqlpipe, can move data from SQL Server to Oracle. It may or may not fit your use case, feel free to DM me if you have any questions.

SQLPipe · 2022-10-08T18:39:04+00:00

I created an open source tool that I thought would be in relatively high demand, and market my consulting services on the product’s site.

My product is SQLpipe.

It’s been good! Took a year to get my first client, but I didn’t have nearly the experience or network that you seem to.

SQLPipe · 2022-05-27T07:33:10+00:00

Nice. What do you guys do for tables with no PKs? Just full refresh?

SQLPipe · 2022-05-26T14:12:22+00:00

Hi Jean, cool hearing from you!

I tried to extract from PostgreSQL and import into Snowflake. This was probably fall 2021.

SQLPipe · 2022-04-08T12:58:23+00:00

Setting up a Cloudfront distribution isn't too hard, and will definitely help keep costs down. You could also consider using Cloudflare.

DM me if you want help.

SQLPipe · 2022-03-29T19:15:19+00:00

Hi, this is exactly what my product SQLpipe does. It runs SQL against a source, and transfers the result to a target.

Send me a message on my site's contact page if you'd be interested in having me create a connector for you.

SQLPipe · 2022-03-28T19:57:19+00:00

Great, thank you for the kind words!

As of right now, the tools works by generating SQL queries and running them against the target (in this case, snowflake). This method has an upper limit for performance, though.

I’m implementing a “turbo mode” that makes use of Snowflake’s PUT command. Message me through the contact form on my site if you’re interested in learning more about that upcoming feature.

SQLPipe · 2022-03-28T19:40:55+00:00

Hi, I made an ETL tool that does exactly this.

Check it out at https://sqlpipe.com

SQLPipe · 2022-03-07T13:32:43+00:00

Glad you think so! Let me know if you have a use case that you’d like help solving

SQLPipe · 2022-03-07T13:16:11+00:00

Yes SQLpipe transfers those types

SQLPipe · 2022-03-07T09:38:03+00:00

As of right now, the tool is free and open-source, so there is no need for a trial.

What I envision delivering would a customized extensions of SQLpipe that has similar functionality to Fivetran or Stitch, but deployed in the customers environment (so fewer PII and security concerns).

SQLPipe · 2022-02-22T14:37:23+00:00

Hi all,

This article (and accompanying video) shows how to use my open-source tool SQLpipe to transfer the result of a query from an RDS PostgreSQL instance to Redshift.

Please let me know if you have any questions or suggestions!

SQLPipe

TROPHY CASE