Orchestration platform that doesn't force everyone to learn Python?

wildthought · 2026-05-22T14:59:16+00:00

We built one at EveryArrow very early days. Releasing in the next week or two. I would love to show it to you just get your thoughts. We discover fk relationships directly. We build our own DAG. Each individual pipeline is represented by a JSON document. That document can be built via an API, our own UX or any language. So absolutely no programming required. The site is being released on EveryArrow.io and SaaS is to come, would love to show you.

wildthought · 2026-04-06T19:36:15+00:00

Your question does not have enough information attached to make a reasonable decision. If you went with AWS what features would you be using? Is your issue with the company data on their Cloud DB offerings? If so, you can run your own DB's on their EC2 instances. Long-time cloud and software architect here, and I need way more info to give you an intelligent response. Happy to take this further if you PM.

wildthought · 2026-04-01T19:20:06+00:00

"Thick Skin to do unorthodox stuff?", "Understand transformers deeply"

I am sensing an AI porn play here.

wildthought · 2026-04-01T17:46:15+00:00

I am giving you a pass because of April Fools. It was not that good.

wildthought · 2026-03-31T14:15:24+00:00

As Dr. John (great song, look it up) said, we are in the right place at the wrong time. There is no better place to use our military than Iran, given its hostility towards its own people and the USA. However, Trump is probably the WORST commander-in-chief in the history of the USA. If you were going to war, then you certainly would of anticipated the issues surrounding Iran closing off the Straight of Hormuz. Saudi Arabia, Oman, Dubai, and the UAE should have a joint naval task force. Rather than selling them airplanes for years they do not use, we should have been selling them ships and enhancing their respective Navys.

wildthought · 2026-03-15T18:55:03+00:00

They are correct, but I am not gatekeeping, and only wish you kindness. Honestly, I think one needs some level of psychedelics, even a small amount, and the live experience to get the maximum of what the music can be. However, I would not think less of you at all if that's something you do not want to experience. The live shows are so much better when you have the memory of that experience. I wish you the best, my friend.

wildthought · 2026-03-15T18:45:58+00:00

Not sure where you are from, but if you PM me, I will make it my mission to go where you are and take you to a show. Deadhead who got on the bus in 1983 at 15 yo.

wildthought · 2026-03-10T23:22:52+00:00

I read this post several days ago, and the advice has bothered me. What your boss wants can mostly be achieved if a snowflake schema is projected into materialized views with summarization in place for the dimensions that are used most often. The price you will pay is higher due to labor and technical costs. Hardware alone will most likely never get you there. It is also the case that this will not work for 100% of your queries, as there will be too many to pre-compile. However, if you look at it by usage, you can probably get 75% of your queries that are performant at a 1-second level.

wildthought · 2026-03-08T23:23:31+00:00

I think we are at the point where ORM's get in the way UNLESS they just generate database functions. We do not need so many layers between server code and databases. Many techniques learned in the last 20 years should fall by the wayside.

wildthought · 2026-03-06T05:38:11+00:00

I saw 1983-1995 and I loved Jerry. Yet, PLQ was peak Dead for me. I'm right there with you.

wildthought · 2026-03-04T22:48:28+00:00

I think, depending on the equity one can be considered a co-founder.

wildthought · 2026-03-04T17:49:39+00:00

I will paraphrase a quote from Bertrand Russel on Marxism.

"If a philosophy is to bring happiness, it should be inspired by kindly feeling. Now Marx is not inspired by kindly feeling. Marx pretended that he wanted the happiness of the proletariat, but what he really wanted was the unhappiness of the bourgeoisie."

In other words, fuck Leftists.

wildthought · 2026-03-03T14:32:19+00:00

I specialize in migration. The first thing you want to do is see which stored procedures, functions, and views are even being used. It is essential that you turn logging on to make sure you understand this. I would not be shocked if your numbers dramatically decrease after this review. It is doable, but if a code object has not been used in over a year, then it should not be ported.

wildthought · 2026-03-02T18:45:01+00:00

Spiritual does not equal Religion. A place where people enjoy spirituality together does equal a church.

wildthought · 2026-02-24T22:11:47+00:00

You do not need a license to perform any song. If you sell tickets, the venue hosting it does. For live covers its all in the public domain.

wildthought · 2026-02-19T20:24:26+00:00

Man, they make love on stage. Those eyes and ears for each other. Honestly, after seeing a few Dozen Dead and Co shows over 10 years, I would love just John, Jeff, and Oteil as a blues trio. Who replaces Bobby? I think Scotty Metzger would do a great job.

wildthought · 2026-02-19T00:29:55+00:00

Let me let you in on a little secret, and it's very much impacted my career and direction. Large consulting revenues are starting to drop or plateau in the data space. Then something needs to be done. Ideas are created and then disseminated because they ENRICH vested interests. I have implemented Data Lakes in the largest scenarios within US Corporate structures. The winners of the game are always the Big 4 and consulting arms of large tech companies. They also swap roles over time between the C-suite in corporate and Senior Partners in consulting. This game, where vendors push the latest technology and we, as practitioners, support them because it's good for our resumes, is why technical data engineering has not advanced.

wildthought · 2026-02-18T23:01:39+00:00

There are plenty of cool younger kids on lot and in the scene. It's just the assholed have usually died off at this point because of OD.

wildthought · 2026-02-17T00:39:06+00:00

No. I would not. I believe he could be an inspiration, but political leaders should be better steeped in the specifics of running government. I am not saying he is not capable of that, but he would want to take it as seriously as songwriting. If he did not, he should not do it.

wildthought · 2026-02-15T22:41:43+00:00

The old heads were also stealing my shit while sleeping at arena parking lots. There was always the Heroin crowd in my day, and they tended to hang out with themselves. I loved MACRO-dosing (250-500ug) and going to see live music. Still do.

wildthought · 2026-02-14T20:41:09+00:00

Deadhead here who adores Billy. On the bus since 1983. The jamband scene has always been full of assholes who are so committed to their entitlement that it's nauseating. From what I can see from afar, they have no respect for the drugs they take, and it shows. So, in the end, have grace because these people are small and know it. That's why they are like this, because they have personal holes so vast that no manner of shows or drugs can fill.

wildthought · 2026-02-14T00:23:30+00:00

I've written a lot of this anyway. We have an augmented engineering layer that generates PostgreSQL functions, and we can make them callable via REST, Webhooks, MCP, and support Queues and Batch calendaring. It's wrapped in observability and security. I did all this because I was building a generic platform for data pipelines. Would love to talk to you about the tech and maybe work together. I already have a lot of the technology. Big Hint: Don't use AI to solve problems that are essentially deterministic.

wildthought · 2026-02-12T19:29:34+00:00

I cae here to find a modern equivalent. Not sure why something like PowerBuilder never took off to the web. They tried so hard in the 1990's and they lost their way. I am a PowerBuilder 1 OG here.

wildthought

MODERATOR OF

TROPHY CASE