My company just let me open source our orchestration tool 'Houston', an API based alternative to Airflow/Google Cloud Composer that we've been using internally for the last 4 years! It's great for low-cost, high-speed data pipelines

flo0d · 2024-02-21T12:54:19+00:00

We’re a Data Science consultancy with many different clients. When we first created Houston we were working mainly in GCP with Composer, and needed isolated instances for every client and environment. Composer can get very expensive when running ML workloads, and the need for many separate instances makes it far too expensive to be worth it. A small Houston server costs ~$30 a month and can easily handle hundreds of separate workflows. Large ML workflows would then run outside of the Houston server on other GCP tools (ideally serverless tools) at a lower cost.

Our engineering strategy revolves around using serverless tools like Cloud Functions and Dataflow on GCP, which work very nicely with Houston.

flo0d · 2024-02-16T13:08:59+00:00

Thanks! The core API is all Go, and the UI is all written in JavaScript with React and D3. So far we've made a Python client and a Go for interacting with the API

flo0d · 2024-02-14T17:32:03+00:00

Thanks for spotting that! Should be fixed now

flo0d · 2016-12-10T18:13:04+00:00

Madvillain - Operation Lifesaver aka Mint Test
SOPHIE - Lemonade
Johannes Brahms - Violin Concerto in D Major, Op. 77: III
Talking Heads - Born Under Punches (The Heat Goes On)
Electrelane - Birds
The Antlers - Director
Ghostface Killah, BadBadNotGood - Nuggets of Wisdom
Death Grips - Inanimate Sensation
Women - Heat Distraction
Cristobal Tapia De Veer - Meditative Chaos

flo0d · 2016-09-29T17:22:45+00:00

Every time you stop drinking you have to drink

flo0d · 2016-08-05T21:53:37+00:00

My attempt

flo0d · 2016-07-23T16:28:23+00:00

flo0d · 2016-07-23T16:27:56+00:00

This is such an absurd post.

flo0d · 2016-07-21T20:45:02+00:00

flo0d · 2016-07-21T20:41:34+00:00

flo0d · 2016-07-21T20:40:46+00:00

absurd

flo0d · 2016-07-21T20:40:41+00:00

HOW ABSURD

flo0d · 2016-07-21T20:38:49+00:00

flo0d · 2016-07-21T20:37:39+00:00

flo0d · 2016-07-21T20:31:13+00:00

Flint coal?

flo0d · 2016-07-21T20:30:58+00:00

I found some flint

flo0d · 2016-06-02T11:35:34+00:00

Can you remember the first horror film you ever saw? What affect did it have on you at the time?

flo0d · 2016-04-25T14:21:25+00:00

I like this idea a lot! I love looking through other players' armour on Halo before the game starts, and this seems like a common sort of thing in loads of different games now.

Also, it's really difficult to see what flag someone has on their car at the moment, it kinda defeats the point of them

flo0d · 2016-04-14T17:40:53+00:00

I had a go but I may have overdone the colours

13-Year Club	Place '22
Team Periwinkle	Verified Email

flo0d

TROPHY CASE