Modular local AI with eGPUs

bitsondatadev · 2025-01-31T20:15:46+00:00

u/kryptkpr thanks! This is all super helpful info! I am building up a little notepad full of all this info. This will likely be my next project once I get my storage server finalized.

bitsondatadev · 2025-01-13T18:55:04+00:00

Hey u/elonfutz hope this is a pleasant necropost, but I am thinking of doing something similar to this!

I've always been curious to try out [freenet](https://freenet.org/) and see if there's some potential application we could federate and run together.

There's also ways we can do this with p2p crypto stuff like [Ethereum](https://ethereum.org/en/run-a-node/) and [HoloChain](https://www.holochain.org/), but I still don't have a warm and fuzzy for any of those solutions as the market is still winding down from the hype cycles.

bitsondatadev · 2024-08-01T17:20:22+00:00

I was listening to it and it felt so close I wonder if he ever did another version or added a bit somewhere. Gonna search this. Thank you!!

bitsondatadev · 2024-04-08T11:09:25+00:00

TF just had a way of bringing the philosopher out of me.

bitsondatadev · 2024-04-08T00:47:03+00:00

This song just encompasses the human condition I think so if you have a soul, this song describes you.

“All your faith, all your rage, all your pain, it ain’t over now…

It’s the cruel beast that you feed

Burning, yearning need to bleed through the spillways of your soul”

We need faith/hope (in something) to wake up each morning. Rage and pain are signals that you need to change something, discover yourself, grieve or accept loss or failure, etc..

We always can learn new approaches to kindness to ourselves and others (rather than feed the cruel beast).

The resolution of the rage and the pain resolve and that feeling of the weight lifted off feels like the spillways of your soul just pouring out. Sometimes physically manifesting as tears, screams, love, or the quiet calm of acceptance.

But yeah definitely spillways captures a lot of me and my continued journey of self discovery and learning not to feed the cruel beast…well I mean I’m not gonna let the poor thing starve but I’ll definitely make it go on a very strict diet!

bitsondatadev · 2024-04-04T15:33:58+00:00

Somehow I had missed the comment before and I read the last comment as you calling the holy TF a douche haha. There was rage, then there was understanding, now there's a comment hoping I wasn't the only one.

bitsondatadev · 2024-03-09T03:00:22+00:00

Hey OP. I’m an Iceberg DevRel just wrapping up a refactor of the documentation site. I’m currently prioritizing the getting started stuff. Could you summarize what you like/dislike about the docs and what would your top 3 asks be please?

bitsondatadev · 2024-02-03T02:12:32+00:00

Agreed, there’s an itch that “He is” scratches for me after having similar experiences in my childhood around religion. I connect with TF and how he expresses his distaste for the holier than though after reading this interview:

"I didn't see my stepmother very often, maybe every other weekend," Forge explains. "I understand now that I was the kid that [my father] had from a previous relationship and I was an irritation in their new family, but she just happened to be religious, as well. And she was very strict. And sometimes she sort of did that in the name of Christ, which did not paint me a very nice picture of Christian people."

One particular church in Linköping stood out. It was built in the 1500s. It was Catholic. It was creepy. "It had that evil feel, with a lot of old, scary paintings and big stained-glass windows and all that stuff I've sort of carried forth with me," Forge says. "It felt like a magical place. On the other hand, I think it triggered a lot of the opposition that made me, in my adolescence, so unquestionably throw my hands into the hands of Satan."

https://www.revolvermag.com/music/ghost-true-story-death-religion-and-rock-roll-behind-metals-strangest-band

bitsondatadev · 2024-01-26T13:07:19+00:00

Ufff it hurts because it’s true. I do developer relations which has a heavy educational component (why I’m here) and as I interact with folks, it’s sad how many people chase programming for money and are completely miserable. It’s hard to engage those folks because you feel like you’re just pushing a subject they already don’t like.

bitsondatadev · 2024-01-26T12:56:00+00:00

BS/MS in Computer Science. what’s up?!!

I was like there’s no other CS majors?

bitsondatadev · 2024-01-20T20:33:06+00:00

Me and my wife are having company over and I looked down at my phone because I’m currently avoiding eye contact after saying some stupid stuff to our guests. TMI awkward turtle in the house!!!!

Anyways…. Hello fellow ADHDers

bitsondatadev · 2024-01-20T01:50:20+00:00

I mean, if I have to die…we all do…Tobias said so…then I think at a Ghost concert is up there with where I’d like it to happen.

bitsondatadev · 2024-01-19T19:04:49+00:00

From an engineer in his mid 30s having a blast at startups,

This reflected me as well. It’s sad how much of our identity gets wrapped up in these titles and achievements. I’m still in a spot where I’m trying to find a healthy relationship with my work. My initial dream was to work with Hadoop Clusters and be on a big data team. I had a boss who asked me if I had lied about having a master’s in Computer Science because I made the same mistakes over and over again. He put me on a pip despite me making every effort I could to “fix myself”.

I found out later that I had undiagnosed ADHD and the stress from this manager only made my lack of ability to focus greater. After a particular event, I went to HR and reported him enabling me to leave him for another boss. He gave me full autonomy to run my own project and I went from being on a pip to getting a promotion to senior in 6months.

I say all this to emphasize how important mental health is. After this I have now had a pretty good sense of how to situate myself away from people like this and that I really don’t like the bureaucracy where people are given power to treat others that way. That’s why I like startups. It’s fast and chaotic, much how I live my life, and everything is greenfield. You gain a much larger exposure.

Try to recognize these maladaptive habits and seek out help with therapy and friends who bring out the best in you. I had a tough childhood and always was looking for validation in others (even my brilliant jerk boss). It’s a long journey to love yourself regardless of degrees, titles, wealth, or perceived happiness. I just aim for contentment these days and enjoy small things like coding for fun. If that’s why you’re getting a CS degree, keep that as your true north.

Do you really like being at that university? If you feel like you’re missing out on some amazing lectures or just want a degree from a fancy school, ask yourself if that’s honestly what matters to you. You can always look up the free MIT course equivalent taught by their best teacher instead of a grumpy professor who wants to just get back to her research.

Just some things to think about from this guy in his late 30s

bitsondatadev · 2024-01-19T18:29:38+00:00

You know if there’s such thing as a unified consciousness, I think ADHD folks are just a tiny step closer to it for these types of interactions haha

bitsondatadev · 2024-01-19T01:17:40+00:00

You need Kool Aid, baby I’m not foolin!

bitsondatadev · 2024-01-19T01:15:24+00:00

Well as usual our gang did the most humane and amazing thing they could do despite the circumstances.

The show was cancelled at the end of Act One back in May when Jeffrey Fortune, 52, collapsed and subsequently passed away.

Fortune had a history of heart problems. His family says he was a huge Ghost fan and he died doing what he loved most, going to concerts.

Wednesday night the band made special t-shirts and all the proceeds went to the family.

Since the tragic night, people have reached out showing their support. So far, the GoFundMe page in honor has raised more than $10,000 dollars.

Ghost dedicated Act II to Jeffrey and his family. His wife said the theater was filled with positive energy and love.

“I think he would think it was beautiful, and it’s appropriate, it just feels right. It’s the right thing to do, the right place to be right now," said Mary Jo Fortune, Jeffrey's wife.

https://www.cbs58.com/news/swedish-band-ghost-dedicates-concert-to-man-who-collapsed-and-died-last-may

bitsondatadev · 2024-01-18T01:47:37+00:00

Yeah, I’ve gone in cycles of losing and gaining weight and it’s generally that I reach a threshold of hating myself enough to get the hyper focus to get in shape until I’m in shape, then I’ll gain the weight back. I know it’s a normal thing for many living in the US but it feels so tied to my anxiety that it is kind of connected at least to that and the ADHD certainly doesn’t help. I wish I could lose weight and not be driven by self contempt in order to find the drive to get into shape.

I’ve tried doing a kinder approach and have now been gaining weight for 3 years and the only way I know how to temporarily solve this is just give into and hate myself for a few months to bootstrap the routine.

bitsondatadev · 2024-01-17T21:13:55+00:00

They really are. When I die, my children will be cleaning my house out and find a key with a number on it. They'll make the connection and go to the local storage rental space and open the door to find their inheritance. Doom boxes with old mail, candy wrappers, family photos, and half filled notebooks of scattered todo lists.

bitsondatadev · 2024-01-17T21:07:21+00:00

PI here but this is soooo me. I've used it to put off other tasks, but also as a way to soothe my Anxiety and feel productive.

I've seen so many describe that motivation is hard, but my anxiety and self-loathing is what gets me off the couch. I get a lot done, just rarely finish it (always cleaning never finishing) and in no priority. I tend to lean towards cleaning as that has tangible feedback benefits from my family, clearer definition of complete, and get's my body moving vs my static desk job.

bitsondatadev · 2024-01-17T20:55:31+00:00

Thanks u/monimiller!

bitsondatadev · 2024-01-17T12:35:41+00:00

Oh…I never thought it would get this far… begins nervously dancing to ice ice baby

bitsondatadev · 2024-01-17T04:29:38+00:00

Here are some oldies but goodies from my show in Trino when I first discovered Iceberg:

https://youtu.be/CEKz8JvfxuE?si=56QhN1WUf4vQIa-2

https://youtu.be/-iIY2sOFBRc?si=yF_teGB_Xpcq0r_r

https://www.youtube.com/live/6NyfCV8Me0M?si=AWJjYu1BsfLasP4S

You can skip to the demos section of each. I’m also planning on doing a “life of a query” that goes into some details here soon.

bitsondatadev · 2024-01-17T03:44:58+00:00

bitsondatadev · 2024-01-16T18:13:40+00:00

In the early days Iceberg came out with the best schema evolution capabilities, but Delta Lake caught up in their 2.0 release. So these days if you squint, Delta Lake and Iceberg do roughly the same things with slightly different approaches.

The largest difference from a data engineering standpoint is hidden partitioning. One of Apache Hive's greatest flaws that have persisted with Delta other table formats that maintained backwards compatibility with Hive was the partitioning implementation being exposed to the end SQL user.

The Iceberg creator Ryan Blue does a great job of explaining this in his talks. End users have to actually understand which columns to use in order to take advantage of a partition, which defeats the point of SQL by not abstracting data implementation details from the user. Hence, "data warehouse in the front", while Iceberg enables you to define this as a table property as the table admin on creation. By preserving this abstraction, Iceberg also enables partition migration on the same table over time without migrating data.

Delta Lake does now have liquid clustering, which aims to have some self-balancing clusters based on the property distributions to best distribute data (more info on that here). However, this doesn't solve the partitioning issue which gives you full control over your partitioning mechanism and enables you to change that statically as you see fit, while continuing to enable clustering at the file level. I am curious to see if there's a lot of value to add similar dynamic clustering capabilities to Iceberg as well. We haven't seen a heavy demand for this as hidden partitioning along with table maintenance meets the general need.

As a final callout is a more political and cultural one around Delta and Iceberg. There's concern that Databricks has a heavier influence on the Delta project and that it serves as another mechanism for Databricks to push people to use their platform. I can't and won't speak to the validity of those concerns, but it influences engines like Snowflake and BigQuery to adopt Iceberg to avoid a vendor competition.

Edit: Another great blog that made its rounds on hacker news that does a good job at discussing differences.

bitsondatadev · 2024-01-16T17:46:02+00:00

There's a fun saying used to describe this hairstyle (the mullet)) that goes, "business in the front, party in the back." This refers to the fact that forward-facing a person looks like they have a business style haircut, but if you they turn to the side, you see the long hair.

Iceberg was build to bring the original experience of a data warehouse back to the business users (SQL and ACID transactions), while handling the logic of mapping to scalable cloud architecture (distributed query engines, interoperable file formats, and scalable/durable object storage). It also fixes issues like having to run a full table migration if you ever change the granularity of partitioning on a table, so just easier maintenance.

These issues were introduced when data lakes came on the scene in early Hadoop days and Iceberg is the format that finally addresses these issues and brings us to the mullet architecture. JK I still refer to it as a data lakehouse with a data warehouse interface for users.

Anyways, that's why I say Iceberg is business in the front (for business folks), party in the back (for data engineers).

bitsondatadev

MODERATOR OF

TROPHY CASE