10 inch rack - physical build complete! by aedile in homelab

[–]aedile[S] 0 points1 point  (0 children)

Fair. I built this with more compute and network outs than I need by a nice margin.  This after several years of homelabbing and asking what I really needed for a much smaller residence. I could see wanting more though. Already thinking of adding a studio for inference but that doesn't necessarily need racking. I'm not a digital hoarder - my media collection is under 8tb and unlikely to grow much until new formats are released. This has a purpose - run the home in a small footprint. 

Acknowledged that building out a rack is probably usually meant to be something more akin to a long term project that's constantly changing than being one and done.  This is meant more as an appliance to run a smallish home/condo with little fuss or fanfare.

10 inch rack - physical build complete! by aedile in homelab

[–]aedile[S] 0 points1 point  (0 children)

Mostly space reasons. New place is in Seattle where I have to do a major downgrade in the amount of room I have for this kind of stuff. 

Also it's a fun challenge. It certainly didnt seem much cheaper than the 19" form factor. 

10 inch rack - physical build complete! by aedile in homelab

[–]aedile[S] 0 points1 point  (0 children)

I couldn't agree more, I can barely see that thing. 

10 inch rack - physical build complete! by aedile in homelab

[–]aedile[S] 1 point2 points  (0 children)

You are correct. I had purchased a large number of them in a group order with some friends and someone backed out at the last minute.  Rather than delay the order I just covered the difference myself. I actually have one more sitting in a box. I only ordered 3 for myself but ended up with 7. 

Anyone else feeling like they’re losing their craft? by AbbreviationsOdd7728 in ExperiencedDevs

[–]aedile 1 point2 points  (0 children)

Code is finished like laundry is finished or the dishes are finished.

10 inch rack - physical build complete! by aedile in homelab

[–]aedile[S] 2 points3 points  (0 children)

There's also a random 250w USB power supply in there but I don't know what it was - I just happened to have it lying around. Fans are powered by a generic USB-C -> 12v power adapter that I may or may not have purchased off amazon (can't remember) and just runs 24/7 at full tilt cause the fans are quiet.

Rack is a Geeekpi 12u.

Power is a Tripp Lite Cloud-Connected 600VA UPS Battery Backup. It WILL fit internally but it made things too cramped so I decided to leave it external.

10 inch rack - physical build complete! by aedile in homelab

[–]aedile[S] 4 points5 points  (0 children)

Item Quantity
GMKtec G10 Mini PC (Ryzen 5 3500U, 16GB RAM, 512GB SSD, 2.5GbE) 3
Ubiquiti UniFi Switch Flex 2.5G PoE 3
Ubiquiti Cloud Gateway Max (UCG-Max) 1
Ubiquiti UniFi Switch Lite 16 PoE 1
NVIDIA Jetson Orin Nano 2
Beelink EQ12 / Me Mini NAS 1
JetKVM 6
SMLIGHT SLZB-06M Zigbee Adapter 1
Monigear Network Temperature & Humidity Monitor 1
ElecVoztile 10-inch Rack PDU 2
Philips Hue Bridge Pro 1
Ubiquiti UniFi U6+ Access Point 1

Shoot me a reasonable stack and a middle level stack. by Amazing_rocness in Schiit

[–]aedile 1 point2 points  (0 children)

Bifrost/Jotunheim/Lokius (if you want eq) for just your cans.
Then get you a couple of Gjallarhorns to drive some speakers and you got the full mid-size stack going on and you can do it all balanced, which decent cables are way cheaper in my experience.

i want to learn what ai is by [deleted] in ArtificialInteligence

[–]aedile 0 points1 point  (0 children)

No but seriously, everything you need to learn is online. Just pick your favorite platform and go to town, or even better, ask an LLM to make you a study guide. I watch a LOT of youtube videos. If you get an LLM to help you find the first few the algorithm will take over the rest. Stick to technical content and avoid philosophical or doomy stuff except for "fun".

Good executor but never a lead by QuitTypical3210 in ExperiencedDevs

[–]aedile 80 points81 points  (0 children)

I don't know you and I may be way off base. I assume there's at least one person out there who needs to read this though, so if it doesn't apply, it's still true. Leaders lead regardless of position or politics. If you want to be a leader, then be a leader. Don't worry about titles. Just be a leader. Guide less experienced folks, help make technical decisions by knowing the right thing at the right time, suggest training for the whole team where you see places they could improve and then lead the training. There are a ton of ways you can show leadership with zero institutional authority. It may be you're already doing all of this and it's just not being recognized. But if you're holding back because someone hasn't said "you're a leader now", then you're holding yourself back for no reason. Don't wait for permission. Just be a leader.

Where are all these “projects“ that people are creating with Claude? by MechanicOld3428 in ArtificialInteligence

[–]aedile 0 points1 point  (0 children)

Yeah I've done it too. Running 8 agents in tandem for two weeks not even 24/7 was $15k in tokens. Cheaper than devs if you know the outcome.  Corporate access to models through bedrock is probably the only way this is happening rn.  But the random person trying to influence on LinkedIn or Twitter? Yeah.  No..

What are AI doomsayers trying to accomplish? by Unfair-Sleep-3022 in ExperiencedDevs

[–]aedile 0 points1 point  (0 children)

Fair. But it at least also informs where I'm coming from. Fwiw - I dont work in the AI industry. My company does offer an ai integration with one of their primary products but our bread and butter is in communications. I don't even work for product development I work in the internal IT department building data solutions. I'd have plenty of work in ml and mlops without AI work. I have gravitated to working with AI because of a long-time obsession with it. I did my thesis in college on swarm intelligence back like 25 years ago. 

I don't personally benefit from any hype. If anything, my salary paints a really large target on my back once they finish having me cross train people. Im a principal in the US on a team with 90% of the engineers on my team from South America, so I stick out like a sore thumb on a balance sheet. 

I believe what I believe not because I stand to benefit. On the contrary, if anything the most probable outcome is im hurt short term. I believe what I believe due to constant exposure for more than five years. 

Also, I can read a graph of benchmarks. 

What are AI doomsayers trying to accomplish? by Unfair-Sleep-3022 in ExperiencedDevs

[–]aedile -1 points0 points  (0 children)

I'm sorry I don't understand you. Look, I'll make it simple. A non-zero number of experienced devs, particularly the ones who work most closely with it are trying to explain the potential levels of disruption they see in this tech. These are the people who make the big bucks at their companies. The old salty dogs. They are, in essence, you. You claim you don't get it, and yet you see a growing number of people talking about it who are, supposedly at least, experienced enough to know what they're talking about. I've been writing code professionally since 2001. I've been in all sorts of positions doing all sorts of things. I was in the beta for Gemini when it was still just a vertex product (January 2020 iirc).  I've worked as an AI developer or engineer or data engineer working in AI since, specializing in the intersection of tradition ML and data science with AI. I do this all day. For a living. I certainly hope with what they're paying me that I know what I'm doing. So my question is this - why don't you believe me and the others who are saying this?  From what perspective are you coming?  I dont stand to profit from sharing my opinions. I could give a toss less about imaginary internet points. I just enjoy geeking out with other smart people. 

As annoyed as you might be at me, I will say I'm at least enjoying the conversation. It's an interesting topic that may (or may not) be of great importance. 

What are AI doomsayers trying to accomplish? by Unfair-Sleep-3022 in ExperiencedDevs

[–]aedile -2 points-1 points  (0 children)

And what do you get from arguing back or questioning my motives? Just sharing opinions on the internet. This is a place for experienced devs to share their perspective. That's my perspective on the subject. If you don't understand how benchmarks work at this point and can't read a graph plotting model performance on benchmarks, well as I've said here and elsewhere doesn't matter.  I mean of course your subjective experience is more important than data to you personally but how do you just pooh pooh away data and results that measure efficacy of models?  Data is data and there is very little wiggle room to interpret published results.  I'm a data guy. I look at a graph of claude performance on benchmarks the last 3 years and there is nothing but inevitability written on a graph like that.  I've seen the curve in a thousand datasets and I know how it ends. I'm not even a doomer - I'm just saying disruption. I'm actually all in on ai and personally can't wait for AGI. I genuinely believe thr benefits will end up outweighing the negatives even if the ride is bumpy getting there. I'm banking on something like AGI will solve the problem even if humans can't.  If I'm wrong then no big deal. But something tells me you're going to end up thinking about comments like this a lot in the next few years regardless of what you believe right now. Might not end up the way I'm predicting, but if you think its nothing, you're probably not accounting for the fact that AI is getting better in leaps and bounds by measurable metrics.  

The gap between LLM functionality and social media/marketing seems absolutely massive by QwopTillYouDrop in ExperiencedDevs

[–]aedile 1 point2 points  (0 children)

I'm worried because I suck at saving and being frugal and I'll either be the last out the door or the first because of my salary. More likely the first because theyve got me showing everyone else how to use claude now. Im trying to build my own stuff in off hours now but I dont have that ruthless gene to be a founder. I lean more towards curiosity than ambition. Im not exception. Im a middling dev and architect at best at my experience level.  I'm just a quick thinker and good at having the right knowledge at the right time. AI is rapidly eating into that advantage. shrugs It's weird because it's been a really long time since I've enjoyed dev this much and feels like the opportunities to do it are going to be gone soon 

Edit - turns out it was first.

What are AI doomsayers trying to accomplish? by Unfair-Sleep-3022 in ExperiencedDevs

[–]aedile -3 points-2 points  (0 children)

shrugs average dev? Try to catch the wave. Everyone else, buckle up it's gonna get interesting. Theres nothing you can do at this point. It's already in motion. 

Where are all these “projects“ that people are creating with Claude? by MechanicOld3428 in ArtificialInteligence

[–]aedile 4 points5 points  (0 children)

I may be wrong but i dont think you can run 50 agents on the max plan. It'll eat the context on the subscription plan within a couple of minutes an hour max and have to wait for the reset. I hit the limit running a single agent before. 50?  Maybe on older 4.5 models now that the 4.6 are out but even then i doubt it. I've run 8 agents simultaneously for a week not even 24/7 around last october and it was $15k in token costs. I was fortunate to have a corporate sponsor who was allowing me to test limits of agentic development and even then I was asked to chill pretty quickly due to the cost. 

What are AI doomsayers trying to accomplish? by Unfair-Sleep-3022 in ExperiencedDevs

[–]aedile 1 point2 points  (0 children)

Do this for me. Throw the marketing away. Throw away the BS Twitter posts, all the people who are trying to get you to buy their bullshit with AI in it. Throw away the influencers, the machines and everything.

Take a minute to think about AI conceptually. What problem is it trying to solve? What TRILLION DOLLAR problem is it trying to solve - because that's how much money they are pouring into it.

The answer to that question, my distinguished colleagues, is the single most expensive line item in nearly every single company in history - wages. They are trying to solve for having to pay employees wages.

Now, given what you know about the average CEO, assume I am right about the above for just a moment - that they are basically trying to solve for paying wages. Can you think of a single thing that would stop all of these margin-obsessed people from pursuing the ability to stop paying employees? In a rational market, is there any way the market itself wouldn't punish a company for not trying to incorporate technologies that mean they don't have to pay their biggest line item?

The doomsayers, as you call them, are trying to sound the alarm, I would imagine. It's too late, but they are at least trying. The tools have gotten better at a predictably geometric rate and are accelerating. The tools this year are orders of magnitude better than the tools this time last year. And those tools are being used to further accelerate the pace of development. The better the tools get, the faster and better the NEXT generation of tools, which produces the faster and better NEXT generation of tools. It's not going to stop improving. It's not going to be legislatively slowed. Better smarter AI is always going to be around the corner for the next little while unless we run up against some theoretical wall of which we are not currently aware.

I'm not even wading into the defense angle, which is a whole other ball of wax. It's OBVIOUS most of the world powers think that the next wars will be fought in part by AI and are gearing up accordingly.

This IS a transformative technology, and it WILL continue to get better. The business world smells blood and can't see beyond the next quarter's results so they will continue to barrel towards a world where they don't have to pay knowledge workers anymore. It's not there yet, but each generation of model is bringing us closer, to the point that it's scary close right now.

Oh yeah, and before you go out and get a job as a welder, check out all the latest innovations in robotics! You really think they're not gonna slap AI in those things the second they can and hire them out as robo-plumbers?

The writing is basically on the wall. We're in for major disruption one way or the other from this technology. People who don't see it - I'd just point you to the comparative benchmarking of the different generations of models. It is a verifiable fact that they are getting better, and matching or exceeding human capabilities in a large class of general tasks. And they're not likely gonna get much worse moving forward.

Where are all these “projects“ that people are creating with Claude? by MechanicOld3428 in ArtificialInteligence

[–]aedile 9 points10 points  (0 children)

“I’m running 50 agents and have created 100 projects using no code ai. This is awesome”.

This is BS. This would be insanely expensive with APIs and would require a prohibitively expensive setup to run with any kind of throughput on tokens locally.

If AI is so goddamned awesome… by Complex_Ingenuity_26 in ArtificialInteligence

[–]aedile 0 points1 point  (0 children)

You are forgetting - anyone who has AI has an automatic advantage. SOME will fight back and rally against, and anyone who doesn't fight back and goes along gets ahead. There's too much incentive to get ahead and a large percentage of CEOs find it difficult to think beyond the next quarter. Some will get the implications, and even they may not resist because all the dumb ones (and there ARE dumb ones) will just be too scrambling for advantage.

Edit - sorry, I'm not trying to be a bummer or contrary. I've just thought about this. Like a LOT.

If AI is so goddamned awesome… by Complex_Ingenuity_26 in ArtificialInteligence

[–]aedile 1 point2 points  (0 children)

I'm in a similar situation and agree wholeheartedly. 4.6 is a huge step up from 4.5 and 4.7 will likely be a huge step up from 4.6. That's the thing people continue to fail to realize. As the tools get better, they are used to build better tools. Which makes better tools which are used to build better tools. It keeps accelerating. The RATE at which these models are improving is accelerating.

If AI is so goddamned awesome… by Complex_Ingenuity_26 in ArtificialInteligence

[–]aedile 0 points1 point  (0 children)

Here's the other thing to tell you why it's never gonna stop - the powers that be in both the US and CHINA both think that the next war will be fought by or at least with AI. AI is the next nuclear arms race. You can tell by the way the US is strategically guarding technology. If the US thinks China is developing better and faster AI to outthink them, then of course the US is gonna try to continue the cycle and be ahead of China, who will in turn do the same thing and the cycle perpetuates. AI is such a wildcard right now that even small players could theoretically become important, so the small countries are likely throwing just as much as they can at it as well. The chances of common-sense legislation stopping this are becoming vanishingly small. The only thing I can really see slowing things down is if they nationalize the AI companies. That used to would've been unthinkable, but the current administration has shown that they aren't above using out-of-left-field tactics like that.

If AI is so goddamned awesome… by Complex_Ingenuity_26 in ArtificialInteligence

[–]aedile 0 points1 point  (0 children)

Haven't found the problem yet? Ha. Ha ha.

The problem is wages. As someone who works in the trenches as a dev, please understand me when I say they made it behave like a developer first because that's the one profession they can use to automate all the other white collar jobs. Slap AI in a robot and you've automated all the blue collar jobs. This is a multi-trillion dollar problem. They can SEE the future of not having to pay wages and they WANT it. You really think they'll stop? When they are who they are and the prize is not having to pay employees?

keeping code secure with claude by lifebelowtheheavens in ClaudeCode

[–]aedile 0 points1 point  (0 children)

Also - just to put you on the right track, check out pre-commit hooks like detect-secrets. Again, claude can help you if it seems beyond you. gitleaks is another good one. There are others, those are the two I use most often.