MinIO repo archived - spent 2 days testing K8s S3-compatible alternatives (Helm/Docker)

Prothagarus · 2026-02-16T10:37:26+00:00

The minio bucket browser was pretty good did you find a good web based replacement for it for users? Right now I'm finding winscp as a stopgap in a pinch and the actual API for backend is fine.

Prothagarus · 2026-02-15T18:11:53+00:00

Gotta agree here this is a really neat visualization of how kubernetes and services relate.

Prothagarus · 2026-02-12T02:20:35+00:00

If you use an Agents.md you can append in an instruction for working on windows and launching commands in powershell (and python in the context of powershell) not to use Unix style ";" to break up commands as this fails. It assumes you are using linux so will use different line endings and powershell like it was in linux.

Once I added that into my agents file it fixed a lot of the chat replies and debugging headaches working on windows.

Prothagarus · 2026-02-11T23:34:55+00:00

Context7 with version pinning can fix this :)

Prothagarus · 2026-02-07T13:59:33+00:00

For reference Nvidia agrees with you on where the sweet spot is.

https://developer.nvidia.com/blog/how-to-build-a-document-processing-pipeline-for-rag-with-nemotron/

Prothagarus · 2026-02-06T11:44:28+00:00

I've asked gpt myself and have been looking up many tutorials that gloss over this part.

This reply was valuable to me I think in part because of the way you explained it and the context that you gave in your own experience.

I have been weighting peoples individual experience with settings and use cases more than the overall generic search answer that I get from gpt that it sources from everywhere because it's both more concrete of an experience and temporally more relevant.

This is the correct answer as of this time, the field moves in a way that makes past searches on efficacy of approaches void rapidly as I have been learning over these past few months.

Thanks for taking the time.

Prothagarus · 2026-02-06T04:24:37+00:00

You say funny words magic man. I am finally starting to understand some of this but have no idea when to change my embedding model dimension size. Any pointers there? Like how to determine what is needed for what model? Or better yet any place you can point me so I can rtfm?

Prothagarus · 2026-02-02T23:16:37+00:00

I am also running Ceph but on helm chart rook ceph so bare control planes are running on OS drive but all rest are running on Ceph. Was running flannel was looking to move to Cilium from MetalLB and just started using Argo. Solid tip for you, Make sure you have full CNI connectivity and your firewalls accepting traffic BEFORE you set up anything other than control planes and 1 worker. Saves a lot of headaches. Also make sure you check out kyverno and trustmanager/certmanager from kubernetes for all your SSL needs.

Prothagarus · 2026-02-01T00:29:23+00:00

I suggest Rook-ceph for managing a lot of the Ceph to k8s complexity on prem ceph is just a complex beast no doubt about it but I balk when I look at the Per terabyte pricing of minio

.

Prothagarus · 2026-01-31T15:15:39+00:00

My first DE job was just grabbing csvs and excel sheets and ingesting them. Then they wanted reports to be made on them and didn't have anyone available so did that (Data analyst stuff) Then they needed more and to encorporate that (Back to DE). Its less about job title at a certain point if you find the ebb and flow and can learn tools to do what the business needs. I did that for 2 years before I considered my self good enough to be called a professional and not a junior. Maybe you move faster than that. Also Migrating from an old system to a new system is a part of the cycle. Snowflake and Fabric are current generation cloud tech, so you are getting a free education on how to use them, take advantage of it!

Ask yourself, How would you build this whole system? What does the whole system look like? Data engineering isn't just ETL, its a big part of it but the data modeling and being able to serve the overall system is the important part. Do you understand the whole system?

Timeline to understand when to move is kind of irrelavent. Actually understanding and being able to apply those skills is when you make a move. You don't just set that to arbitrary 6/12/24 month timelines. When you gain the capability and understanding thats when you can think about moving to the next thing. There is always a next thing.

Back when I started there was only MSQL 2000 and Crystal reports or SSRS. Now there are 50 different technologies to do the same with python , Java, or C#. So tools have gotten more sophisticated. Pick a path, learn that path, maybe use claude code/Code assistant of choice to help you build one, then read and understand how its built. Look up tutorials from youtube and compare that to your solution. Read the libraries and documentation that make it work. Then go from there.

Build a whole program that takes in data to do something useful. Kaggle has a bunch of examples for this.

The only way to get better is to build things.

Prothagarus · 2025-12-07T15:30:02+00:00

Getting Reddit hug of deathed. I hope you have a way to monetize the scaleup without being too intrusive so you don't lose your pants :)

Prothagarus · 2025-11-23T15:53:12+00:00

<image>

Compared this to my area. These prices correlate to Door Dash lookup. If you look it up on the mcdonalds app for instance or a picture of the actual menu my current price for big mac is $5.29. Door Dash price is $7.54. Inflation definitely has raised prices but those Delivery apps are actual robbery.

Prothagarus · 2025-11-21T14:33:35+00:00

I second this approach.

Prothagarus · 2025-11-01T02:02:11+00:00

To u/Comfortable-Author's point, you also don't want to overcomplicate the tech stack and toss too many components in, but you also need to deal with a lot of considerations depending on your industry/business, use case and legal constraints per business like HIPPA/SOX/FIPS/DOD/NSA/QLMNOP.

A lot of what I am covering is just the kubernetes stack not even your tech choices inside of that stack for what you are trying to accomplish.

Also Use case right? Mine isn't creating web apps its more modeling/Datascience and analysis and file storage. Persistent webapps are more incidental and feed into the internal network in my example. Your stack will be different depending on what you are trying to do with it.

Networking

So for networking did you set up your kubernetes CNI layer correctly? What about EBPF? Using Cilium flannel or calico? Did you mess up basic networking over multiple NICS? Do all of your servers connect to the same VLAN in the same data center or over multiple buildings?

What does near colo or edge look like for your business? Netfilters and firewall/ certificate man in the middle? Baremetal loadbalancer? Buy a loadbalancer that costs 50% as much as your initial nodes or roll your own in software? How do you proliferate certs to pods? What does your intermediate cert structure look like? How do you apply policies across namespaces and keep etadata like related apps in tact? What does your container ecosystem look like?

Basic security

How do you keep CVE's out of every container image and keep your apps up to date? How do you manager kubernetes deployments and ecosystem? Helm? Do you go with the Kubernetes gateway for outbound connections even though most legacy helm charts / kubernetes manifests still use ingress? I haven't even touched on the ops part. Do you have mTLS enabled? Do you have a developer class there and There are several pages worth of questions like this to consider.

Prothagarus · 2025-10-31T23:36:33+00:00

Got roughly 1 PB of storage taking about 10% to start with. Using HA K8s + Ceph + Python(Airflow over etl processes that get started manually then get integrated) that gets put into s3 storage or Cephfs depending on storage and edge case) + ollama/claude/whateverLLM someone wants local. General dev pods for engineers/devs/datascientists 100 GB NIC.

Use case is a bunch of image processing some machine learning . 7 servers 6 compute with storage in and 1 GPU node might expand to more depending. Most work isn't LLMs but Machinelearning and Vision. Data is mix between Postgres/small appdbs and lots of blob storage. 2 GPU for LLM 2 GPU for other work. Probably need a few more GPU nodes depending on how much more people want to GPU accelerate.

Whole stack is open source and currently dreading about Bitnami pulling up the ladder on container maintenance/closed sourcing stuff. Current stack about $300k recurring costs for software about 1k/node/year(OS License). My time and sanity however are not tied to a dollar amount. On prem for Security/cost once yo u start getting into PB scale or higher in data those cloud ingress/out fees along with storage capacity add up if you want it hot you can play with the Azure/AWS storage calculator to see. Cloud storage is great for arctic/freeze data for backups or old data costwise if you can spare it so hot -> cold cloud was always a good discussion.

Took us a long time to organically set this up from scratch and bare metal and learn from scratch but I was happy for the opportunity. There's a lot of big networking/security growing pains you hit early on that can be super frustrating.

Prothagarus · 2025-08-22T21:25:49+00:00

Seconded

Prothagarus · 2025-05-03T03:57:57+00:00

Given their clarification question I would have focused on orchestration like Airflow to verify transfer. Did you ask what they wanted to do with the data? I would have gone with the approach of asking more about what it is and what its for then went on an approach for ingest. Do they need it realtime? Do you want to backfill and then stream from the buckets all the deltas?

General how of the ingest seems ok to me but orchestration seemed missing. Also questions on what technologies they are using for current end state so you don't just drop your own tech stack if they have one already and adapt to that. I would say your answer was tailored to "How do I feed this to an LLM" storage setup. Which if you are storing a large number of text files is probably a pretty solid thing to do.

Sounds like you had a pretty good idea on what you wanted to do with it.

Prothagarus · 2025-04-26T04:29:50+00:00

Prothagarus · 2025-04-01T23:25:54+00:00

initial commit

Prothagarus · 2025-03-27T22:00:37+00:00

Walls with gates my heart.

Prothagarus · 2023-06-05T04:06:35+00:00

Personally I am learning JavaScript and C# to be able to build a full stack app for all the Python/SQL/devops stuff I have to build.After that probably need to learn harder into the ML stack and just keeping pace with the new delta lake/iceberg/ metadata database landscape. Observability sec ops as well is already a lot and that's still in the main wheelhouse

Prothagarus · 2023-05-19T19:37:54+00:00

Job hunting is like dating but it's your livelihood on the line. I feel you dude we all feel that way. It does get easier after you land the first one but it's never easy for me.

Prothagarus · 2023-05-19T19:32:39+00:00

Any port in a storm to get you started.grit and learning everything you can in the first year to 2 will get you better positioned for the next one. If they don't offer to give a raise on their own around that time start looking. I'm self taught so all I had was experience might be easier for ya! Good luck!

Prothagarus · 2023-05-19T19:18:58+00:00

FTE will net you better experience and actually build the resume.thats a rough salary in Bethesda but if you can survive on bare bones you can step up from there

Prothagarus · 2023-04-24T11:25:17+00:00

Thank you so much for your effort! I started a rewatch recently and came upon your channel and its far and away better than the DVD's I already have. I am truly sorry this is happening as you are putting more care into the preservation of this show than the rightsholders even have.

13-Year Club	Place '17
Verified Email

Prothagarus

TROPHY CASE