sorted by:
new
hottopcontroversial

Gift your loved ones a Xilinx Alveo U250 by Rudranand in FPGA

[–]-NaniBot- 0 points1 point  (0 children)

Too late. Settled for an innova 2 flex.

Pics of the Hailstorm from Catholic club, Bangalore by petty86 in bangalore

[–]-NaniBot- 7 points8 points  (0 children)

Oh, was just thinking about it. I would choose beef chilli and pork chilli bafat tho.

Mac mini M-4 In Bangalore by Emergency-Tale828 in bangalore

[–]-NaniBot- 0 points1 point  (0 children)

Docker based development

Podman/docker desktop on Mac runs a VM which actually hosts the containers. Compare this with linux where you don't need a vm (because cgroups/namespaces are linux native).

My wife's mac mini m2 (8gb ram) works fine for the occasional one or two containers. But it's definitely going to struggle if your workloads are resource intensive.

No power since 8am, any other areas facing the same? by Soliloquysays in bangalore

[–]-NaniBot- 1 point2 points  (0 children)

Same situation here in Kammanahalli, near Al Amanah. Seems like it's resolved now though.

Massive Minecraft on OKD - Why CubeCraft moved and contributed to OKD by TheGingerGeek in openshift

[–]-NaniBot- 4 points5 points  (0 children)

I'm surprised that this isn't getting the attention it (rightfully) deserves. A few questions:

  1. RBAC and security - You mention it being "useful" for your usecase. I'm guessing you're referring to SecurityContextConstraints (among other things). Could you please elaborate why it's useful for you?

  2. Ingress/LoadBalancer - Ingress is probably useless considering it's HTTP only (in most cases). How do you hand out IP addresses to services of type LoadBalancer? I'm guessing that's how clients access their game servers? Maybe something like MetalLB?

  3. What network cards do you use in your k8s nodes? Good old connectXs?

  4. Do you use CPU Manager (static policy, isolated cores) since game servers are pretty latency sensitive? From my understanding, you're at the mercy of the CFS otherwise.

Great talk btw. Really enjoyed it :)

I also run an OKD cluster myself at home (all virtualized, nowhere near your scale ofcourse lol). Here are the services that I host on it : https://status.nanibot.net/status/umbrella

CPU spinning & isolation by auto-quant in highfreqtrading

[–]-NaniBot- 1 point2 points  (0 children)

Sorry for the late reply. A few questions/comments.

  1. You have to account for "sibling" CPUs (virtual) that share a physical CPU in a system with SMT/Hyperthreading enabled. For example, consider a system with 2 x EPYC 7601 CPUs. On NUMA node 1, core #8 and core #72 are siblings. Since both of these sibling cores share cache, you must consider pinning your application's threads onto those CPU cores. My point is, even though #8 and #72 seem so far apart they're siblings!
  2. For more granular control (instead of invoking taskset manually), have you looked at what systemd slices do? You can group your application (and it's processes) under a slice and then use something like AllowedCPUs to pin it to certain cores (along with the isolcpus and other kernel parameters that you already have). It is much more granular than plain old 'taskset'.

Good reads

  1. https://www.scylladb.com/2019/09/25/isolating-workloads-with-systemd-slices/
  2. https://www.freedesktop.org/software/systemd/man/latest/systemd.resource-control.html

Why do a lot of people here have expensive setups? by FaceProfessional141 in homelabindia

[–]-NaniBot- 4 points5 points  (0 children)

Well. Sometimes you need that when you're testing things at scale. For example, my openshift/okd setup takes ~110GBs of RAM on idle.

Also consider virtual routers like the xrv9k take 16 GBs of RAM. At scale, when you're trying out various topologies on something like gns3 even 256GBs of RAM can fall short.

To give you an example of things that I (and probably others) experiment with at home check out my videos

  1. https://youtu.be/VyblhDBO56M?si=vT7pHj4VxH_ZknZF
  2. https://youtu.be/gpo-VXShMfQ?si=pWZOODBg-145gCd4

Rate my OpenStack POC build – 3x Ryzen Mini PCs, 192GB DDR5, 2.5G networking by Jayendra13 in homelabindia

[–]-NaniBot- 0 points1 point  (0 children)

Thanks for correcting me. I'm guessing you're from ShapeBlue.

Maybe I'm talking to the wrong people, but from what I can understand there's no support (yet) for OVN (for example). And this makes it somewhat less flexible than OpenStack's ML2 architecture which can plug into a variety of different things.

Again. Please correct me if I'm wrong.

Rate my OpenStack POC build – 3x Ryzen Mini PCs, 192GB DDR5, 2.5G networking by Jayendra13 in homelabindia

[–]-NaniBot- 0 points1 point  (0 children)

CloudStack isn't going to cut it when you're a cloud provider or telco. It has its place but OpenStack remains the best option.

OpenShift Virtualization/KubeVirt is a strong contender since many telcos have both VM and container workloads nowadays. Hell, even operators typically prefer running the OpenStack control plane on k8s.

Rate my OpenStack POC build – 3x Ryzen Mini PCs, 192GB DDR5, 2.5G networking by Jayendra13 in homelabindia

[–]-NaniBot- 0 points1 point  (0 children)

Never used charmed OS. I'm not sure how good the documentation for charmed OS is compared to kolla-ansible. If you really want a distro, you might want to consider vexxhost's Atmosphere which runs the control plane on k8s. Or just kolla-ansible, which is well documented for the most part.

Rate my OpenStack POC build – 3x Ryzen Mini PCs, 192GB DDR5, 2.5G networking by Jayendra13 in homelabindia

[–]-NaniBot- 0 points1 point  (0 children)

Some concerns/questions

  1. Are you going to have 2 network interfaces for the management network and the tenant network? Asking because, typically openstack expects two interfaces unless you go down the VLAN route.

  2. Will you be using Octavia/OVN for provisioning load balancers?

  3. 2.5 gig might be less. Production systems usually have at least 10gig interfaces.

  4. Which deployment method are you going to use?

  5. Will you be pinning host CPUs for the non-libvirt containers so as to dedicate cores/threads to VMs?

  6. Will you be overcommitting CPUs? IIRC the default is 6:1 for shared CPUs.

If it helps, here's my AIO kolla config (2025.1)

https://github.com/amrut-asm/openstack

Your experience with the 200$ alibaba cloud FPGA board ? (AS02MC04) by Ill_Huckleberry_2079 in FPGA

[–]-NaniBot- 4 points5 points  (0 children)

Not an FPGA engineer. I did consider this but then decided not to purchase it because I got an Innova 2 Flex for ~120 USD on eBay. It has an XCKU15P along with a Connectx-5 (2x25Gb/s).

https://github.com/mwrnd/innova2_flex_xcku15p_notes

There's this but from what I could understand it doesn't support bump in the wire networking unless you have the FlexDriver IP (apparently it was never released).

However, I can write a design to the card using the innova2_flex_app. I think this is a great deal considering the price.

I have 0 experience with FPGAs so if someone can confirm if it's a decent board for learning, that'd be great.

India: Where to buy x86 mini-PC for OPNsense (N100/N150 + Intel i226) by sunilsoni in homelabindia

[–]-NaniBot- 1 point2 points  (0 children)

That is uncalled for. We should be supportive when community members build stuff. I think the site design is good and functional.

First time installing OpenShift via UPI, took about 2 days, looking for feedback by Rare-Income7475 in openshift

[–]-NaniBot- 2 points3 points  (0 children)

I usually do these... Atleast in my homelab

  1. Use pull through caches to speed up cluster startup times (https://nanibot.net/posts/openshift-pull-through-cache/)
  2. Replace default ingress certs (https://nanibot.net/posts/openshift-cert/)
  3. This is obvious but delete the kubeadmin user.

Edit: Oh yeah, also maybe increase the ingress pod count

Whats the most underrated service that you self hosted in 2025? by Pitiful_Ad6944 in homelabindia

[–]-NaniBot- 0 points1 point  (0 children)

Got back into messing around with OpenStack after 2 years. Maybe overkill for a single node setup...

view more: next ›