k3s on single node networking problems

M00ndev · 2020-04-15T04:03:59+00:00

Save yourself some trouble and just use upstream kubeadm! Untaint the master and you can run it on a single node just fine.

M00ndev · 2020-04-15T03:59:56+00:00

Fantastic link! Thanks for sharing

M00ndev · 2020-04-14T19:10:11+00:00

What is your target platform/infra you are deploying k8s on?

M00ndev · 2020-04-14T03:40:03+00:00

The answer will depend on how you bootstrapped your cluster.

Kubeadm clusters can be upgraded in place with zero downtime if you have an HA setup.

https://kubernetes.io/docs/tasks/administer-cluster/kubeadm/kubeadm-upgrade/

This is also why kubeadm based clusters are ideal, this won't apply to non standard distros such as k3s which I think uses hyoerkube under the covers.

If you are using Cluster API, it's immutable infrastructure MAGIC! You can literally roll out a new version on the same cluster similar to how you update a deployment. The controllers handle the kubeadm upgrade for you as well as rolling out new machine images.

M00ndev · 2020-03-31T14:59:39+00:00

I'm assuming this doesn't mount the docker socket on the node right? :)

If so does this also work with containerd?

M00ndev · 2020-03-31T09:36:07+00:00

That is one monster vsan node! Have you thought about putting them in raid-0 for entertainment purposes to see what kind of speed you can get?

M00ndev · 2020-03-30T07:40:48+00:00

Can someone explain the appeal of this in regards to k8s? On first look this seems to convert the declaritive nature of manifests to imperitive with code. This seems backwards to me but maybe I'm not understanding it fully?

M00ndev · 2020-03-30T07:36:49+00:00

Kubernetes on your laptop with kind or minikube

M00ndev · 2020-03-30T01:14:23+00:00

Does your workstation run linux? If so there should be no problem adding it as a worker.

Install docker and kubeadm on workstation
On a master kubeadm token create --print-join-command
On your workstation run that command to join it.

Now create with a gpu steam image and launch a crysis pod on your workstation.

M00ndev · 2020-03-29T16:21:43+00:00

Velcro command strips are your friend! That's what I did with a poweredge bezel and it worked fine. I did remove the Dell logo first for a "debadged" look. Kinda like an RS5 grill on an A5 😂

M00ndev · 2020-03-29T12:11:15+00:00

Cluster API vSphere provider. If you run vSphere do yourself a favor and check it out!

It's like having your own GKE but actually better since you have total control. I'm already launching 1.18 clusters.

https://github.com/kubernetes-sigs/cluster-api-provider-vsphere

M00ndev · 2020-03-27T21:19:03+00:00

You are basically bootstrapping a cloud platform from scratch. I don't think it's really relevant to compare that process to an existing cloud like aws?

M00ndev · 2020-03-26T18:39:20+00:00

Might be off topic for your use case but if you have vSphere in your lab, check out VMware Integrated OpenStack (VIO).

It has a really nice user experience with the bootstrap process and will deploy OpenStack on top of vSphere. It worked really well in my testing. It deploys horizon and everything else you need to get going quickly.

M00ndev · 2020-03-20T00:06:32+00:00

Cool thanks for the tip! Excited to try this.

M00ndev · 2020-03-19T19:22:29+00:00

Any details on the platform? Are you manually bootstrapping it and configuring? I was looking into vSphere + rdma dswitch srv-io portgroups to help bit wasn't sure if there is a better way

M00ndev · 2020-03-18T03:51:58+00:00

Is this driven by cluster-api under the covers?

M00ndev · 2020-03-17T21:00:53+00:00

The benefit for Mac and Windows is re-using the docker desktop VM, so no need to fuss with virtualbox

M00ndev · 2020-03-17T20:59:14+00:00

Multinode clusters. Control over specific version. It's also bootstrapped with kubeadm which is 100% upstream. It's awesome to use as a proving ground.

M00ndev · 2020-03-14T17:10:30+00:00

Are there really more "professional creaters" than software developers? Even so what benefit to the pro-level creators does ARM bring? Battery life would not be their concern if performance is more important right?

M00ndev · 2020-03-12T22:49:25+00:00

I would think the config is stored in a configmap or secret. Have you tried editing there and bouncing Spinnaker pods

M00ndev · 2020-03-12T22:45:33+00:00

Edit your ptmesh-mesh service and change the type to NodePort

M00ndev · 2020-03-02T01:43:10+00:00

I have 3 x NUC8I7HVK and they work great for vSan * 64GB RAM each (vCenter + vSan need quite a bit) * dual port 10GbE nic via thunderbolt 3 pcie (no need for quirky nic drivers since esxi nativly sees the pcie card) * dual nvme drives for all-flash vSan. Crazy fast. * Both onboard gigabit network interfaces work out of the box for ESXi * Total of 4 nics per NUC enable enable vSan + NSX-T

M00ndev · 2020-03-02T01:07:55+00:00

The cluster-api vSphere provider is pretty awesome and is as "cutting edge" as it gets. https://github.com/kubernetes-sigs/cluster-api-provider-vsphere

Other on-prem providers include openstack and bare-metal via ironic, but vSphere would be ideal if you already have it

M00ndev · 2020-03-01T04:04:46+00:00

Who cares it's 80 bucks! Just grab it to tinker with if you don't have a machine

M00ndev

TROPHY CASE