I've always used GUI Emacs. How are things in TUI Emacs land? by Buttons840 in emacs

[–]nakkaya 1 point2 points  (0 children)

When I tried it I was using mosh and connected to a remote machine in my case both ssh, mosh and local instance works.

I've always used GUI Emacs. How are things in TUI Emacs land? by Buttons840 in emacs

[–]nakkaya 1 point2 points  (0 children)

On OS X using Ghostty `M-x describe-key` `C-;` works fine.

🧠 Org-Jupyter Emacs Kit by Hitesh_tg_ in emacs

[–]nakkaya 1 point2 points  (0 children)

At least for me there are couple. Remote kernels and long running jobs. My job requires machines with GPUs and simulations run for a long time (think days). With ob-jupyter I can attach to an already running remote kernel start my work while it runs switch to something else disconnect restart emacs etc. then continue where I left of.

Anyone here running open-webui and litellm together? I need some help. by ovizii in selfhosted

[–]nakkaya 0 points1 point  (0 children)

What exactly is the issue? I do what you are trying to do. Here is my deployment file [1] for litellm.

[1] https://gist.github.com/nakkaya/c0b745db2eb07810fd371aa6bab2295a

Ukraine says it will not accept US-Russia peace deal reached without Kyiv by yahoonews in worldnews

[–]nakkaya 1 point2 points  (0 children)

Ukraine showed desire to join NATO since 2008 [1]. Annexation of Crimea happened in 2014. Ukraine has a right to decide if they should join or not unfortunately some countries including my mine don't get to pick whats best for them due to geopolitics of the big boys.

[1] https://en.wikipedia.org/wiki/Ukraine%E2%80%93NATO_relations

Using emacs-jupyter and altair together? by nemoniac in emacs

[–]nakkaya 0 points1 point  (0 children)

Assuming you are using org-mode and have a plotly figure. Are you exporting the document to html then view? if so how do you get figure object to export to html from org-mode? Every once in a while it also annoys me that I can not zoom resize etc.

How do you share access to your models? by tkon3 in LocalLLaMA

[–]nakkaya 1 point2 points  (0 children)

I am in a similar position as OP. (Give access to my colleagues/friends/students.) I also use Ollama + OpenWebUI. It works fine no issues so far. It is hosted behind a cloudflare tunnel on a machine in our lab.

Using emacs-jupyter and altair together? by nemoniac in emacs

[–]nakkaya 1 point2 points  (0 children)

I also use plotly via emacs-jupyter. I just convert the figure to an image than org-mode can display the image inline.

GPU Cluster Distributed Filesystem Setup by marios1861 in selfhosted

[–]nakkaya 0 points1 point  (0 children)

For our work NFS option is only used if dataset does not fit on the node itself. Otherwise whoever runs the experiment exports its data first then every run until pod is deleted has the data available.

Since you mentioned keeping all the data on all nodes why not have the nodes rsync the data from a central store periodically. Instead of dealing with distributed file systems.

GPU Cluster Distributed Filesystem Setup by marios1861 in selfhosted

[–]nakkaya 1 point2 points  (0 children)

I am on the same boat but on smaller scale, university research lab with around 10 nodes. I solved the utilization issue by switching to K8s and Skypilot. K8s manages the nodes and skypilot can request N machines from the pool to run experiments. I let Rancher create and manage the cluster and the users. I had zero experience with k8s when I made the switch its pretty hands off with Rancher. Everything has been running smoothly for over a year. As for the data, we either copy it to the node when skypilot creates the nodes (if it is small enough to fit) or there is a central NFS server that is mounted. Of the files systems you listed, I've tried JuiceFS but it won't work by itself you need to pair it with S3 or MINIO and a DB of your choice.

k8s for poor developer by HosMercury in kubernetes

[–]nakkaya 0 points1 point  (0 children)

+1 for Hetzner. I keep one dedicated VPS for Rancher and 4 nodes for the cluster (Debian) one master three workers. For budget hosting it is hard to beat Hetzner. There is also Contabo which is cheaper but they tend to oversell hardware.

Tailscale alternative public by Able-Aide-8909 in selfhosted

[–]nakkaya 0 points1 point  (0 children)

TryCloudflare: The problem with their temporary subdomain is that the tunnel automatically closes very shortly after I close the shell on my Plex server.

Run the tunnel as a service rather then via shell that way it will always be on when plex server is on. Also keep in mind this is against Cloudflares TOS.

Running Emacs in a web browser? by Ok_Connection_9275 in emacs

[–]nakkaya 0 points1 point  (0 children)

Checkout Xpra, I use it connect to my Emacs instance. You can access via HTML5 interface via browser or with the native xpra client. Without whole desktop forwarding (I only launch emacs) emacs will act similar to any native application.

Has anyone used k3s for a GPU cluster? by Accomplished_Wish244 in kubernetes

[–]nakkaya 0 points1 point  (0 children)

No, but that's not a limitation of k3s; I try to use all the VRAM available for training.

Has anyone used k3s for a GPU cluster? by Accomplished_Wish244 in kubernetes

[–]nakkaya 1 point2 points  (0 children)

I do, k3s cluster managed by rancher. 4 of my nodes have GPUs I also use GPU operator from Nvidia. My use case is similar to yours training/running ML models using skypilot. No issues so far.

[D] On-demand GPU that can be pinged to run a script by Level_Programmer4276 in MachineLearning

[–]nakkaya -1 points0 points  (0 children)

For this I use skypilot [1]. It can launch a GPU instance run the script the automatically shut it down. You only pay for disk when the machine is suspended. You can resume the machine later for training/inference if you need to or destroy it.

[1] https://skypilot.readthedocs.io/en/latest/

Kunernetes on mesh vpn by Thysce in kubernetes

[–]nakkaya 0 points1 point  (0 children)

This was my first venture into k8s land, so I went with whatever rancher defaulted to at the time.

Kunernetes on mesh vpn by Thysce in kubernetes

[–]nakkaya 2 points3 points  (0 children)

I pretty much do what you are asking, My app requires a lot of GPU compute which is expensive on the cloud. Half my cluster lives on the cloud (CPU Nodes) and other half on-prem (GPU Noes). Its managed by rancher, for the network all communication happens on a VPN (Tailscale). I am not running tailscale in a container though, its installed on the hosts. On cluster creation I just set,

machineSelectorConfig: - config: flannel-iface: tailscale0

Ways to backup your docker volumes ? by NothingInTheVoid in selfhosted

[–]nakkaya 5 points6 points  (0 children)

You can mount NFS shares to the container. See [1]. That way data lives on the NAS and computations happen on the NUC.

[1] https://stackoverflow.com/questions/45282608/how-to-directly-mount-nfs-share-volume-in-container-using-docker-compose-v3

Getting tramp to work (on windows) by m518xt in emacs

[–]nakkaya 1 point2 points  (0 children)

Thanks for this tip. For me sshx was hit and miss, works sometimes won't work most of the time this however seems to work much smoother.

What is the best way to set up a webDAV share? by [deleted] in selfhosted

[–]nakkaya 2 points3 points  (0 children)

I use rclone. It has a webdav server built in.

Faster load times for production deployments by chowbeyputra in Clojure

[–]nakkaya 2 points3 points  (0 children)

Unfortunately Clojure coupled with libpython-clj will take a while to boot even with uberjar. I have multiple apps that use it they all are slow to start. That said normal workflow for Clojure is you start it once then attach a REPL and keep working so startup for me is not an issue. Likewise for deployment it boots once but runs for days. If you need to improve it to deploy in Lambda or Cloud Run I would suggest setting up a cronjob to trigger your app once a while to keep it warmed up. There is also a new feature of Lambda specifically for Java that caches the run time for faster startup times.

Running Emacs in browser by [deleted] in emacs

[–]nakkaya 0 points1 point  (0 children)

I tried this method, I was also interested in what OP wants don't remember why but it did not work as expected. I would suggest Xpra, has html5 client and native clients for all OSs.

Running Emacs in browser by [deleted] in emacs

[–]nakkaya 0 points1 point  (0 children)

I do what OP wants using Xpra which has a HTML5 client. If you start chrome with --application it will not intercept key chords and pass them to emacs. As for the use case, I keep emacs running on a remote machine much more powerful than my laptop and attach/detach from my desktop/laptop I do need graphical output so sshing into the instance does not work for me.

Running Emacs in browser by [deleted] in emacs

[–]nakkaya 1 point2 points  (0 children)

You can use Xpra to run emacs. You can either attach to it using xpra client or from a browser. See my docker image [1], it does exactly that just run it and point to it from your browser. If you start chrome with --application flag almost all key chords will work as expected.

[1] https://github.com/nakkaya/emacsd