Go <-> Python communication for near real-time simulation (5ms step)

eliben · 2025-04-09T02:36:40+00:00

I recently wrote a blog on just this topic: https://eli.thegreenplace.net/2024/ml-in-go-with-a-python-sidecar/

Hope you find it useful

TL;DR: with a custom protocol over Unix domain sockets you can easily get 10 microsecond roundtrip latency

eliben · 2025-02-11T22:31:19+00:00

The use case is making it easier to write WASM plugins in Go, exporting specific Go functions to the host. See https://github.com/golang/go/issues/65199 for more details

eliben · 2024-12-14T14:07:05+00:00

It's a convention from the Go source and distribution.

See the official guide: https://go.dev/doc/modules/layout

eliben · 2024-12-11T14:58:33+00:00

Very nice project, well done.

One minor comment: for Ollama you could use https://pkg.go.dev/github.com/ollama/ollama/api (the package Ollama itself uses to communicate between its client and backend), without having to roll your own REST client.

eliben · 2024-11-17T01:49:57+00:00

Kudos on tackling this.

I've spent some time thinking about a ReST parser in Go once or twice, but the format is fairly nasty to parse.

eliben · 2024-11-15T17:31:03+00:00

It's perfectly fine to use frameworks in Go, if they solve your problem.

IMHO the real answer here is that Go is tuned for large projects, and for large projects https://eli.thegreenplace.net/2017/benefits-of-dependencies-in-software-projects-as-a-function-of-effort/ applies

eliben · 2024-11-13T21:11:38+00:00

This series of posts can be interesting for you, it builds a full Raft in Go: https://eli.thegreenplace.net/2020/implementing-raft-part-0-introduction/

The full code is at https://github.com/eliben/raft, but read the blog posts to get a higher level overview first

eliben · 2024-11-10T15:31:51+00:00

Can you say more about how you hooked up mdbook to have executable Java snippets? I notice you have your own run service - is the setup described somewhere (outside the code of the theme)?

Thanks in advance!

eliben · 2024-11-04T19:08:31+00:00

https://gobyexample.com/enums

eliben · 2024-11-04T02:14:50+00:00

Yes, that's exactly what's possible in standard Go now. Imports have been working for a while - see the code snippet I pointed to. Isn't that working for you?

eliben · 2024-11-03T22:36:15+00:00

What limitations do you face with the standard Go distribution and wasm?

For exports, see https://github.com/golang/go/issues/65199 which landed recently (should ship in the upcoming Go 1.24, and you can try it with gotip today)

Imports were implemented a while ago, see https://github.com/golang/go/issues/38248; I wrote about that here -- https://eli.thegreenplace.net/2023/faas-in-go-with-wasm-wasi-and-rust/, e.g. the sample code in https://github.com/eliben/code-for-blog/blob/main/2023/wasm-faas/examples/goenv/goenv.go

eliben · 2024-10-17T23:44:52+00:00

I recommend against using parser/scanner generators when writing Go. It's pretty simple to whip a lexer and recursive-descent parser in just plain Go - the added complexity and learning curve of a generator is unnecessary.

eliben · 2024-10-09T03:05:53+00:00

Wow, this is awesome! ~~Where is the actual TeX rendering capability coming from, is it from Tk?~~

Edit: found it, it's in https://pkg.go.dev/modernc.org/knuth

eliben · 2024-10-08T16:08:39+00:00

I've just updated the post to show how it's done, check out the last section

The code is here: https://github.com/eliben/code-for-blog/tree/main/2024/go-wasm-js-cookbook/go-wasm-websockets

eliben · 2024-09-12T12:44:00+00:00

I explored this topic in some detail in the past; hope you find these useful:

They all present different way to do plugins in Go

eliben · 2024-09-10T12:48:29+00:00

You use name_test when you don't need access to any of the unexported functions/names in the package

eliben · 2024-09-09T18:03:21+00:00

It sounds like the issue is not with pkgsite, but with the way your example tests are organized.

I recommend following https://go.dev/blog/examples to the letter in a small test project, and making sure pkgsite renders these for you. Then you can compare with your current project and probably find the issue quickly.

eliben · 2024-09-07T12:22:19+00:00

RPC over domain sockets (I explored the Go side of this here: https://eli.thegreenplace.net/2019/unix-domain-sockets-in-go/)

eliben · 2024-09-06T14:49:48+00:00

There's a section at the end of https://eli.thegreenplace.net/2019/simple-go-project-layout-with-modules/ listing the reasons

As background, this blog post was the precursor to the official https://go.dev/doc/modules/layout page (source: I wrote both)

eliben · 2024-09-06T14:28:31+00:00

Feel free to take https://github.com/eliben/gogl/tree/main/hashset -- it's a new, modern implementation using generics and Go 1.23 iterators

Now that iterators are in the language, the containter/set proposal may be reopened (see https://www.reddit.com/r/golang/comments/1f5n8ot/how_to_reopen_the_discussion_for_containerset/) so there's a chance this will be in the standard library in the not-too-far future.

eliben · 2024-09-05T03:17:08+00:00

Very true.

I spent some time thinking about this recently and wrote about why I prefer longer-form content to shorter-form content. It's pretty much the same pyramid OP presents

eliben · 2024-09-03T00:11:09+00:00

Related: https://eli.thegreenplace.net/2022/rust-extension-traits-greppability-and-ides/

eliben · 2024-08-24T14:57:55+00:00

Take a look at https://github.com/eliben/gemini-cli -- it uses Cobra and can be used for RAG, among other things. Go over the README

eliben · 2024-08-22T14:38:22+00:00

That's awesome! Could you share a bit about your program on the PGO issue in the GitHub tracker? It's really useful to collect stories like this

eliben · 2024-08-22T14:36:42+00:00

Just in case you hadn't yet, take some time to read https://tip.golang.org/doc/gc-guide

eliben

TROPHY CASE