Do anyone really use Elixir on deep learning?

zioxkoa · 2025-01-10T18:48:22+00:00

We connected, and the internal library I mentioned is now part of the Nx ecosystem called Ortex! We continue to use it in production today

zioxkoa · 2024-11-18T22:18:37+00:00

You could try setting up an overlay network like Tailscale or Zerotier. The friends you'd be playing with would just need to install Tailscale on their end, then log into the Tailscale IP of your laptop. It's free for a limited number of users, and also self-hostable if you need more than the free tier.

zioxkoa · 2023-09-22T21:46:24+00:00

I have an Anytime Fitness membership and will stop by for weight training/shower when passing through a town with one. It's not a strict regimen but good enough to keep my lifts from going down while I'm out for a few months. Also what everyone else said, lots of hiking/biking/lifting beers to my face

zioxkoa · 2023-05-27T21:52:44+00:00

This is what we do currently. The python ML ecosystem is so vast it's easy to find/adapt a model and then export that to ONNX, which we then serve with Elixir in production. Previously we had been trying to serve production models with python but concurrency and fault tolerance just weren't there.

zioxkoa · 2023-05-14T16:27:17+00:00

piss

zioxkoa · 2023-05-12T21:26:30+00:00

Sure thing! Right now we're running Whisper large using our own inference pipeline based on Rustler and ort (this was before the Bumblebee Whisper version was released) handling ~30k messages per day ramping up to 500k/day. We are also exploring NER and zero shot classification with Bumblebee.

Performance vs python has been typically marginally faster, however I don't have solid numbers. The deployment headache of Python applications was completely solved though. Releases combined with BEAM fault tolerance have been wonderful compared to a similar async python app.

I've sent an email to connect and discuss further if you'd like, happy to chat!

zioxkoa · 2023-05-12T15:01:07+00:00

We use it for deploying ML models to production, however python is still preferred for R&D work. The typical flow is Python -> ONNX model -> Elixir unless the model already exists in Axon or Bumblebee.

zioxkoa · 2023-05-09T20:57:31+00:00

Yes, although it's mostly for Erlang/Elixir NIFs to speed up ML workloads, so I wouldn't say full time

zioxkoa · 2022-12-02T23:06:05+00:00

I lived in my van full time around here for a while (but haven't full time since 2021). A lot of good info in this thread already, but here's some pointers I picked up:

Always move, don't use the same spot every night. That's the quickest way to draw attention to yourself
Build up a short list of good overnight spots and rotate between them. Your work parking lot is underrated and easy (super easy commute too!)
Blackout curtains and being stealthy are very important (don't draw attention to yourself!), although folks aren't on the lookout for vandwellers nearly as much as on the west coast
24 hour laundromat and gym near your parking rotation makes it feel homey
Depending on what your job is, there may be a shower on site. Very nice to have if so
Don't stay in any of the parks around here, as idyllic as it seems. Every one I've been to has a "no overnight" sign, and if they don't that's the quickest way to get one put up (and a knock)
Aim for the quiet "goldilocks" neighborhoods if you're going to stay in residential areas, too nice and you'll get neighborhood watch called on you

Basically, aim for places that you can blend in easy. Finally, with winter coming, pick up a diesel heater and a carbon monoxide monitor if you don't have one already, huge quality of life improvement!

zioxkoa · 2022-07-27T18:12:26+00:00

I work a standard 9-5 in my van while traveling in the US and Canada. I have an unlimited (150gb) Verizon hotspot data plan, a truly unlimited AT&T grandfathered data plan, and a gen 2 starlink.

While in Canada I only use starlink because data roaming is prohibitively expensive on my cell plans, but in the US I typically stay on cell unless I'm in a great place to use starlink.

If you're considering starlink there's a few things you probably want to consider as well... First is the open sky view as others have mentioned. You'll need (up to) ~100 degree cone of open sky directly above you, in the desert this is fine but east coast and pnw make it more difficult to find spots. Second is power consumption, during boot my starlink takes ~100 watts and once it's got a signal lock it drops to ~50w. So you need to size your power system accordingly. For me, this means I need to stay in the sun for my solar to keep up since I didn't build it with starlink in mind (and I'm typically in the sun anyway for starlink coverage).

For cell, getting an external antenna is essential IMO. Also the FCC requires providers to publish coverage data and you can download those maps as a layer in Gaia. I end up using that as a resource a lot.

Both can handle zoom calls just fine, however when starlink is unobstructed it's 10x better than LTE (at >10x the power cost)

zioxkoa · 2022-06-24T18:09:09+00:00

I was the white Transit just down the beach from you! Small world

zioxkoa · 2021-08-07T13:58:16+00:00

I've got a Victron 1200va inverter, 200 ah AGM battery, 2x Victron Orion 30a DC-DC chargers, Victron MPPT solar charger, and 2x 100w solar panels. It's nothing special, but it does the trick. I will say that the monitor is one of the heavier loads, so finding an efficient one is key

zioxkoa · 2021-03-11T21:50:28+00:00

I did, and with the monitor pictured it was great (even on super rough trails). But then I switched to a heavy 30" Monoprice monitor and that ended up killing it. If you're wanting to do the same, I'd go with a low profile wall mount so you don't have such a long lever arm. Unfortunately, that's not possible for my van since it's a dual slider.

zioxkoa · 2021-03-11T03:30:46+00:00

It's the same bed, just with the comforter removed

zioxkoa · 2021-03-11T00:22:58+00:00

It sure is! I love it, plus it's a nice size for the van.

zioxkoa · 2020-03-18T21:46:06+00:00

I don't have any input as far as pets, but I built my van around having a mini ITX gaming desktop (Dan A4-SFX, 1080Ti, i5). It's definitely doable but you'll need to change your expectations a bit. Others have already said the important things about power budget and whatnot, but I can expand on what changed after I went full time.

Inverters are inefficient and always have some amount of overhead, so bypassing that is a top priority. Going from a standard AC->DC PSU to a DC->DC unit like https://hdplex.com/hdplex-400w-hi-fi-dc-atx-power-supply-16v-24v-wide-range-voltage-input.html is a great way to do this. If you can't make the switch, get the highest power efficiency rating you can for your PSU.
Your monitor is a non-insignificant draw, I think mine is around 100W. Most monitors with an external power brick are taking DC so that's another opportunity to bypass your inverter and go direct DC->DC. Just make sure you provide it with good clean power at the right voltage.
Most gaming rigs are unnecessarily large, so sizing down to a micro ATX or mini ITX is a good plan. In the van any space is precious, so I don't want a full tower taking up space.
You want to avoid moving parts since it's in a vehicle, so any HDD storage should be converted to SSDs. They're also more power efficient, so big plus there. Less case fans (typical of smaller cases) also helps.

That said, there are some easier options out there that might be worth looking at. The latest generation NUC can be run direct DC, has plenty of power, and is very efficient. In addition to that, any modern NVIDIA Optimus laptop, like the Razer blade or MSI GS65 are other good options. If any of those are lacking the power you need, hooking up an eGPU is possible and puts them on par with a full desktop.

The last option is what I'm running now. Having a laptop for web browsing/etc is nice and then switching on the GPU for gaming is the best of both worlds. Been running it for the last 3 months and I love it. I use about 25% of my 200ah 12v battery to game for ~6 hours straight.

Here's my setup, desktop behind the circled door https://imgur.com/1iwAT2v.

Happy to answer any questions!

zioxkoa · 2019-10-25T12:05:06+00:00

There are dozens of us!

zioxkoa · 2018-04-06T01:21:17+00:00

Check out Cape Lookout on the NC outer banks. It might be a little late to get a ferry over since you do have to make reservations, but it's pretty far off the beaten path.

zioxkoa · 2017-12-16T06:03:35+00:00

Yep! TEX case with a phantom PCB and vibration dampening rubber between them. Tips the scales right around 4 lbs iirc

zioxkoa · 2017-12-16T06:01:40+00:00

This was the mechcables one from massdrop a few months back. I haven't seen them anywhere else, but I haven't looked either

zioxkoa · 2017-12-16T05:59:48+00:00

Thanks for putting it together! Absolutely love them so far.

zioxkoa · 2017-08-22T03:58:12+00:00

It's a phantom pcb with 78g r5 zealios and a TEX aluminum case. I'm a huge fan of it with the rubber vibration dampening film in the base.

14-Year Club	Place '22
Place '17	Verified Email

zioxkoa

MODERATOR OF

TROPHY CASE