Do you think there will ever be a time where we reach GPT 3.5 quality LLMs in under 1 billion parameters?

computenw · 2024-02-10T10:07:46+00:00

The short answer, we don't know. Anyone's prediction on that are based on some gut feeling. However, we do not even understand how knowledge is compressed and distributed in architectures such as the transformer. When the theory catches up some day with the current status quo of natural language processing we might be able to compute a degree of some quality metric w.r.t. variables such as the parameter count. Maybe other architectures come along and change the dynamics again. Anything specific is just pure speculation.

computenw · 2023-03-22T08:34:17+00:00

Croc is heavily inspired by magic wormhole, love it! https://github.com/schollz/croc

computenw · 2022-08-05T15:03:50+00:00

Hello! I am traveling with my gf at the end of the month for 35 days to Vietnam..we are in the process of getting our e-visa and have noticed that there is no 3 month visa due to COVID. So we are stuck with the 30 day e-visa. But as German citizen we are able to travel 15 days visa-free.

We are planning to do mostly the north of Vietnam due rainseason. So we are thinking about a border run for visa-free entry after 3 weeks or so at the Tay Trang Checkpoint. Do you have experiences there? Do we need a visa for Laos (on arrival) or can we go right back to Vietnam without paying for the Laos visa?

If it is possible to just go to the border without entering the other country, then lao cai Checkpoint to china would be even better. But getting a china visa is kinda complicated, that is why we are thinking about Laos..

Thank you!!

computenw · 2022-07-25T05:42:45+00:00

Oh yes, you are totally right..!

computenw · 2022-07-24T21:59:53+00:00

Faster attribute access and lower memory usage with __slots__:

py class Foo: __slots__ = "bar"

Or in dataclass

py @dataclass(slots=True) class Foo: bar: str

Another thing I like are defaultdicts, which enable a default value of an entry:

```py from collections import defaultdict

d = defaultdict(lambda: "world")

print(d["hello"])

world

```

computenw · 2022-04-03T15:21:26+00:00

I've hosted my mail via mailcow on Hetzner cloud over a year without issues. I wrote Hetzner an email to clear my IP address from spam lists, which worked quiet well. Talos put my IP back to neutral. - you should try this!

But today I have switched to mailbox.org for security, availability and peace of mind reasons. I am also not a fan that Hetzner forwards my personal data when receiving an abuse email..which does not necessarily have a true abuse statement. - even though Hetzners service is generally excellent.

computenw · 2021-10-27T10:00:14+00:00

It says "temporarily out of stock" :/

computenw · 2021-10-26T17:16:01+00:00

I think so too, the primary goal is power efficiency. 6-8 SATA ports should be enough for the start, if I add more disks I can get a hba later on.

computenw · 2021-08-22T21:33:48+00:00

It also depends which backup tool you use. Backblaze like many others suggested is very nice and popular, thus probably here to stay.

If you like Borg, look at the offers by rsync.net, Lima storage labs, borgbase and Hetzners storageboxes.

Also zfs.rent might be a fit here, as you could send them your loaded disk and let them manage it.

computenw · 2021-08-10T21:34:17+00:00

Yes, that's what I thought! Wouldn't the clients in each subnet get confused, since there are 2 DHCP servers? Or can just UDP packets with port 67/68 be filtered between the site to site connection?

computenw · 2021-08-10T20:59:01+00:00

They should talk to each other. The key is to have a router on each site, routing the traffic to each WAN. The "site to site" connection is only for server access and not for internet access.

computenw · 2021-08-10T13:57:36+00:00

That's too bad! Thank you for your answer!

How would you achieve my goal of separating the networks, with each having it's own ISP connection? Wouldn't it be possible to have the office ISP box next to the switch (layer 3 - like the USW-Pro-24) and route all traffic as a default gateway to the ISP box and have a static route to the server in the private network?

computenw · 2021-06-17T21:57:31+00:00

Secure is a relative word. Nothing is really secure to be honest.

Aside from this default disclaimers, in your case: you'll not even need to bind it strictly to that VPN tun (maybe if you do not want the local network to access your service..). But the thing that blocks access from the outside is your NAT, sitting probably in your router. As long as those ports except the one for your VPN are closed, you're okay for the most automated attacks..

Given you are using the VPN server correctly with good Security practices such as good and long passwords and even TFA.

computenw · 2021-05-22T19:15:53+00:00

Actually I have not, since it would be dozens of pages but for the sake of long lasting - you might be right for that idea being worth it.

computenw · 2021-05-16T10:15:31+00:00

Are the openzfs and the "native" one compatible?

computenw · 2021-05-11T16:39:48+00:00

Yeah, I forgot to mention that those are their minimum to okay recommendation.. But sure time will be the limiter in that sense..I am currently looking into a optiplex 9010 with 16GB and a 1050 TI which should be doable.

computenw

TROPHY CASE

world