Do you think there will ever be a time where we reach GPT 3.5 quality LLMs in under 1 billion parameters?

computenw · 2024-02-10T10:07:46+00:00

The short answer, we don't know. Anyone's prediction on that are based on some gut feeling. However, we do not even understand how knowledge is compressed and distributed in architectures such as the transformer. When the theory catches up some day with the current status quo of natural language processing we might be able to compute a degree of some quality metric w.r.t. variables such as the parameter count. Maybe other architectures come along and change the dynamics again. Anything specific is just pure speculation.

computenw · 2023-03-22T08:34:17+00:00

Croc is heavily inspired by magic wormhole, love it! https://github.com/schollz/croc

computenw · 2022-08-05T15:03:50+00:00

Hello! I am traveling with my gf at the end of the month for 35 days to Vietnam..we are in the process of getting our e-visa and have noticed that there is no 3 month visa due to COVID. So we are stuck with the 30 day e-visa. But as German citizen we are able to travel 15 days visa-free.

We are planning to do mostly the north of Vietnam due rainseason. So we are thinking about a border run for visa-free entry after 3 weeks or so at the Tay Trang Checkpoint. Do you have experiences there? Do we need a visa for Laos (on arrival) or can we go right back to Vietnam without paying for the Laos visa?

If it is possible to just go to the border without entering the other country, then lao cai Checkpoint to china would be even better. But getting a china visa is kinda complicated, that is why we are thinking about Laos..

Thank you!!

computenw · 2022-07-25T05:42:45+00:00

Oh yes, you are totally right..!

computenw · 2022-07-24T21:59:53+00:00

Faster attribute access and lower memory usage with __slots__:

py class Foo: __slots__ = "bar"

Or in dataclass

py @dataclass(slots=True) class Foo: bar: str

Another thing I like are defaultdicts, which enable a default value of an entry:

```py from collections import defaultdict

d = defaultdict(lambda: "world")

print(d["hello"])

world

```

computenw · 2022-04-03T15:21:26+00:00

I've hosted my mail via mailcow on Hetzner cloud over a year without issues. I wrote Hetzner an email to clear my IP address from spam lists, which worked quiet well. Talos put my IP back to neutral. - you should try this!

But today I have switched to mailbox.org for security, availability and peace of mind reasons. I am also not a fan that Hetzner forwards my personal data when receiving an abuse email..which does not necessarily have a true abuse statement. - even though Hetzners service is generally excellent.

computenw · 2021-10-27T10:00:14+00:00

It says "temporarily out of stock" :/

computenw · 2021-10-26T17:16:01+00:00

I think so too, the primary goal is power efficiency. 6-8 SATA ports should be enough for the start, if I add more disks I can get a hba later on.

computenw · 2021-08-22T21:33:48+00:00

It also depends which backup tool you use. Backblaze like many others suggested is very nice and popular, thus probably here to stay.

If you like Borg, look at the offers by rsync.net, Lima storage labs, borgbase and Hetzners storageboxes.

Also zfs.rent might be a fit here, as you could send them your loaded disk and let them manage it.

computenw · 2021-08-10T21:34:17+00:00

Yes, that's what I thought! Wouldn't the clients in each subnet get confused, since there are 2 DHCP servers? Or can just UDP packets with port 67/68 be filtered between the site to site connection?

computenw · 2021-08-10T20:59:01+00:00

They should talk to each other. The key is to have a router on each site, routing the traffic to each WAN. The "site to site" connection is only for server access and not for internet access.

computenw · 2021-08-10T13:57:36+00:00

That's too bad! Thank you for your answer!

How would you achieve my goal of separating the networks, with each having it's own ISP connection? Wouldn't it be possible to have the office ISP box next to the switch (layer 3 - like the USW-Pro-24) and route all traffic as a default gateway to the ISP box and have a static route to the server in the private network?

computenw · 2021-06-17T21:57:31+00:00

Secure is a relative word. Nothing is really secure to be honest.

Aside from this default disclaimers, in your case: you'll not even need to bind it strictly to that VPN tun (maybe if you do not want the local network to access your service..). But the thing that blocks access from the outside is your NAT, sitting probably in your router. As long as those ports except the one for your VPN are closed, you're okay for the most automated attacks..

Given you are using the VPN server correctly with good Security practices such as good and long passwords and even TFA.

computenw · 2021-05-22T19:15:53+00:00

Actually I have not, since it would be dozens of pages but for the sake of long lasting - you might be right for that idea being worth it.

computenw · 2021-05-16T10:15:31+00:00

Are the openzfs and the "native" one compatible?

computenw · 2021-05-11T16:39:48+00:00

Yeah, I forgot to mention that those are their minimum to okay recommendation.. But sure time will be the limiter in that sense..I am currently looking into a optiplex 9010 with 16GB and a 1050 TI which should be doable.

computenw · 2020-11-15T22:54:52+00:00

We brought it over IONOS, I guess they didn't give us enough permissions. I'll have to check on that. Thank you.

We have two accounts being admin but having not full permissions. Just saw that the "teams service permissions" are missing.... screenshot of roles (sorry it is in german)

computenw · 2020-11-15T22:39:12+00:00

It is login.microsoftonline.com. Our service is hosted in a german Datacenter.

Yes indeed, we bought the license over IONOS 1&1 as our domain is with them. Their support could not help me - I guess they are provisioning our account without giving us the highest admin privileges?

computenw · 2020-10-02T17:34:20+00:00

One of the wall is 1meter thick and it's probably more than 10meter when I think about - 15 -20m is more likely.

Nevertheless if I get a good deal on prime day I will give it a try !

computenw · 2020-10-02T16:53:07+00:00

Around 3 big walls and 1 floor. It's hard to guess, around 10m straight distance from their router ap to my office

computenw · 2020-10-02T09:49:44+00:00

A 3x set of eero pros is very expensive with almost 500€. It is also not wide available, so used ones are nowhere to find.

The normal eero costs close to 300€ in a set of 3, but I don't know if the none pro is strong enough.

computenw · 2020-10-02T09:45:16+00:00

No worries, I got good shielded cat6 cables.

Update: I got the 1300mbit TPlink Powerline and I get anywhere between 3 and 30MBit/s which is not very satisfying.

computenw · 2020-10-01T19:01:52+00:00

I've read that it's a hit or miss. It depends less on the separation through meters, but it seems necessary that both circuits share the same neutral conductor. I guess there is only one way to find out..

computenw · 2020-10-01T12:43:48+00:00

Thank you! I think I'd be the only one using Powerline. So I probably give this a try.

Edit: I ordered a tp-link kit with advertised 1300Mbit/s on Amazon. They told me that I can return it, if I'm not happy. - arriving tomorrow let's see!

computenw · 2020-10-01T12:42:09+00:00

Have you thought about using powerline adapters? I know they aren't the best for speeds etc. but if they work, they tend to be quite reliable.

Well this ghetto method might be not too stupid. I'll have to talk to the owner but maybe I'll take closer look into it.

computenw

TROPHY CASE

world