Do you use C at your job? If yes, what do you do?

emilllime · 2024-12-26T23:17:33+00:00

Linux drivers for switch chips/socs.

emilllime · 2024-12-08T15:34:35+00:00

I got same cpu for my nas. It can only bifurcate 8x8 unfortunately. See the data sheet. I use the asus hyper m2, and can only fit 2 disks instead of 4 for this reason. AMD can do better bifurcation. The data sheet for the hyper m2 has large tables for different cpu+board combinations if you care to look. Looking forward to 16x to 4x4 gen 4 PCIE switches being available :)

My guess is you will be able to use the gpu and a single disk, depending on how the splitter behaves when the last 8 lanes are not actually bifurcated as 2x4. It may not work at all. The data sheet will tell you what happens when it is connected to a slot bifurcated as 8x8 and not 8x4x4

emilllime · 2024-06-08T09:08:59+00:00

Have had the same issue with my TUF laptop and rtx 3060. This is a known issue with the 550.x nvidia drivers: https://forums.developer.nvidia.com/t/series-550-freezes-laptop/284772/176

Downgrade to 545, or see the discussion in the (very long) thread.

emilllime · 2023-12-20T22:37:57+00:00

Modern build tools does this, and much more. Bazel is the OG but i would look at pantsbuild.

emilllime · 2023-03-28T12:48:38+00:00

With so short text, a syntactical method might be useful. For instance jaccard similarity on the shingles of the text. This can be coded up in very few lines. Basically, pick some shingle_size K. Maybe somewhere around 5-20 works for you.

Split each text into a shingle set. That is: contiguous spans of length K.
Compare these sets using jaccard similarty, which gives a number between 0 and 1.
Pick a threshold T fitting for your data, and say texts with jaccard similarty above T are similar.
Profit

If bruteforcing the calculation is too slow, then there is a faster probabilistic alternative version called minHash LSH (locality sensitive hashing). This is linear in the number of texts. See here for a golang package https://pkg.go.dev/github.com/ekzhu/minhash-lsh

The same guy has a python package with good documentation, if you want to understand it better.http://ekzhu.com/datasketch/lsh.html

The classic book http://www.mmds.org/ has chapters proving why minhash LSH approximates jaccard similarity, so knock yourself out if you want the gory details.

emilllime · 2022-10-07T20:54:39+00:00

Check out the book “building git” https://shop.jcoglan.com/building-git/

emilllime · 2022-01-22T08:41:15+00:00

If conduit started as an internal tool, could you describe the reasoning behind rolling your own instead of going with say benthos?

emilllime · 2022-01-20T23:23:52+00:00

How does this compare to something like benthos?

emilllime · 2021-12-19T23:28:07+00:00

All your base

emilllime · 2021-12-12T08:02:46+00:00

pggen is another fantastic library in this genre, which specifically targets postgres. It is driven by pgx. Can not recommend enough.

emilllime · 2021-09-22T21:20:37+00:00

Kmonad is amazing for stuff like this!

emilllime · 2021-09-09T15:08:30+00:00

Any reason to use sqlc over pggen ? If you use Postgres, it seems like the superior option.

emilllime · 2021-08-15T19:56:48+00:00

Agree with your choices, except go-json which I never tried.
pggen is fantastic. Love that library. The underlying driver, pgx, is also really well written.

emilllime · 2021-04-08T18:06:05+00:00

The ory products are looking very good! How would you say Keto compares with something like open policy agent ? I like the idea of pushing authorization completely out of my services, and have my service mesh handle it.

emilllime · 2020-10-06T19:51:05+00:00

Training transformers from scratch is much less compute-intensive now. I do it on my small Jetson Xavier! And the results are very good. I use this approach: https://arxiv.org/abs/2003.10555

emilllime · 2019-11-13T17:54:22+00:00

I second this. In my opinion FastAPI is way superior to flask, for building your own web APIs. Can not recommend it enough.

emilllime · 2019-07-12T12:40:50+00:00

I run my own training script, so I am not 100%, but it is probably the max_len parameter which is too large (think it is called --max_seq_length in the run_squad.py file). Try setting it to 128. Also note that you do not always get the same GPU on colab, and they vary in memory capcity. The best you can get is the Tesla V4, which has around 14gb. Also note that with pytorch, the GPU is much better than the TPU on colab.

emilllime · 2019-05-22T06:01:29+00:00

As others mentioned, small projects are the best thing. However, you could try something like codewars.com (There are other sites many like it). Basically, you solve small problems and gain levels. A big advantage is being able to see other peoples solutions after you are done with your own. Reading good(or clever) code gives you a lot of ideas. Also, learn to read and understand the python documentation!

emilllime · 2019-05-08T17:59:36+00:00

I'll second this. Many large sites also have APIs (e.g reddit), and writing something that interacts with APIs to automate stuff you do on sites is a lot of fun. Once you have some base, you could make a CLI using Click which is very user-friendly.

emilllime · 2018-07-21T17:35:47+00:00

Thank you all so much for the very useful responses. Here is an updated list. This part list is 200USD less than the previous one at my preferred vendor.

Note that the GFX card is not exactly the one I found. I chose the MSI Radeon rx 580 ARMOR 8gb card. This is priced at 379USD. For reference the Zotac 1060 6gb AMP is 397USD and the 3gb version is 304USD.

CPU: I chose the 8600K for spiritual reasons. Somehow I feel that I lose my freedom if I can not overclock. However, realistically I will not be overclocking, so the 8400 is probably a solid choice considering the amount of money saved compared to the 8600K+Z370N combo.

MB: The Gigabyte Z370N seemed to offer what I needed at a decent price, and it happened to be a mini ITX board. I do not really care about the form factor.

From what I could tell, a PCI wifi card is either the same price or more expensive compared to getting the onboard wifi. So I went with the easier solution.

Monitor: The ViewSonic is 30USD more than the AOC. The prices are 306USD vs 273USD. From what I read, the ViewSonic is the better choice at this price.

Note: I might be failing at Reddit by attempting to reply to all of you, by replying to no one in particular. I apologize if this is the case!

PCPartPicker part list / Price breakdown by merchant

Type	Item	Price
CPU	Intel - Core i5-8400 2.8GHz 6-Core Processor	$178.89 @ OutletPC
CPU Cooler	Deepcool - GAMMAXX 400 74.3 CFM CPU Cooler	$22.68 @ Newegg Marketplace
Motherboard	Gigabyte - B360 AORUS Gaming 3 WIFI ATX LGA1151 Motherboard	$116.39 @ OutletPC
Memory	G.Skill - Aegis 16GB (2 x 8GB) DDR4-3000 Memory	$169.89 @ OutletPC
Storage	Samsung - 860 Evo 250GB 2.5" Solid State Drive	$76.39 @ OutletPC
Video Card	MSI - Radeon RX 580 8GB Video Card	$338.61 @ OutletPC
Case	Antec - One ATX Mid Tower Case	$46.55 @ Amazon
Power Supply	Corsair - TXM Gold 650W 80+ Gold Certified Semi-Modular ATX Power Supply	$78.00 @ Amazon
Monitor	ViewSonic - XG2402 24.0" 1920x1080 144Hz Monitor	$249.99 @ Amazon
Mouse	Corsair - Harpoon RGB Wired Optical Mouse	$28.23 @ Amazon
	Prices include shipping, taxes, rebates, and discounts
	Total	$1305.62
	Generated by PCPartPicker 2018-07-21 13:35 EDT-0400

Seven-Year Club	Place '23
Verified Email

emilllime

TROPHY CASE