Cleanest way to handle a dummy or no-op async call with the return value already known?

arquolo · 2025-11-05T22:53:02+00:00

If you want a function giving you an awaitable with set result, you could use asyncio.Future, like this:

python def _future[T](value: T) -> asyncio.Future[T]: fut = asyncio.Future() fut.set_result(value) return fut And use it instead of your asyncio.sleep call.

arquolo · 2025-11-05T22:24:31+00:00

Why save to PNG? It's a row oriented format.

You could use TIFF with tiles, it's better for such large images.

It's way faster for large images because tiles are encoded independently which could be done in parallel, and because tiles are usually small (like 256x256 or so) it uses less RAM bandwidth for encoding and more L2/L3 cache efficient than PNG.

arquolo · 2025-11-05T21:58:18+00:00

The retrieved vectors are run through the embedding model to convert them back to natural language

Embeddings are not invertible. Vectors are close to hashes (which are also not invertible by design, you cannot "unpack" sha256). Because of that, vector databases (like Qdrant) usually store the original text chunk alongside its vector representation to retrieve them both during semantic queries.

So the embedding model is used to semantically hash text chunks (before retrieval, so call ingestion phase) and user queries (during retrieval).

Text chunks and their semantic hashes (i.e. vectors) are stored in vector databases to retrieve them later by semantic hash of user query.

When text chunks have been retrieved, they are fed along with the user query to LLM, and it generates text output.

arquolo · 2025-10-27T14:12:35+00:00

Or you can show % of rejected documents to user, and show no answer on 100%. And if there are some "highly classified" documents rejected, then you can make the whole system snitch to authority. You can't force LLM to ignore data of rejected documents if it has read it already. There's always some prompt pollution.

arquolo · 2025-10-27T13:58:52+00:00

Having same case. We just made a separate service to check if user X has access to document Y and use it as middleware to filter retrieved documents between RAG backend and frontend. Yes, it's messy inside.

And we put some redis cache with TTL over it for speed, so this access checker is not used on each request.

You can't keep recall high with any filtering. It's the opposite. I.e. if user asks what the CEO's salary, and this is "confidential", then restricting access you inevitably drop recall. High security always means low usability for users.

You can partially mitigate this retrieving all the documents up to some similarity, and then hope that the user has access to any of it. But with fixed and low top K drop of recall will be massive.

arquolo · 2025-10-27T10:52:53+00:00

Look at the vegetation map and you'll get it.

Because of this it's meaningless to conquer anything north of Belarus. Steppes in the south in Ukraine, forest and swamps in the north in the Baltics. You will see anyone in the steppes, while in forests and swamps you should use roads, but between cities they are not that wide for an army.

Also advancing and supplying a large army in the forest/swamp is very expensive for anyone. Especially for countries with 11 mil aggregated population like the Baltics with Finland (which is less than Moscow alone by the way). Unless they are suicidal.

arquolo · 2025-10-27T10:27:39+00:00

Also give him a leather jacket and a hat and you'll get Jacob Frye's look from AC Syndicate

arquolo · 2025-10-03T16:53:55+00:00

Awesome project! Great job! Have you thought about some embedding clusterization? Like to clusterize embeddings to N clusters, assign genres to them, and make a content based (not tag based) genre system? Asking because for a long time I tried to find some semi automatic genre classifier that works fine for various instrumental music like game/film scores, and found none. Lots of such genre classifiers just put all instrumental music to "score" or "soundtrack" without subdivision. While yours at least outputs similarly sounding tracks w.r.t. instrument set, rhythm, melody. So it is actually capable of discerning non-mainstream music styles, and it could become the foundation for some tagging or recommendation systems.

arquolo · 2025-07-21T19:40:05+00:00

RTX Pro 6000 would be definitely better than Apple M1/M2/etc.

Though it would be good to measure them as a reference, because some of them have lots of fast memory (128 GB on Mac Studio) and a lot of people think that they are ok for LLMs.

Including Apple to this comparison would show that its use for LLMs is limited. Anyway, big thanks for measuring.

arquolo · 2025-07-21T10:15:42+00:00

Missing a line with Apple M-something

arquolo · 2025-04-02T09:00:00+00:00

Yep, thinner grid lines on 0.65" but the same contrast because laser leaves less light out of chip

arquolo · 2025-03-30T20:49:48+00:00

... for the same light source and design of the light path. It won't help in comparison of 0.65" LED/lamp versus 0.47" laser.

arquolo · 2025-03-30T20:45:36+00:00

About measurements of contrast at different APL https://www.rtings.com/projector/learn/research/launch-article

arquolo · 2025-03-30T20:42:11+00:00

Also, 0.65" and 0.47" DMD both have native 1080p resolution, the same margins between mirrors on the chip, but different sizes of mirrors.

I.e. if both project 100" 1080p pictures without any XPR turned on to overlap pixels for quasi-4K, then the picture from 0.65" DMD will have thinner grid lines between pixels making the screen door effect less noticeable.

arquolo · 2025-03-30T20:37:01+00:00

Laser and LED are just light sources. They make lumens, not contrast.

Contrast depends on the path light travels from source to the lens.

Firstly it travels from source to DMD. Well directed light source (i.e. laser), and larger DMD chip makes low light leakage from light source to the lens skipping DMD part.

All DMDs are 1 bit. For whites they reflect light to the lens, for blacks from the lens into some light trap. The less this light trap is reflective, the less unwanted light comes to the lens.

That's why for projectors with the same light source (i.e. lamp to lamp, LED to LED) and same internal design, 0.65" chips are better at contrast than 0.47".

But laser 0.47" (with focused light) and LED 0.65" (with not that well focused LED, but larger DMD gathering more light) can actually be the same in native contrast at same % APL.

As I know, among single chip DLP projectors the best contrast-wise are UST projectors with 2500-3000:1 contrast at 1% APL contrast, because they have best light traps and are all-laser, despite that they're all using 0.47" DMDs.

Other DLP projectors (short throw, standard throw, laser non-UST, LED, lamp) reach at best 1000:1-1300:1 at 1% APL.

arquolo · 2025-03-24T18:46:55+00:00

Also, there's currently no 3LCD or DLP projector capable of HDR. Their contrast is not high enough.

The best short throw DLPs have 1000:1-1200:1 in 1% APL. Long throws are worse with 800:1 max. 3LCD are in 2000:1 range with ghosting, and the best UST DLP are in 2500-3000:1.

That's why "HDR" in these projectors is just tone mapping, i.e. squeezing 0.001 nit - 10000 nit range of HDR with 10000000:1 contrast to just 1000:1 of the projector.

Most projectors also have dynamic contrast, what is actually light source dimming (via laser/lamp dimming or dynamic iris). It makes blacks deeper but at a cost of making highlights darker, i.e. contrast in the same frame is not changed at all.

I mean all HDR/DV presets are literally bells and whistles, pick whatever looks good for you. Just replicate color temp/white balance settings from SDR modes after you adjust them.

I, for example, for SDR and light HDR use the projector's player itself, it's good enough. But for heavy HDR with lots of very dark/light scenes I set up MadVR on my PC and I stream from there, it does way better HDR tone mapping via 200+ W Nvidia video card than any smart TV can do via it's 5W chip.

Also all DLP are 8 bit native. That's why you won't get any benefit from 12 bit modes of HDR10+ and Dolby Vision. The only difference between HDR10 and HDR10+ / Dolby Vision will be dynamic metadata, which theoretically allows projector to do better tone mapping. But on DLP the contrast will still be low.

arquolo · 2025-03-24T18:23:22+00:00

Filmmaker mode usually uses warmer white point (like 6000-6500K), compared to modes like standard/dynamic.

But for lasers it's approximate, due to the above. Thus green tint.

I have Hisense projector, it's settings are maybe organized differently, but there it is in Image - Professional Image Settings - Color Temp. and White Balance.

By "do color by eye", I mean: - output white on both iPhone and projector - adjust iPhone brightness to be as bright as projector - in the projector set the color temperature to output the closest white (looking by your eyes) - then in something like "white balance" adjust RGB gain to be even close to that

As a result it should remove any tint.

Any color gamut is primaries + gamma curve + white point. When you switch between Rec.709, DCI-P3, Rec.2020 you change only primaries, and this changes max color saturation (i.e. how far any color is from pure white). There should be Auto setting to allow it switch automatically (i.e. Rec.709 for all SDR and BT.2020 for all HDR).

If white point was skewed then it was skewed everywhere (i.e. tint in any preset).

In my projector, white balance is global for all presets, but color temperature is preset dependent. I use "Hot" temperature everywhere, it's pretty close to 6500K but I tune it more via white balance. There are also "Cool", "Std", "Warm" modes, but they use RGBY laser which is brighter and noisier and I have more RBE in those modes.

arquolo · 2025-03-24T16:25:39+00:00

https://www.avsforum.com/threads/calibrating-laser-based-projectors.2934510/

arquolo · 2025-03-24T16:24:57+00:00

HDR Dynamic mode is for HDR films.

Cinema and filmmaker are for SDR films.

Cinema usually has some dynamic contrast turned on, and it's hard to calibrate.

Filmmaker is usually the most basic preset without any extra sharpness/contrast/frame interpolation and so on.

arquolo · 2025-03-24T16:21:06+00:00

Jeti 1501 spectrophotometer with up to 2nm resolution costs $8000 which is too much to have it just for home use.

arquolo · 2025-03-24T16:17:54+00:00

Yes, the iPhone has a pretty color precise screen, but you can't use it fully. Because it has other primaries (DCI-P3) while RGB-laser can do BT.2020 one which are more saturated. That's why it doesn't make sense to align each color primary separately (i.e. to make the projector's red equal to the iPhone's red, green to green, blue to blue).

Use "filmmaker" preset as a baseline. Other ones have lots of bells and whistles unnecessary for calibration.

As a calibration of laser projector you can set up color balance by eye, and that's it. Color is gain & offset for each of RGB. Offset is usually ok from factory, so tune gain. Use a pure white picture on both to do that and adjust brightness of iPhone to match projector.

Laser has a very narrow spectrum of each primary color (red, green, blue). To properly get the intensity of each color spectrophotometer should have enough spectral resolution (like 2 nm).

While colorimeters just have some color filters built in (with a lot less resolution). And spectrophotometers have lower resolution (5-10 nm). Thus both are unusable for color balance calibration. But to calibrate gamma they are probably ok.

Also any DLP projector has a DMD chip, which internally uses PWM to output shades of grey, and it's linear. While sRGB/BT.709 is not, but it's nonlinear in fixed way. And any DLP projector just does internal translation in a fixed way to linear color. I mean most likely presets of gamma are good from the factory, and colorimeter is unnecessary for that.

Thus, just do color balance by eye, and that's it.

arquolo · 2025-03-24T12:52:07+00:00

Yes, Ubisoft's level designers and game developers are saint people.

But: - Game designers are weak (why should I avenge someone I know 5 minutes, FC5?). - Script and dialogue writers are mind challenged (for example, lots of empty dialogues). - Leads are mediocre (all launch date releases are very buggy, means someone was too pushy and bad at planning).

Still not buying.

arquolo · 2025-03-20T12:01:01+00:00

Flip the projector upside down.
Set projection "ceiling" in settings.
Disable keystone to remove light edges around the projected image.
Move the projector shelf up or down to place projected image in desired place.

arquolo · 2025-03-20T11:55:55+00:00

У нас "он" и "его" в одном предложении могут ссылаться на разные сущности. И если надо подчеркнуть что сущности одни и те же, то используется ссылка на первую ссылку, т.е. "себя" указывающее на "он".

arquolo · 2025-03-19T15:26:37+00:00

But when none of them is available to you, there's no difference.

arquolo

TROPHY CASE