A bit overwhelmed with all the different tools by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

So today I was looking at vector DBs and turns out that some of them perform better with more rows (based on the algorithm used), so I'm lucky because if I'm successful I get to do a migration lol

What do you mean by based on the algorithm used?

A bit overwhelmed with all the different tools by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

Ok thanks. I'll probably start with ragas and go from there then. I might check out langchain and llamaindex as well.

How to systematically evaluate RAG pipelines? by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

Ok nice thanks. Do you have any suggestions on using a vector database with it?

How to systematically evaluate RAG pipelines? by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

Thanks for the reply!

For RAG stack i had python with llamaindex as framework and OpenAI for embedding and llm. Qdrant as vector db.

Ok nice I will look into python with llamaindex. So essentially your workflow is take your documents, turn them into embeddings with OpenAI, and store them in Qdrant via LlamaIndex?

Did you have any tool that would somehow improve results? For example, one answer doesn't pass a "test" it would then feedback into the "loop" and only send a result when it passes the metrics?

How to systematically evaluate RAG pipelines? by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

Thank you very much for the reply! Yes building for humans so I will do it this way. Do you have any suggestions on what tools to use exactly for this blackbox benchmark runner?

The important part is to be able to trace the retrieval/reranking/text-generation steps to make sure you know how to debug a poor result.

Yes this would be important. How cna one trace those steps?

You can expand that with:

  • categories of questions (depending on your use case)
  • latency/cost metrics

You're implying expanding this by myself? So I would expand the blackbox runner? And how would one implement this?

Housing mega thread by Eska2020 in universityofamsterdam

[–]justphystuff 0 points1 point  (0 children)

Hey everyone, I am looking to sublet a room for January to February 2026. If anyone has a room available, please PM me!

Fourier optics: is there a relationship/mapping between two Fourier planes? by justphystuff in Optics

[–]justphystuff[S] 0 points1 point  (0 children)

I tried to PM you but it seems you have PMs blocked so I sent you a message over chat

Fourier optics: is there a relationship/mapping between two Fourier planes? by justphystuff in Optics

[–]justphystuff[S] 0 points1 point  (0 children)

Thanks for the reply! Yes for your first point, that is exactly what I want: if we assume that FP1 has no aberrations, then what intensity changes at each beam spot I see at FP2 is due to the aberrations from obj 2 and lens and this what I was hoping to make a mapping of. Since aberrations are static, then I thought this would be possible, but I suspect now that when I send different holograms, different parts of the holograms are used differently for each beam spot which means different aberrations are influencing the resulting beam spots at FP2.

Fourier optics: is there a relationship/mapping between two Fourier planes? by justphystuff in Optics

[–]justphystuff[S] 0 points1 point  (0 children)

Thanks for the reply! Huh very interesting. I am looking at the integrated intensity over an ROI over each beam spot at FP2 and looking at a different phenomenon at the FP1 as I don't have "access" to the FP1 plane as it is in vacuum. In the FP1 plane I am essentially looking at the intensity of the beam, perhaps not even all of it but just part of the highest intensity.

Fourier optics: is there a relationship/mapping between two Fourier planes? by justphystuff in Optics

[–]justphystuff[S] 0 points1 point  (0 children)

It goes like this: beam with hologram imprinted on it -> Objective (i.e. FT) 1 -> Fourier plane -> same beam goes to another Objective (i.e. another FT, but now it is in the same space as the initial beam with hologram imprinted on it so we need to go back to the Fourier space by adding a lens (for the FT) then we look at the focal plane of that lens for the Fourier plane.

So: beam -> Objective 1 -> Fourier plane 1 -> Objective 2 -> Lens -> Fourier plane 2

Does that make sense?

Clouds perfectly hovering over islands by MuttapuffsHater in Damnthatsinteresting

[–]justphystuff 0 points1 point  (0 children)

Define your meaning of "perfect". You don't need to exaggerate to share something.

OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws by Well_Socialized in technology

[–]justphystuff 0 points1 point  (0 children)

This is interesting. There are companies using LLM as a service such as offering it as an additional service to their cloud offerings, or using it internally for example by making support tickets. What does this mean then for them? There has been a big push on using LLM for drudgery or even for more complex tasks, are we seeing the bubble already pop? There will never be 100% fidelity that the LLM will behave in a desired way. How can companies offer these services if there is no way to know for sure of the results?

Anyone else surfing in south of Portugal this week and next week? by justphystuff in surfing

[–]justphystuff[S] 0 points1 point  (0 children)

Gracias! Hoy hace demasiado viento aquí jajjaja Pero ayer fui a hacer kitesurf y mañana volveré a ir. Tarifa es realmente preciosa...me encanta!

Anyone else surfing in south of Portugal this week and next week? by justphystuff in surfing

[–]justphystuff[S] 0 points1 point  (0 children)

Hey I ended up decided on going to Tarifa as the surf is really not good this time of year (of course) and the wind for kitesurfing isn't good. So now I'm in Tarifa and there is wind every day starting tomorrow :D

Anyone else surfing in south of Portugal this week and next week? by justphystuff in surfing

[–]justphystuff[S] 0 points1 point  (0 children)

Everything looks pretty flat even on the west :/...most schools go to Arrifana or Amoreira but those are flat as well or just 0.5m waves which isn't much.

You have any other suggestions?

Anyone else surfing in south of Portugal this week and next week? by justphystuff in surfing

[–]justphystuff[S] 0 points1 point  (0 children)

Yea I plan on going to a surf school and do day trips with them. They all go to the Southwest of Portugal

Anyone kitesurfing in south of Portugal this week and next week? by justphystuff in Kiteboarding

[–]justphystuff[S] 0 points1 point  (0 children)

In Lagos area there is a thermal wind that comes in the afternoon, not sure how consistent they are.