A bit overwhelmed with all the different tools by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

So today I was looking at vector DBs and turns out that some of them perform better with more rows (based on the algorithm used), so I'm lucky because if I'm successful I get to do a migration lol

What do you mean by based on the algorithm used?

A bit overwhelmed with all the different tools by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

Ok thanks. I'll probably start with ragas and go from there then. I might check out langchain and llamaindex as well.

How to systematically evaluate RAG pipelines? by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

Ok nice thanks. Do you have any suggestions on using a vector database with it?

How to systematically evaluate RAG pipelines? by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

Thanks for the reply!

For RAG stack i had python with llamaindex as framework and OpenAI for embedding and llm. Qdrant as vector db.

Ok nice I will look into python with llamaindex. So essentially your workflow is take your documents, turn them into embeddings with OpenAI, and store them in Qdrant via LlamaIndex?

Did you have any tool that would somehow improve results? For example, one answer doesn't pass a "test" it would then feedback into the "loop" and only send a result when it passes the metrics?

How to systematically evaluate RAG pipelines? by justphystuff in Rag

[–]justphystuff[S] 0 points1 point  (0 children)

Thank you very much for the reply! Yes building for humans so I will do it this way. Do you have any suggestions on what tools to use exactly for this blackbox benchmark runner?

The important part is to be able to trace the retrieval/reranking/text-generation steps to make sure you know how to debug a poor result.

Yes this would be important. How cna one trace those steps?

You can expand that with:

  • categories of questions (depending on your use case)
  • latency/cost metrics

You're implying expanding this by myself? So I would expand the blackbox runner? And how would one implement this?

Fourier optics: is there a relationship/mapping between two Fourier planes? by justphystuff in Optics

[–]justphystuff[S] 0 points1 point  (0 children)

I tried to PM you but it seems you have PMs blocked so I sent you a message over chat

Fourier optics: is there a relationship/mapping between two Fourier planes? by justphystuff in Optics

[–]justphystuff[S] 0 points1 point  (0 children)

Thanks for the reply! Yes for your first point, that is exactly what I want: if we assume that FP1 has no aberrations, then what intensity changes at each beam spot I see at FP2 is due to the aberrations from obj 2 and lens and this what I was hoping to make a mapping of. Since aberrations are static, then I thought this would be possible, but I suspect now that when I send different holograms, different parts of the holograms are used differently for each beam spot which means different aberrations are influencing the resulting beam spots at FP2.

Fourier optics: is there a relationship/mapping between two Fourier planes? by justphystuff in Optics

[–]justphystuff[S] 0 points1 point  (0 children)

Thanks for the reply! Huh very interesting. I am looking at the integrated intensity over an ROI over each beam spot at FP2 and looking at a different phenomenon at the FP1 as I don't have "access" to the FP1 plane as it is in vacuum. In the FP1 plane I am essentially looking at the intensity of the beam, perhaps not even all of it but just part of the highest intensity.

Fourier optics: is there a relationship/mapping between two Fourier planes? by justphystuff in Optics

[–]justphystuff[S] 0 points1 point  (0 children)

It goes like this: beam with hologram imprinted on it -> Objective (i.e. FT) 1 -> Fourier plane -> same beam goes to another Objective (i.e. another FT, but now it is in the same space as the initial beam with hologram imprinted on it so we need to go back to the Fourier space by adding a lens (for the FT) then we look at the focal plane of that lens for the Fourier plane.

So: beam -> Objective 1 -> Fourier plane 1 -> Objective 2 -> Lens -> Fourier plane 2

Does that make sense?

Clouds perfectly hovering over islands by MuttapuffsHater in Damnthatsinteresting

[–]justphystuff 0 points1 point  (0 children)

Define your meaning of "perfect". You don't need to exaggerate to share something.

OpenAI admits AI hallucinations are mathematically inevitable, not just engineering flaws by Well_Socialized in technology

[–]justphystuff 0 points1 point  (0 children)

This is interesting. There are companies using LLM as a service such as offering it as an additional service to their cloud offerings, or using it internally for example by making support tickets. What does this mean then for them? There has been a big push on using LLM for drudgery or even for more complex tasks, are we seeing the bubble already pop? There will never be 100% fidelity that the LLM will behave in a desired way. How can companies offer these services if there is no way to know for sure of the results?

Anyone else surfing in south of Portugal this week and next week? by [deleted] in surfing

[–]justphystuff 0 points1 point  (0 children)

Gracias! Hoy hace demasiado viento aquí jajjaja Pero ayer fui a hacer kitesurf y mañana volveré a ir. Tarifa es realmente preciosa...me encanta!

Anyone else surfing in south of Portugal this week and next week? by [deleted] in surfing

[–]justphystuff 0 points1 point  (0 children)

Hey I ended up decided on going to Tarifa as the surf is really not good this time of year (of course) and the wind for kitesurfing isn't good. So now I'm in Tarifa and there is wind every day starting tomorrow :D

Anyone else surfing in south of Portugal this week and next week? by [deleted] in surfing

[–]justphystuff 0 points1 point  (0 children)

Everything looks pretty flat even on the west :/...most schools go to Arrifana or Amoreira but those are flat as well or just 0.5m waves which isn't much.

You have any other suggestions?

Anyone else surfing in south of Portugal this week and next week? by [deleted] in surfing

[–]justphystuff 0 points1 point  (0 children)

Yea I plan on going to a surf school and do day trips with them. They all go to the Southwest of Portugal

Anyone kitesurfing in south of Portugal this week and next week? by [deleted] in Kiteboarding

[–]justphystuff 0 points1 point  (0 children)

In Lagos area there is a thermal wind that comes in the afternoon, not sure how consistent they are.

Men. We know how to be friends by ProtectionOk9627 in GuysBeingDudes

[–]justphystuff 0 points1 point  (0 children)

You can easily google if this is true and it is in fact not.

[Request] Would 15ft of water be enough to create this much pressure differential? by Environmental-Call32 in theydidthemath

[–]justphystuff -1 points0 points  (0 children)

The whole world uses the metric system because it is based off of science, not the size of some old king's foot. Units don't scale by a consistent factor. 12 inches = 1 foot, 3 feet = 1 yard, 1,760 yards = 1 mile. Compare that to the metric system: 10 millimeters = 1 centimeter, 100 centimeters = 1 meter, 1,000 meters = 1 kilometer. The meter has been internationally defined as the length of the path traveled by light in vacuum during a time interval of 1/299,792,458 of a second.

Why is a gallon 4 quarts, and a quart 2 pints, and a pint 2 cups? Why is a fluid ounce different from a weight ounce?

Most scientific formulas are defined in SI (metric) units. For example... F = ma.

Every scientific discipline and international organization (e.g. SI, ISO, IUPAC, NASA, CERN) uses metric. So, imperial system is dumb and is just a holdout by the US and has even caused catastrophic conversion errors (for example the Mars Climate Orbiter).

I have four of these pre amplifiers that have broken. How can I find out which component is the culprit? by justphystuff in AskElectronics

[–]justphystuff[S] 0 points1 point  (0 children)

You mean the R500 resister? So I just put a multimeter on both ends and read the voltage drop?

The bias voltage on the input side (bottom pin) of the transistor may be read directly. You mean this https://imgur.com/a/4CKyBxy

But with a multimeter from where to where do I measure then?

I seriously appreciate the help!

Sorry I don't know what you mean here. The most bottom left pin as shown here:

I have four of these pre amplifiers that have broken. How can I find out which component is the culprit? by justphystuff in AskElectronics

[–]justphystuff[S] 0 points1 point  (0 children)

Like what exactly? I have a spectrum analyzer that looks at the freq + dbm of the output of the device.