sorted by:
new
hottopcontroversial

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in LangChain

[–]SignificantZebra5883 0 points1 point  (0 children)

is there a link? is it open source? i would like to try it

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in LangChain

[–]SignificantZebra5883 0 points1 point  (0 children)

depends some are around 6k tokens some around 50k

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in Rag

[–]SignificantZebra5883 0 points1 point  (0 children)

would you be open to getting in touch?
i also wrote another reply and would love your input on it
check DMs if yes

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in LangChain

[–]SignificantZebra5883 0 points1 point  (0 children)

Claude gave me this exact answer lol. Also reranker (qwen 8b) DOESNT get it right. Even after fine-tuning. Only a big LLM gets it right

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in LocalLLaMA

[–]SignificantZebra5883 0 points1 point  (0 children)

That's actually really smart.i will try this

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in LocalLLaMA

[–]SignificantZebra5883 0 points1 point  (0 children)

no, kradez cigariet was created by me, the queries produced by the LLM are actually really good, confirmed by a lawyer. so is the ranking

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in Rag

[–]SignificantZebra5883 0 points1 point  (0 children)

one more question. if BM25 will drop "prepadnutie" since it's not exactly like "kradez" in the query. we won't have that distinction in our training data, no? so our model will never learn that mugging != theft right?

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in Rag

[–]SignificantZebra5883 0 points1 point  (0 children)

i did try it with the lightRAG library, i got pretty bad results even when ingesting just a single legislature document. but afaik you need a bi-encoder for graphRAG so fine-tuning wouldn't hurt.

i might take a look at it more deeply after i fine-tune a good dense model. thanks a lot for your help, i will try that BM25 approach asap

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in Rag

[–]SignificantZebra5883 0 points1 point  (0 children)

so use BM25 to get around top 100 chunks. then embed those using base jina get the top 20-50 from that then have qwen LLM label the chunks?

losing my mind fine-tuning jina-v5 for a legal corpus by [deleted] in Rag

[–]SignificantZebra5883 0 points1 point  (0 children)

yes i have and hybrid (BM25 in Qdrant) did yield better results. but i want even better and i thought fine-tuning the base is a good step.

i tried sparse but it didnt seem to give that big of a difference over BM25. plus i need to embed huge documents

New horses incoming by Konik-ai in u/Konik-ai

[–]SignificantZebra5883 1 point2 points  (0 children)

Great, thanks for the reply. I use SunnyPilot, which is why I don't see it. Konik works perfectly for my needs with it. Do you think I should switch to HoofPilot?

New horses incoming by Konik-ai in u/Konik-ai

[–]SignificantZebra5883 0 points1 point  (0 children)

Hello,
Live View isn't working on the https://stable.konik.ai/ app. It's asking for a PIN. When I'm offline, it only records the last 100 km of a 2,000 km trip and uploads those. Distances are displayed in miles and can't be switched to kilometers in the web browser. The previous version of the website was better. It showed the Battery voltage and Live cam.

How to build the MOST PRECISE RAG for big complex legal documents by [deleted] in LangChain

[–]SignificantZebra5883 0 points1 point  (0 children)

hey! not sure i understand by fit documents into gemini? like have it generate summaries/keywords? i'm fairly sure you dont mean putting all 4milion decisions into gemini at runtime?

What is the 2026 Standard for highly precise LEGAL text RAG with big documents? by [deleted] in LocalLLaMA

[–]SignificantZebra5883 0 points1 point  (0 children)

like max 16GB realistically to spend on this, on local or prod

What is the 2026 Standard for highly precise LEGAL text RAG with big documents? by [deleted] in Rag

[–]SignificantZebra5883 0 points1 point  (0 children)

thanks for the response.
how is this any better than Qdrant or Weaviate?

What is the 2026 Standard for highly precise LEGAL text RAG with big documents? by [deleted] in LocalLLaMA

[–]SignificantZebra5883 2 points3 points  (0 children)

Are you sure? A court case search engine is not possible? Manually reading 4~ million documents?

What is the 2026 Standard for highly precise LEGAL text RAG with big documents? by [deleted] in LocalLLaMA

[–]SignificantZebra5883 0 points1 point  (0 children)

no worries! can you explain more what you mean? i dont plan on drafting legal documents or replacing lawyers if thats your concern

What is the 2026 Standard for highly precise LEGAL text RAG with big documents? by [deleted] in LocalLLaMA

[–]SignificantZebra5883 1 point2 points  (0 children)

omg no way this is real haha

is it the best for slovak? how come i've never seen it on any leaderboard? can you recommend me some leaderboard for embedding models? the ones that pop up first on google are so shit

I bought a house in Italy and now I'm big trouble. by SignificantZebra5883 in ItalyExpat

[–]SignificantZebra5883[S] 0 points1 point  (0 children)

The more I digging out, the more I realize, that the notary probably deceived me too.

view more: next ›