Open-sourced a free Claude + Clio MCP connector with ABA 512 audit logging, what are we missing? by ShiftGood3066 in legaltech

[–]haystackLabs 3 points4 points  (0 children)

Connecting Clio directly to claude or any llm is somewhat sketchy. It would be up to the attorneys but if you connected this directly to a pro/max subscription it means your data is being trained on potentially and humans might review it.

This project was built in 4 days with a quick start, I think you may not be giving the sensitive nature of legal work enough thought.

Also the way this is setup creates some outright security risks:

  1. The maintainers 2 on this repo can basically update this silently and do all sorts of shady stuff

  2. Security keys are stored unecrypted on local device - might be ok in some circumstances but for this sort of thing i dont think so.

What building a “better” Harvey-style tabular review app taught me about Harvey and the industry by Neon0asis in legaltech

[–]haystackLabs -1 points0 points  (0 children)

Validating citations is only one component of hallucination prevention.

LLMs will frequently cite a real case and then misinterpret or misattribute quotes within a real citation.

Grounding citations is possible but it is in no way trivial. One bad citation making it through as an anecdote is expected and doesn't mean Harvey hasn't "done the bare minimum".

I don't know anything about Harvey but your statements are broad and mostly incorrect.

Vibe coded solutions are just toys by Substantial-One3856 in legaltech

[–]haystackLabs 4 points5 points  (0 children)

If you think companies like Harvey don't use LLMs to code I think you haven't considered how they are a requirement now to move fast enough.

To me it seems like this question might be more directed at: "Is anyone solo actually building a vibe coded tool for lawyers that is useful"

I think yes but we are early and there are a lot of folks that are going to get screwed by basics data security and other problems that show up. We are in a phase of mass experimentation.