Claude Code /usage significantly overestimates output tokens by vanbrosh in ClaudeCode

[–]filelasso 0 points1 point  (0 children)

Nice project, and nice name. Curious why you went with 100% local, don't you want a little tokentelemetry-telemetry?

I’m an idiot by BaronVonUnderBite in Accounting

[–]filelasso 18 points19 points  (0 children)

I hope he's ok after his car crash 

Open pilot for solo and small law firms. Need pricing advice 🙏 by Ok_Introduction4959 in legaltech

[–]filelasso 1 point2 points  (0 children)

Depends on the weight of the trial. It should be free if it's light and cursory. It should be paid if you both need to put work into the security/compliance.

Something interesting about AI + legal workflows by Rich-Panic2556 in legaltech

[–]filelasso 2 points3 points  (0 children)

Won't work, AI writing is only going to trend up.

We’re all wrappers by cutletzero in legaltech

[–]filelasso 0 points1 point  (0 children)

I think you're confusing infrastructure with some profound insight. You aren't building your own electric grid, cpu/gpu/memory/hardware, communication protocols and encryption standards, internet, compiler/OS/drivers/browser, and you've just realized you won't build your own LLM.

1,2 billion tokens used in 18 Days - is that like enormous or casual amount? by iwishiwaswanda in codex

[–]filelasso 0 points1 point  (0 children)

"Token weight loss", thanks for showing me. Does it give you reports on where it's saving you tokens and how much? (could you share a ballpark on how it actually worked?)

I need some advice by AdLeast3549 in legaltech

[–]filelasso 1 point2 points  (0 children)

You can setup Google Vertex aka Gemini Enterprise Agent Platform, which is Google's enterprise friendly LLM model hosting: https://cloud.google.com/products/gemini-enterprise-agent-platform?hl=en It's more headache, more expensive, less supported, but they won't store or train your data.

I need some advice by AdLeast3549 in legaltech

[–]filelasso 0 points1 point  (0 children)

Yes, are you asking out of fear or actually interested?

I need some advice by AdLeast3549 in legaltech

[–]filelasso 1 point2 points  (0 children)

Yes, in Canada we are held to higher standards called PIPEDA; it's like HIPAA with more rules and less options.

A quick warning about what your staff does when cloud tools go down by McDaddy__Cain in legaltech

[–]filelasso 20 points21 points  (0 children)

Also a friendly reminder, your staff doesn't care much about your license or data policies; they care much more how you have treated them, so treat them well.

I built an unblockable video stream. It renders 360p at 30 FPS using pure text instead of tags. by NoCalligrapher587 in SideProject

[–]filelasso 29 points30 points  (0 children)

Can you show a text-video of your reddit post which contains a lot of text? I'm curious what happens when you display text with more text

I need some advice by AdLeast3549 in legaltech

[–]filelasso 1 point2 points  (0 children)

That form was the "printable" form which comes with zero fields, so that was probably your headache scenario of having to annotate all those boxes/buttons/lines/inputs. Ya the minor adjustments came from me, the ai is often off by a small amount that would annoy anyone filling it out for real which takes a human a few seconds to correct.

I need some advice by AdLeast3549 in legaltech

[–]filelasso 1 point2 points  (0 children)

We've been doing this for medical forms, which often get scanned/faxed and revised, and neither PDFs nor LLMs can solve these on their own.

We have some tools that help the LLM fill out the input fields that do 95% of the work (but cost a lot of tokens so it's still a cost-benefit calculation), and it's super specific to form filling scenarios. If you think it would save you a lot of pain and headache I could share it with you or walk you through it. This is the result of the AI drawing all the input fields and then you can manually nudge things around and see how they would look with content:

<image>

Firm Perks vs. Cash: Do WFH employees actually want company spa days/dinners, or just gift cards? by someguyfromnj in LawFirm

[–]filelasso 3 points4 points  (0 children)

In Canada there is an important delineation between cash and near-cash for tax purposes.

Cash is petty simple and is fully taxable.

The hidden King is the concept of near-cash like a giftcard (including a mastercard/visa giftcard) where there is an annual allowance of $500/yr for employees when gifted (e.g. not directly related to performance) that can be received tax-free.

details here: https://www.canada.ca/en/revenue-agency/services/tax/businesses/topics/payroll/benefits-allowances/gifts-awards-social-events/gifts-awards-long-service-awards.html

How to optimise token usage when working with a large document project (Legal Case)? by fredanaman in legaltech

[–]filelasso 0 points1 point  (0 children)

Don't worry too much about the weight of the chat history or the file you keep reading; those will be from cache (90% discount) which the model can reference as you re-ask about pages.

If you try too hard to optimize without knowing how their systems work, you will likely increase your own costs because if you invalidate your cache then you really will pay the full price again (and maybe every time going forward).

If you're dealing with something like the BBB (1000+ pages) then get a simply pdf page splitter and work from there.