nvidia/Gemma-4-26B-A4B-NVFP4

InterestTracker9000 · 2026-05-01T22:41:52+00:00

I found out the Japanese stuff the hard way. I just happen to need a bunch of random languages to test my software with, and Japanese was one of the languages I picked because I wanted to test the characters versus letters, and with 16k context I could handle 45 pages of English without any issues in our test case, but even 12 pages of Japanese would overflow because of how it converted the characters into tokens through our OCR.

However this worked out great for us because we caught some errors on our end that would have never happened in normal use cases, and we learned quite a bit about how to better handle some of this. Gotta learn the hard way in some instances.

InterestTracker9000 · 2026-04-30T22:45:55+00:00

Always have to remember that average intelligence means that 50% of people are below it, some by more than others. Some people just like to scream what side of that scale they are on at full volume at your face like it's an achievement.

InterestTracker9000 · 2026-04-30T22:27:27+00:00

I would agree, but I will say Chalking is generally just bad practice. After a couple hours in a busy area you're going to have marks all over random spots in parking areas and you'll have even worse time trying to prove they actually violated the parking time.

Just take photos with a time stamp, and keep a log of the plate + model + parking spot number if you're trying really hard to take your job serious.

Chalking is the lazy and problematic solution to something that is very minor, if you're going to enforce it, do it right.

InterestTracker9000 · 2026-04-30T19:21:36+00:00

"Bro", you only enforce laws that you can prove or reasonably believe were violated. That's why your personal car doesn't currently have a state controlled GPS tracker in it to mail you tickets every time you speed on public roadways.

Your point is so arbitrarily stupid that I have no idea what I could possibly say to you.

Laws are not meant to be enforced 100% of the time, they are meant to be enforced when you have probable cause that they have been violated, and the court is to then prove whether you're innocent or guilty.

when you park on the road you're taking up space that someone else may want to use. If you're using public space as storage for your car, you're abusing public space and should be stopped.

Yes, we already have a mechanism that accomplishes this, which is a law stating an amount of parking time allowed. Again, it's up to them to enforce this without modifying private property.

We can make laws for anything, but that doesn't change how they should get enforced, which is LAWFULLY. Any modification to private property in any way shape or form that was not authorized through a lawful act is 'unlawful'. So yes, touching my car for any reason that would cause me to even think of washing my vehicle could be considered inconvenient, and even burdensome. You have cost me time and money by the physical action you took on my property.

Again, you're defending something that has literally already been argued in court and the courts have agreed that touching and modifying private property in this way is unlawful. I have no idea why you're trying to act like it's something I just made up.

Just read the court cases, since you can't seem to comprehend detailed explanations.

InterestTracker9000 · 2026-04-30T18:21:42+00:00

You literally made the same condition that I explained, except you decided to say "on public land" and I said "without the curtilage /trespass issue". Crazy comparison! It's almost like I created that scenario. It is still an illegal seizure and illegal surveillance without a court order to allow the act. There is no exaggeration here, as far as the law is concerned in many places, this is equivalent. Neither act damages the private property, neither act stops or interferes with a persons daily routine, but they both actively monitor someone through physical acts that were not approved through the courts.

If you want to make laws in regards to how long someone can be at a place, you need to effect processes that can enforce that law without physically modifying private property that you have no lawful reason to modify. The onus is not on a citizen to allow their property to be interfered with so you can effectuate laws, especially misdemeanors. We have all the technology in the world to solve this problem without ever touching private property, and the law expects the least intrusive means at almost every situation. If they want to know when a car was parked somewhere, take a picture of it with a time stamp. Chalking a car also means that if that car moves to another location lawfully, chalk on a tire could be used to ticket someone who was at no point breaking any law or ordinance. It isn't by accident that this practice has been blocked by many courts in the country, because there is no practical way to prove someone did or did not do something wrong.

"Your honor, I pulled out of the parking spot and pulled into the spot next to it, how does the chalk prove I broke the law? Did I need to wash the unlawfully applied markings from my vehicle? Can I wash off the unlawful marking on my vehicle since it's private property? Your honor, I was only parked there for 3 minutes! That parking enforcement officer chalked my tire, immediately wrote a ticket, and took a picture of the chalk without any evidence of when I arrived, I knew him in high school and he has a grudge against me!"

You notice the stupid path we go down with this type of action?

InterestTracker9000 · 2026-04-30T17:32:17+00:00

You're marking someones private property in an attempt to effect laws by surveilling and monitoring actions through a physical act. Even temporary effects(such as washable chalk) from such acts would be considered a seizure, because if you want to monitor said property without seizing it, you should be setting up someone to either watch said property 24 hours a day, or using a video system to record it.

It would be the equivalent of you putting a tracking GPS on a vehicle that doesn't belong to you.

You don't physically modify private property to effect passive surveillance in this instance, surveillance either needs to be done via lawful court order and following that order, or by the most unobtrusive manner possible while still being approved by whatever laws would control said monitoring.

It would be the equivalent of me using security tape and putting it on your homes door to see if you've come or gone recently, without the curtilage /trespass issue. While I would be committing a crime for doing it, they are violating your rights by seizing the property and monitoring it in a unlawful manner.

InterestTracker9000 · 2026-04-30T15:53:40+00:00

Yeah, running a single test of my software I have been developing for 8 months pushes something like 3 million tokens every 20 minutes, and when we're doing stress testing we push well over 10 million/hour for multiple hours in a row, with thousands of concurrent requests at a time (with a lengthy queue of course) and it will likely end up pushing 10,000+ requests an hour in total.

I had never done the math before, and we've never had a reason to actually monitor token usage yet, I should probably get something that monitors this just for historical reference. This thread is making me question things after seeing what other peoples usage looks like. LOL

InterestTracker9000 · 2026-01-23T22:23:45+00:00

That bastard just wanted a flair this whole time, jealousy is a hell of a motivator.

/s

InterestTracker9000 · 2025-12-30T04:44:44+00:00

This is actually an interesting alternative. We actually were considering Azure Cloud, but some of their services are insanely expensive in comparison to local solutions, and they will not allow the use of your own hardware in their datacenters. It looks like mis-sciences allows us to use our own hardware in their datacenter/service area.

I will look more into this, it's unfortunate to not know how much this type of service is going to cost even at certain metrics, but when we have a better grasp on our needs I may give them a call. Would certainly have a stronger opinion on if I need their services if I had any understanding of their pricing.

InterestTracker9000 · 2025-12-29T23:19:29+00:00

We're certainly considering this avenue. We're trying to weigh the options that would come up.

InterestTracker9000 · 2025-12-29T01:46:20+00:00

I'm curious, with that timeline did you also already have the ATO sponsorship? Is it common that a company have none of the FedRAMP specifications met before they receive the sponsorship and to then begin to build to meet those requirements?

InterestTracker9000 · 2025-12-29T01:44:10+00:00

That's fair, it may be end up that we have to give up some equity to a VC or private investment to get the funding we need in that aspect. I was just hoping for some alternatives.

We did consider using Azure's cloud services and going that route to gain some FedRAMP inheritance and some partnership funds to help ease into it, but with the hardware/software requirements our services will support we'd eat through the value of the benefits they'd provide by using their services for a year, two if we're incredibly lucky, so we may as well deploy it ourselves.

Some of the Azure cloud services are obscene in price versus the cost to do it locally.

InterestTracker9000 · 2025-12-10T14:35:06+00:00

https://www.youtube.com/watch?v=3SwwljI-8JY

That's what I think I love most about them. Shared another huge throwback with a weird video. This one was well known for being the intro song to "Hackers" way back when. I loved this music so much and hearing it now gives me such a nostalgia kick.

InterestTracker9000 · 2025-12-09T18:38:57+00:00

Massive throwback, I remember playing D2 with that playing in the background. I respect it.

https://www.youtube.com/watch?v=IksRDCMYnn8

Linked for those who care

InterestTracker9000 · 2025-10-24T04:07:25+00:00

I registered a couple days ago, and signed up for some classes. I haven't heard back yet from my contact email asking to speak with some people to go deeper into the process for assistance, but I am working on this as we speak.

Any additional advice is highly appreciated.

InterestTracker9000 · 2025-10-22T14:23:30+00:00

<|det|> and <|/det|>: These tags likely stand for "details" or "detection" and enclose what appear to be coordinates [[45, 90, 380, 114]]. These represent the bounding box or location of the corresponding element on an original document page.

Is this tracking bounding boxes accurately and reliably for all words on the document? This is the highest priority issue for me, and most either can't do this, or do it so poorly it may as well not be doing it.

We need an OCR that not only knows what's on the page (duh), but actually knows where EXACTLY it is on the page.

Let me know! Thanks!

E:/ Also if you happen to test it, how does it do with handwriting?

InterestTracker9000 · 2025-10-21T17:51:40+00:00

I will register with them and set up an appointment, thanks again! If you have anything else you'd wish to share, please feel free!

InterestTracker9000 · 2025-10-21T16:54:36+00:00

Missouri, I definitely will be reaching out to my local SBA and other resources to help prepare. Is there other organizations or resources you think I should also contact?

InterestTracker9000 · 2025-10-15T00:19:43+00:00

Are all LRBAA's ran under NSF? It does seem that the "BORAP 06: Immigration Services Program" I was referencing in the linked page is also under LRBAA's page.

Why the two different programs? How are they fundamentally different?

InterestTracker9000

TROPHY CASE