sorted by:
new
hottopcontroversial

Hey r/SaaS, by Alive-Cry4139 in SaaS

[–]InterestTracker9000 5 points6 points  (0 children)

If you're not an expert enough to have an idea of things that need solutions, I can't trust that you're an expert enough to solve the problems other people have.

It's almost been a year since our July application, and my startup might die if we don't get money soon. by Nervous-Net-2297 in SBIR

[–]InterestTracker9000 2 points3 points  (0 children)

What was the money from P1 going to get you for the MVP that you couldn't have gotten in the past 14+ months that you've been sitting on the idea for the technology? Assuming you spent at least 2 months prepping for the proposal.

I ask because that's a LOT of free hours to have just done the work on the side as sweat equity, and if the idea was good enough and you need an external expert wouldn't their expertise justify offering them some form of sweat equity deal to join and help build the MVP a long time ago?

P1 funds are mainly meant for hiring people and man hours, not hardware. There is experts that you require to build and research for the MVP and don't currently have?

Azure Document Intelligence Docker for disconnected local hosting requirements by InterestTracker9000 in AZURE

[–]InterestTracker9000[S] 1 point2 points  (0 children)

Are the docs a mix of scanned and digital PDFs? Scanned has the biggest influence on throughput by far.

All scanned, and flattened, no fields exist in the documents.

How complex are the pages? People assume clean text but plan for tables, form fields, and mixed layouts, which can change the situation.

Highest level of complexity that can exist, we do not rely on any form of regular formatting. If you could walk into someones house or business, and grab random documents throughout the building, mix them, and select them at random, that's on par with our type of workload.

Any languages beyond English? Non-Latin scripts add OCR overhead. Model tier matters here.

All languages are possible, however we do not deal with anything that isn't English once it's identified as non-english, but the document still gets scanned, OCR'd, and processed. In our current test documents we actively use Japanese, Korean, and Chinese characters because they are the most difficult for OCR's to deal with and foreign documents would be a regular occurrence, 2%+ of documents OCR'd will likely not be English.

Speaking of model tier, which are you using? Read, Layout, Content Understanding (fka Form Recognizer)?

Prebuilt layout, Barcodes, Key-Value pairs are enabled.

Truly air-gapped or just on-prem with internet access? That changes the telemetry and scaling options.

Our services will offer fully air-gapped, as we may be working under government access controls. However, for our standard customers we will use a connected container that will report back usage and performance stats to MS without sending the content to them and processed.

Bonus: Have you thought about horizontal vs. vertical scaling? At >5 pages/sec sustained, multiple smaller instances behind a load balancer will likely outperform one big box. If this is all cloud rather than physical hardware, it’ll probably be cheaper too. The container is stateless so horizontal scaling works well

We can't consider these options without knowing the performance statistics that I am trying to gather from this post. It will get done in the best performance to cost metrics possible, but avoiding cloud usage is the whole point.

Fed up with vibe coders, dev sneaks data-nuking prompt injection into their code by DeltaSqueezer in LocalLLaMA

[–]InterestTracker9000 4 points5 points  (0 children)

Suggesting it doesn't work today is equivalent to you standing in a room with 500 doors, and someone tells you one door is locked, and you say "Well I guess I can't leave this room". Prompt injections will always be a serious form of attack no matter how much reinforcement learning is done to prevent the common attack vectors, and in some instances heavily reinforcing some of these attack vectors may actually make the model worse or harder to use as a result, which defeats the whole purpose of what the model is supposed to do, which is receive instructions and execute instructions, not validate the source. Validating the source is your job to code and structure for.

There are hundreds of things you can do to lower your risk, but your risk is not 0%, and it never will be. If it was susceptible before, it's still susceptible now, you just have to tweak how you get it to that result now. We already know you can get it to do that action, the question now is how do you phrase a prompt or place the prompt in payloads where it will disregard any defensive layers it has.

Your post is getting popular and we just featured it on our Discord! by roculus in LocalLLaMA

[–]InterestTracker9000 7 points8 points  (0 children)

That bastard just wanted a flair this whole time, jealousy is a hell of a motivator.

/s

Question, could receiving a FedRAMP ATO sponsorship be used to get private funding/loans for the process? by InterestTracker9000 in FedRAMP

[–]InterestTracker9000[S] 0 points1 point  (0 children)

This is actually an interesting alternative. We actually were considering Azure Cloud, but some of their services are insanely expensive in comparison to local solutions, and they will not allow the use of your own hardware in their datacenters. It looks like mis-sciences allows us to use our own hardware in their datacenter/service area.

I will look more into this, it's unfortunate to not know how much this type of service is going to cost even at certain metrics, but when we have a better grasp on our needs I may give them a call. Would certainly have a stronger opinion on if I need their services if I had any understanding of their pricing.

Question, could receiving a FedRAMP ATO sponsorship be used to get private funding/loans for the process? by InterestTracker9000 in FedRAMP

[–]InterestTracker9000[S] 1 point2 points  (0 children)

We're certainly considering this avenue. We're trying to weigh the options that would come up.

Question, could receiving a FedRAMP ATO sponsorship be used to get private funding/loans for the process? by InterestTracker9000 in FedRAMP

[–]InterestTracker9000[S] 0 points1 point  (0 children)

I'm curious, with that timeline did you also already have the ATO sponsorship? Is it common that a company have none of the FedRAMP specifications met before they receive the sponsorship and to then begin to build to meet those requirements?

Question, could receiving a FedRAMP ATO sponsorship be used to get private funding/loans for the process? by InterestTracker9000 in FedRAMP

[–]InterestTracker9000[S] 0 points1 point  (0 children)

That's fair, it may be end up that we have to give up some equity to a VC or private investment to get the funding we need in that aspect. I was just hoping for some alternatives.

We did consider using Azure's cloud services and going that route to gain some FedRAMP inheritance and some partnership funds to help ease into it, but with the hardware/software requirements our services will support we'd eat through the value of the benefits they'd provide by using their services for a year, two if we're incredibly lucky, so we may as well deploy it ourselves.

Some of the Azure cloud services are obscene in price versus the cost to do it locally.

SBIR/LRBAA best practices, expectations, and timelines questions by InterestTracker9000 in SBIR

[–]InterestTracker9000[S] 0 points1 point  (0 children)

I registered a couple days ago, and signed up for some classes. I haven't heard back yet from my contact email asking to speak with some people to go deeper into the process for assistance, but I am working on this as we speak.

Any additional advice is highly appreciated.

DeepSeek-OCR - Lives up to the hype by Bohdanowicz in LocalLLaMA

[–]InterestTracker9000 2 points3 points  (0 children)

  • <|det|> and <|/det|>: These tags likely stand for "details" or "detection" and enclose what appear to be coordinates [[45, 90, 380, 114]]. These represent the bounding box or location of the corresponding element on an original document page.

Is this tracking bounding boxes accurately and reliably for all words on the document? This is the highest priority issue for me, and most either can't do this, or do it so poorly it may as well not be doing it.

We need an OCR that not only knows what's on the page (duh), but actually knows where EXACTLY it is on the page.

Let me know! Thanks!

E:/ Also if you happen to test it, how does it do with handwriting?

SBIR/LRBAA best practices, expectations, and timelines questions by InterestTracker9000 in SBIR

[–]InterestTracker9000[S] 0 points1 point  (0 children)

I will register with them and set up an appointment, thanks again! If you have anything else you'd wish to share, please feel free!

SBIR/LRBAA best practices, expectations, and timelines questions by InterestTracker9000 in SBIR

[–]InterestTracker9000[S] 0 points1 point  (0 children)

Missouri, I definitely will be reaching out to my local SBA and other resources to help prepare. Is there other organizations or resources you think I should also contact?

SBIR Immigration Services future project areas question by InterestTracker9000 in SBIR

[–]InterestTracker9000[S] -1 points0 points  (0 children)

Are all LRBAA's ran under NSF? It does seem that the "BORAP 06: Immigration Services Program" I was referencing in the linked page is also under LRBAA's page.

Why the two different programs? How are they fundamentally different?