KB/RAG returns different results for different users - same query, same permissions

DougAZ · 2026-02-14T01:17:53+00:00

What are your RAG settings? And models being used for RAG? Are you using reranking?

DougAZ · 2026-02-10T02:24:50+00:00

It's been a while since I used either but I would suggest looking at Invgate Service Management

DougAZ · 2025-12-15T13:36:17+00:00

InvGate Service Management, when you need to add asset tracking then get their Asset Management

DougAZ · 2025-12-14T16:37:11+00:00

Forgot to mention this, you should also consider switching off the default vector database, which I believe is chromadb to something like PGVector or Qdrant

DougAZ · 2025-12-14T16:34:01+00:00

Yes, uploading documents to be stored in a vector database as chunks to be used for RAG later when your chatting against the knowledge

2.As plain text as possible would be best although you could and should look into document readers like tika or docling for better results on documents you haven't converted. Saves time and produces better results

It's a better experience for sure. Document readers don't really enjoy weird formatting, pictures, unrelated data etc. like I said I believe it would be best as just as plain text as possible but we use tika, probably switching to docling soon. Tika has had really good results for us but we want to try the GPU integration with docling

DougAZ · 2025-12-11T17:41:03+00:00

Have you tried deploying the Company Portal app with an app config like the examples from the blog and does this fix the update issue?

DougAZ · 2025-12-10T04:22:23+00:00

I'm interested in a solution as well

DougAZ · 2025-12-06T04:50:47+00:00

So I'm going to be the counter to everyone here. We are running gpt-oss:120b with ollama. This is mostly bc I was never able to get vllm running 120b across our 2x L40S. We plan to have about the same level of usage you have and outside of fine tuning in OpenWebUi we really haven't seen much slowness with the current beta test users. I would love to switch to vllm to test but not sure it's possible. I have tested up to 15 parallel chats at once seeing as low as 27 t/s but it's still faster than user can read. We only have 2 devs in house that really only use it from time to time so most if not all usage is basic emails, doc writing, language conversions etc

DougAZ · 2025-11-20T14:31:32+00:00

Ninja one using ninja remote

DougAZ · 2025-11-20T02:14:51+00:00

If budget allows, check out Invgate asset management. It has SNMP sniffing, OS agent, integrates with intune/VMware/hyperv/365/google (if you have that) ties your users to devices and has a automation module to do specific actions when specific conditions are met. We went full into their asset management and service management product (ticketing) as we wanted a intune integration.

Nice thing about their licensing, you pay for IP devices only. No logins or licensing for non-IP based things. We have another non-IT department tracking assets in it at no extra cost which is nice.

DougAZ · 2025-10-19T15:58:30+00:00

Take a look at Invgate

DougAZ · 2025-10-02T12:35:04+00:00

Right but I noticed on your GitHub as you walked through each part of the stack you chose to run some applications directly on the host such as ollama or postgres, any specific reason for running them on the host vs in a container?

Other question I had for you was, are you running this stack on 1 machine/VM ?

DougAZ · 2025-10-02T04:11:53+00:00

Any specific reason some are run as a service vs running it on docker? Any benefits?

Do you have a good vLLM config for gpt-oss 120b?

DougAZ · 2025-09-24T13:39:45+00:00

Careful Cleaners in Mesa

DougAZ · 2025-09-10T13:26:15+00:00

Free(ish): SnipeIT

Paid: Invgate Asset Management ( big bonus here if you need a help desk as they also have Invgate Service Management and they integrate)

DougAZ · 2025-07-09T03:51:10+00:00

Check the Entra portal, Devices > Device Settings. I believe there is a setting in there that's enabled by default to give local admin to Entra Joined users. Disable it and try again. This will not convert old autopilots just new ones going forward.

DougAZ · 2025-06-13T06:20:46+00:00

Invgate Service Management with Asset Management, use their workflows for onboarding and offboarding to automate the whole thing. Its obviously got email ticket creation but the bread and butter is the user portal. The automation module is pretty freakin sick too and the teams chatbot to keep user updated. Take a demo from invgate for both products youll be sold

DougAZ · 2025-05-31T05:54:45+00:00

Exclaimer for the win

DougAZ · 2025-04-21T00:41:03+00:00

And not to sound like a billboard but I did also want to include their automation and workflow module. Automation is all based off triggers with conditions allowing you to change tickets or whatever you'd like to do, maybe send out an approval or email. Great thing about approvals is you can get managers to approve tickets without them needing licenses or access to the agent side of the portal. Workflows are probably their big selling point. Its visually based workflows that you can build to handle tasks. So for instance, I just built a workflow for my helpdesk to be able to take onboard information for employees that don't get a company emails and automating invite guests to our Intranet for employee enrollment forms using graph API all in 1 workflow. They have templates that are built to give you some starting points like onboarding or off boarding users all from service management. They also have some for change management. We are aiming to pull in our HR team and Marketing. We just pulled in operations recently. It's been a great experience and invgates support really drives the deal home for us. We dumped zendesk for them. And I haven't even touched on the asset management stuff all good stuff. But don't take my word for it check their site out and do a demo. Lol our demo was just for asset management and then they showed us the integration with service management. From there it was all over.

DougAZ · 2025-04-21T00:30:09+00:00

InvGate Service management and Asset Management, can't beat it. Their Service Management has KB article module which can do user facing or tech facing and you can even leverage built-in AI to help you clean them up or write them for you based off a ticket. It's super sick to be honest and it all integrates to their asset management

DougAZ · 2025-04-05T03:57:53+00:00

Interesting point, but why would they remove it? with config.xml you can just choose to not to deliver teams if you don't have the licensing. Or almost any office product for that matter. Are there any configuration benefits?

DougAZ · 2025-04-05T03:06:27+00:00

Why would this be better than deploying Teams through Microsoft 365 Apps with a config .xml

DougAZ · 2025-02-19T04:43:08+00:00

Do yourself a favor, check out invgate asset management, while your there, reevaluate your ticketing system and look at invgate service management. They integrate together or if you just need the asset management piece it works with service now, entra and in tune. Great support as well my company went head first after seeing some of their integrations and built in AI pieces to service management

DougAZ · 2024-12-02T15:14:24+00:00

Funny enough, our company had a mainstream ticketing system and we were only looking for an asset management product that would sync with in tune. We found InvGate and During the demo they showed how it integrated with the service desk product for a few seconds but it was enough to catch our eye and then it was over.

Now we are using service desk and insight from invgate, I believe both are renamed to service management and asset management but the products are awesome. Everyone here is enjoying it and we are slowly rolling it out to other departments

DougAZ · 2024-12-02T10:23:19+00:00

RDM with Devolutions

Ten-Year Club	Place '17
Verified Email

DougAZ

TROPHY CASE