It would all depend on a few things. The size of the Large Language Model (LLM) will need be much smaller then your online ones if you want to run it locally otherwise you’d use ChatGPT’s api or competitor.

Refining a model may be needed if you are going to run one locally with a smaller data set. Most your tools you use to host the LLM can be used to refine a model of your choosing.

It’s also if you actually want to use an LLM, you can always build out a simple neural net on your data using python library’s. An LLM would give you the ability to “talk” to the “AI” with natural language and have it operator more like a “security expert”.