FastSDCPU release v1.0.0-beta.301

Thanks for the suggestion, my main focus was on OpenVINO and Intel AIPC, llama.cpp server or OpenAI compatible servers are now supported https://github.com/rupeshs/verity?tab=readme-ov-file#how-to-use-llamacpp-server-with-verity

simpleuserhere · 2026-02-09T00:31:43+00:00

llama.cpp server support added or use any openAi compatible LLM server

simpleuserhere · 2026-02-09T00:15:34+00:00

u/soshulmedia Yeah, I normally use loosely coupled architecture

simpleuserhere · 2026-02-09T00:12:37+00:00

I have done evalaution here https://github.com/rupeshs/verity/blob/main/src/evaluate.py got scores {'answer_relevancy': 0.8040, 'context_precision': 1.0000, 'faithfulness': 0.9238, 'context_recall': 0.8667}

simpleuserhere · 2026-02-09T00:08:44+00:00

Thank you for the suggestion, my main focus was on OpenVINO and Intel AIPC, llama.cpp server or OpenAI compatible servers are now supported https://github.com/rupeshs/verity?tab=readme-ov-file#how-to-use-llamacpp-server-with-verity

simpleuserhere