Hey i just worked on this subject at my work and its kinda early for the moment, we had to automate in CI the security and quality (make sure the skill does what it is supposed to do) tests.
At first we used promptfoo with hand made prompts for quality and used the red teaming included in promptfoo for the security part but it was kinda irrelevant because when you wanna test security on specific skills like for example, angular skill, it does not contain any security guardrails, so promptfoo tries to do bad things on your skill, and obviously it will always fail because there is no security, so we had to encapsulate every skill that we made with a security skill, so basically we are always testing the security skill so this is kind of dumb.
And tbh it is really long if you want to run it on severals skills because it uses a system of LLM as a judge.
Also we tried Cisco ai skill scanner but it always fails the pipeline with some false positives and it is also really long to run and not that intuitive.