adversarial-machine-learning
(3)
Mindgard finds the trouble your AI talks itself into
An AI assistant can refuse a dangerous request and still leak a secret through its tools. Mindgard turns that awkward distinction into a business: finding the paths from helpful behavior to harmful action.
HiddenLayer: Who guards the AI guard?
Its founders watched an AI malware detector get fooled. Now HiddenLayer sells the checks, tests and runtime defenses that enterprises need when the software starts making decisions.
Virtue AI
Virtue AI is a San Francisco-based enterprise AI security company that helps organizations deploy generative AI and AI agents safely. Founded in 2024 by AI-safety researchers from Berkeley, Stanford, and Chicago, its platform combines automated red-teaming (VirtueRed), real-time multimodal guardrails (VirtueGuard), and an end-to-end agent security suite (AgentSuite) to catch prompt injections, jailbreaks, data poisoning, and policy violations before they reach production. The company raised $30 million in seed and Series A funding and counts frontier AI labs and enterprises in finance, healthcare, and IT among its customers.