San Francisco / AI Infrastructure / AgentOps
Co-Founder & CEO, AgentOps — formerly EY, Check Point, Menubites.ai
"You can't fix what you can't see." The monitoring layer for the AI agent era.
Profile
At 525 Market Street in San Francisco, Alex Reibman is building the thing every AI engineer eventually realizes they need: a window into what their agents are actually doing. Not what they claim to do. What they do.
AgentOps - the company he co-founded in 2023 with Adam Silverman, Braelyn Boynton, and Shawn Qiu - is an observability platform for AI agents and LLM applications. Think of it as a flight data recorder for AI: session replay, time-travel debugging, real-time cost tracking, audit trails, and comprehensive monitoring across 400+ integrated LLMs and frameworks. Microsoft, Google, Samsung, and Meta use it. So do thousands of dev teams building the next wave of agentic applications.
The origin story is blunt. Reibman started building AI agents that scraped the web. His assessment of how they performed: "They sucked." Rather than iterate in the dark, he decided to build the visibility layer first - the monitoring stack that would let engineers see exactly where and why their agents were failing. That decision became AgentOps.
Reibman came to this by an unusual route. He studied Economics and Philosophy at Emory University - a combination that surfaces later in his writing about the St. Petersburg Paradox and behavioral decision theory. After graduation, he went to Tel Aviv to work as a cybersecurity data scientist at Check Point, where he built classifiers to detect obfuscated malicious JavaScript. It was rigorous, adversarial ML work, the kind where getting the model slightly wrong means something dangerous slips through.
He returned to the US for Ernst & Young, where he led machine learning engineering teams managing engagements worth $40M+ with clients like Goldman Sachs, American Express, and Westpac. That's the world where enterprise AI goes to be taken seriously - and where the gap between a working prototype and a production-grade, auditable system becomes painfully clear.
Agents need observability just like production software does. You can't fix what you can't see - and right now, most teams are shipping black boxes to production and hoping for the best.
- Alex Reibman, AgentOpsBy The Numbers
The Company
Every commercial airline flight is required to carry a flight data recorder - a black box that captures every instrument reading, every control input, every system state. The entire purpose is to make failure investigable. AgentOps is building that for AI agents.
The platform's headline feature is session replay: a visual time visualization of every LLM call, tool invocation, action event, and error that occurred during an agent's run. Engineers can rewind, step through frame by frame, and pinpoint exactly where a multi-step workflow diverged from intent. Reibman calls it "time travel debugging."
Underneath the visual layer: real-time cost tracking with live LLM pricing, comprehensive audit trails for compliance, performance optimization tools that can fine-tune specialized models at up to 25x lower cost than frontier models, and enterprise-grade security monitoring. For teams operating at scale, there's SSO, SLA, on-premise deployment, and certifications for SOC-2, HIPAA, and NIST AI RMF.
The market timing is deliberate. By Reibman's research, 89% of surveyed CIOs named agent-based AI a strategic priority for 2025 and beyond. The $5 billion AI agents market is projected to hit $50 billion by 2030. Every one of those deployments will eventually need monitoring. AgentOps intends to be the default choice when they do.
AI agent observability, testing, and monitoring platform. Deployed by engineering teams at Microsoft, Google, Samsung, and Meta.
Core Platform Features
Career
2014 - 2016
Emory University - Economics & Philosophy. Found his way to econometrics, causal inference, and data mining. The Philosophy degree shows up later in a blog about paradoxes of rational choice.
2016 - 2018
Check Point, Tel Aviv. Cybersecurity data science. Built a classifier to detect obfuscated malicious JavaScript - adversarial ML in one of its most consequential real-world applications.
2018 - 2021
Ernst & Young. Led ML engineering teams on $40M+ engagements for Goldman Sachs, American Express, and Westpac. Learned what it takes to make machine learning work at enterprise scale - and what the auditors require.
2021 - 2022
Axio. Full-stack data science, Python and TypeScript. Closer to the product layer.
2022 - 2023
Co-founded Menubites.ai with Gloria Felicia and Ivan Porollo - AI-powered photography to improve small restaurant visibility. First exit: acquired by Snappr, March 2023.
2023
Brief stint as Chief Vibe Officer at Cerebral Valley. Best job title in AI, possibly ever. Then: co-founded AgentOps with Adam Silverman, Braelyn Boynton, and Shawn Qiu.
August 2024
AgentOps raises $2.6M pre-seed from 645 Ventures, Afore Capital, and Plug & Play Tech Center. TechCrunch covers the raise. Emory Entrepreneur Award. TEDAI San Francisco panelist.
2024 - 2025
AgentOps reaches 400+ integrations, serves Microsoft, Google, Samsung, Meta. Releases Llama Stack support and 90% faster Autogen integration. Hosts dinner with Madrona Ventures for top Agent founders.
The Backstory
San Francisco's AI hackathon circuit is brutal. Teams build in 24-48 hours, demos are live, and judges are usually the people who write the checks. Winning once is lucky. Winning 17 times is a different kind of data point.
For Reibman, the hackathon circuit served as a rapid-iteration product lab. Each event was a compressed test of idea, execution, and demo - the same three variables that determine whether a startup survives its first year. He entered more events than most engineers knew existed and came out with more wins than any single person reasonably should.
The technical output from those sessions seeded AgentOps. Building and breaking AI agents in compressed time frames revealed the same failure mode repeatedly: agents were unpredictable in production because their internal state was invisible. You knew the input. You knew the output. Everything in between was a black box.
The insight wasn't just that agents needed monitoring. It was that the monitoring had to be designed specifically for agents - not adapted from APM tools built for stateless microservices, not jury-rigged from logging libraries. Agent workflows are multi-step, branching, stateful, and often long-running. Watching them requires a different mental model and a different instrument.
They sucked. The agents I was building to scrape the web - they just didn't work reliably. So I decided to build the thing that would let me see why.
- Alex Reibman on the origin of AgentOpsFun Fact
His company's URL is agen.cy - a domain hack that doubles as the company's legal name. The full name "Agency" appears in both.
Chief Vibe Officer
Held this title at Cerebral Valley before founding AgentOps. Possibly the most SF job title ever documented.
700 Stars / Week
The Chidori open-source agent framework hit 700+ GitHub stars in its first week - the open-source community voted with clicks.
Achievements
Open Source
Reibman's GitHub profile sits at 80+ repositories. The open-source work isn't peripheral to AgentOps - it's core to the adoption strategy. The main AgentOps repository under the AgentOps-AI organization is the distribution channel for the monitoring SDK, updated continuously as new LLM frameworks emerge.
The Chidori framework - an open-source system for AI agents with time-travel debugging, agent versioning, and runtime mutability - gained 700+ GitHub stars in its first week. That's a signal: the developer community recognized both the problem and the approach.
Other notable projects include Bottleneck (a code review tool for coding agents), Hyperbox (a dedicated cloud Mac Mini preloaded with every major coding agent), and a growing library of integrations with the LLM ecosystem. The pattern: build tools that reduce friction for engineers working at the edge of what's possible with current AI systems.
Tech Stack
Notable Open Source Projects
AgentOps SDK
Core monitoring SDK with 400+ LLM integrations. The open-source backbone of the platform.
Chidori Framework
AI agent framework with time-travel debugging and runtime mutability. 700+ stars in week one.
Bottleneck
Desktop-native code review tool designed specifically for coding agents.
Watch & Listen
Writing & Ideas
Reibman maintains a blog at alexreibman.com that runs against type for a technical founder. The posts engage with behavioral economics, decision theory, and the mathematics of paradox - the St. Petersburg Paradox, the paradox of choice, privacy as a behavioral problem. The Philosophy degree from Emory surfaces in unexpected places.
He also writes for the Hyper Engineering publication, covering technical deep dives on 100x-ing developer efficiency with AI. On Substack as @hacktrace, he publishes work that sits at the intersection of security thinking and AI engineering.
The through-line in the writing: Reibman is interested in systems that behave in ways their designers don't fully anticipate. That's true for markets with infinite expected value (St. Petersburg), for humans with too many options (paradox of choice), and for AI agents running in production. The observability platform is, in a sense, an engineering answer to a philosophical question: how do you understand a system that surprises you?
Fun Facts
Domain Hack
AgentOps operates at agen.cy - a Cayman Islands domain that doubles as the company's name. One URL, two meanings.
Tel Aviv to SF
Career arc from cybersecurity data science in Tel Aviv's tech ecosystem to AI infrastructure in San Francisco's. Both cities obsessed with adversarial systems.
Behavioral Economics
The Philosophy minor shows up in blog posts about St. Petersburg Paradox and paradox of choice. Rare for a systems-focused ML engineer to write seriously about decision theory.
Chief Vibe Officer
This was an actual job title, held at Cerebral Valley in 2023. The role blended product leadership with deliberate focus on team culture. He kept it brief.
Connect
Alex Reibman is active across LinkedIn, Twitter/X, and GitHub. AgentOps has an open-source SDK and a growing developer community.
Press & Coverage
TECHCRUNCH
Born from SF's AI hackathons, Agency lets you see what your AI agents do - Aug 2024
TEDAI SAN FRANCISCO
Panelist profile at TEDAI San Francisco conference
PR NEWSWIRE
Agency AI Raises $2.6M in Pre-Seed Funding - Aug 2024
EMORY UNIVERSITY
2024 Emory Entrepreneur Award - Alex Reibman 14Ox16C
Share Alex Reibman's profile
Co-Founder & CEO, AgentOps - Watching every move your AI makes.