content-moderation
(22)
Alice (Formerly ActiveFence)
Alice, formerly ActiveFence, is an Israeli-American AI safety and security company that acts as a protective layer for online platforms and AI systems. Founded in 2018, it uses a decade of real-world abuse intelligence to detect and stop harms such as fraud, deepfakes, child exploitation, disinformation, prompt-injection attacks, and jailbreaks. Its technology helps protect roughly 3 billion people and secures 7 of the 10 largest AI foundation models, serving customers including Amazon, TikTok, Nvidia, and Cohere.
Copyleaks
Copyleaks is a New York-based content authenticity company that uses AI to detect plagiarism, AI-generated text, source code, and increasingly images and video. Founded in 2015 by Alon Yamin and Yehonatan Bitton, it serves educational institutions, publishers, and enterprises that need to verify whether content is original, licensed, or machine-generated, and it claims over 99% accuracy across 30+ languages with integrations into major learning management systems.
iMerit Technology
iMerit is a global AI data solutions company that supplies the labeled, enriched and expert-refined data used to train, fine-tune and evaluate machine learning and generative AI models. Founded in 2012 by Radha Basu, it pairs a specialized human workforce with its Ango Hub annotation platform and its Scholars network of domain experts to serve Fortune 500 clients across autonomous vehicles, healthcare, geospatial and financial services. In June 2026, enterprise-AI firm EXL agreed to acquire iMerit for up to $310 million.
Linklabs
Linklabs (branded 'Remix The Web') is a Sao Paulo-based software platform that helps brands, publishers and agencies collect, moderate, display and analyze social content from across the web. It aggregates user-generated content from 15+ social networks, review sites and messaging apps into curated social walls, website hubs, event projections and ad units - with built-in content-rights management and campaign analytics to turn peer recommendations into measurable marketing conversions.
GGWP
GGWP is a San Francisco-based AI company that builds moderation and community-safety tools for online games, media networks and large fan communities. Founded in 2020 by esports pioneer Dennis 'Thresh' Fong, Crunchyroll co-founder Kun Gao and data scientist Dr. George Ng, its Community Copilot platform uses machine learning to detect toxic behavior across text chat, voice, usernames and Discord, triage player reports, and track long-term player reputation - across 20+ languages. GGWP has moderated tens of billions of messages across 100+ games and works with publishers including Unity, Sony, Krafton and Fandom.
Noam Schwartz
Noam Schwartz is the CEO and co-founder of Alice (formerly ActiveFence), the trust and safety company that quietly built the moderation and adversarial-intelligence pipes behind platforms serving three billion people and seven of the ten largest AI foundation models. He founded the company in 2018 after encountering child sexual abuse material while mapping the internet at his previous startup, and has led it through Series A/B rounds totaling $100M, two acquisitions (Spectrum Labs, Rewire), and a 2026 rebrand to Alice that repositions the company from social-platform moderation to securing generative AI.
ModSquad
ModSquad is a Sacramento-based digital engagement company that provides on-demand customer support, content moderation, trust and safety, community management, and social media services for global brands. Founded in 2007 as Metaverse Mod Squad, it built a distributed network of vetted freelance moderators - called Mods - spread across 90+ countries and 55+ languages, letting clients scale coverage up and down without the overhead of a traditional call center. Its clients range from game studios and children's entertainment to e-commerce, media, and the U.S. Department of State.
Pangram Labs
Pangram Labs builds AI-content detection software that identifies text written by models like ChatGPT, Claude, Gemini and Grok. Founded in 2024 by Stanford classmates Max Spero and Bradley Emi, the New York-based startup claims third-party-verified accuracy above 99.9% and a roughly 1-in-10,000 false-positive rate, positioning itself as the reliable alternative to perplexity-based detectors. Its detector, browser extensions, API and LMS integrations are used across education, publishing, enterprise trust & safety and platform moderation.
Birago Jones
Birago Jones is the co-founder and CEO of Pienso, a no-code AI platform that lets subject-matter experts train, fine-tune and deploy their own machine learning models without writing code. Born out of research he and Karthik Dinakar did at the MIT Media Lab on cyberbullying detection, Pienso is built on a simple conviction: the people who understand the data best, not just the engineers, should build the models. His customers now include the US government and Sky, the UK's largest broadcaster, which used Pienso to process half a million customer calls a day.
Thoth AI
Thoth AI is a Singapore-headquartered global AI data solutions company that builds the high-quality datasets, evaluation frameworks, and human-in-the-loop operations that production AI systems depend on. Spanning 200+ languages and 100+ countries, it handles data collection and annotation across images, video, 3D point cloud, text, and audio, along with RLHF, model evaluation, content moderation, and multilingual customer experience for teams building LLMs, VLMs, multimodal systems, and applied AI like robotics.
Moonshot
Moonshot is a London-founded technology and intelligence company that maps and disrupts online harms - from violent extremism and disinformation to gender-based violence, human trafficking, and harassment of public figures. Founded in 2015 by Vidhya Ramalingam and Ross Frenett, the firm pairs data science, OSINT, and behavioral research with field interventions like its pioneering Redirect Method, which steers people searching for extremist content toward safer alternatives. It works for governments, technology platforms (Google, Facebook, Spotify), and, more recently, sports organizations protecting athletes from online abuse.
TrustLab
TrustLab is a San Mateo-based trust and safety software company building AI-with-human-in-the-loop tools that detect, evaluate, and enforce against harmful online content - from misinformation and hate speech to identity fraud. Founded in 2020 by former trust and safety leaders from Google, YouTube, TikTok, and Reddit, it sells content-safety and AI-oversight products (DetectAI, ModAI, SuperviseAI) to social platforms, marketplaces, and governments, and was selected by the European Commission to independently measure disinformation across major platforms under its Code of Practice.
Zigazoo
Zigazoo is a video-based social network built specifically for kids and teens, where every post is human and AI moderated before it goes live. Founded by former educators during the pandemic as a daily challenge app for kids stuck at home, it grew into what the company calls the largest and safest social network for children in the world. Kids respond to short video challenges from museums, zoos, teachers, musicians and celebrities, earn in-app currency called Zigabucks, and connect through creativity rather than private chat. It is KidSAFE COPPA certified, has no text messaging, and removes anything negative before it ever reaches a feed.
Pienso
Pienso is a no-code AI platform that lets domain experts - not just engineers - train, fine-tune, and deploy their own machine learning and large language models without writing a single line of code. Founded by MIT Media Lab alumni Birago Jones and Karthik Dinakar, Pienso keeps humans in the loop and data in the customer's control, with cloud or on-premise deployment for governments, media companies, and regulated enterprises.
OpenWeb
OpenWeb is a social engagement and monetization platform that helps publishers own the conversation on their own sites instead of renting their audiences to social networks. Founded in Israel in 2015 as Spot.IM and now headquartered in New York, it pairs comment sections, live blogs and polls with AI moderation and in-conversation advertising. The company works with 5,000+ publishers, reaches more than 150 million monthly active users, and reached a $1.5B valuation after a $170M Series F in 2022.
Tom Siegel
Tom Siegel is the co-founder and CEO of TrustLab, a San Mateo company building independent technology to detect and measure harmful online content. He spent roughly 15 years at Google, where he founded and scaled the company's first Trust & Safety team into the industry's leading abuse-fighting organization, protecting billions of users. In 2020 he left to build the external referee he felt the internet was missing - a third party that measures disinformation, hate speech, and AI-generated harm without a platform's conflict of interest. TrustLab was chosen by the European Commission to run the first independent measurement of disinformation under its Code of Practice.
Coactive AI
Coactive AI is an enterprise multimodal application platform that turns unstructured video, image, and audio into searchable, time-aligned, taggable data - giving media, retail, and tech companies a way to actually see what is inside their content libraries without an army of human taggers.
Hive
Hive is a San Francisco AI company that sells pre-trained machine learning models as APIs, focused on content moderation, AI-generated content detection, and visual understanding. Founded in 2013 by Kevin Guo and Dmitriy Karpman, Hive powers trust and safety at platforms like Reddit, BeReal, and Chatroulette, and runs deepfake detection contracts with the U.S. Department of Defense and Department of Homeland Security.
Eric Zhang
Eric Zhang is the Chief Executive Officer of Thoth AI, a Singapore-headquartered global AI data solutions company with R&D operations in Silicon Valley. Under his leadership, Thoth AI powers frontier AI models for some of the world's leading AI labs by providing high-quality training data, RLHF workflows, model evaluation, and multilingual customer experience services across 170+ countries in 200+ languages. Zhang operates at the intersection of AI safety, responsible deployment, and global scale - building the human infrastructure that makes AI smarter, safer, and culturally aware.
Amy Pritchard
Amy Pritchard is the founder and CEO of ModSquad, a global leader in outsourced digital engagement services. A former commercial litigator, she launched the company in 2007 inside a virtual bar in Second Life with four colleagues - their first gig was guarding Newt Gingrich's avatar. Today ModSquad runs 10,000+ independent contractors across 70 countries, serving clients from the NFL to the U.S. Department of State with customer support, content moderation, trust and safety, and community management - blending agentic AI with high-EQ human expertise.
Kevin Guo
Kevin Guo is the Co-Founder and CEO of Hive, a San Francisco-based enterprise AI company that built what may be the world's largest human-labeled training dataset - over 1 billion labeled items - and deployed those models as cloud APIs used by Reddit, BeReal, and more than 15 of the top social platforms for content moderation. A Stanford triple-degree graduate (biology BA, mathematical/computational sciences BS, computer science MS), Guo co-founded Kiwi - a social Q&A app that grew to 100 million users - before pivoting that team into Hive in 2017. Hive reached unicorn status with a $2 billion valuation after its $85 million Series D in April 2021, and Guo has become one of the most prominent voices on AI-generated content detection and the fight against deepfakes.
Casey Newton & Zoe Schiffer
Casey Newton and Zoe Schiffer are two of the most influential tech journalists working today. Newton founded Platformer, a newsletter covering social networks at the intersection of tech and democracy, co-hosts the Hard Fork podcast with the NYT, and broke landmark investigations into Facebook's content moderation crisis. Schiffer co-ran Platformer as managing editor, authored 'Extremely Hardcore: Inside Elon Musk's Twitter' (Penguin Random House, 2024), and now serves as Director of Business & Industry at WIRED. Together they shaped some of the most consequential tech journalism of the 2020s.