apache-spark
(10)
DualBird
DualBird is a Boston-based data infrastructure company building a cloud-native engine that brings hardware-grade acceleration to big data and AI workloads. By running rewritable FPGA silicon on AWS as a software service, DualBird plugs into existing Apache Spark and Apache Iceberg pipelines and claims 10-100x faster processing at 50-90% lower cost, without asking teams to change their code or workflows. The company raised $25M in combined Seed and Series A funding led by Lightspeed Venture Partners in November 2025.
Gilad Tal
Gilad Tal is co-founder and CEO of DualBird, a Boston-based deep tech startup rebuilding the foundation of analytics and AI data infrastructure by running silicon acceleration as cloud-native software. A Technion-trained electrical engineer and physicist with 14 years in ASIC and software development, he previously founded and led TerrainEDA, an EDA startup acquired by Synopsys. At DualBird he and his co-founders use rewritable FPGA hardware to plug into Apache Spark and Iceberg environments, claiming up to 100x faster performance and up to 90% lower cost with no changes to existing workflows.
Databricks
Databricks is a San Francisco-based data and AI company founded in 2013 by the original creators of Apache Spark. It builds the Data Intelligence Platform - a lakehouse architecture that unifies data engineering, analytics, and machine learning on open formats. Used by more than 10,000 organizations worldwide, Databricks helps enterprises store, govern, and analyze data and build AI applications on top of it, all under a single governance model.
InfoObjects Inc.
InfoObjects Inc. is a San Jose-based AI consulting and digital transformation firm, founded in 2005 by Rishi Yadav. Built originally around the open-source big data stack - Apache Spark, Kafka and Hadoop - the company has repositioned around generative and agentic AI, offering services from data engineering and cloud migration to LLM fine-tuning, retrieval-augmented generation and AI application development. It partners with AWS, Google Cloud, Microsoft Azure, Databricks, Anthropic and OpenAI, and works with enterprise clients across finance, healthcare, manufacturing and retail.
Lynx Analytics
Lynx Analytics is a Singapore-founded, AI-native analytics firm built by INSEAD students and professors in 2010 to apply graph theory to hard business problems. Its flagship platform, LynxKite, turns very large datasets into graphs and runs hundreds of graph algorithms - many GPU-accelerated - to power everything from telecom churn prediction and fraud detection to drug discovery. Over the past few years the company has pivoted its focus toward AI-native consulting and products for pharma and life sciences, combining biomedical knowledge graphs, large language models, and NVIDIA's accelerated computing stack.
Unravel Data
Unravel Data is a Mountain View, California company building an AI-native data observability and optimization platform. It plugs into modern data stacks - Databricks, Snowflake, Google BigQuery and Cloudera - and uses AI, machine learning and a context graph of workloads, infrastructure and users to automatically troubleshoot, tune and control the cost of data pipelines. Where most monitoring tools stop at telling teams what is wrong, Unravel aims to fix it: its newest engine, Arvix AI, rewrites code, reconfigures infrastructure and validates the changes before deploying them, so data engineers can build instead of firefight.
Reza Zadeh
Reza Zadeh is the founder and CEO of Matroid, a Palo Alto computer vision company that lets people build and deploy AI detectors without writing code. He is an adjunct professor at Stanford, a founding team member at Databricks, co-author of Apache Spark's machine learning library MLlib, and the person who built the algorithm behind Twitter's first machine-learning product, Who To Follow. Born during the Iran-Iraq war in Ahvaz, raised in London and Toronto, he turned a Stanford PhD on large-scale graphs into a company betting that one day every camera will understand what it sees.
Raj Bains
Raj Bains is the Founder and CEO of Prophecy, a Palo Alto-based low-code data engineering platform that lets analysts and engineers build Apache Spark pipelines visually - generating real, production-grade code to Git. With a background spanning compiler engineering at NVIDIA (where he was a founding CUDA team engineer), product management at Hortonworks through its IPO, and a patent for designing a language for insurance contracts, Bains launched Prophecy in 2017 to solve a problem he had watched the data industry ignore for two decades: making data transformation fast and accessible for everyone, not just Spark specialists. The company has raised $114M+ from Insight Partners, SignalFire, JPMorgan, and HSBC, and counts Fortune 50 enterprises including HSBC, JP Morgan, Microsoft, and Toyota among its customers.
Prophecy
Prophecy is an AI-powered data engineering platform that turns visual workflows into production-grade Spark and SQL code, letting analysts and engineers build, deploy, and govern pipelines together on Databricks, Snowflake, and BigQuery.
Vikas Marwaha
Vikas Marwaha is the Co-Founder of Prophecy, an AI-powered data transformation platform trusted by Fortune 500 enterprises for building data pipelines at scale. With a career spanning Satyam, HP, Headstrong, and Wipro, he brings over two decades of enterprise sales and global partnerships experience to a company that raised $155M in total funding and achieved 3.5x revenue growth in FY2024. Prophecy's platform lets data teams build, deploy, and monitor pipelines visually while generating clean, open-source code - bridging the gap between business users and data engineers.