In the admittedly small world of people who obsess over data technologies, one of the hottest topics of the last year has been the “data mesh”.
Created by Zhamak Dehghani of ThoughtWorks, the concept struck a chord and made the rounds in countless conversations on Twitter and elswhere.
As I highlighted in the 2021 MAD Landscape, the data mesh concept is both a technological and organizational idea. A standard approach to building data infrastructure and teams so far has been centralization: one big platform, managed by one data team, that serves the needs of business users. This has advantages, but also can create a number of issues (bottlenecks, etc). The general concept of the data mesh is decentralization – create independent data teams that are responsible for their own domain and provide data “as a product” to others within the organization. Conceptually, this is not entirely different from the concept of micro-services that has become familiar in software engineering, but applied to the data domain.
It was a real treat to get to chat with Zhamak at our most recent Data Driven NYC.
Below is the video and below that, the transcript.
Full resolution version of the landscape image here
It’s been a hot,hot year in the world of data, machine learning and AI.
Just when you thought it couldn’t grow any more explosively, the data/AI landscape just did: rapid pace of company creation, exciting new product and project launches, a deluge of VC financings, unicorn creation, IPOs, etc.
It has also been a year of multiple threads and stories intertwining.
One story has been the maturation of the ecosystem, with market leaders reaching large scale and ramping up their ambitions for global market domination, in particular through increasingly broad product offerings. Some of those companies, such as Snowflake, have been thriving in public markets (see our MAD Public Company Index), and a number of others (Databricks, Dataiku, Datarobot, etc.) have raised very large (or in the case of Databricks, gigantic) rounds at multi-billion valuations and are knocking on the IPO door (see our Emerging MAD company Index – both indexes will be updated soon).
But at the other end of the spectrum, this year has also seen the rapid emergence of a whole new generation of data and ML startups. Whether they were founded a few years or a few months ago, many experienced a growth spurt in the last year or so. As we will discuss, part of it is due to a rabid VC funding environment and part of it, more fundamentally, is due to inflection points in the market.
In the last year, there’s been less headline-grabbing discussion of futuristic applications of AI (self-driving vehicle, etc.), and a bit less AI hype as a result. Regardless, data and ML/AI-driven application companies have continued to thrive, particularly those focused on enterprise use cases. Meanwhile, a lot of the action has been happening behind the scenes on the data and ML infrastructure side, with entire new categories (data observability, reverse ETL, metrics stores, etc.) appearing and/or drastically accelerating.
To keep track of this evolution, this is our eighth annual landscape and “state of the union” of the data and AI ecosystem – co-authored this year with my FirstMark colleague John Wu. (For anyone interested, here are the prior versions: 2012, 2014, 2016, 2017, 2018, 2019 (Part I and Part II) and 2020.)
For those who have remarked over the years how insanely busy the chart is, you’ll love our new acronym – Machine learning, Artificial intelligence and Data (MAD) – this is now officially the MAD landscape!
Today, Dataiku is announcing a major new financing – a total of $400m at a $4.6B valuation, led by Tiger Global (which had also invested in the company’s Series D), alongside a great group of existing and new investors.
While financings are ultimately just milestones, this is certainly a testament to the remarkable progress the company has been making towards becoming a major global software player, as it has scaled to hundreds of customers around the world and some 750 employees (and yes, hiring a lot more).
Beyond the headlines and high-fives, what is the story? Here’s a quick industry backgrounder and reminder for anyone new to the company.
A huge part of the data world has been historically focused on business intelligence, with both historical players (Tableau, Microsoft’s Power BI, Google Looker) and newer players (SiSense, Mode, etc.). Business intelligence tools enable you to analyze the past and the present of your business: “which region performed best last quarter?”, “who are our best salespeople?” etc. This is sometimes referred to as descriptive analytics.
Dataiku is a leader in another part of the data world, which different people call different names: data science, enterprise AI (for artificial intelligence), enterprise machine learning. Beyond the semantics, the core idea is to make it possible to asnwer questions about the future of your business, based on the analysis of historical data: “which customers are most likely to buy this product?”, “which customers are most likely to churn?”, “which transaction is most likely to be fraudulent?”, “which region is most likely to show strong demand this month?”. This area is sometimes referred to as predictive analytics.
This morning, Sketchfab announced that it was joining the Epic Games family.
From inception, Sketchfab has been a visionary company in the creator economy, pioneering the emergence of 3D as a key format on the web. It built the best 3D viewer on the market, and leveraged it to build a remarkable community of 3D creators and enthusiasts all around the world. It navigated the ups and downs of the “VR Winter” and, through entrepreneurial grit and great execution, emerged on the other side a stronger, profitable company – a journey that CEO Alban Denoyel documented with remarkable transparency.
Epic is the perfect partner for Sketchfab. It has epic (yes) plans for building the Metaverse (see Matthew Ball’s excellent essays on the Metaverse here and Epic here). The Metaverse will be a heavy consumer of 3D, AR and VR content, and Sketchfab fits perfectly within that vision. Sketchfab will continue operating largely as an independently branded service, and will be able to access Epic’s resources and distributions capabilities.
This last year has seen tremendous levels of activity for early stage startups in the data infrastructure ecosystem. At our most recent Data Driven NYC, we featured some of the rising stars:
Nick Schrock, Founder & CEO, Elementl (Dagster) | Elementl is building the next generation of open source data tools including Dagster, the open-source data orchestrator for machine learning, analytics, and ETL.
DeVaris Brown, Founder & CEO, Meroxa | Meroxa is a real-time data platform that gives data teams the tools they need to build real-time infrastructure in minutes.
Abe Gong, Founder & CEO, Superconductive (Great Expectations) | Superconductive is the team behind Great Expectations, the leading open source tool for defeating pipeline debt through data testing, documentation, and profiling. The company’s mission is to revolutionize the speed and integrity of data collaboration.
A member of our Emerging MAD Index of companies on their path to an IPO, Confluent is a very interesting company in a strategic part of the data space, providing infrastructure for real-time data streaming – what it nicely calls “data in motion”, in contrast to the world of batch processing or “data at rest”.
I had the pleasure of hosting the company’s co-founder and then CTO, Neha Narkhede, at Data Driven NYC back in 2016, and her great talk remains entirely relevant to understand the premise behind the company and its core technical foundation.
Databricks is an enterprise software giant in the making. Most recently valued at $28B in a $1B fundraise announced in February 2021, the company has global ambitions in the data and AI space.
An unlikely story of a company started by seven co-founders, most of whom were academics, built around the Spark open source project, Databricks is heading towards a monster IPO that will accelerate its rivalry with its chief competitor, Snowflake.
A couple of years ago, FirstMark led the Series A of Text IQ, an impressive AI startup focused on the management of unstructured data in the enterprise for legal, privacy and compliance purposes. The company was co-founded by Apoorv Agarwal (CEO, left) and Omar Haroun (COO, right), and had managed to grow both fast and profitably after raising a seed from our friends at Floodgate.
At its core, Text IQ leverages unsupervised learning to identify sensitive information (privileged documents, PII, PHI, etc.) in large amounts of unstructured data – a challenge that AI is uniquely equipped to solve.
After its Series A, Text IQ continued to make strong progress, building a great team, evolving the product into an enterprise-grade platform and securing an impressive list of Fortune 1000 customers.
Not surprisingly, this attracted the attention not just from potential Series B investors, but also acquirers.
One of the most exciting emerging areas for AI is content generation. Powered by anything from GANs to GPT-3, a new generation of tools and platforms enables the creation of highly customizable content at scale – whether text, images, audio or video – opening up a broad range of consumer and enterprise use cases.
At FirstMark, we recently announced that we had led the Series A in Synthesia, a startup providing impressive AI synthetic video generation capabilities to both creators and large enterprises.
As a follow up to our investment announcement, we had the pleasure of hosting two of Synthesia’s co-founders, Victor Riparbelli (CEO) and Matthias Niessner (co-founder and a Professor of Computer Vision at Technical University of Munich).
Some of topics we covered:
The rise of Generative Adversarial Networks (GANs) in AI
Use cases for synthetic video in the enterprise
Synthetic videos vs deep fakes
What’s next in the space
Below is the video and below that, the transcript.
MongoDB’s path from unlikely NYC enterprise tech startup to global category leader has been amazing to watch.
I’ve had the pleasure of hosting two of MongoDB’s co-founders over the years, first Dwight Merriman back in 2012 (here) and then CTO Eliot Horowitz in 2016 (here). So it was a real treat this time to get to chat with CEO Dev Ittycheria, who has been leading the company since 2014, and it particular has presided over the company’s remarkable ride in public markets since its 2017 IPO.
In addition to being a truly world-class CEO, Dev has had an outsized impact on the New York tech scene, as he’s been playing a central role both at MongoDB and also at Datadog, where he’s been a long time board member (after leading the company’s Series B back in 2014).
We had a wide-ranging conversation where we covered:
Dev’s journey as a CEO and investor
The evolution of enterprise tech in New York
MongoDB’s database as a service offering, Atlas
Newest products and product roadmap
GTM strategies, bottoms up vs top down
Lessons in scaling the team
Being a student of the game rather than a master of the game
A few weeks ago, my colleague John Wu and I introduced the MAD Index, a new public market index to track the progress of “pure play” machine learning, AI and data public companies. This was an initial group of 13 companies, which has since then increased to 14, following the UiPath IPO.
Today, we’re introducing the Emerging MAD Index, a companion to the public MAD index. The idea is to track a group of private companies that show high potential to join the MAD Index in the future.
Just like the Public MAD Index, our goal is to capture “pure play” machine learning, AI and data companies.
In practice, that generally means infrastructure companies offering tools to store, process and analyze data, create and manage machine learning models, and/or automate core processes deep in the stack – broadly horizontal companies serving a variety of business needs across departments, industries and geographies.
Dataiku (in which I’m a proud investor and board member) has had an impressive ride over the last few years. An early entrant in the enterprise Data Science and Machine Learning platform category, the company successfully expanded from its French/European roots to build a very strong presence in the US (where it is company is now headquartered) and, increasingly, Asia.
Along the way, Dataiku:
became a unicorn, most recently raising a $100M Series D in 2020
was named a “Leader” in Gartner’s Magic Quadrant for Data Science and ML Platforms in both 2020 and 2021
collected many accolades, such as CB Insight’s “AI 100” and several of Forbes lists: “Cloud 100”, “AI 50” and “America’s best startup employers in 2021”
It was really fun to host CEO Florian Douetteau at Data Driven NYC once again, after previous appearances in 2016 (here) and 2018 (here). We covered a bunch of different topics, including:
What enterprise AI is about: not flying cars, but optimizing hundreds of business processes
Why enterprises need to move past their fear of data and AI
The key principles behind the design of the Dataiku platform: handling the entire data lifecycle, and democratizing data/AI across teams
Dataiku’s partnership with Snowflake
The upcoming launch of their starter / SMB self-serve product, Dataiku Online
Below is the video and below that, the transcript.
At our most recent Data Driven NYC, we had the great pleasure of hosting Bindu Reddy, CEO and co-founder Abacus AI, and formerly GM & creator of AI verticals at AWS, and an ex-Googler. Bindu also has a very witty and entertaining Twitter account (@bindureddy), where she talks about all things machine learning and AI.
This was a very educational and approachable conversation, where we covered:
some key definitions: neural networks, weights and biases, supervised vs unsupervised learning, feature store
Applying neural networks to structured, tabular data
Abacus’ vision around “autonomous AI”
How companies wait too long to start experimenting in ML/AI
Below is the video and below that, the transcript.
We all have insatiable appetite for video, both in our personal and professional lives. Time and again, video is shown to capture our attention better than any other medium. This is increasingly how we learn, explore, collaborate and get entertained.
However, especially in an enterprise context, creating professional-quality video remains a complex and costly endeavor. For all the capabilities of smartphones, most companies still need studio-level equipment to produce enterprise-grade videos: cameras, sound equipment, actors, post-production editing. The process is time-consuming, and not very scalable. Shooting a video in multiple languages, for example, requires multiple actors or dubbing, Any update requires everyone to go back to the studio.
But what if video could be just… code? What if it could be infinitely flexible and customizable at scale, as simple as an API call?
Today we’re excited to announce that FirstMark led a $12.5M Series A investment in Synthesia – a fast-growing startup that offers exactly that.
Synthesia makes creating a business video as simple as writing an email or putting together a powerpoint presentation – a compelling “text to video” experience.