Emily Glassberg Sands34:10 And then, the impact is even greater for these tiny merchants who never used to contest chargebacks at all, and they now have this AI paralegal that's working for them. And so, you weren't asking about Smart Disputes, you were asking about the mental model, but it's basically: big user pain, abundant Stripe-only data, a clear model-driven fix, and that's how we decide where the next place that Stripe AI should go.
And a lot of what we talked about so far has had to do with stopping bad things from happening. So fraud, card testing, illegitimate chargebacks. Are there examples where you use AI to generate revenue? I guess the example that you just mentioned does generate increased revenue, but whether that's a smarter route or faster checkout, any of those things?
Emily Glassberg Sands34:44 For sure. And by the way, fraud done well also generates revenue, in the sense that the alternative is usually doing fraud poorly, which has a bunch of false positives, which means you're blocking some good users.
Emily Glassberg Sands35:02 But the way we think about it is, we use AI across every stage of the payments lifecycle. So, from the second a customer lands on the checkout page all the way through to handling those refunds and disputes. And if you think about that lifecycle, there's kind of five meaty steps. There's checkout, there's authentication, there's fraud detection, which is where we've spent most of our time talking, there's authorization, and then there's the downstream events like refunds and disputes.
Emily Glassberg Sands35:38 Checkout is sort of the easiest for you or me, pre-Stripe, to reason about because we all experience it as consumers. And I think we could all agree that checkout experiences feel pretty staid and inefficient. No matter who you are, no matter where you're shopping from, no matter how you like to pay, you usually get the same old form. It doesn't adapt. It doesn't know you. And a lot of times, that's all it takes for a customer to drop off at the finish line.
Emily Glassberg Sands36:06 Some of that is little stuff, but some of that is big stuff. If I only have an Amex on me and Amex isn't shown, I literally would have to text my husband to get a Visa card. And if I'm in another country and have no access to any of the payment methods that are listed, then you've basically shut off my market entirely. So we've been working a lot on fixing that in checkout. AI is our magic wand here.
Emily Glassberg Sands36:29 We call it Stripe's Optimized Checkout Suite, and it's just about making the checkout experience increasingly personalized for our users' customers. So, dynamically tailoring that experience to each of the end users, again, our users' users, in real time. So, Turo, maybe you've used it. They're the world's largest car-sharing marketplace.
Emily Glassberg Sands36:55 They moved over to our Checkout Suite and saw a 5% increase in recaptured revenue, which for them was, I think, like $100-some million a year. Payment methods are a really interesting subcomponent of checkout. So, there has been a proliferation of payment methods in the world, which from a market efficiency perspective is probably a great thing. Stripe now supports well over 100 payment methods, like Apple Pay, iDEAL, buy now, pay later. And so, what we do in the Optimized Checkout Suite is: more payment methods is better for business because it comes kind of out of the box for businesses.
Emily Glassberg Sands37:27 They can reach more customers with what they need. But actually showing more payment methods to their customers is suboptimal because people get choice anxiety. If they don't see what they need in the first three, they give up. And so we provide all these payment methods, but then we automatically surface the most relevant payment methods based on who the customer is and what they're buying. And it works. Businesses that show at least one relevant payment method beyond just cards see, like, a 12% increase in revenue and more than 7% lift in conversion.
Emily Glassberg Sands37:47 So conversion goes up and the size of the transaction goes up. And that's a really big deal for something as small as the order of buttons on a screen. So that's checkout.
Can we nerd out on data infra for a few minutes? I'd love to talk about lessons learned operating data infrastructure, specifically for data science, machine learning, and AI at this scale: what tools you use, what worked, what didn't, any lessons around scaling and operating at that level?
Emily Glassberg Sands38:41 We use ML infrastructure that we've developed over time at Stripe and that relies on open source where available and sort of third-party buy solutions where it's not differentiated for us and where there's a third party that meets our reliability, latency, and cost consideration needs. So, for example, the data scientists and MLEs and even some of the software engineers here use notebooks for experimentation. We use Databricks notebooks. We use Flyte for orchestrating our training runs. We use NVIDIA GPUs and PyTorch for model training.
Emily Glassberg Sands39:08 Feature computation, including those LLM embeddings and feature serving, is done in Shepherd, which, again, we built in partnership with Airbnb and have since open-sourced under the name of Chronon. Shepherd is new for us. Actually, we just completed the full migration to Shepherd a month and a half ago. That migration took on the order of about six months. But one lesson learned is to really make sure that we're investing sufficiently in the horizontal infrastructure layer so that individual product teams snap to the same infrastructure, versus allowing their golden workflows to diverge and everyone to spin their own.
Emily Glassberg Sands39:58 Transparently, the original feature computation and feature serving system we built, which was called Semblance, had a number of limitations. It was pretty hard to develop on. And as a result, one of our largest machine learning groups at Stripe decided to fork, buy Tecton, a third-party solution. We couldn't adopt Tecton across Stripe because Tecton was only useful for batch solutions and didn't meet the latency and reliability requirements of the charge path. So, you could use it, for example, to score merchant risk at onboarding because you have a couple of minutes to make that decision, but you couldn't use it to score a charge because you have tens of milliseconds.
Emily Glassberg Sands40:40 To make that decision. And we ended up in this fractured world, which led to all sorts of issues, including one of the most valuable signals for understanding whether a merchant is fraudulent is looking at the transactions that are happening on that merchant. Because there are certain patterns of transactions. Many of your buyers are from the same IP, or there's a big jump in prices. You used to be selling everything at $2, and suddenly you're selling everything at $2,000.
Emily Glassberg Sands41:14 That in and of itself indicates that the merchant is fraudulent. And those features actually couldn't be shared because we were bifurcated. Plus, just from an investment perspective, you basically have mini ML infra teams within the applied teams that are operating inefficiently. And so, we brought all that together under Shepherd. It was a bit of a long journey, but it was definitely worth doing. And then we put enough work into it that we were like, we should just open-source it and make sure other people can build on it as well.