Yeah, I think it's really kind of like the new paradigm to build all tech. So I think in a few years, if you build a product without the help of AI, without AI, it's going to be like creating a shop without kind of like software 20 years ago, which doesn't mean that it's going to completely disappear, right? You still open shops today, maybe without software, but the norm will be to build products and technologies with AI, in my opinion.
For the second half of this conversation, let's talk about Hugging Face, starting with the founding story. Hugging Face is one of those fascinating stories in technology. I guess we were talking about Twitter and X, a little bit like Twitter that came out of a podcasting company. Hugging Face came out of a different product. Do you want to give us all the details? What did that chatbot do?
Yeah, we started out of our excitement and passion for AI. And at the time, eight years ago now, we were like, okay, what's a scientifically challenging topic that we can work on, but that is fun at the same time, and ended up starting building this Tamagotchi AI, right? So at the time, it's like a Siri, Alexa, but we wanted to make it entertaining. We did that for a bit more than three years.
So it was kind of Character.AI today?
Yes, kind of Character.AI or ChatGPT, but kind of like entertaining. Not saying that ChatGPT is not entertaining, but more focused on entertainment, I guess. And we were lucky to kind of work very early on on transformer models, on transfer learning for NLP. And the kind of origin story of the pivot is quite interesting with Thomas, one of our co-founders.
Wolf, and chief scientist, coming up to Julien and me on, I think it was on a Friday afternoon. Oh, there's this thing that came up which is called BERT from Google, but it kind of sucks because it's in TensorFlow and most people today want to use PyTorch. So he said, oh, I think I'm going to spend the weekend hacking around it and maybe release something. And then on Monday, he releases a PyTorch implementation of BERT and tweets about it. I think at the time we got maybe like 1,000 likes on his tweet on Twitter.
And we're like, wow, we broke the internet. At the time, we were literally like nobody, didn't really have much visibility. And then progressively, we realized that there was something around kind of like not just creating the final application, but providing a platform, providing technology for companies to adapt this, adopt this new paradigm for building software. So after, I think after a few months, I think in addition to BERT, we added, or the researchers from the labs added, XLNet, which was from Guillaume Lample at Meta, who's now the founder of Mistral.
We added GPT at the time from OpenAI, and then progressively it evolved into this platform that is Hugging Face today.
And that became the Transformers library.
Transformers library. Yeah, that's kind of like—so the first repository was PyTorch-Pretrained-BERT, which became PyTorch Transformers when we added more models than BERT, which became Transformers.
Which is one of the most successful open-source libraries of all time. And the G in GPT.
So that's one of these examples of pivots, right? Of this ability of startups to be flexible, to be opportunistic, to follow when you see some demand, some kind of potential in the market. And for us, it's also a good example of community-driven evolution of a startup, because it's really kind of like the community that gave us the signal that it was useful, and then the community that helped us make it better by adding more models from the early models to then contributing more.
When was that moment? Because having a highly successful library is one thing, but then turning yourself into a platform to host a bunch of different libraries and models and all the things, when did that happen?
It started quite early, even in the first days of Thomas releasing the first port of BERT. I think contributors, open-source contributors, started to solve bugs and improve some small things. And then progressively, as we added more models, more contributors started to add more models. So progressively, the community contributed more and more, and we felt this movement where the more we contributed to the community, the more open source we did, the more the community was giving us back. So it validated us into this approach to today, as I mentioned, where we have 5 million AI builders using our platform.
who collaboratively shared 1 million public models. Half of them have been downloaded in the past 30 days. So most of them are actually very useful and active for the community. They also contributed, I think it's more than 200,000 datasets to the platform. So it's open datasets that anyone can go and use to fine-tune, to customize their models for specific languages, specific domains, specific use cases. And collectively they built over 300,000 Spaces, which are the apps on the Hugging Face platform.
When did you feel you sort of had it? This idea of being the GitHub for machine learning or AI, rewind back to whenever that was, 2014, '15, '16, '17, '18, that general period of time, there were a number of companies that were sort of talking about doing this, and none of them really ever took off. And in some ways, GitHub never became the GitHub. Why do you think that is? And why do you think you were able to break through? Was it perfect timing?
Was it transformers? What were the reasons?
Luck. I think it's a big aspect in anyone's success. Sometimes we forget to talk about it, and we kind of look back at things, and we're like, okay, I had the perfect strategy, I had the perfect approach to things. The truth is that we got lucky in many ways. We got lucky in terms of timing, as you mentioned. I think we were at the right time, at the right place. We were lucky in terms of who we were as founders compared to, in alignment with what we were trying to build.
Before, we had some experience around consumer, and so I think it helped us to have a very community-driven approach instead of maybe a more enterprise-driven approach or a more traditional kind of like B2B approach. And then we got lucky that the community adopted us and started to contribute to our platform and that we could collaborate with a lot of the products that were around at the time. Right from the beginning, actually, we took much more of a collaborative approach than a competitive approach.
And so it helped us kind of like to focus on where we were adding value, in a way, to the community, where we were building kind of like something useful for the community, and usually integrating with other offerings and other technology products when it was making more sense.