“I have no moat, and I must scream”

- Google

The leaked document from a Google researcher argues that open source is rapidly outpacing Google and OpenAI in terms of AI models. They have solved major problems, are faster, more customizable, and more capable, with the gap in quality quickly closing. This means that Google needs to collaborate with what is being done outside of the company, consider where its value-add is, and make small variants a priority. The document notes that the innovations that power open source’s recent successes directly solve problems that Google is still struggling with, and that LoRA is underexploited inside Google.

Jfc this is hilarious

Keeping our technology secret was always a tenuous proposition. Google researchers are leaving for other companies on a regular cadence, so we can assume they know everything we know, and will continue to for as long as that pipeline is open.

I’m cheering for the open-source team to successfully surpass Bard and ChatGPT eventually.