“…The premise of the paper is that while OpenAI and Google continue to race to build the most powerful language models, their efforts are rapidly being eclipsed by the work happening in the open source community…”

  • Veritas@lemmy.ml
    link
    fedilink
    English
    arrow-up
    8
    ·
    edit-2
    2 years ago

    The leaked document from a Google researcher argues that open source is rapidly outpacing Google and OpenAI in terms of AI models. They have solved major problems, are faster, more customizable, and more capable, with the gap in quality quickly closing. This means that Google needs to collaborate with what is being done outside of the company, consider where its value-add is, and make small variants a priority. The document notes that the innovations that power open source’s recent successes directly solve problems that Google is still struggling with, and that LoRA is underexploited inside Google.