This troubling ability could be used by scammers or to target ads.

Vechev and his team found that the large language models that power advanced chatbots can accurately infer an alarming amount of personal information about users—including their race, location, occupation, and more—from conversations that appear innocuous.

  • Terrasque@infosec.pubEnglish
    4·
    9 months ago

    Unfortunately, the larger models are way too big to run client-side.

    There is some hope. Mistral is pretty incredible for it’s size, and it’s a 7b model. There are finetunes on top of that which makes it even better - my favorite right now is Open Hermes 2

    There’s still room for improvement, and it’s getting better and better.