Smorty [she/her]

I’m a person who tends to program stuff in Godot and also likes to look at clouds. Sometimes they look really spicy!
image of Biene Maja
image of cutie fluttershy

  • 36 Posts
  • 449 Comments
Joined 2 years ago
cake
Cake day: July 5th, 2023

help-circle












  • fair, if u wanna see it that way, ai is bad… just like many other technologies which are being used to do bad stuffs.

    yes, ai used for bad is bad. yes, guns used for bad is bad. yes, computers used for bad - is bad.

    guns are specifically made to hurt people and kill them, so that’s kinda a different thing, but ai is not like this. it was not made to kill or hurt people. currently, it is made to “assist the user”. And if the owners of the LLMs (large language models) are pro-elon, they might train in the idea that he is okay actually.

    but we can do that too! many people finetune open models to respond in “uncensored” ways. So that there is no gate between what it can and can’t say.




  • the training process being shiddy i completely agree with. that is simply awful and takes a shidload of resources to get a good model.

    but… running them… feels oki to me.

    as long as you’re not running some bigphucker model like GPT4o to do something a smoler model could also do, i feel it kinda is okay.

    32B parameter size models are getting really, really good, so the inference (running) costs and energy consumption is already going down dramatically when not using the big models provided by BigEvilCo™.

    Models can clearly be used for cool stuff. Classifying texts is the obvious example. Having humans go through that is insane and cost-ineffective. Meanwhile models can classify multiple pages of text in half a second with a 14B parameter (8GB) model.

    obviously using bigphucker models for everything is bad. optimizing tasks to work on small models, even at 3B sizes, is just more cost-effective, so i think the general vibe will go towards that direction.

    people running their models locally to do some stuff will make companies realize they don’t need to pay 15€ per 1.000.000 tokens to OpenAI for their o1 model for everything. they will realize that paying like 50 cents for smaller models works just fine.

    if i didn’t understand ur point, please point it out. i’m not that good at picking up on stuff…