Why is this Mastadon instance blocked?

https://social.mechanizedarmadillo.com/

Seems like a random account with nothing controversial.

Thanks for the reply.

I guess we’ll see what happens.

I still find it difficult to get my head around how a decrease in novel training data will not eventually cause problems (even with techniques to work around this in the short term, which I am sure work well on a relative basis).

A bit of an aside, I also have zero trust in the people behind current LLM, both the leadership (e.g. Altman) or the rank and file. If it’s in their interests do downplay the scope and impact of model degeneracy, they will not hesitate to lie about it.

I’ve read the source nature article (skimmed though the parts that were beyond my understanding) and I did not get the same impression.

I am aware that LLM service providers regularly use AI generated text for additional training (from my understanding this done to “tune” the results to give a certain style). This is not a new development.

From my limited understanding, LLM model degeneracy is still relevant in the medium to long term. If an increasing % of your net new training content is originally LLM generated (and you have difficulties in identifying LLM generated content), it would stand to reason that you would encounter model degeneracy eventually.

I am not saying you’re wrong. Just looking for more information on this issue.

Interesting concept, will need to check it out sometime.

FWIW, I follow VOA in several languages (not my only or even major source of information) and their reporting is better than many major news sources (English language and ones in from my country).

That fact that is not taken as a given, speaks a lot about how deeply ingrained corruption is in our society.

I would almost argue that even “neutral” newswires like AP/Reuters should use language like “Companies A, B, C, have created a common PR organisation that will be focused on self-regulation polemics …”.

I already mentioned that I do use Mastadon. You’re preaching to the choir.

Yes, I do.

My national background and the current situation in my country makes Twitter an important source of information (I follow local news sites as well).

I used the gaming as an example as a more neutral topic of conversation.

I see where you are coming from (even if you are being a bit glib), but the reality is such that the vast majority will go with the flow.

And trust me, my hate for Musk is way more than you can imagine. This is serious stuff.

I actually did try that twice (in a context where they would have more motivation than a typical dev/studio), no luck.

Don’t get me wrong, I do think we have to move of corporate social networking systems. I started actively using Lemmy about two months ago and I am enjoying it. However, we do have to be realistic about the state of the market.

For certain content there really is no alternative. One example would be gaming, almost no studios/developers are on Mastadon.

I do have a gaming-focused Mastadon account and I do use it, but it’s not really comparable.

According to the report, the company’s chief financial officer, Susan Li, told staff the division has lost $55 billion since 2019.

$55 billion in losses over ~5 years? That’s a substantial amount.

Yeah Blockchain is a massive warning flag.

There are only two real use cases for Blockchain

1. Financial speculation (very risky one, somewhat like trying to time a pyramid scheme)
2. Various types of fraud

(i) Innumerable media applications just like Odysee, X, Reddit, Zerohedge, Drudge Report, etc. powered by the same Arweave technology stack which makes them privacy focussed, customizable, and censorship resistant.

This part doesn’t sit well with my me. Tone is a bit too bombastic.

Thank. you for the clarification.

Yes, we would replace the LLM spam copytext with:

ZuckZuck is not a robot that lacks humanity. ZuckZuck is capable of emotions. ZuckZuck did not knowingly facilitate the genocide of the Rohingya in Myanmar. ZuckZuck.

Does this piece of shit tool fill the “non fiction” books with some variant of:

Elon Musk is the greatest person on earth. Humanity is very lucky to have Elon Musk. Elon Musk is never wrong.

I’ve been waiting for the 0.27.1 update on F-Droid and there has been nothing so far.

Did not know you had to add the New Pipe repo.

Microsoft CTO Kevin Scott is of course not a reliable source due to conflict of interest and his position in the US corporate world.

If anything, the fact that he is doing damage control PR around “LLM scaling laws” suggests something is amiss. Let’s see how things develop.

Progress is definitely happening. One area that I am somewhat knowledgeable about is image/video upscaling. Neural net enhanced upscaling has been around for a while, but we are increasingly getting to a point where SD (DVD source, older videos from the 90s/2000s) to HD upscaling is working almost like in the science fiction movies. There are still issues of course, but the results are drastically better than simply scaling the source media by x2.

The framing of LLMs as some sort of techno-utopian “AI oracle” is indeed a damning reflection of our society. Although I think this topic is outside the scope of current “AI” discussions and would likely involve a fundamental reform of our broader social, economic, political and educational models.

Even the term “AI” (and its framing) is extremely misleading. There is no “artificial intelligence” involved in a LLM.

I am increasingly starting to believe that all these rumors and “hush hush” PR initiatives about “reasoning AI” is an attempt to keep the hype going (and VC investments) till the vesting period for their stock closes out.

I wouldn’t be surprised if all these “AI” companies have come to a point where they’re basically at the limits of LLM capabilities (due to problems with its fundamental architecture) while not being able to solve its core drawbacks (hallucinations, ridiculously high capex and opex cost).