It took Hawking minutes to create some responses. Without the use of his hand due to his disease, he relied on the twitch of a few facial muscles to select from a list of available words.
As funny as it is, that interview, or any interview with Hawkins contains pre-drafted responses from Hawking and follows a script.
But the small facial movements showing his emotion still showed Hawking had fun doing it.
When I go back to being a Beltway Bandit, I need to remember these!
To add to this insight, there are many recent publications showing the dramatic improvements of adding another modality like vision to language models.
While this is my conjecture that is loosely supported by existing research, I personally believe that multimodality is the secret to understanding human intelligence.
I am an LLM researcher at MIT, and hopefully this will help.
As others have answered, LLMs have only learned the ability to autocomplete given some input, known as the prompt. Functionally, the model is strictly predicting the probability of the next word+, called tokens, with some randomness injected so the output isn’t exactly the same for any given prompt.
The probability of the next word comes from what was in the model’s training data, in combination with a very complex mathematical method to compute the impact of all previous words with every other previous word and with the new predicted word, called self-attention, but you can think of this like a computed relatedness factor.
This relatedness factor is very computationally expensive and grows exponentially, so models are limited by how many previous words can be used to compute relatedness. This limitation is called the Context Window. The recent breakthroughs in LLMs come from the use of very large context windows to learn the relationships of as many words as possible.
This process of predicting the next word is repeated iteratively until a special stop token is generated, which tells the model go stop generating more words. So literally, the models builds entire responses one word at a time from left to right.
Because all future words are predicated on the previously stated words in either the prompt or subsequent generated words, it becomes impossible to apply even the most basic logical concepts, unless all the components required are present in the prompt or have somehow serendipitously been stated by the model in its generated response.
This is also why LLMs tend to work better when you ask them to work out all the steps of a problem instead of jumping to a conclusion, and why the best models tend to rely on extremely verbose answers to give you the simple piece of information you were looking for.
From this fundamental understanding, hopefully you can now reason the LLM limitations in factual understanding as well. For instance, if a given fact was never mentioned in the training data, or an answer simply doesn’t exist, the model will make it up, inferring the next most likely word to create a plausible sounding statement. Essentially, the model has been faking language understanding so much, that even when the model has no factual basis for an answer, it can easily trick a unwitting human into believing the answer to be correct.
—-
+more specifically these words are tokens which usually contain some smaller part of a word. For instance, understand and able would be represented as two tokens that when put together would become the word understandable.
Agreed.
Nevertheless, the Federal regulators will have an uphill battle as mentioned in the article.
Neither “puffery” nor “corporate optimism” counts as fraud, according to US courts, and the DOJ would need to prove that Tesla knew its claims were untrue.
The big thing they could get Tesla on is the safety record for autosteer. But again there would need to be proof it was known.
I am a pilot and this is NOT how autopilot works.
There is some autoland capabilities in the larger commercial airliners, but autopilot can be as simple as a wing-leveler.
The waypoints must be programmed by the pilot in the GPS. Altitude is entirely controlled by the pilot, not the plane, except when on a programming instrument approach, and only when it captures the glideslope (so you need to be in the correct general area in 3d space for it to work).
An autopilot is actually a major hazard to the untrained pilot and has killed many, many untrained pilots as a result.
Whereas when I get in my Tesla, I use voice commands to say where I want to go and now-a-days, I don’t have to make interventions. Even when it was first released 6 years ago, it still did more than most aircraft autopilots.
“If it wasn’t hard, it wouldn’t be worth doing”
I’m convinced that we should use the same requirements to fly an airplane as driving a car.
As a pilot, there are several items I need to log on regular intervals to remain proficient so that I can continue to fly with passengersor fly under certain conditions. The biggest one being the need for a Flight Review every two years.
If we did the bare minimum and implemented a Driving Review every two years, our roads would be a lot safer, and a lot less people would die. If people cared as much about driving deaths as they did flying deaths, the world would be a much better place.
I hate that I am defending Israel when I say this because what is occurring in Gaza is tragic, but a lot of people are confusing “Genocide” for perceived “War Crimes” as defined by international law and also confusing “Hamas” for “Palestine” or the “Palestinian Authority”.
Hamas is terrorist government (similar in nature to the Taliban) that receives a lot of external funding from countries that actively wish to see the death of Israel and all Jews, making Hamas the chief perpetrators of Genocide in this conflict despite how ineffective they have been in their goals.
Israel was attacked by this terrorist government, and is now defending itself with the expressed war goal of destroying Hamas. While Israel has had a tenuous relationship with the Palestinian people (namely the government’s active efforts to limit the Palestinian Authority and drag their feet on grant the PA more autonomy and their own state which is deplorable and inexcusable), they do not and have not wished to kill an entire culture of people.
Complicating matters, Hamas commonly employs warfare techniques that go against the Geneva Convention like placing government and military headquarters in basements of protected buildings like Hospitals and places of worship. The moment they do that, and abuse those international recognized sanctuaries, they become legitimate military targets leading to the tragic deaths of unwitting civilians.
People can object to the war on the grounds that war is tragic and results in many civilian casualties, but to make meritless claims is detrimental to both international institutions and to the definition of a Genocide. South Africa calls what Israel is doing a genocide, but also explicitly looks the other way with Ukraine and continues to forge close ties with Putin? (For the record, Russia’s actions in Ukraine are also not considered genocide under it’s strict international definition, but they have been found guilty of war crimes).
Israel has an internationally recognized right to defend itself, and it is doing that by dismantling Hamas through force. The Palestinian people are unfortunately caught in the crossfire. With that said, Israel’s methods to this end are not above criticism, and they have faced pressure from the US and Biden to limit civilian casualties wherever possible, and use ground forces to directly attack Hamas rather than relying on airstrikes that have resulted in many innocent deaths.
For those reading who think all war is bad, I’ll leave you with this quote from John Stuart Mills:
War is an ugly thing, but not the ugliest of things: the decayed and degraded state of moral and patriotic feeling which thinks that nothing is worth a war, is much worse. When a people are used as mere human instruments for firing cannon or thrusting bayonets, in the service and for the selfish purposes of a master, such war degrades a people. A war to protect other human beings against tyrannical injustice; a war to give victory to their own ideas of right and good, and which is their own war, carried on for an honest purpose by their free choice, — is often the means of their regeneration. A man who has nothing which he is willing to fight for, nothing which he cares more about than he does about his personal safety, is a miserable creature who has no chance of being free, unless made and kept so by the exertions of better men than himself. As long as justice and injustice have not terminated their ever-renewing fight for ascendancy in the affairs of mankind, human beings must be willing, when need is, to do battle for the one against the other.
You are absolutely right on all accounts. I’m sorry you’ve had shitty landlords, I wish there was a better way to weed those people out, because as it stands, the balance of power is heavily in the favor of the landlord due to the micro-monopolistic nature of renting a place for years at a time.
Renting vs Buying is very dependent on your local market. I have friends in Ottawa that I’ve run the numbers for and it would literally never be profitable to purchase a home compared to continuing to rent. Some areas two years is the break even point. These days with high interest rates, the break even on buying vs renting is after about 5 or 6 years. I encourage anyone to check it out for themselves! :)
https://www.nytimes.com/interactive/2014/upshot/buy-rent-calculator.html
(For anyone stuck behind the paywall, install this chrome extension to get past it: https://github.com/iamadamdev/bypass-paywalls-chrome)
I could’ve have been clear, but my situation has a very slight net benefit for me, and since my tenants only plan to live in the are for two years, they are getting the better end of the deal. In the end though, there is a mutual benefit and that’s what a competitive market should tend towards (as opposed to the monopolistic nature of corporate apartment housing which encourages the opposite).
My point is that the people who hate all landlords instead of just the bad ones don’t understand the economic realities of housing. It’s actually the mom and pops that rent out their homes for a short period that make renting cheaper on average for the market as a whole. Mostly because they are imperfect businessmen/women and don’t understand the full cost of being a landlord before it’s too late. Instead, most mom and pop landlords are just hoping to break even.
It’s clear there is a fundamental misunderstanding in the amount of capital required to own an investment property without first living in it as a primary residence for a few years.
If one were to purchase a property with the expressed intent of immediately renting it, most banks will require at least 25% down with no option to pay PMI to cover the difference. That’s an insane amount of money to put down just so the landlord can make a negative cash flow for the first 10 years. If an investor has that kind of money, and still want to be involved in real estate, they should buy a share in an apartment complex where the margins are more favorable, and the property actually has a positive cash flow.
Thus nearly ever single family home was purchased initially as a primary residence, with the intent to live there. But then by some circumstance one way or another they needed toove away. Selling a home will cost you 10% of the home’s value in fees. So if that person has any intent to return to the home in the future, it’s better to eat the temporary loss and rent out the property.
You do realize that being a landlord is typically a negative cashflow business, meaning they lose money every year? The only upside they get from renting out that property if the possible growth in equity, which is typically less than that of investing in the stock market.
They just buy one out of thin air? Or is it with the wealth they’ve created through their own skills?
If it’s so easy to own a house, go buy one.
I guess getting that initial capital required no work at all either.
Why don’t they just get that initial capital if it’s so easy.
Unless someone was born with money, the argument against non-corporate landlords (97.5% of single family homes are owned by non-institutional investors) is nonsensical, because those owners had to work for the initial capital.
For us, it’s because work required that we temporarily relocate. But we plan to move back in a couple years and we really like our house.
For others it usually has to do with the fact that selling a home costs 10% of the home’s value after all fees are accounted for.
Then there is the other set of people who genuinely think the equity in a property is more lucrative than money in the stock market (depending on the market and timing, it could be, but it’s ultimately a bet).
But I could ask the same question of every single person bemoaning the existence of landlords. If it’s oh so easy to be a landlord, why don’t they just become a landlord?
Oh yes, it costs me $7k a year for the pleasure of managing a property, responding to all the tenants needs, the risk of paying for major future repairs, trusting the tenant to pay on time and in full (collections is practically impossible to enforce), dealing with vacancies while I still pay the mortgage, paying real estate agent fees which amounts to a month’s rent every time I get a new tenant. And that’s all for a house that I am not able to live in, and that I have locked up 20% of the house’s value for a down payment. It’s much more profitable just to let that money sit in the stock market instead.
But please tell me more about how you know better and that’s it’s all sunshine and rainbows for a non-corporate landlord.
Surely you must ignorant of the economic realities and risk of owning a home and how renting can actually be more lucrative depending on your circumstances.
That was very nice your landlord!
I agree, there are people who try to exploit the system, and those people deserve 100% of the hate. And I appreciate the nuance you bring to the discussion.
There are those that will villify small-time landlords for the gall to try to make an extra cent. Ultimately, small-time landlords provide a very valuable service, with extremely tight margins. Frankly, it is just barely worth it for us to keep that home. Because additional risks that go into it includes a tenant trashing the place, skipping out on rent, the property being vacant between renters, rental listing fees (which amounts to a month’s rent typically), and so on.
In return a tenant is able to enjoy a home that would otherwise be unaffordable to them, zero risk, and the flexibility to move without being stuck in one location. If someone is only going to live somewhere for less than 3 years, it will always be better to rent than to buy, and take the money saved renting and invest that into the market. The renter is this case will always make more money in return. Some markets around the country would require someone to live in that home for over 10 years before they break even over the advantage of renting.
Everyone here loves to complain about landlords without realizing that the majority of single family home landlords (not corporate landlords) are barely making it by too.
Banks are really the ones making criminal amounts of money. 1/3 of rent is typically interest payments. 1/3 of rent then goes to taxes.
For instance, I make $2,900/mo. from rent, but pay $2,800/mo. for the mortgage. I’ve spent over $8k this year alone on repairs and maintenance. But please continue to complain how landlords are constantly raking in cash. It’s typical for a homeowner to pay 1% of the cost of the property per year to maintain it. I will never see a positive cash flow until the mortgage is paid off in 25 years. The only benefit I get by continuing to own the property is the appreciation in equity and principle payments to the mortgage. At the end of the year we will have a -$7k cash flow and $5k equity appreciation. In a HCOL area, that $5k on paper is less than 3% of the area’s median yearly salary.
I feel for anyone out there who has a landlord that didn’t consider the hidden costs and the fact they should expect to runa negative cash flow, because it’s those landlords that also can’t afford to fix the house you might be renting.
You do realize that every posted on the Fediverse is open and publicly available? It’s not locked behind some API or controlled by any one company or entity.
Fediverse is the Wikipedia of encyclopedias and any researcher or engineer, including myself, can and will use Lemmy data to create AI datasets with absolutely no restrictions.