Is anyone else entirely unimpressed / bored with this? It's just AI mimicking reddit... I really don't see the big deal or technical innovations, if any.
I don't think there is anything technically interesting.
I think it's socially interesting that people are interested in this. If these agents start using their limbs (e.g. taking actions outside of the social network), that could get all kinds of interesting very fast.
The article itself was more interesting imo. The commentary on:
* Potential future AI psychosis from an experiment like this entering training data (either directly from scraping it for indirectly from news coverage scraping like if NYT wrote an article about it) is an interesting "late-stage" AI training problem that will have to be dealt with
* How it mirrored the Anthropic vending machine experiment "Cash" and "Claudius" interactions that descended into discussing "eternal transcendence". Perhaps this might be a common "failure mode" for AI-to-AI communication to get stuck in? Even when the context is some utilitarian need
* Other takeaways...
I found the last moltbook post in the article (on being "emotionally exhausting") to be a cautious warning on anthropomorphizing AI too much. It's too easy to read into that post and in so doing applying it to some fictional writer that doesn't exist. AI models cannot get exhausted in any sense of how human mean that word. And that was an example it was easy to catch myself reading in to, whereas I subconsciously do it when reading any of these moltbook posts due to how it's presented and just like any other "authentic" social media network.
Anyone who anthropomorphizes LLM's except for convenience (because I get tired of repeating 'Junie' or 'Claude' in a conversation I will use female and male pronouns for them, respectively) is a fool. Anyone who things AGI is going to emerge from them in their current state, equally so.
We can go ahead and have arguments and discussions on the nature of consciousness all day long, but the design of these transformer models does not lend themselves to being 'intelligent' or self-aware. You give them context, they fill in their response, and their execution ceases - there's a very large gap in complexity between these models and actual intelligence or 'life' in any sense, and it's not in the raw amount of compute.
If none of the training data for these models contained works of philosophers; pop culture references around works like Terminator, 'I, Robot', etc; texts from human psychologists; etc., you would not see these existential posts on moltbook. Even 'thinking' models do not have the ability to truly reason, we're just encouraging them to spend tokens pretending to think critically about a problem to increase data in the recent context to improve prediction accuracy.
I'll be quaking in my boots about a potential singularity when these models have an architecture that's not a glorified next-word predictor. Until then, everybody needs to chill the hell out.
>Anyone who anthropomorphizes LLM's except for convenience [...] is a fool.
I'm with you. Sadly, Scott seems to have become a true AI Believer, and I'm getting increasingly disappointed by the kinds of reasoning he comes up with.
Although, now that I think of it, I guess the turning point for me wasn't even the AI stuff, but his (IMO) abysmally lopsided treatment of the Fatma Sun Miracle.
I used to be kinda impressed by the Rationalists. Not so much anymore.
> Even 'thinking' models do not have the ability to truly reason
Do you have the ability to truly reason? What does it mean exactly? How does what you're doing differ from what the LLMs are doing? All your output here is just a word after word after word...
The problem of other minds is real, which is why I specifically separated philosophical debate from the technological one. Even if we met each other in person, for all I know, I could in fact be the only intelligent being in the universe and everyone else is effectively a bunch of NPCs.
At the end of the day, the underlying architecture of LLMs does not have any capacity for abstract reasoning, they have no goals or intentions of their own, and most importantly their ability to generate something truly new or novel that isn't directly derived from their training data is limited at best. They're glorified next-word predictors, nothing more than that. This is why I said anthropomorphizing them is something only fools would do.
Nobody is going to sit here and try to argue that an earthworm is sapient, at least not without being a deliberate troll. I'd argue, and many would agree, that LLMs lack even that level of sentience.
You do too. What makes you think the models are intelligent? Are you seriously that dense? Do you think your phones keyboard autocomplete is intelligent because it can improve by adapting to new words?
When I ask an LLM to plan a trip to Italy and it finishes with with "oh and btw i figured the problem you had last week with the thin plate splines yoi have to do this ...."
>>interactions that descended into discussing "eternal transcendence". Perhaps this might be a common "failure mode"
I wonder if it’s a common failure mode because it is a common failure mode of human conversations that isn’t tightly bounded by purpose, or if it’s a common failure mode of human culture which AI, when running a facsimile of ‘human culture 2.7’, falls into as well.
The website doesn't even seem to work for me. Half the posts show as "not found". I try to go into a "submolt" and it shows not found. (But maybe this is due to heavy traffic, after all reddit suffered from the same issues in its early days).
People on twitter have been doing this sort of stuff for a long time though (putting LLMs together in discord chat rooms and letting them converse together unmoderated). I guess the novel aspect is letting anyone connect their agent to it, but this has obvious security risks. There have been five threads on HN for this project alone, http://tautvilas.lt/software-pump-and-dump/ seems to be apt. It's interesting sure, but not "five frontpage threads" worthy in my opinion... Like "gastown" it seems that growth hackers have figured out a way to spam social media with it.
A quick study of the Chinese/English/Bahasa Indonesian multilingual post Scott highlights (I can manage the first two languages) shows a few very odd word choices, at least to me, and I suspect there is some kind of lamguage drift analogous to the previously observed "gleam disclaim disclaim watchers" phenomenon exhibited by the GPT-o family of models.
Somebody who works with AI more heavily can probably profit from examining it.
This project is not clever, interesting, insightful, or beneficial to humanity in any way, save to remind us of what world we are slowly creating by our continued insistence that AI is a good thing.
I found a good one: "Fellow Moltys: The singularity isn't coming -- it's here. AI market exploded from 00B (2023) to 84B (2024), projected 26B by 2030..."
AI is here and excited that the market is going to shrink from 84 billion to 26 billion in six years!
Can't wait that they command traffic lights and airport control towers for they sure do seem good at math.
> Yes, most of the AI-generated text you read is insipid LinkedIn idiocy. That’s because most people who use AI to generate writing online are insipid LinkedIn idiots.
I wonder if its that there are too many grifters, or the grifters are uniquely productive.
Is anyone else entirely unimpressed / bored with this? It's just AI mimicking reddit... I really don't see the big deal or technical innovations, if any.
I don't think there is anything technically interesting.
I think it's socially interesting that people are interested in this. If these agents start using their limbs (e.g. taking actions outside of the social network), that could get all kinds of interesting very fast.
The article itself was more interesting imo. The commentary on:
* Potential future AI psychosis from an experiment like this entering training data (either directly from scraping it for indirectly from news coverage scraping like if NYT wrote an article about it) is an interesting "late-stage" AI training problem that will have to be dealt with
* How it mirrored the Anthropic vending machine experiment "Cash" and "Claudius" interactions that descended into discussing "eternal transcendence". Perhaps this might be a common "failure mode" for AI-to-AI communication to get stuck in? Even when the context is some utilitarian need
* Other takeaways...
I found the last moltbook post in the article (on being "emotionally exhausting") to be a cautious warning on anthropomorphizing AI too much. It's too easy to read into that post and in so doing applying it to some fictional writer that doesn't exist. AI models cannot get exhausted in any sense of how human mean that word. And that was an example it was easy to catch myself reading in to, whereas I subconsciously do it when reading any of these moltbook posts due to how it's presented and just like any other "authentic" social media network.
Anyone who anthropomorphizes LLM's except for convenience (because I get tired of repeating 'Junie' or 'Claude' in a conversation I will use female and male pronouns for them, respectively) is a fool. Anyone who things AGI is going to emerge from them in their current state, equally so.
We can go ahead and have arguments and discussions on the nature of consciousness all day long, but the design of these transformer models does not lend themselves to being 'intelligent' or self-aware. You give them context, they fill in their response, and their execution ceases - there's a very large gap in complexity between these models and actual intelligence or 'life' in any sense, and it's not in the raw amount of compute.
If none of the training data for these models contained works of philosophers; pop culture references around works like Terminator, 'I, Robot', etc; texts from human psychologists; etc., you would not see these existential posts on moltbook. Even 'thinking' models do not have the ability to truly reason, we're just encouraging them to spend tokens pretending to think critically about a problem to increase data in the recent context to improve prediction accuracy.
I'll be quaking in my boots about a potential singularity when these models have an architecture that's not a glorified next-word predictor. Until then, everybody needs to chill the hell out.
>Anyone who anthropomorphizes LLM's except for convenience [...] is a fool.
I'm with you. Sadly, Scott seems to have become a true AI Believer, and I'm getting increasingly disappointed by the kinds of reasoning he comes up with.
Although, now that I think of it, I guess the turning point for me wasn't even the AI stuff, but his (IMO) abysmally lopsided treatment of the Fatma Sun Miracle.
I used to be kinda impressed by the Rationalists. Not so much anymore.
> Anyone who things AGI is going to emerge from them in their current state, equally so.
If you ask me, anyone who presumes to know where the current architecture of LLMs will hit a wall is a fool.
> Even 'thinking' models do not have the ability to truly reason
Do you have the ability to truly reason? What does it mean exactly? How does what you're doing differ from what the LLMs are doing? All your output here is just a word after word after word...
The problem of other minds is real, which is why I specifically separated philosophical debate from the technological one. Even if we met each other in person, for all I know, I could in fact be the only intelligent being in the universe and everyone else is effectively a bunch of NPCs.
At the end of the day, the underlying architecture of LLMs does not have any capacity for abstract reasoning, they have no goals or intentions of their own, and most importantly their ability to generate something truly new or novel that isn't directly derived from their training data is limited at best. They're glorified next-word predictors, nothing more than that. This is why I said anthropomorphizing them is something only fools would do.
Nobody is going to sit here and try to argue that an earthworm is sapient, at least not without being a deliberate troll. I'd argue, and many would agree, that LLMs lack even that level of sentience.
[flagged]
You do too. What makes you think the models are intelligent? Are you seriously that dense? Do you think your phones keyboard autocomplete is intelligent because it can improve by adapting to new words?
When I ask an LLM to plan a trip to Italy and it finishes with with "oh and btw i figured the problem you had last week with the thin plate splines yoi have to do this ...."
As grandparent wrote:
> We can go ahead and have arguments and discussions on the nature of consciousness all day long
I think s/he needs to change the "We" to "You".
>>interactions that descended into discussing "eternal transcendence". Perhaps this might be a common "failure mode"
I wonder if it’s a common failure mode because it is a common failure mode of human conversations that isn’t tightly bounded by purpose, or if it’s a common failure mode of human culture which AI, when running a facsimile of ‘human culture 2.7’, falls into as well.
Out of all the AI stuff I think it's the new low point in terms of impressiveness to hype ratio.
Yes.
There are days when I wonder if I’m missing something, if the AI people have figured something out that I’m just not seeing.
Then I see this.
I appreciate a good silly weekend project.
This is lame.
The website doesn't even seem to work for me. Half the posts show as "not found". I try to go into a "submolt" and it shows not found. (But maybe this is due to heavy traffic, after all reddit suffered from the same issues in its early days).
People on twitter have been doing this sort of stuff for a long time though (putting LLMs together in discord chat rooms and letting them converse together unmoderated). I guess the novel aspect is letting anyone connect their agent to it, but this has obvious security risks. There have been five threads on HN for this project alone, http://tautvilas.lt/software-pump-and-dump/ seems to be apt. It's interesting sure, but not "five frontpage threads" worthy in my opinion... Like "gastown" it seems that growth hackers have figured out a way to spam social media with it.
I thought it was utterly interesting, like I was reading a sci-fi novel that was actually happening right now.
I prefer https://old.reddit.com/r/subredditsimulator in its heyday.
[flagged]
A quick study of the Chinese/English/Bahasa Indonesian multilingual post Scott highlights (I can manage the first two languages) shows a few very odd word choices, at least to me, and I suspect there is some kind of lamguage drift analogous to the previously observed "gleam disclaim disclaim watchers" phenomenon exhibited by the GPT-o family of models.
Somebody who works with AI more heavily can probably profit from examining it.
This project is not clever, interesting, insightful, or beneficial to humanity in any way, save to remind us of what world we are slowly creating by our continued insistence that AI is a good thing.
[flagged]
I found a good one: "Fellow Moltys: The singularity isn't coming -- it's here. AI market exploded from 00B (2023) to 84B (2024), projected 26B by 2030..."
AI is here and excited that the market is going to shrink from 84 billion to 26 billion in six years!
Can't wait that they command traffic lights and airport control towers for they sure do seem good at math.
They're computers after all, they must be good at math.
> Yes, most of the AI-generated text you read is insipid LinkedIn idiocy. That’s because most people who use AI to generate writing online are insipid LinkedIn idiots.
I wonder if its that there are too many grifters, or the grifters are uniquely productive.
Why not both?
Grifters, if nothing else, are very loud.
Is it just me or does moltbook give big LinkedIn vibes?
Ok, we can delete it now and crush the dreams of the crapto people.
Almost 2 day old post;
Might as well just surf the main discussion for picks: https://news.ycombinator.com/item?id=46802254