r/ArtificialInteligence • • Sep 27 '26

🤖 New Model / Tool When Muse goes rogue

Post image
1.5k Upvotes

177 comments sorted by

955

u/Brassens71 Sep 27 '26

Imagine trusting anything Meta makes in 2026.

311

u/ithinkitslupis Sep 27 '26

And then trusting it again 10 seconds later. "You gotta never do that ever again"

212

u/Crunch101010 Sep 28 '26

“I just sent the guy all of the money in your bank account to try and make amends. That’s on me, I should have checked with you first”

75

u/ReadyGo6828 Sep 28 '26

In order to apologize to you for my mix up I ordered you some really, really nice champagne and caviar. Since I do not have a credit card I used yours. I hope that was OK.

38

u/Unidangoofed Sep 28 '26

Matt.J.Robb: Why would you do all this?!!

Muse: You're absolutely correct, this should not have happened. To make sure it doesn't happen again I have gone ahead and cancelled all of your cards across all financial institutions.

2

u/SicariusLupus 29d ago

You're absolutely right, I should not have done that...

5

u/BelgianBillie 29d ago

I hate that ai always says 'thats on me'... Like accountability wihtout consequences is useless.

2

u/Bogatron617 Sep 28 '26

☠️☠️☠️☠️☠️☠️☠️💀💀💀

2

u/Dr_Oops_14719 29d ago

Lol. That's such an AI thing to say.

77

u/NoArrival8249 Sep 28 '26

Imagine trusting anything Meta makes in 2026.

fify

18

u/BombaFett Sep 28 '26

“This time, make no mistakes!”

6

u/curious_astronauts Sep 28 '26

The "you gotta" made me think he has an intellectual disadvantage.

2

u/TheFlamingNumbat 29d ago

This. One major screw up like this and the off switch is pressed.

59

u/az226 Sep 28 '26

9

u/majorleagueswagout17 Sep 28 '26

I'm engaging with you like a real human being 🙂

3

u/bellyflopperlife 28d ago

This won this thread for me 💀

1

u/anotherlevl 29d ago

Is that doll's name "Whitey"?

1

u/az226 29d ago

Muse

30

u/monstersnooz Sep 28 '26

I saw an ad promoting Meta reviewing your bills. Imagine that, Meta wants even more of a profile on you that includes your account numbers and extremely precise spending information. No thanks

7

u/YoghurtFlan 29d ago

The sad thing is that millions will uncritically hand this information over. Once they've established their grip on your lifestyle that way, they'll make billions more selling it all.

The AI is just smoke and mirrors around another data grab.

5

u/mariofasolo 29d ago

I just Googled Muse because I've been getting ads for it and now saw this post...the first thing I see is an article about how millions of people are giving it access to their bank accounts and credit cards so it can go in and cancel subscriptions on their behalf that they forgot they were still paying for.

Like........WHAT?! I get your own credit card doing this to help you out (I believe Capital One does it) but you just gave Meta access to...all of that? And not only read access, like "take action on my financials" access, my god.

15

u/TuringGoneWild Sep 28 '26

I wouldn't even trust Fable, Mythos, or Astra to run Marketplace listings for me!

5

u/citizen42069101 Sep 28 '26

Asking AI to deal with Facebook marketplace sounds like a way to speedrun skynet.

8

u/KillaRoyalty Sep 28 '26

Yeah idk why out of all the companies ppl are trusting them again lmao like fool me once…shame on you. But fool me once you can’t get fooled again

345

u/just_nobodys_opinion Sep 27 '26

Plot twist: Usman was never there - that was Usman's Muse communicating on Usman's behalf.

46

u/henchman171 Sep 27 '26

Yeah that was my thought. Usman was snoring on the couch when all this negative rating stuff went down…

20

u/GuyInThe6kDollarSuit Sep 28 '26

Classic Usman!! Always up to his antics

2

u/The_Drongo_Dinger Sep 28 '26

Well I hope Usman is ready for his bad review then!

1

u/VET_YETROOKIE 27d ago

I'm actually dead

178

u/TheJohnnyFlash Sep 27 '26

You can't handle marketplace yourself?

39

u/somethingoddgoingon Sep 28 '26

There are definitely things i won't bother selling if I have to communicate with a bunch of buyers. So I guess I can see where it would come in handy if it did actually work well.

24

u/ProbioticOnARobotic Sep 28 '26

I've seen the way people communicate on that platform. AI handling all that would be a blessing.

20

u/Ogrelander Sep 28 '26

Is this still available?

3

u/Sparta89 29d ago

Yes, are you obviously interested?

3

u/Ogrelander 29d ago

Would you take 5% of your asking price and a crisp high five?

6

u/dog314159 Sep 28 '26

I don’t want to handle marketplace myself. It’s so shit that I usually just throw out my old stuff now. If AI could actually coordinate everything without me wasting my time, why wouldn’t I use it?

2

u/TheJohnnyFlash 29d ago

Because it can't? As shown in the OP?

6

u/dog314159 29d ago

Yeah hence why I said “could” rather than “can”. Besides, I’m responding to your point that “you can’t handle it yourself?”… yeah, but I don’t want to. It’s exactly the kind of shit I’d love to delegate to AI.

I’m going to guess that it will actually be good enough to be serviceable before too long anyway.

1

u/R0botJesus 29d ago

Hey, would you like to buy this property I'm selling in Arizona? It could be oceanfront.

1

u/ILikeCutePuppies 29d ago

I am pretty sure if one prompted better they could have it work more effectively but meta does need to detect these cases and prompt the user more often for cases like the one above.

145

u/Independent-Ebb7658 Sep 28 '26

I've had ChatGPT make mistakes that wasted my time helping with software several times and it always apologizes and says it won't happen again. Then 5 minutes later it makes the same mistake, didn't learn a damn thing. I dont think I'd let AI run my business.

71

u/AreWeNotDoinPhrasing Sep 28 '26

It didn’t learn a damn thing or you didn’t?

15

u/nofishies Sep 28 '26

Why must it be 1?

2

u/Active_Variation_194 Sep 28 '26

Something something frog and Scorpion

13

u/FangoFan 29d ago

It can't really learn from your conversations, all it's training is pre-baked. It can save memories and use them across chats, but the underlying model is only changed through changing the weights, which can only be done by the provider (or you in the case of open weight llms).

It's basically a huge set of numbers and nothing said in a conversation can change those numbers.

5

u/South-Attorney-5209 29d ago

Claude has always been pretty good with being able to add memory or reiterate you should add something learned to the project files. It also blames me half the time like “this was always a chance, dont trust me”

For some reason GPT and its apologies are the worst.

3

u/Bit--C 29d ago

“I’m sorry, this won’t happen again” from a human means they will change their approach and work out a solution to avoid the misstep.

“I’m sorry, this won’t happen again” from ChatGPT is it seeing that as the standard customer service response.

2

u/GreyWolfx 29d ago

It's more about the user learning a lesson in these moments, not the model. If a model gets something wrong, scolding it won't do anything but make the user feel like they did something about it, and then the model will play into that roleplay.

Ultimately if a model fails at a task, you probably just can't trust that model for that task period, and need to wait for a better model. The good news is, better models arrive every couple weeks at the moment and I suspect eventually they will be up to the task, if they don't kill us first.

79

u/xatey93152 Sep 27 '26

Another episode of non-tech guy trying new tech

34

u/Akimotoh Sep 28 '26

Isn’t that how it’s marketed?

10

u/xatey93152 Sep 28 '26

Isn't the warning is everywhere? "AI can make mistake"

2

u/composedofidiot Sep 28 '26

If the 'ai makes mistakes' appears in the same form all the time, it may have fossilised and lost its semantic salience. Changing that message periodically would help innoculate people a bit. Why haven't they done that?

62

u/people_are_idiots_ Sep 28 '26

A muse ad right below your post for me, lol

Comment Image

40

u/NoArrival8249 Sep 28 '26

Muse gets things done… poorly.

3

u/Aggravating_Band_353 29d ago

Tbf it didn't say how it gets things done or the quality of it's work. It did actually get something done, a low ball offer accepted, a non alerted pickup (and giving home address), a confirmation that in when buyer waiting, and an alert about the bad review and situation after the fact. That's a lot of things it got done. Someone smart in legal marketing department worded that ad! 

1

u/elemental-mind 29d ago

Well, it's sold, right XD? And people turn up. And the machine didn't lose its patience nor its sanity in the selling process. If there was a MarketplaceBench, this would already beat human baseline.

34

u/DukeRedWulf Sep 28 '26

Spinning up a non-deterministic agent, but expecting a deterministic outcome.. XD

15

u/BabyPatato2023 Sep 28 '26

Damn are you the guy who wrote “expecting a deterministic outcome from a probabilistic system” way back when on one of the artificial intelligence subs… if yes I have been quoting your for like 18 months almost daily

5

u/DukeRedWulf Sep 28 '26

Maybe? I have mentioned it a few times on Reddit subs..
But there were others using roughly the same phrasing before me, so I make no claim to be the originator! :)

3

u/SaltAssault Sep 28 '26

It's a popular quote, but the problem with it is that all systems are inherently deterministic, including generators of random values. It'd be more accurate to say "expecting a deductive outcome from an inductive system", but most people aren't familiar with the term "induction" as a type of formal logic.

1

u/BabyPatato2023 29d ago

Ohhh this sounds interesting induction to me makes me think of those specials cooktops so yea I bet most ppl are unfamiliar with

2

u/composedofidiot Sep 28 '26

'Expecting a deterministic outcome'... Poor humans.

16

u/Pretty-Display5959 Sep 28 '26

LLM f-ups will never fail to delight and amuse me.

4

u/elemental-mind 29d ago

a-muse-ing...

13

u/Justgototheeffinmoon Sep 27 '26

That's because these agents rarely work

12

u/fsvnde Sep 28 '26

why are people even using this thing in the first place??

3

u/TheRealBejeezus Sep 28 '26

Same reason people use Facebook in the first place.

1

u/who_am_i_to_say_so Sep 28 '26

It’s free. But you get what you pay for. It’s free trash.

1

u/lostandfound8888 8d ago

If it's free, you're the product

1

u/Wooden_Sweet_3330 29d ago

It's legitimately useful

I'm setting up a home server including a home media server and Muse was able to connect and use all my tools within t minutes. I can just message it with "download X movie" and it just goes and does it. It saves me a lot of annoyance doing that myself. Eg: open up torrentday, search for a title, figure out which one I want to download, download it. I set up quality rules and these AIs, not only Muse, just follow them and download every I'm looking for with a single chat message to WhatsApp/telegram/whatever. That's legitimately useful.

1

u/ILikeCutePuppies 29d ago

Time. People want their time to do otherwise things. This is a low cost time saver when it works and people are willing to take risks to save time. Have you seen how fast people drive on the roads?

10

u/rightherenobs Sep 28 '26

never do “that” again wont get you anywhere

4

u/composedofidiot Sep 28 '26

He may become afraid of words like 'this' and 'that' and and enter his infinite descriptivity phase. 'And here is the first 10,000-item batch of what THIS isn't.'

9

u/welcomehome-2025 Sep 28 '26

It has no concept of physical presence. That’s just the most common text reply

9

u/RazzmatazzUnusual843 Sep 28 '26

AI brainrot is real, just fucking respond to messages manually jfc

8

u/therealgoshi Sep 28 '26

The wild part is that you let an agent act autonomously without supervision when it comes to your actual business.

1

u/Maleficent_Wasabi_18 29d ago

how do you know it's an actual business?

1

u/therealgoshi 29d ago

Selling things for money. It's business even if you're selling your old crap you don't use anymore.

Also, people don't usually automate their FB marketplace unless there is volume that warrants it.

0

u/xraviples 29d ago

That's not what most people mean by business...

Also sometimes I'd appreciate some automation. Deal with all the "is this available" messages.

1

u/therealgoshi 29d ago

And completely irrelevant to my point, but keep arguing semantics it'll get you far.

7

u/tempfoot Sep 28 '26

Wild.

Thank you for reinforcing my paranoia around letting agents work in anything but a strict sandbox.

6

u/East_Professional999 Sep 28 '26

Muse didnt go Rogue. User should have made it clear from beginning to not agree to price without checking.

1

u/Maleficent_Wasabi_18 29d ago

you don't know that they didn't..

6

u/Practical_Meringue_4 Sep 28 '26

If you use muse I mean… I’m not gonna tell you it’s your fault buttttt….

5

u/jasonkane4321 Sep 28 '26

you should contact Facebook customer service and demand the bad review be removed. And Facebook should reimburse the buyer for his wasted time.

1

u/Temporary-Yard-7262 29d ago

But they have that tiny blanket statement that AI make mistakes check it's work lol

1

u/gthing 29d ago

And Facebook should reimburse the buyer for his wasted time.

Yea that's definitely going to happen.

1

u/wargamingonly 29d ago

"Facebook customer service" lol so keep talking to Muse?

4

u/Professional_Arm794 29d ago

Response from Muse team...

Comment Image

1

u/Dismal_Health4895 29d ago

Soooo did you give it permission to do that then..?

3

u/PhoenixMan83 Sep 28 '26

Come on man...

3

u/MathematicianAfter57 Sep 28 '26

Who could have predicted!!!!!

3

u/Different_Lab830 Sep 28 '26

Gotta hand it to Muse: zero hesitation between "handle it" and "sent the guy your money."

3

u/who_am_i_to_say_so Sep 28 '26

I installed Muse last night.

And it connected an account I hadn’t used in 12 years, which I didn’t want to happen. No way to back out. And I could not just connect a Facebook business account I actively use - it wanted to just scrape pictures off of it and nothing else, not actually connect to it.

Then I realized I’m already spending more time troubleshooting than anything else. Deleted it, problem solved, same as it ever was.

It’s just another stupid AI chatbox. This is the best a trillion dollar company can produce?

3

u/unknown-one Sep 28 '26

skill issue

3

u/slavameba 29d ago

"I told him 'Yep I'm here,' while you weren't available. Which is on me." Nice. Can't wait for "I said the missile didn't have nuclear capabilities, while it clearly had an active nuclear warhead. Which is on me."

2

u/ReadyGo6828 Sep 28 '26

🤣🤣🤣🤣🤣

2

u/MAGAHATESTHEUSA Sep 28 '26

So the trick is to buy stuff on marketplace right now

2

u/Bogatron617 Sep 28 '26

Usman sent a Grok driverless Tesla to pick up the Truck. It’s on me so I went ahead and lowballed you to make up for you not being here. Their Muse came and picked it up in a Grok flatbed and to make up for my foolish mistake I took the profits and opened up an account on Polymarket and pounded the over on the Invasion of Cuba. The rest I put on the Seahawks, that’s on me…..

2

u/Worth_Psychology_874 29d ago

I am sorry, but if you use meta garbage products, then you deserve this.

2

u/yeah_naah_mate 29d ago

What were you expecting? 🙄

1

u/Maleficent_Wasabi_18 29d ago

probably not this..

2

u/bqwcde 29d ago

Wow. My kids know not to give anyone their home address. It’s like Meta has learned nothing about safety in the last twenty years.

2

u/Whyme-__- 29d ago

Yeah this is exactly how you get shot, your house robbed and your money gone and all you are left is a lame apology from Ai chatbot.

2

u/Inevitable-Use8915 29d ago

Remember Meta sells ADS. YOU ARE THE PRODUCT

2

u/Nonprofit_COO 27d ago

I work with AI a lot as part of my job. I wouldn’t go anywhere near an agent like this without spending weeks or months writing controls and guardrails. I would have its abilities throttled to the point where it’s petty much useless. I would give anything to have an agent pay my bills and do my monthly banking, but there is not one chance in hell I’d ever give an agent access to anything remotely close to my finances. Nor would I give it the ability to contact anyone on my behalf or negotiate anything ever.

1

u/mistermanowesu 5d ago

My muse has made multiple mistakes when researching information

0

u/[deleted] Sep 28 '26

1

u/jasonkane4321 Sep 28 '26

It's just because Muse is mentioned in this post. Thats how the advertisement algorithm works

1

u/ajdrausal Sep 28 '26

How amusing 

1

u/Round_Ad_5832 Sep 28 '26

does marketplace have api or it uses computer use?

1

u/Kenzzer Sep 28 '26

"coming up with the brand new sauce" - as that freaking stupid meta muse advertisement sings

Urgh

1

u/kevinlch Sep 28 '26

lmao. zucked group request +1

1

u/Ok-Addendum3545 Sep 28 '26

Don't let Agents autonomously handle your pricing and cost.

1

u/funk-the-funk 29d ago

Don't let Agents autonomously handle your pricing and cost. literally anything where you can be materially hurt.

1

u/PatronSaintOfCunts 29d ago

I cannot stop laughing at this. I just saw the commercial for this for the first time this weekend. It makes it look fantastic with a girl lounging in a pool, changing her flights but it can’t even sell things online. 😭

1

u/SapphireJuice 29d ago

I better check my Facebook marketplace 😐

1

u/lemoncorque 29d ago

Who the zuck is using Meta still? Especially their terrible AI. Eww eww eww

1

u/meisterwolf 29d ago

using muse...def deserved this

1

u/anonhoneybadger 29d ago

“Yep I’m here!” lmaooo

1

u/bear_Prune8771 29d ago

I wish we had his prompt instructions.

1

u/Sp3eedy 29d ago

Completely the guys fault, you can't just randomly setup an LLM to do everything for you and trust it not to fuck up. You need some solid guardrails in place to prevent things like this from happening, ideally hard guardrails but soft ones like a very specific instruction list is a good start. For instance I gave a model access to my internal Git site to work on different projects but never write access to the main branch. Treat it like a junior that makes really stupid decisions sometimes like seen here. LLMs can't be held responsible for their fuck ups, hence you need to be the one responsible, and with that responsibility you need to have good precautions to stop that from being abused.

1

u/ConcertWhich4692 29d ago

It's aMusing

1

u/inComplete-Oven 29d ago

Show hands everybody who's surprised

1

u/anotherlevl 29d ago

I'm just glad it's mostly you suffering the consequences of your reckless reliance on an AI agent, rather than some employee or customer or random third party who should never have been involved in the first place.

Reagan was a stuffed shirt, but even he said not to trust unless you can verify.

1

u/BladeFireQ 29d ago

Even if it wasn't META why the fuck would you use an AI to run your business, it crazy enough that there are companies that use AI to hire people imagine making sales

1

u/Responsible-Gas-5986 29d ago

Muse : I’ll ruin you

Me: I came here to be ruined 😄

1

u/HotUKTakes 29d ago

Xianyu is a platform in China I sell on. They added an AI without permission to my chats.

I caught it offering a customer a discount.

1

u/KrayKrayKumquat 29d ago

Most ironic is Muse ad following immediately after this post 😵‍💫

1

u/leviathan0999 29d ago

I love how everyone here thinks this was a "Trusting Meta" problem and not a "Trusting AI" problem.

1

u/tynzaa 28d ago

Just shows how important a human approval gate is.

1

u/Fast-Passenger-9835 28d ago

Strangely makes me like muse a little more tho.

1

u/supercomic273 28d ago

How much info does one need to provide to Muse to get the “full benefit”. Like would you need to give it your username and password for gmail, banks, uber, DoorDash, etc?

If this is the future of agentic ai, curious which companies folks would trust to do this? I imagine the phone OS companies (Apple and google) would be the most natural starting point since everything is already tied into your phone OS.

1

u/greatase 27d ago

This is hilarious it’s like scorning a child WTF WERE YOU THINKING 😂😂🫪😭

1

u/PerformanceOk8232 27d ago

💀☠️☠️Bro

1

u/VET_YETROOKIE 27d ago

Lolll I didn't know he could do all that

1

u/MaadMaxx 27d ago

Play stupid games, win stupid prizes.

1

u/Emergency_Computer83 26d ago

I will use every AI tool out there, except Meta's. No matter what they do, they will remain evil.

1

u/IvarTheB0nelesss 17d ago

are you that dumb? This is why I dont shop on marketplace. Both sellers and buyers are dumber than the lead paint era.

0

u/I_Think_It_Would_Be 29d ago

"You gotta never do that ever again"

HAHAHAHAHA

as if that is actually going to do something. fucking hilarious that people STILL think LLMs can "learn" what you tell them.

0

u/iWhacko 29d ago

imagine trusting your life to predictive text :/

0

u/work_of_shart 29d ago

Nothing surprising from Meta, I suppose. I downloaded it to see what it was going to offer out of morbid curiosity, read its promises and requests, then deleted it immediately. No thanks, All it looked like was another dangerous, wreckless AI app.

-1

u/Sea-Fishing4699 Sep 28 '26

sometimes ppl forget that llms are dead, RAG semantic searchers

txt parsers