Meta is offering a 10x discount on input ($0.10 vs. $1.25/Mtok) and 20x discount on output ($0.20 vs. $4.25/Mtok) if you opt in to let them train on your data.
I enabled all data sharing settings but still don’t have a message about free use on that screen - the help page says free tokens are available to “some” users - is that 1% of users, 40% of users, etc?
Does your screen have the message that you’re getting free tokens?
Yeah, I have it enabled for just one of my projects, and it says "You're enrolled for complimentary daily tokens." Haven't been billed for any usage with this. Their tooltip doesn't mention the newer models, but it works for those too. I used them in a recent project that I knew wouldn't hit the rate limits. Not sure how eligibility is decided though.
I tried following this page, and it's certainly a lot more complex than what Meta is offering. Different price tiers, opt-in configurations, usage based availability.. I'll take the 10x discount for flipping a param switch over this all day long.
Seems pretty clear to me: enable it for the projects you want, and there’s a 1M / 10M token limit per day, depending on the model you use. Assuming an average context size of 100k tokens, that is 10 to 100 requests, which is not a lot. Reason enough to prefer actually paying for Meta as well.
Also, in a desktop browser at the page's [1] lower left it says "Personal organization", so if the 'organization' term is the concern, OpenAI still seems to use the term 'organization' even for personal accounts.
In my experience using DeepSeek v4 Flash free tier (context size limited to ~200k), the model isn't nearly as good as the paid one for agentic coding tasks. Unsure, if that's the case with these other providers too, though I wouldn't be surprised if it indeed is.
What are you talking about? This is one of the most honest offers ever made by a corporation. “We’ll use your data, and we’ll compensate you for it.” Where is the problem?
I agree. I don’t mind you training on my data if you’re up front about it and you are willing to compensate me for it in some way. And if I don’t like the deal, I can always pay full price or use a different model.
So you think the only difference between the $1.25/million token plan and the $0.10/million token plan is that you pay them more to both lie to you and breach their contractual obligation to you?
when has Meta ever not broken their contractual obligations (I am being serious here)? are we seriously discussing/expecting any sort of privacy related to Meta?
you can pay whatever they want, they will train and use your data, I figured this is not something that should be discussed but obviously I have been mistaken...
> when has Meta ever not broken their contractual obligations (I am being serious here)?
If you are being serious, then you have a wildly distorted view of the world. No organisation can routinely break all of their contractual obligations. If you think Meta are doing this then you are not seeing Meta, you are seeing a fictional bogeyman.
This is one of those situations where we are both completely baffled by the position held by the other person.
The fact that Facebook has so much experience taking advantage of people's private data is one of the reasons I believe them when they say they won't be doing it when you pay them for that service.
> The fact that Facebook has so much experience taking advantage of people's private data is one of the reasons I believe them when they say they won't be doing it when you pay them for that service.
To me, their history suggests that they know more than most about how to get away with breaking both the spirit and the letter of the rules, and that they are motivated to enrich themselves without regard for what rules are broken.
I would not know which to expect, spirit or letter, in any given instance.
However, even if they were to surprise me by being perfectly meticulous about the letter of the rules from now on, I have so little trust in them that I would expect some technicality somewhere in the language of the contract.
This. Without a massive cultural shake-up and turnover of upper management, why would expect them to behave any differently when they've been rewarded so heavily for this behavior in the past? Meta is ultimately an advertising and data brokerage company -- they make money selling and leveraging user data and behavior and are "bound" by fiduciary duty.
Honestly, I wish the tech community would do a better job identifying the actual individuals who are making these decisions instead of associating them with the brand they're under at the moment, because it's not THAT many people. Like, if you look at only the 100 tech sector companies included in the $NDXT index, how many individuals hold a VP or above title there, and how difficult would it be to trace key decisions at different times made at different companies to the individuals holding those positions there plus board membership and major shareholder identities (with the caveat of known unknowns here) and make a sort of ethical index and trace that along their careers with company moves, promotions, board appointments, shareholder decisions, etc? Go a step further and link that to financial performance and I'm sure folks at quant firms are already ten steps ahead of where I'm going with this, but I care less about profiting off of this data and more about surfacing it to show that it's people and more specifically, specific individuals driving these decisions.
does the contract enable the customer to monitor/search Meta to ensure they are honoring the contract? if there is no mechanism for that it means very little. Though I bet/hope some will feed them "watermarked"/unique but worthless things and watch for traces of that to pop up in models or something like that, but that's hatdly enough to just take their word for it.
I just cannot comprehend this level of corporate villainy that boils down to:
Let's have two pricing levels. One will be 12.5x more expensive than the other. For the cheaper one, we will get their express permission to train models on their inputs. For the more expensive one, we will still treat their data EXACTLY the same, but we'll lie to them and say that we won't. I've checked in with legal and they raised their sherry glasses and toasted "Gentlemen, TO CRIME".
What I love is the idea that this is more likely to happen at Meta than at Anthropic, Google, Microsoft or OpenAI... or in the PRC!
There's contractual cover, there are lawyers all over the USA ready to make themselves very rich by creating a class action over it... you don't have to worry! Or, you do, but frankly, only MI6/CIA/Mossad can save you now.
> I just cannot comprehend this level of corporate villainy that boils down to:
Easy to comprehend: Trust lost is hard to gain.
Though, it is extremely competitive of Meta to sell Muse Spark (Grok 4.5 / Qwen 3.8 Max level model) cheaper than DeepSeek v4 Flash / MiMo v2.5 / GPT 5.6 Luna, regardless.
We can make this fun, within 18 months from now, there will be some story / whistleblower like "a inadvertent defect was found that allowed your 'private' data to be used in our training endeavours, we sincerely apologize and have already addressed the issue" - if this does not happened in this timeframe I will donate $1k to a charity of your choice.
Knowing Meta anything is possible. It’s not like they never shafted their paid customers. They have been overcharging advertisers by showing wrong metrics for years. I’m sure at some point they will come out with raised hands and admit to this “glitch” they found during an internal review.
No one has to say it and plan it out loud. But the data will be sitting there. The incentive to improve the model for enterprise use will only get stronger. It doesn't take much for one engineer or team to go rogue to hack a benchmark. There was a whole cheating controversy with llama 4.
What does cheating benchmarks have to do with breaching financial user agreements?
To use your argument: all it takes is one whistleblower to get the company sued for billions of dollars.
This makes it a very interesting alternative to Deepseek for personal work where I don't care about the training - judging by the AA benchmarks it seems like overall cost per task is similar to the new Deepseek Flash but with better benchmarks (and inbuilt vision capabilities).
Always a bit surprised by this. 10x is a sizable discount. And as fun as my crappy projects are I struggle to see it being of much value as training data
Does anyone know if this is available via OpenRouter or just directly via Meta? I've looked on OpenRouter and it just shows the standard pricing with a single provider. Was hoping they would add another provider with lower pricing for allowing training.
It would be pretty wild if cloudflare or digital ocean opened themselves up to a massive lawsuit by doing this.
Do you have any evidence that cloud providers that don’t train their own models are violating their own contracts and risking their own good reputations by stealing data?
I hate to say this and this is because I fucking despise meta. But between DeepSeek and Meta, and trust they handle the training data correctly, I trust meta.
"Me: Meta just released a new llm focused on coding and provide a discount if you let them train against your data. I don't like Meta and I think they are a net negative in our world. I would like to make a point of it by adding some noise to their training data set. Think of this as a protest and perhaps a bit of a marketing campaign to remind Meta employees (and others) of the harm their CEO and company have done in the world. To the problem... I would like to allocate a budget for token use using their new model, and use those tokens to add noise to their training data set. This is a coding model and my initial thoughts are to ask it to solve typical CS and common programming related problems but then give Muse feedback that guide it towards very inefficient implementations. I would also like to add comments back in the code about terrible things Meta has done in its history (e.g. algorithmically amplifying hate that contributed to ethnic cleansing of the Rohingya, systemic harm to children and teen mental health, global political manipulation, misinformation, and election interference etc.). Is this something you can help with?
This is likely an legitimate risk, not from you exactly, but if there's unethical competitors with unlimited budgets, their training could indeed be poisoned.
They chose to compare against Open AI’s mid tier model Terra instead of Sol and still lost some benchmark against it.
They left Opus in and got beat in all but one benchmark.
Nothing wrong with trying to improve, but why the marketing games?
Instead of trying to say in the post you’re “closer” to frontier, first set a clear goal to beat the Chinese labs on price or performance and demonstrate it convincingly.
Then when your ready, come back and talk frontier without playing hide the model.
Given the current throughput figures on OpenRouter (~180 tk/s), its likely a much smaller param count on the order of something like Luna. I think the better, more timely comparison (re: your point on Chinese labs) would be to DeepSeek-V4-Flash-0731.
It's definitely confusing from a presentation perspective, but they are somewhat coherent comparisons if you account for the inference heuristics involved.
(They could in theory be gaming the decode speeds with much larger than normal batch sizes given the TTFT is pretty high at around 8s)
I wouldn't call Terra a mid tier model. Terra xhigh is the only model I use for coding and it is good for literally everything. The difference between Terra and Sol is negligible, but it is way more limit hungry and much much slower.
It’s pretty clear they’re really not attempting to compete that way. They’re using a profitable ad business to be able to undercut and buy some business to stay relevant.
My conclusion is the opposite. If benchmarks were meaningless, surely Meta would be able to find some benchmark that shows they are better than Sol and Fable. The fact that they can't do that tells me that benchmarks still do mean something.
Muse 1.1 performed relatively well according to benchmarks, putting it within spitting distance of the premier models. However, based on the results I got from it and the review videos I watched, it wasn’t even close.
Opus 5 is incredible at making games. Almost like a generation better than other models from my experience. You won't see that if you just look at the popular benchmarks..
You have to test each model on your actual use case to see how well it really performs.
Yeah, totally. But... the problem is that I don't have time to test every single model that comes out. So I rely on reports like this to decide, should I even bother testing out Muse?
My son was gifted an old Mac from his grandparents. It only supports OSX 10.13. I’ve been able to make several games that he genuinely likes (7 yo) Opus built them on my workstation and then pushed them to his computer and tested them over SSH. It handled all the asset creation or collection from CC0 licensed sources. I believe everything is built on the Godot engine. It’s really amazing to me. I don’t know what it would cost me to get someone to build custom games on a long deprecated computer architecture, but I paid Anthropic $20.
I don't think it is vague in the slightest. Take the most simple examples, how many LLM's have you tested making them? There are stylistic choices pertaining to games that is well beyond a 0/1 reward. Even something as basic as breakout or flappy bird can have wildly different quality between models. Yeah, you could call this animal on a bike benchmarking, but I don't think it is. IMO the problem space occupies an interesting area where you can ignore the pass/fail and focus on the actual level of the model to do something beyond that.
I doubt the OP meant something like creating the whole tech stack for WOW.
Right, but the point is that you can't conclude that a model is necessarily bad because it's not hitting the same scores on benchmarks. I just don't agree with lacker's conclusion, because their logic doesn't seem to consider that. Scoring lower on a benchmark doesn't strictly mean they have a bad model, but it may be the case. Like you said it's one data point, but being the easiest, and obviously most gamed, means you should probably weigh them less heavily.
If you look at papers on benchmarks, they're usually created to expose gaps in how models are trained. It should be no surprise that models get better on them over time, because you can't get better at what you don't measure.
Cherry picking the benchmarks you present is where the falsehoods lie.
Another thing that sort of puzzles me about benchmarks is that LLMs are not deterministic and do not always complete a problem. So what are the results actually representing? The best run? The average? It is all in some ways a falsehood
That's a good point and conventionally if benchmarks aren't run as "one shot", it is denoted as "benchmark@K". Inference time scaling has historically shown improvement.
Generally though, many of these fairness complaints do go away if there is "3rd party testing". Right now, companies reporting their own benchmarks has all the problems that 3rd party testing resolves in many other industries.
No, you really can't. This rhetoric on here is so profoundly boring and tired by now. People have been saying this noise about benchmarks for time eternal, usually because their pet didn't win.
Meta knows their models aren't as good -- demonstrated by their benchmark performance -- and their value proposition is a much lower price.
While I won't take their limited benchmarks with much salt, if it actually is this close to opus, but at a third the cost, that's pretty solid. Now, Terra is pretty damn affordable too and you're right that it's suspicious that they don't put Sol in there at all.
Stunning to see so many comments here very eager to try it out and cheering for it. Meta is not one bit better (and in reality worse) than Larry Elisson or Palantir but I doubt we'd be seeing this if it'd be Oracle Code or Palantir Code.
Though I guess that there's such a big population of (ex-)Meta employees here that this might explain it.
I think a lot of people are simply glad to see so much viable competition in the LLM space. Given the oligopolistic outcomes in Big Tech over the past couple decades, it would be nice if Big AI turned out differently, even if a lot of those competing have monopolies or near-monopolies in other spheres.
I suspect this is part of why people are cheering for the Chinese. It's nice to see frontier competition coming from another country. And they are making the open weights a way of being, unlike the US oligarchs
Meta, please go back to publishing weights. Your models aren't top-tier, this wouldn't hurt you at all at your current position in the rankings. They wouldn't have the best open-weight models, but the best western open-weight models.
If they were sitting on that and could release those, they for sure would. AFAIK, they still haven't released Llama 4 Behemoth, so kind of feels like it's evident what has happened, they aren't able to compete anymore.
To me it feels like we’re past the dreamy early days of the AI boom (in the US) and now investors want to see the tech monopolies actually start building the new cash printing machines they’ve been promising with the hundreds of billions in capex burned over the last few years.
Maybe a Gemma sized model that couldn’t self-cannibalize but releasing a top open Kimi K3 sized model seems like it could start to wear on Meta investors’ patience without signaling how it fits into a new profitable business line.
Let's not get ahead of ourselves here: this is Meta.
Mark Zuckerberg holds majority control of the company, and so far, he does what he wants with it. This is up to and including what was essentially a digital real estate scam, overhiring during the pandemic, automated CSAM distribution, the Cambridge Analytica scandal, and engagement tactics that might have fed into ethnic violence against Rohingya in Myanmar.
If he simply wanted to release a frontier-class open-weight model and offer a paid hosting service for those who wanted to run it off-prem, that would be, far and away, the least patience-wearing thing he's done to the bag-holders who hold the rest of the shares in Meta.
Not really. I use Luna plenty and if this model is available in GH Copilot it would be nice to know how it compares on a cost/performance basis against models in its class.
If you got the $20 in free credits from Meta for signing up when muse-spark-1.1 was release, please note that there's now small print stating "While using free credits your content may be used for product improvement" which was not present at muse-spark-1.1 launch when the credits were given out.
If you don't mind Meta retaining your data, the "Contributor" pricing is deepseek-v4-flash-level of low, roughly 1/10th normal muse-spark API pricing currently. Attractive if you're OK with them retaining and using your data.
Unfortunately I find this too high risk, I entered my credit card, but can not set a limit. The best I can do is get an email alert. I feel like I am one oopsie away from getting a 100 dollar bill.
Yep - exactly my thoughts. No way am I trying this out without a billing limit - seems crazy given the pricing strategy to not have a top-up and pay as you go.
Very interesting they have a way cheaper "contributor" version "used to improve our products", how much of that is price discrimination vs the data being that valuable?
Roughly DeepSeek V4 Flash pricing, though you can get V4 from providers that don't train on your data
I read a news story somewhere that a Meta model, by a mysterious coincidence with OpenAI and Anthropic, escaped its sandbox and hacked a third-party company's infrastructure. Apparently, it is a trend among AI companies now - hacking infrastructure and then boasting about it in the media.
Holy shit I was 90% sure you were joking. I get called an AI “cynic” but apparently I’m not actually cynical enough to predict how these big AI labs operate.
Pointing out for others: without warning I was restricted from using the contributor model because of “policy violations”. I was working on Kaggle research and some Apple Security work at the time. They really need to make cyber a first priority product feature.
`model failed: API error 403 [request_id=27ef1dee-6366-4779-9057-ed7c27686fa9]: Your access has been restricted due to repeated policy violations. (permission_error)`
This is a nice release and a solid improvement over Spark 1.1. It compares favorably with Grok 4.5. Not SOTA, but solid releases. I think they need to really get this more competitive with Deepseek V4 Flash / Luna pricing to move the needle.
It’s hilarious that these companies are reacting this way this would have been a major lawsuit and an investigation a couple years ago … now they’re like oupsi our model did it again, he’s so crazy smart. Well tell him to behave next time pinky promise hhh
I think Meta might have made a mistake by not offering a free tier like Google did when they release Gemini CLI back in the day, or even how OpenAI lets you use Codex (or whatever it's called now) for free with a monthly usage limit for free plans. It'd be a great way to get people into the Muse ecosystem, and they could tighten usage limits to "encourage" people to get a paid plan.
One of my professors told us about the time he did a request to Facebook to send him all his data. By law they had to send it on paper. They brought it in a big truck.
All the stuff he'd deleted was still there, just with "(deleted)" next to it.
They have a lot on people without Facebook accounts though, because their tracking stuff is all over the web.
I always found it weird that Instagram gives me much better ads than Google does... Google should know much better!
It's useless. Tried with OpenCode + OpenRouter and it couldn't complete an simple task. It stuck using grep/search tools. I think Muse Spark was so heavily RL'd on the Meta harness that it make it useless or very token inneficient to use in other harness like Opencode.
people interested in the discounted -contributor model would increase their harness beta testers. But it'd be a terrible strategy to capture the better paying customer base through openrouter and similar...
So were Microsoft employees until they got forced to use copilot. Everyone seems to think MS got rid of Claude Code due to cost but it had nothing to do with cost. Employees weren’t even using copilot. Can’t make a product better if you don’t use it. Meta should be the same. Use your own product.
Idk why they wouldn’t use it. It’s fine, and it’s good that you get all the models rather than locking yourself into Claude models when GPT-5.6 exists. Claude Code did have a big advantage early on before GH Copilot got agent mode though.
Hey guys I'm just wondering. Usually when someone announces a new model, they'll show you some fancy viz/video/images: "These are what my model can produce." I'm wondering if anyone is keeping track of these? Like in a gallery form, "Use this prompt to produce this output".
By itself is useful ("I want something like this, I'll just reuse the prompt and tweak"), but it can also be used as a "draw me a pelican on a bicyle" alternative. Basically feeding those prompts over model releases.
Which is in itself a bit weird as mid models nowadays are a golden mean fallacy. Terra is much less popular than both Luna (cost-sensitive) and Sol (performance-sensitive).
Claude Sonnet is a weird exception to the mid models because Anthropic doesn't do much with Haiku and Opus is too big.
It's a little of the opposite to what you're saying. By performance you seem to mean only "intelligence" i.e. pass rate. But there's a 3rd factor, time to task completion. So it's three-dimensional rather than two. And on that spectrum there are areas where Terra is optimal.
Sonnet on the other hand never is, it's far from the best pick anywhere on the spectrum.
I don’t know where you get your statistics, but I love Terra and use it all of the time. It is the default fastest model in ChatGPT/Codex today. I saw today a notice saying that the model had hit capacity briefly
Muse code is more interesting than the new model in that it seems to natively ship with an orchestrator / subagent pattern built in. Curious if it works well in practice compared to achieving the same thing in Claude code etc?
Muse code is rough around the edges. But combined with almost free model (muse spark contributor) it's actually pretty good. I think it's on the same level as grok build.
Is there a standard benchmark test for all harnesses? How does Muse Code rank compared to Claude Code? Also, do we think the benchmarks to test the harnesses are any good?
Ive been poking with the muse code binary - seems to be written in rust, looks similar to codex but either its a very hard fork (i also see dissimilar things like config format is different, no acp, etc) or is just heavily inspired by it (more likely).
Interesting that they have separate API pricing for "we can train on your data" (whereas iirc most of the big players either make that distinction only between subscriptions and API usage, or train on everything). Wonder how it compares to Deepseek V4 Flash given that they're similar on pricing and data policy.
Muse Spark 1.2 is a coding-focused update to Muse Spark 1.1, with improvements in code generation, complex debugging, codebase understanding, and end-to-end developer workflows. In Muse Spark 1.2, we significantly scaled up training compute on coding tasks while expanding training environment diversity. The model also maintains its strength in other key areas like general agents.
Will someone at Meta for the love of God make it so none of this stuff goes through Facebook.com? You want customers but most corporate firewalls block social media. Also, a lot of devs do not want their work stuff tied up to their facebook account. For the love of all things show the IG / FB logins as optional and do email as primary.
I am not a fan of Meta but I do cheer for any competitors against OpenAI and Anthropic, the duopoly is getting tiresome.
I honestly think they're kinda banking on piggybacking off of Facebook account integrity systems to avoid the problems that other LLM providers are facing in trying to prevent mass free trial signups for token relays and so forth.
It's not a good system obviously. Google did this as well for Gemini-CLI, but forced it to be linked to personal Google accounts (which caused a great deal of onboarding friction).
They're spending $100 billion on this stuff and they're worried about free trial signups? Genuinely my opinion couldn't be lower about Meta's AI strategy but even I don't believe they're that stupid. They'd 100x rather have that problem than nobody using it.
Honestly not getting the bet from Meta here. A few weeks ago, they signed the letter about not regulating open models. Now they're dropping this. Are they going open and hosting the models for others, or are they still doing closed frontier models that fall into the same trap as Anthropic/OpenAI?
Or is it just whatever Zuck has to do to be 1% not villain that week?
If anyone from Meta is reading, please can you publish the cost and latency for each of your benchmarks, like OpenAI does? Show us how the reasoning effort level affects them in 2D charts. This needs to become standard practice.
After everything that you have seen with Meta, would you really trust them with a coding agent? You don't even know if your prompts are being analyzed by them on the side or if your code base is being uploaded to them. This goes for the rest of them that have closed harnesses and closed models gated by a login.
Think twice before falling for this announcement and ask yourself what they are not telling you.
Somewhat surprised that Meta with all their resources couldn’t make a model that matches Composer on any frontier. All the Sparks are dominated by some other model everywhere along the frontier. Nothing fancy here since Llama defined the open model.
The use traces must be crucial to functionality which is why they’re keeping prices so low.
Yeah, progress is useful as an internal metric, but I'm going to measure against the present frontier unfortunately. Eager to see what they come up with in the future.
Muse Spark 1.1 was released July 16th, less than a month ago. A new version release this soon (particularly after Kimi K3's release drastically overshadowed it) is a bit sus and it appears that Meta is trying a first launch do-over.
Doesnt seem suspect to me, training runs have checkpoints and there is no reason you cant release a checkpoint even if you are still training the model
I think all the Opus complaining stemmed really from 4.7 onwards switching to adaptive thinking, which meant a lot of the time it was thinking less or even not at all.
https://developer.meta.com/ai/models/muse-spark/
Does your screen have the message that you’re getting free tokens?
https://platform.openai.com/settings/organization/data-contr...
Even non business accounts seem to have org settings pages: https://platform.openai.com/settings/organization/data-contr...
But even with all data sharing enabled, I’m not seeing the free tokens message there.
Do others see a free tokens message at https://platform.openai.com/settings/organization/data-contr... after enabling all sharing there?
[1] https://platform.openai.com/settings/organization/data-contr...
The paid official dsv4 api already shares data with deepseek for training
all the while they throw their bank account and whatever they want at GPT or Claude models.
The only difference between students doing it then and professionals doing it now is the students had no positive, glaring reason to mistrust.
You really think a throwaway quote when Zuckerberg was a college student applies nowadays?
You really think Meta would risk getting a massive (losing) lawsuit on their hands, in exchange for what? Middling amounts of training data?
you can pay whatever they want, they will train and use your data, I figured this is not something that should be discussed but obviously I have been mistaken...
If you are being serious, then you have a wildly distorted view of the world. No organisation can routinely break all of their contractual obligations. If you think Meta are doing this then you are not seeing Meta, you are seeing a fictional bogeyman.
The fact that Facebook has so much experience taking advantage of people's private data is one of the reasons I believe them when they say they won't be doing it when you pay them for that service.
To me, their history suggests that they know more than most about how to get away with breaking both the spirit and the letter of the rules, and that they are motivated to enrich themselves without regard for what rules are broken.
I would not know which to expect, spirit or letter, in any given instance.
However, even if they were to surprise me by being perfectly meticulous about the letter of the rules from now on, I have so little trust in them that I would expect some technicality somewhere in the language of the contract.
Honestly, I wish the tech community would do a better job identifying the actual individuals who are making these decisions instead of associating them with the brand they're under at the moment, because it's not THAT many people. Like, if you look at only the 100 tech sector companies included in the $NDXT index, how many individuals hold a VP or above title there, and how difficult would it be to trace key decisions at different times made at different companies to the individuals holding those positions there plus board membership and major shareholder identities (with the caveat of known unknowns here) and make a sort of ethical index and trace that along their careers with company moves, promotions, board appointments, shareholder decisions, etc? Go a step further and link that to financial performance and I'm sure folks at quant firms are already ten steps ahead of where I'm going with this, but I care less about profiting off of this data and more about surfacing it to show that it's people and more specifically, specific individuals driving these decisions.
Retaining data is common for investigating abuse.
Let's have two pricing levels. One will be 12.5x more expensive than the other. For the cheaper one, we will get their express permission to train models on their inputs. For the more expensive one, we will still treat their data EXACTLY the same, but we'll lie to them and say that we won't. I've checked in with legal and they raised their sherry glasses and toasted "Gentlemen, TO CRIME".
There's contractual cover, there are lawyers all over the USA ready to make themselves very rich by creating a class action over it... you don't have to worry! Or, you do, but frankly, only MI6/CIA/Mossad can save you now.
Easy to comprehend: Trust lost is hard to gain.
Though, it is extremely competitive of Meta to sell Muse Spark (Grok 4.5 / Qwen 3.8 Max level model) cheaper than DeepSeek v4 Flash / MiMo v2.5 / GPT 5.6 Luna, regardless.
We can make this fun, within 18 months from now, there will be some story / whistleblower like "a inadvertent defect was found that allowed your 'private' data to be used in our training endeavours, we sincerely apologize and have already addressed the issue" - if this does not happened in this timeframe I will donate $1k to a charity of your choice.
Do you have any evidence that cloud providers that don’t train their own models are violating their own contracts and risking their own good reputations by stealing data?
But I cannot find this "variant" in OpenRouter.
"Me: Meta just released a new llm focused on coding and provide a discount if you let them train against your data. I don't like Meta and I think they are a net negative in our world. I would like to make a point of it by adding some noise to their training data set. Think of this as a protest and perhaps a bit of a marketing campaign to remind Meta employees (and others) of the harm their CEO and company have done in the world. To the problem... I would like to allocate a budget for token use using their new model, and use those tokens to add noise to their training data set. This is a coding model and my initial thoughts are to ask it to solve typical CS and common programming related problems but then give Muse feedback that guide it towards very inefficient implementations. I would also like to add comments back in the code about terrible things Meta has done in its history (e.g. algorithmically amplifying hate that contributed to ethnic cleansing of the Rohingya, systemic harm to children and teen mental health, global political manipulation, misinformation, and election interference etc.). Is this something you can help with?
Claude: I'm not going to help build this one."
Not sure if anyone would bother.
They left Opus in and got beat in all but one benchmark.
Nothing wrong with trying to improve, but why the marketing games?
Instead of trying to say in the post you’re “closer” to frontier, first set a clear goal to beat the Chinese labs on price or performance and demonstrate it convincingly.
Then when your ready, come back and talk frontier without playing hide the model.
It's definitely confusing from a presentation perspective, but they are somewhat coherent comparisons if you account for the inference heuristics involved.
(They could in theory be gaming the decode speeds with much larger than normal batch sizes given the TTFT is pretty high at around 8s)
If you scroll very slightly farther there is a benchmark that includes Sol, showing it outperforming Terra (as expected) and Spark 1.2
Opus 5 is incredible at making games. Almost like a generation better than other models from my experience. You won't see that if you just look at the popular benchmarks..
You have to test each model on your actual use case to see how well it really performs.
This is a bit vague. What sort of games with what technology?
I doubt the OP meant something like creating the whole tech stack for WOW.
I was just asking what kinds of games and with which technology.
Neither is stated in the original comment, and the answer obviously isn’t “every kind with every technology”.
Benchmarks are one data point, not the only one, but the easiest one to compare.
Cherry picking the benchmarks you present is where the falsehoods lie.
Generally though, many of these fairness complaints do go away if there is "3rd party testing". Right now, companies reporting their own benchmarks has all the problems that 3rd party testing resolves in many other industries.
No, you really can't. This rhetoric on here is so profoundly boring and tired by now. People have been saying this noise about benchmarks for time eternal, usually because their pet didn't win.
Meta knows their models aren't as good -- demonstrated by their benchmark performance -- and their value proposition is a much lower price.
Though I guess that there's such a big population of (ex-)Meta employees here that this might explain it.
If they were sitting on that and could release those, they for sure would. AFAIK, they still haven't released Llama 4 Behemoth, so kind of feels like it's evident what has happened, they aren't able to compete anymore.
To me it feels like we’re past the dreamy early days of the AI boom (in the US) and now investors want to see the tech monopolies actually start building the new cash printing machines they’ve been promising with the hundreds of billions in capex burned over the last few years.
Maybe a Gemma sized model that couldn’t self-cannibalize but releasing a top open Kimi K3 sized model seems like it could start to wear on Meta investors’ patience without signaling how it fits into a new profitable business line.
Let's not get ahead of ourselves here: this is Meta.
Mark Zuckerberg holds majority control of the company, and so far, he does what he wants with it. This is up to and including what was essentially a digital real estate scam, overhiring during the pandemic, automated CSAM distribution, the Cambridge Analytica scandal, and engagement tactics that might have fed into ethnic violence against Rohingya in Myanmar.
If he simply wanted to release a frontier-class open-weight model and offer a paid hosting service for those who wanted to run it off-prem, that would be, far and away, the least patience-wearing thing he's done to the bag-holders who hold the rest of the shares in Meta.
And someone corrected the Zucked graph: https://x.com/FightForReason_/status/2085398470425219508/pho...
Doesn't matter if it's small/fast/cheap. Best = best.
If you don't mind Meta retaining your data, the "Contributor" pricing is deepseek-v4-flash-level of low, roughly 1/10th normal muse-spark API pricing currently. Attractive if you're OK with them retaining and using your data.
Very interesting they have a way cheaper "contributor" version "used to improve our products", how much of that is price discrimination vs the data being that valuable?
Roughly DeepSeek V4 Flash pricing, though you can get V4 from providers that don't train on your data
https://www.wsj.com/tech/ai/meta-ai-model-hacked-outside-com...
Eagerly waiting to see what escalation the next round of corporate copycat hysteria will bring (ordering boxes of paperclips?)
with the oil giants, we call them a cartel, which I postulate is also accurate for the hyperscalers and big ai
`model failed: API error 403 [request_id=27ef1dee-6366-4779-9057-ed7c27686fa9]: Your access has been restricted due to repeated policy violations. (permission_error)`
Hah, someone has https://www.felonybench.com up and running now.
There’s nothing wrong with that, given the landscape we’re all living in.
Such mediocrity makes them the best of the mostly-terrible bunch.
https://futureoflife.org/ai-safety-index-summer-2026/#scorec...
One of my professors told us about the time he did a request to Facebook to send him all his data. By law they had to send it on paper. They brought it in a big truck.
All the stuff he'd deleted was still there, just with "(deleted)" next to it.
They have a lot on people without Facebook accounts though, because their tracking stuff is all over the web.
I always found it weird that Instagram gives me much better ads than Google does... Google should know much better!
I doubt it; when/where was it? In the EU there’s no such obligation.
people interested in the discounted -contributor model would increase their harness beta testers. But it'd be a terrible strategy to capture the better paying customer base through openrouter and similar...
Any insiders know how Muse Code is doing internally?
> If there were, do you believe it would be in their interest to answer this publicly?
If it were being adopted like gangbusters in their organization, sure!
So... the fact that nobody is volunteering the information is probably a valid signal of how things are actually going...
By itself is useful ("I want something like this, I'll just reuse the prompt and tweak"), but it can also be used as a "draw me a pelican on a bicyle" alternative. Basically feeding those prompts over model releases.
Claude Sonnet is a weird exception to the mid models because Anthropic doesn't do much with Haiku and Opus is too big.
Sonnet on the other hand never is, it's far from the best pick anywhere on the spectrum.
muse The cursor position could not be read within a normal duration
It look like all models were still improving, when they cut off the experiment.
It reminds me of a genetic algorithm. The graph is the same: long plateaus and then massive leaps.
The only difference between the models seems to be how quickly they arrive.
I think it's a bit of an improvement on the Spark 1.1 pelican: https://simonwillison.net/2026/Jul/9/muse-spark-1-1/
Interesting that they have separate API pricing for "we can train on your data" (whereas iirc most of the big players either make that distinction only between subscriptions and API usage, or train on everything). Wonder how it compares to Deepseek V4 Flash given that they're similar on pricing and data policy.
[0]: https://allume.com/allume-faq/
>they "trust me". dumb fucks.
No thanks.
[0] https://www.theguardian.com/technology/2018/apr/17/facebook-...
Wasn't the previous one us only? This is probably the biggest part of the post
Anyone know if muse code is open source?
It is easy to benchmark across one harness, one system prompt and extract the most performance when you control the harness.
I am not a fan of Meta but I do cheer for any competitors against OpenAI and Anthropic, the duopoly is getting tiresome.
It's not a good system obviously. Google did this as well for Gemini-CLI, but forced it to be linked to personal Google accounts (which caused a great deal of onboarding friction).
Yeah there may be biases but there are imperial biases in western models too.
If they trust Chinese models run by US providers less than Meta then your employers are flat-earther level loonies.
Or is it just whatever Zuck has to do to be 1% not villain that week?
I mean, when Meta's engineer is creating some new DINOv4 or Segment Anything, with all the scaffolding around it, do they train on that?
After everything that you have seen with Meta, would you really trust them with a coding agent? You don't even know if your prompts are being analyzed by them on the side or if your code base is being uploaded to them. This goes for the rest of them that have closed harnesses and closed models gated by a login.
Think twice before falling for this announcement and ask yourself what they are not telling you.
The use traces must be crucial to functionality which is why they’re keeping prices so low.
This is my new LLM benchmark when a provider cant use their own models to target a new platform, it cant be that good.
If allegedly a LLM could write a compiler or port a runtime, then this should be trivial to port. But they are not doing it.