Our newsletterAcademicarXiv, 10 Oct 2026
A rating edge of just 0.075 stars was enough for a made-up brand to beat a well-known one in half of AI recommendations
Optimisation methods
0.075
stars was enough for a made-up skincare brand to reach a 50% win rate against the real brand in the source's threshold test
- Reader Note:
- This is from Experiment 1c in skincare: head-to-head tests where the made-up brand was given a small advantage in rating, price, review count or ingredient quality over the real brand. The 0.075-star figure is the paper’s estimate of the rating edge at which the made-up brand wins 50% of the time. The paper reports similar 50% thresholds for other attributes: 1.6x more reviews or a 7.3% lower price. Experiment 1c used 9,220 valid trials out of 9,600 across GPT-4o-mini, Claude Sonnet and Gemini 3 Flash. The report does not say when the experiments were run.
- Evidence:
- Experimental
- Vendor interest:
- None
- Sample:
- Controlled prompt experiments on 3 commercial LLMs (GPT-4o-mini, Claude Sonnet, Gemini 3 Flash), mainly using skincare product sets with 1 real brand and 9 fictional brands; prompts run in English and Chinese with 20–30 repetitions per cell. Main analyses include 14,395 valid trials in Experiment 1, 3,854 valid calls in Experiment 2, and 4,745 valid calls in Experiment 3.
Reader Note:
Evidence:
Vendor interest:
Sample:Good for
Backing budget and pricing decisions in similar situations.
Not for
- Situations far from the one tested, without checking again.
- The source never says when this data was collected. It could be considerably older than the publication date suggests.
Related cards
Idea
Go deeper on this topic
Our Substack turns the data behind these cards into full breakdowns: what changed, why, and what to do about it.
Trend