JP.MOTM said:
Alright, let's dig in. This one's mildly irritating. Below is how I make sense of it.
I'd bet plenty of you looked at that and thought, seriously? I know I did. In the paper, retatrutide sits at -13.1% weight loss, placed under tirzepatide and CagriSema. From the trials, everyone knows retatrutide reached roughly 24%. That's the largest figure anywhere in the obesity-drug space. So why would the strongest drug land in the middle of the table?
In retatrutide's phase 2 obesity trial (Jastreboff et al., NEJM 2023; "Triple-Hormone-Receptor Agonist Retatrutide for Obesity," NCT04881760), the 12 mg dose gave -24.2% weight loss across 48 weeks, and it hadn't flattened out yet. Tirzepatide's flagship obesity trial (Jastreboff/Garvey et al., NEJM 2022; SURMOUNT-1, NCT04184622) gave -20.9% at 15 mg across 72 weeks. Put those 2 trials side by side: retatrutide (~24% in 48 weeks) is ahead of tirzepatide (~21% in 72 weeks), not behind it, which is the opposite of how the paper ranks them, right?
So what kind of statistical f*ckery is being done to give these results?
Firstly: why every drug's number is lower than its obesity-trial headline:
- Trial pooling that includes diabetes. Every drug's estimate merges its obesity trials with its type 2 diabetes trials, and people with diabetes shed noticeably less weight on these drugs, so the pooled figure ends up under the obesity-only figure.
- Normalising to one year. The flagship obesity trials mostly ran 68–72 weeks, whereas this paper recalculates every drug to a shared 52-week mark, which cuts the longer trials down as well.
(That's why tirzepatide shows ~15% instead of the ~21% from its SURMOUNT-1 obesity result, and CagriSema ~15% instead of the ~20% from REDEFINE-1.)
The retatrutide issue (frequentist vs Bayesian):
The paper analysed things two different ways. Under the authors' own
frequentist analysis, retatrutide lands at -18.4%, the
highest weight loss of all 19 drugs (that's the table in data Appendix 4, yes you have to read the appendices, boring!).
Under their
Bayesian analysis, reta falls to -13.1%, slipping beneath tirzepatide, CagriSema, ecnoglutide and mazdutide, and the Bayesian figure is the one that made it into the paper. Crucially, retatrutide is the
only drug that the change in statistical analysis method moves. Every other drug shifts by half a point or less between the two methods, while retatrutide alone drops 5.3 points, which is exactly what takes it from first place to fifth.
The likely reason is that retatrutide is the one drug that is both the most extreme estimate and the thinnest evidence (just two small trials), and Bayesian models are built to pull exactly that kind of uncertain outlier back toward the pack, but thats a guess, not something the paper states. The one thing that needs no interpretation: the same data, analysed two ways, ranks retatrutide either the best or mid-table, and they used the mid-table version.
DrugFrequentist (Appendix 4, §6.1.1)Bayesian headline (standard dose)Change
Retatrutide-18.4% (highest of all)
-13.1%-5.3Tirzepatide-15.4%-14.9%-0.5Ecnoglutide-15.1%--14.6%-0.5CagriSema-14.7%-14.8%+0.1Mazdutide-13.3%-13.2%-0.1Orforglipron-10.4%-9.9%-0.5Oral semaglutide-10.4%-10.9%+0.5Survodutide-9.5%-10.2%+0.7
The wierd contradiction with reta showing the largest waist-circumference reduction of any drug in the analysis, -14.4 cm, beating tirzepatide's -11.0 cm. Waist and weight move together. A drug is VERY unlikely to be able to shrink waistlines the most while losing a mid-table amount of weight. This again points to something going on with with statistics. I have no idea what, im not clever enough and dont have the time to figure it out!
Hope that helps!