Why a major paper on the Mediterranean diet was just retracted and replaced

Fads in nutrition come and go, but one diet in particular has been widely heralded for its benefits to health — the "Mediterranean diet," rich with vegetables, fruits, fish, nuts and olive oil. For decades, researchers have shown that people in Mediterranean countries seem to show lower rates of heart disease.

And in 2013, one landmark study gave the strongest proof yet in one of the first major clinical trials to measure the diet's heart benefits. The study, conducted in Spain, showed that consuming a Mediterranean diet can lower the risk of a heart attack, stroke or death from heart disease by about 30 percent in those at high risk.

The five-year experiment, published in the prestigious New England Journal of Medicine, made international headlines and was hailed as a triumph.

But on Wednesday, the study's authors took the rare step of retracting their report. The researchers chose to withdraw their original paper and publish a new one after facing criticism of the way the initial experiment was conducted.

The findings of the revised study arrive at the same conclusions as the original one — that the Mediterranean diet can prevent heart disease. But the language in the new report is a bit more modest.

The original study concluded the diet "resulted in a substantial reduction in the risk" of major heart illness among high-risk people, while the new study said "those assigned" to a Mediterranean diet had a lower risk than those not assigned.

Despite this softened language in the report, the lead author on the study, Dr. Miguel A. Martínez-González of the University of Navarra, told the Washington Post that the causal link is just as strong as the original report.

"We are now more convinced than ever of the robustness of the trial and of the conclusions," Martinez-Gonzalez said, particularly because "no previous trial has undergone such intense scrutiny."

Still, the retraction and replacement of such a major study in one of the world's most reputable journals raised eyebrows in the medical world. If the original study was so problematic that the authors chose to withdraw it entirely, could the new one be trusted?

"Sad day for credibility of major medical journals and nutritional science," tweeted Sekar Kathiresan, a physician scientist, human geneticist and director of the Center for Genomic Medicine at Massachusetts General Hospital.

The unusual chain of events began with the work of one determined sleuth, a British anesthesiologist named John Carlisle.

Since the early 2000s, Carlisle and a few others had been noticing red flags in studies published by academic anesthesiologist Yoshitaka Fujii. Nothing much came of it until about 2009, when Carlisle wrote to the top editor of the journal Anaesthesia raising doubt that Fujii's data was produced by real-life experiments.

The issue had to do with randomized controlled trials, which divide participants by chance into separate groups that compare different treatments. Using chance "means that the groups will be similar and that the effects of the treatments they receive can be compared more fairly," according to the National Institutes of Health.

"If you're making up data the temptation is to make your groups more similar than what would happen under natural circumstances," Carlisle told the Post.

Carlisle urged the journal to analyze the data in the Fujii studies, to which the editor responded, "would you mind doing the work?" Carlisle recounted. While he was no statistics expert, Carlisle agreed. "I don't know what it feels like to be a detective, but I thought it felt like being a detective."

Using online tutorials and YouTube videos, Carlisle taught himself how to sift out patterns and anomalies. He specifically looked for cases in which participants in studies were not assigned randomly to treatments, even when the trial portrayed itself as random.

Carlisle published a report in the journal Anaesthesia in 2012 explaining how and why Fujii's data was too good to be true. And the medical world took notice. Investigations would later make clear that Fujii had fabricated most of his data. As of 2015, he held the record for most retractions by a single author — 183, as Nautilus reported.

In the years since, Carlisle applied the same kind of sleuthing to reports beyond anesthesiology. In 2017, he published a report that took a close statistical look at 5,087 randomized, controlled trials over a 10-year period. His analysis pinpointed, among other things, 11 reports in the New England Journal of Medicine with baseline variables that appeared "almost impossible" to happen randomly, Carlisle said.

Within days, the journal began to review the 11 reports. Of those, only one presented legitimate concerns, the journal said — the 2013 Mediterranean diet study. His analysis questioned whether some participants had actually been assigned diets at random.

After Carlisle published his 2017 report, Martínez-González and his team of researchers contacted the journal, which urged them to perform a new analysis.

Martínez-González and his team went about reevaluating their data, and found that while some of Carlisle's findings were "based on mistaken assumptions," there were two main problems.

The Mediterranean diet trial, which took place at 11 locations in Spain, involved assigning more than 7,000 people at high risk of heart illness to one of three diets: a Mediterranean diet supplemented with extra-virgin olive oil, a Mediterranean diet supplemented with mixed nuts, or a simple low-fat diet (the control group).

It turned out that among about 10 percent of the participants, the same diets had been assigned to individuals in the same household. If a married couple joined the study together, for example, both participants would follow the same diet. For these participants, assignment was therefore not random; family members share genetics and other environmental variables, making it difficult to identify if dieting alone led to health outcomes.

Martínez-González said the authors "inadvertently" forgot to account for the issue in the study's protocol.

In addition, at one of the 11 study locations, a researcher assigned the same diet to an entire village, which Martínez-González described as a "cluster."

In their new report, researchers made statistical adjustments to correct for these issues. The team "took more care to adjust for potential imbalances," Martínez-González said.

The revised report, which has now replaced the retracted study, did not rely on the assumption that all the participants were randomly assigned.

Despite these changes, the results remained intact, Martínez-González said.

But as Allison McCook of Retraction Watch wrote for NPR: "would the New England Journal of Medicine, one of the world's most selective and prestigious journals, have published the Mediterranean diet paper from Martínez González if the randomization issues and softened conclusion had been included in the first place?"

"It is difficult to answer hypothetical questions," New England Journal of Medicine spokeswoman Jennifer Zeis told McCook. "'We believe the evidence (in favor of the diet) is still strong, but not as strong as a randomized study in which the randomization was executed flawlessly.'"

While the conclusions were the same in this case, Carlisle urges readers to remain always skeptical. He argues that all medical journals could do a more thorough job of reviewing papers and data before publication.

For those looking to make decisions based on scientific research - such as whether to pursue a Mediterranean diet — "don't put all your eggs in one basket," Carlisle said.

"Whatever you believe, it shouldn't depend upon just one paper," Carlisle said. "Try to have not only a balanced diet but also a balanced view."

Reader Comments ...

Next Up in Lifestyle

How long and how well kids sleep matters in obesity prevention, new study finds
How long and how well kids sleep matters in obesity prevention, new study finds

A new study from the American Academy of Pediatrics put activity monitors similar to a FitBit on 829 adolescents and looked at quality and quantity of sleep and how it related to blood pressure, waist circumference, cholesterol, both triglycerides and HDL, and the potential for insulin resistance. How long...
Celebrate Father's Day with these 10 so-bad-they're-good dad jokes
Celebrate Father's Day with these 10 so-bad-they're-good dad jokes

Happy Father's Day! Twitter users around the world are using the hashtags #DadJokes and #FunnyThingsDadsSay to celebrate their dads with baffling wisecracks and head-scratching words of wisdom. >> Read more trending news  Check out 10 of the best-worst jokes below: 3. "It's not a dad bod. It's a father figure." – ...
Fly-fishing in Central Texas is about more than the catch
Fly-fishing in Central Texas is about more than the catch

I’m gliding along an inlet of Lady Bird Lake aboard an inflatable raft, casting a line toward shore as fly-fishing guide John Erskine maneuvers us around a leggy blue heron. Erskine, an executive at an Austin gaming company, loves to fish — especially fly-fish — and manages to sneak away from his desk job 30 or 40 days a year to moonlight...
Dear Abby - Sunday, June 17

Dear Abby: I got a stepdad when I was a young teen. He never tried to replace my dad, and was very respectful of that relationship. I didn’t regard him as a father figure, but more as a relative, friend, and a good man who has done a lot of good for my family. I’m a young adult now. My real dad died recently. Father’s Day is now just...
We all scream for ice cream and more family fun, June 17-23
We all scream for ice cream and more family fun, June 17-23

Events Austin Ice Cream Festival. Sure, there’s chocolate and vanilla, but we bet there will be bacon flavor, too. 10 a.m. to 3 p.m. and 6 to 10 p.m. Saturday. $15-$67.50. Fiesta Gardens, 2101 Jesse E. Segovia St. austinicecreamfestival.com Teen Turn Up. Teens ages 11-17 enjoy teen parties all summer long at Austin’s recreation centers...
More Stories