Jessica Wapner is a widely published journalist, writer, and producer. She is the author of \u201cThe Philadelphia Chromosome\u201d and \u201cWall Disease,\u201d and the reporter and co-host of the podcast One Click.<\/p>\n
On a sweltering day in July 2023, a ragtag group of data wonks sat around a table at U Zlat\u00e9ho Tygra, or the Golden Tiger, a historic bar in Prague\u2019s Old Town. A mild sense of outrage hung in the air between jokes about who among them looked the most Medieval. The group was discussing the issue of manipulated images and fabricated data in scientific publishing. Soon someone was passing around a phone showing a black-and-white image with clear traces of tampering. After a couple more rounds, the group made its way across the ornate cobblestone roads. They brimmed with frustration that, until now, had largely been shared only online. \u201cIt\u2019s a toxic dump,\u201d an Italian scientist known to the group by his pseudonym, Aneurus Inconstans, said about science. \u201cIt\u2019s not about curiosity anymore, it\u2019s just a career.\u201d<\/p>\n
These are the sleuths, as the media often refer to them. They are a haphazard collection of international acquaintances, some scientists and some not, from the United States, Ukraine, New Zealand, the United Kingdom, and elsewhere, who are dedicated to uncovering potential manipulation in the scientific literature.<\/p>\n
Those present in Prague, and others who couldn\u2019t make the trip, have different strengths and interests. Some are into exposing statistical skullduggery; others are into spotting manipulated images. Some are academics sticking to their field; others more general-interest vigilantes. But all of them are entrenched in an ongoing battle at the heart of science, in which the pressure to publish and the drive for fame and profit have thrown countless images and statistics into question, sometimes cracking pillars of research in the process. The issue is spread across many fields of science, though some have suffered more than others. \u201cThe biggest paper in Alzheimer\u2019s disease is a fake,\u201d Inconstans said en route from the bar as the sun set over Old Town. He was sharing an opinion that all the other sleuths had already heard.<\/p>\n
![\"\"](\"https:\/\/www.nakedcapitalism.com\/wp-content\/uploads\/2024\/09\/wonks.jpg\")
<\/p>\n
In 2023, a group of data wonks gathered in Prague to discuss a disturbing issue: manipulated images and fabricated data in scientific publishing. Part of that group is pictured here, from left to right: David Bimler, Charles Piller (a journalist who attended a portion of the meeting), Nick Brown, Sholto David, Patrick Starke, Leonid Schneider, Markus Zlabinger, Elisabeth Bik, and Kevin Patrick. Visual: Courtesy of Elisabeth Bik<\/p>\n
The paper in question, published in Nature in 2006, lent credence to a theory that the proliferation of a type of amyloid protein causes Alzheimer\u2019s disease. The amyloid cascade hypothesis, which had all but taken over Alzheimer\u2019s research, has led to billions of dollars going into researching anti-amyloid therapies to slow the disease\u2019s progression.<\/p>\n
But a decade and a half later, some sleuths noticed problems with crucial images in that paper. Core data appeared to be fake. Scientists in the field debated about the importance of the paper after the concerns emerged. Some believed that a landmark finding supporting the hypothesis was now unreliable. Others insisted the paper had never been used as proof.<\/p>\n
No one could deny, though, that thousands of other publications had cited the research. And, in the sleuths\u2019 eyes, the paper\u2019s popularity made investigating any tampering that much more important. \u201cPart of what we need to do, especially when you\u2019re looking at papers that have been cited, many of them hundreds, and a few of them, thousands, of times, is to make it easier for people to recognize the problems,\u201d said Matthew Schrag, a neurologist who treats Alzheimer\u2019s patients and conducts research on the disease at Vanderbilt University. A correction or a retraction would have served that need and kept with the protocols of science.<\/p>\n
Instead, the questions raised about the work revealed cracks that have been slowly eating away at scientific integrity for years. And the sleuths asking those questions would find themselves not just seeking a minor correction but fighting for a greater truth. In a text message to Undark, one man who long went by the pseudonym Smut Clyde before outing himself as David Bimler, a retired perceptual psychologist from New Zealand, wrote: \u201c We are all idealists and united by a wish for the ideals of science to be more like what they used to be.\u201d\u00a0<\/p>\n
Whether they can do anything about it, though, is another question.\u00a0<\/p>\n
The Prague group had come together at the invitation of Kevin Patrick, a financial adviser in the Seattle area. Unlike the other guests at the Golden Tiger \u2014 which, in addition to Bimler and Inconstans, included Elisabeth Bik, well-known for her skill at identifying tampered images, and several others \u2014 Patrick didn\u2019t have a scientific background. Though his investing work occasionally required him to pay attention to drug stocks, he says general curiosity years later led him to discover Retraction Watch, a website for tracking problematic and unreliable papers. As he recalls, Retraction Watch soon led him to PubPeer, a site for discussing published research, where he saw example after example of tampered images.<\/p>\n
Following some sleuths\u2019 posts on X, then known as Twitter, got Patrick wondering if he could spot the patterns that people like Bik are so adept at finding. Patrick trained himself and practiced by asking other sleuths on X to weigh in on his suspicions. \u201cI do have a lot of down time,\u201d he said. Eventually he started posting on PubPeer under a pseudonym assigned by the website, partly to protect his finance work and partly because he thought that authors would not take his comments seriously if they knew he was not a scientist.\u00a0(On X, he uses the name Cheshire.)<\/p>\n
One day in 2021, Patrick noticed that a paper he\u2019d called out on PubPeer for having problematic images a couple years prior had been retracted. It was exciting to be part of the sleuthing world. He started looking at more papers, and, because that retracted paper was Alzheimer\u2019s research, he continued in that vein. Soon he was looking at images showing bands of color \u2014 some in grayscale, some in fluorescent green or pink \u2014 representing the proteins present in samples. Patrick thought the background looked artificially altered. He saw that some sleuths had spotted similar issues in other papers by the same author. One of them was the 2006 paper.<\/p>\n
Patrick rarely understands the science he\u2019s looking at. \u201cI\u2019m not even that interested,\u201d he said. But he enjoyed developing his knack for noticing visual patterns. Divorced and empty-nested, he also liked the online camaraderie. For years, Cheshire, Smut Clyde, Inconstans, and others occupied a fringe corner of the internet that remained frustratingly under the radar considering the amount of questionable images they were routinely uncovering, most often in the biosciences. (In cases where the sleuths haven\u2019t gone public, Undark is using their pseudonyms, rather than their real names, in keeping with how they are known in the scientific community.) The sleuths bonded over their discoveries, their commitment to scientific accuracy, and, for some, the pushback they received from authors and sometimes journal editors who did not always welcome questions raised about their work.<\/p>\n
The problematic 2006 Nature paper was a particularly high stakes finding. Spotted at a time of reckoning for Alzheimer\u2019s research \u2014 a 2019 expos\u00e9 by late STAT journalist Sharon Begley chronicled the disproportionate attention given to research directed by the amyloid cascade hypothesis and lent additional weight to a quietly growing belief that the hypothesis was either incomplete or simply wrong \u2014 the problematic images would further erode the foundation on which decades of work, costing billions of dollars, had been based.<\/p>\n
That\u2019s largely because Patrick wasn\u2019t the only person to notice the issue.\u00a0<\/p>\n
Alzheimer\u2019s disease was first reported in 1906. A German psychiatrist named Alois Alzheimer watched a patient progress from paranoid to aggressive to confused and, upon her death, found strange plaques and tangles in her brain. More cases followed and Alzheimer\u2019s disease became an official diagnosis in 1910. It is the most common form of dementia, an umbrella term for a variety of cognitive impairments for which age is a primary risk factor.<\/p>\n
In 1984, two scientists discovered that a protein called amyloid beta, or A\u03b2, was the main component of amyloid plaques. This discovery led to the notion that amyloid beta is behind the formation of tangles that kill neurons, and are the hallmark of Alzheimer\u2019s disease. For many researchers, the amyloid cascade hypothesis, or ACH, brought about a major sense of optimism for helping to solve the mystery of Alzheimer\u2019s disease and carved a potential path to treatment: Stop amyloid beta and thus stop the decline, maybe even reverse it.\u00a0<\/p>\n
The theory tantalized industry and researchers alike. A biotechnology company named Athena Neurosciences and pharmaceutical giant Eli Lilly and Company produced mice containing a mutated version of the human gene for amyloid; their brains became filled with plaque and the animals lost their memory capacity. A breathless report in The New York Times said the tiny Athena could become \u201cthe mouse that roared,\u201d for this landmark achievement, which was potentially worth a billion dollars a year if it led to an effective Alzheimer\u2019s drug. Soon, scientists, pharmaceutical companies and grant funders went all in on the ACH.\u00a0<\/p>\n
Not everyone fell in line. Matthew Schrag, the Vanderbilt neurologist, was among the skeptics. Schrag, who holds both a medical degree and a Ph.D., had joined Vanderbilt\u2019s Memory and Alzheimer\u2019s Center and launched his own research lab in the mid-2010s. His training included a stint in the Department of Cell Biology at Yale. There, Schrag was captivated by the rigorous adherence to the scientific method.<\/p>\n
Nonconformity, too, was in Schrag\u2019s blood. His grandfather was an atheist whose father had left the Mennonite Church. Schrag\u2019s parents had home-schooled him and his siblings in a small town in Washington. As his career progressed, his commitment to careful science brought him to his own rebellious stance: The ACH was wrong.<\/p>\n
When the 2006 Nature paper came under wider scrutiny in 2022, Schrag already believed the evidence against the ACH was far more persuasive than anything in its favor.\u00a0For one thing, the plaques considered to be a hallmark of the disease also occur in people without it. Also, research had not shown that a build-up of amyloid was a necessary precursor to memory impairment in humans.<\/p>\n
Moreover, the decades of research dominated by the ACH had failed to reverse, stop, or even meaningfully slow the progress of the disease. Not a single clinical trial confirmed that targeting amyloid beta could stop or even dramatically slow the progress of the disease. Nonetheless, pharmaceutical companies forged on to move new candidates forward, but nothing panned out.<\/p>\n
Not everyone agreed that these facts disproved the causative role of amyloid beta. What Schrag saw as disproof others saw as the necessary and incremental process of understanding the pathology of Alzheimer\u2019s disease. This was simply science at work.<\/p>\n
The refusal of the field at large to concede the wrongness of the amyloid cascade hypothesis deepened Schrag\u2019s concerns about an underlying problem. A suspicion that Schrag had long been harboring took root: Alzheimer\u2019s treatment wasn\u2019t stuck because of bad drugs. It was stuck because of bad science.\u00a0<\/p>\n
In 2021, the U.S. Food and Drug Administration approved an A\u03b2-targeted drug called aducanumab in a controversial decision that prompted the resignation of three scientists involved with the review process. \u201cThis might be the worst approval decision that the FDA has made that I can remember,\u201d Harvard Medical School professor Aaron Kesselheim, one of the resigning researchers, told The New York Times.<\/p>\n
Biogen, the drug maker, had stopped clinical trials early because it had failed to show a benefit. But the investigators then analyzed a larger dataset to show a positive impact among patients who received higher doses. The FDA advisory committee strongly recommended against approval of the drug, but the agency went against that advice, granting the drug accelerated approval based on the fact that aducanumab destroys amyloid plaques \u2014 not because it slows the disease. Billy Dunn, head of the FDA\u2019s Office of Neuroscience at the time, left in 2023 and joined the board of Prothena, a drug company with several Alzheimer\u2019s drugs in the pipeline. (Dunn did not respond to a request for comment forwarded from Undark by Prothena\u2019s senior director of corporate communications Michael Bachner.) Researchers like Schrag feared the approval would keep the focus on what he saw to be a dead-end hypothesis.\u00a0<\/p>\n
He spoke up. \u201cWe had been hoping for a recalibration of the field,\u201d he told The Washington Post in 2021, following the approval. \u201cThe proof of efficacy just isn\u2019t there,\u201d he told National Geographic.\u00a0<\/p>\n
Statements like these put Schrag on the radar of two scientists, one a neuroscientist and biotechnology entrepreneur, the other a cardiologist in academia, who suspected foul play in the development of another experimental Alzheimer\u2019s drug called simufilam, made by the pharmaceutical company Cassava Sciences. Jordan Thomas, an attorney known for his whistleblowing lawsuits, asked Schrag to review the published studies for a consulting fee of $18,000. His investigation found that several key images appeared to have been manipulated to show a benefit. He also flagged that the researchers claimed simufilam altered human brain tissue that had been previously frozen, which seemed extremely hard to believe. (In an email, Craig Boerner, media director at Vanderbilt University Medical Center, noted that Schrag\u2019s investigative work is independent of his employment at Vanderbilt University Medical Center.)<\/p>\n
These discoveries rattled Schrag. The major problems he saw led him to doubt on the authors\u2019 other studies, many of which involved patients. \u201cI felt that academically I couldn\u2019t let that stand,\u201d he said. (In a statement posted on its website in August 2021, Cassava asserted that allegations made against the company regarding data and image manipulation were \u201cfalse and misleading.\u201d)<\/p>\n
When it came to assessing the integrity of a study, Schrag was particularly focused on the images. The editing techniques used to place politicians in places where they aren\u2019t and to make celebrities look perfect on magazine covers are also ideal for scientists who need to show results where none exist. Sections of a microscopic image can be copied and pasted elsewhere in the frame. Dimming and brightening in grayscale can eliminate errant data from Western blots, a basic lab technique to separate and identify the proteins present in cell or tissue samples that ultimately results in an image in which the protein contents appear as rows of thick black dashes. Images of neurons can be copied, rotated, and placed nearby, creating a fake result. Photoshop and other tools can make a drug look like it\u2019s hitting a target, or a protein appear important to a disease. It can make a failed study look successful.\u00a0<\/p>\n
But going any further with his forensic investigations would require a reliable method for analyzing images. Schrag needed to find some figures that other sleuths had already flagged for manipulation to validate his approach. So, in 2022, he turned to PubPeer and searched for Alzheimer\u2019s studies that had the kind of images he was trying to tackle. The probe returned a few papers, which in turn led him to the 2006 Nature publication.\u00a0<\/p>\n
It reported on a version of amyloid beta called A\u03b2*56, asserting that mice with excessive amounts of this protein became unable to recall information about their surroundings that they previously knew \u2014 not unlike a person with dementia who can no longer find their way home from the supermarket. The study was led by a postdoctoral neuroscientist at the University of Minnesota named Sylvain Lesn\u00e9, who was working in well-known researcher Karen Ashe\u2019s lab. The results of their experiment had been celebrated as evidence for the amyloid cascade hypothesis. Here, the believers said, was support for the theory that excess amyloid leads to cognitive impairment.\u00a0<\/p>\n
Scientists track how many times a paper is cited by others because it\u2019s a rough indication that the finding was noteworthy. The Lesn\u00e9 paper was cited more than 2,300 times. And the images were the crux of the results. They revealed the presence of A\u03b2*56 in the impaired mice. The Western blots and other figures were the evidence.<\/p>\n
Schrag told the federal government about his concern \u2014 after all, the work had been supported by the National Institutes of Health \u2014 and he also told Nature. Then he told Science magazine, which asked a few experts in image analysis if they agreed with Schrag\u2019s conclusions. They did. In July 2022, the magazine published a story by Charles Piller on both the simufilam research and Lesn\u00e9\u2019s paper. Schrag\u2019s appearance in Science was how Patrick first came to interact with him, a connection that bridged the fringe world of the sleuths with the more accepted world of academia. Their mutual commitment to scientific integrity became a joint mission. \u201cWe\u2019re not cranks,\u201d Schrag said. \u201cWe\u2019re not people hiding in a basement somewhere and just creating trouble on the internet.\u201d<\/p>\n
The expos\u00e9 was widely covered in the media, but action to correct the scientific record would not come swiftly.<\/p>\n
Scientific fraud has existed for as long as people have stood to benefit from it. In the early 1980s, Harvard Medical School heart researcher John Darsee faked data in animal research on heart attack treatments. Beginning in the early 1990s, Japanese researcher Yoshitaka Fujii, an anesthesiologist, fabricated more than 170 papers. And Massachusetts anesthesiologist Scott Reuben fabricated data in at least 21 studies dating back to the 1990s, several of which highlighted the benefits of pain medications made by Pfizer, which had supported much of his research.<\/p>\n
In 2016, Bik, the well-known image sleuth, who holds a Ph.D. in microbiology, co-authored a study showing that nearly 800 of 20,621 papers she and her colleagues examined contained problematic figures. Most of these did not seem like not innocent errors; a 2012 study found that two thirds of all retractions are due to misconduct, not mistakes.\u00a0<\/p>\n
To the sleuths who congregate on PubPeer and on X \u2014 Bik, Patrick, and many others, sometimes including Schrag \u2014 this fakery is emblematic of how science has departed from its original purpose of understanding the natural world. Academic research requires funding and funders want proof that they are making a wise investment. Young investigators have to produce results to win grants and job offers. Senior faculty need to preserve their labs and reputations.<\/p>\n
Jana Christopher, an image analyst for the Federation of European Biochemical Societies, which publishes several journals, says she has seen the effect of the pressure to publish on scientists. \u201cPeople are going to try and be fast,\u201d she said. \u201cPeople are maybe being bullied in their work environment into working faster, coming up with desired results in a certain timeframe. I think in some labs, the atmosphere can be quite toxic and people are not necessarily protected from that in the right way.\u201d<\/p>\n
Many people concerned about scientific integrity see the big egos of star scientists as a contributing factor. Bik called out the work of French physician and microbiologist Didier Raoult after noticing he was listed as the senior author on a paper stating that hydroxychloroquine \u2014 a drug prescribed for autoimmune conditions like lupus and rheumatoid arthritis \u2014 could be used as a treatment for Covid-19. Raoult and Bik subsequently traded barbs on social media and elsewhere over her criticism of this work, and of Raoult\u2019s wider publication record. (In response to a request to Raoult for comment, his fellow researcher and frequent co-author, Philippe Brouqui, forwarded a letter that he said had also been sent to Science magazine, in which Raoult defended himself against critiques by Bik and others.)<\/p>\n
Schrag places much of the blame on the scientific publishing industry. Journals are self-managed, and little oversight exists to address suspected misconduct. And when someone catches problems with published data, the journals are not responsible for identifying whether they stemmed from deliberate misconduct. Meanwhile, the publications\u2019 profits have come under increasing scrutiny. Nature charges around $11,400 to publish a study as open access, even though, by one estimate, it costs at most around $1,000 to move a study from submission to publication. Elsevier, which owns 2,900 journals, reported more than $3.5 billion in revenue for 2022. As Schrag and others see it, the profit coupled with the lack of regulation creates an imbalance that favors abundant publishing but not the time-consuming process of reviewing potential errors.<\/p>\n
In an email to Undark that Katie Baker, communications director for publishing and research services at Springer Nature, asked be attributed to a spokesperson, the publisher noted that the article processing charge \u201creflects the costs of publishing a paper in Nature or a Nature research journal.\u201d Simply, the review and editorial process involved in steering papers from submission to publication requires time and expertise that add up to a significant expense.<\/p>\n
The fraught dynamics don\u2019t end here. Boris Barbour, a neuroscience researcher and organizer of PubPeer and Adam Marcus, a co-founder of Retraction Watch, both noted that universities often seem reluctant to investigate allegations of misconduct. Universities are charged with investigating any allegations of misconduct made against the researchers they employ. The Office of Research Integrity, the U.S. agency that oversees much federally funded science, has proposed new rules aimed at giving ORI more insight into the process and findings of campus investigations. But identifying a researcher engaged in misconduct could risk losing federal funding, as well as tarnishing the institution\u2019s reputation.<\/p>\n
Even when journals and academic institutions are diligent about uncovering bad practices, the investigation can be stonewalled by authors, say journal editors. Sarah Jackson, executive editor at the Journal of Clinical Investigation, said sometimes authors fail to provide the necessary source material to confirm the published data, or become unreachable. \u201cI still see every range of response from senior investigators,\u201d she said.<\/p>\n
When the City University of New York investigated the work of neuroscientist Hoau-Yan Wang, who collaborated with Cassava on the research of simufilam, the report produced stated that Wang failed to provide a single piece of original material, responding that crucial records had been thrown away during a Covid-19 cleaning frenzy.\u00a0<\/p>\n
Many journals have taken steps to cope with image tampering, but not enough, it seems, to staunch the problem. \u201cAnd these days,\u201d says Barbour, \u201cthe slight improvements we\u2019re seeing from the journals are exposing how bad institutions are.\u201d<\/p>\n
The consequences for speaking up are worrisome, says Barbour. Young scientists who spot something awry risk ending their careers for calling out the boss. A lawyer for Raoult accused Bik of harassment and blackmail after she flagged issues with many of his papers. In April 2021, one of Raoult\u2019s colleagues also posted a screenshot on X that revealed Bik\u2019s home address, as she and Barbour were listed as the subjects of a legal complaint. Likewise, Purdue University biologist David Sanders went public with allegations of\u00a0potential\u00a0image manipulation\u00a0in some articles by\u00a0famed cancer researcher Carlo Croce. In response, Croce sued Sanders and The New York Times for defamation, and the Board of Trustees at The Ohio State University, his employer, for inappropriately removing him from an appointment as department chair. (Croce lost the cases against Sanders and The New York Times, and last year, a court ordered a local sheriff to seize and sell Croce\u2019s property, to pay more than a million dollars in outstanding legal fees. Croce won an appeal on the initial ruling against him in the third case, which is currently still open.) \u201cIn general, the whole environment is incredibly structurally hostile to criticizing work,\u201d said Barbour.<\/p>\n
For the crowd at the Golden Tiger and Schrag, the only way to restore integrity to research is by drawing attention to the problems, no matter the cost, no matter who listens, and no matter who they upset.\u00a0<\/p>\n
The first PubPeer comments on Lesn\u00e9\u2019s Alzheimer\u2019s paper appeared in January 2022, six months before Science reported Schrag\u2019s findings of image manipulation. \u201cI have concerns about supplementary figure 4,\u201d a comment said in the neutral language enforced on the site. The figure showed a Western blot. Several such images in the paper showed dark bands affirming the presence of A\u03b2*56 in Alzheimer\u2019s-like mice. Readers of the study saw the images as further support for the ACH when it was first published.<\/p>\n
Now, 16 years after the paper was published, another comment \u2014 Schrag says all of those that appeared that January were posted by him \u2014 flagged that several bands appeared to have been copied and pasted. More PubPeer comments flowed in. One flagged splice marks in figure 1, also a Western blot, signaling that the image appeared to have been cut to add or remove rows of bands. Other comments pointed out issues with additional figures.<\/p>\n
In June 2022, Karen Ashe, Lesn\u00e9\u2019s supervisor and the senior author on the paper, responded to some of the PubPeer comments. Ashe was, and remains, a highly regarded neuroscientist. In 1996, she pioneered research to genetically engineer mice that overproduced amyloid beta and developed dementia-like symptoms. She is recognized as a leading scholar in Alzheimer\u2019s research. And though Lesn\u00e9 was listed as first author, she had overseen his research of A\u03b2*56 and was responsible for the validity of the paper.<\/p>\n
PubPeer users noted Ashe\u2019s willingness to answer questions about the paper. She provided several original images that had been submitted to Nature and said that the anomalies in the images were introduced during the publishing process, an explanation Bik found plausible for some figures since converting them to a publishable format requires digital processing that can lead to subtle but meaningful changes.\u00a0But issues with other images remained.<\/p>\n
A week before the Science story came out broadcasting the problems that Schrag and others had noticed, Nature attached a note to the online version saying that the journal had \u201cbeen alerted to concerns regarding some of the figures\u201d and was investigating them. Other questions on PubPeer flagged additional issues. Bik spotted what appeared to be outright duplications in one figure; a magnified view highlighted an area that seemed to have been copied and pasted, which would make the entire image untrustworthy.<\/p>\n
PubPeer users have raised concerns about manipulated images on several of Lesn\u00e9\u2019s other papers, including one that, according to a comment from Bik, appeared to use a figure lifted straight from another paper. (Ashe declined to comment for this story. Lesn\u00e9 did not respond to Undark\u2019s requests for comment.) Schrag hoped for a swift retraction. \u201cIt\u2019s absolutely critical,\u201d he said, emphasizing that \u201cas a field, we need to take a stand for correcting clearly erroneous data.\u201d The 2006 paper, Schrag believed, was undoubtedly wrong.<\/p>\n
Staff charged with evaluating such complaints insist the slow pace is not their fault. Springer Nature, which publishes more than 3,000 journals, received about 1,600 such queries in 2022. Tim Kersjes, who leads the resolutions team within the publisher\u2019s research integrity department, acknowledged that investigations can take a long time. \u201cIdeally a concern comes in, we investigate it, and we can retract two weeks later,\u201d he said. \u201cBut in practice that\u2019s impossible.\u201d Kersjes said that authors don\u2019t always respond to emails or send explanations that require further review. Marcus noted that the peer review process isn\u2019t geared toward catching images for signs of tampering or other types of misconduct. Jackson, at the Journal of Clinical Investigation, said that the fact that some scientists are willing to fake their data caught publishers off guard.\u00a0<\/p>\n
The growing cadre of sleuths see the matter differently. They are catching problems that, in some cases, they say should never should have made it past a first review. Jana Christopher quickly spotted issues when she reviewed the images Schrag had flagged in Lesn\u00e9\u2019s paper and the simufilam studies, though she emphasized that image-screening experts and automated tools were not widely available at the time the Lesn\u00e9\u2019s paper was published.<\/p>\n
The sleuths and other science integrity watchdogs rankled the publishing industry initially. \u201cWe certainly had journals tell us basically, go fuck off, we don\u2019t have to answer to you\u201d said Marcus. \u201cThat doesn\u2019t happen quite so much anymore.\u201d Still, editors remain wary of PubPeer, which has increasingly become a forum for catching misdeeds rather than discussing new discoveries, which was its initial purpose.<\/p>\n
\u201cWe\u2019ve seen some folks that have taken it on as a personal mission, that they are on a crusade to root out fraud,\u201d said Jackson. \u201cThose individuals may feel like the journal is beholden to them personally and they don\u2019t always respect that there has to be a process for investigating these things.\u201d Universities may also have trepidation about engaging with individuals who call out their researchers on PubPeer or in direct correspondence to the institution. \u201cResearchers are well aware that these types of allegations, whether substantiated or not, can be career-ending,\u201d said Kate Gallin Heffernan, a lawyer who works with institutions on misconduct investigations.\u00a0She says that even when a researcher provides a satisfactory response, an exchange on PubPeer or X can leave a stain.<\/p>\n
Nevertheless, the scientific literature appears to be riddled with unreliable studies. A New Yorker profile of Bik noted that of the 782 papers she\u2019d found to have problematic images in her 2016 analysis, at most 10 had been resolved by the authors disproving her concerns. An analysis by Nature found that a record 10,000 papers were retracted in 2023. PubPeer users uncovered possible issues with images in papers co-authored by former Stanford University president Marc Tessier-Lavigne that made headlines in 2023. (Though Tessier-Lavigne stepped down as president, an investigation commissioned by the university\u2019s board of trustees exonerated him of research misconduct.)<\/p>\n
A 2021 analysis of PubPeer comments found that two-thirds of the comments on the site center on image anomalies, and most of these studies pertain to health and medicine. In other words, they may directly affect people\u2019s lives. Some journals have begun to use AI to scan submissions for image issues. Two entrepreneurs in Austria created ImageTwin for this purpose, and the U.S. federal government also provides resources for accessing and using image scanning software. But even Markus Zlabinger, who co-founded ImageTwin, emphasized that their software is a starting place that helps editors know when to take a closer look. A person must always make the final call, he said.<\/p>\n
The sleuths vary in their approach toward the publishing industry. Some can appear aggressive. Leonid Schneider, whose website For Better Science, has chronicled egregious issues \u2014 such as a paper mill that appears to be behind hundreds of publications discovered by Bik, Smut Clyde, and others \u2014 tends to make harsh accusations. Another sleuth, who uses the pseudonym Claire Francis, has antagonized journals with frequent messages demanding action. \u201cYou are complicit in fraud,\u201d Claire Francis told one staffer in correspondence about a corrected paper. Entire pieces have been written about how to handle anonymous whistleblowers like Claire Francis. Bik takes a more neutral approach, preferring to work with publishers and not as their adversary. She tags authors on social media only when they are towering figures in their fields, preferring to protect vulnerable young researchers from the mean-spirited rebukes that X tends to attract.\u00a0<\/p>\n
Regardless of how each express it, though, many of the sleuths share the same outrage. They are frustrated and angry at the sheer amount of research misconduct and the extent to which researchers may get away with manipulation or faking data because journals and universities don\u2019t take a stand. Others emphasize that tackling these issues is simply part of the job of a scientist.<\/p>\n
In Science\u2019s July 2022 report on the Lesn\u00e9 scandal, Schrag said he allowed the publication to use his identity because he believes science has to be candid and transparent. But that ideal doesn\u2019t mean he\u2019s escaped repercussions. He says he was subpoenaed to provide documents for an investor lawsuit against Cassava, which, by his count, resulted in tens of thousands of dollars in legal fees and required a significant investment of time. He says when Cassava also subpoenaed him for documents, a foundation called the Scientific Integrity Fund stepped in to help with his legal expenses. He had stood up for the cause of research integrity and fought a pharmaceutical Goliath, and now he was dealing with the aftermath. \u201cYou can lose even if you win, right?\u201d he said.<\/p>\n
The losses have been emotional too. His work outing dubious papers led to the identification of problematic images on his own CV. An early mentor, Othman Ghribi, allegedly manipulated images in a few published studies they\u2019d co-authored. After hearing about the alleged manipulations and confirming them for himself, Schrag said he knew he had to alert the journals and ask for retractions. \u201cI think there is a time to stand up and say \u2018Yep, even though it\u2019s somebody I really care about, we can\u2019t have this in our business,\u2019\u201d he said.<\/p>\n
Regardless of the debates over how important the Lesn\u00e9 study has been to Alzheimer\u2019s research, the tampered images and lack of closure to Nature\u2019s investigation became, to many, emblematic of just how damaged science has become.\u00a0<\/p>\n
The matter finally came to a head in mid-2024. In May, Ashe posted a response to Schrag\u2019s June 2023 analysis of a replication study she conducted. She acknowledged the \u201cmisrepresentation of data,\u201d but also maintained her conviction that experiments she and colleagues had conducted and written up in a March 2024 paper had reproduced the main findings of the original work. A correction, rather than a retraction, would keep the scientific record accurate.<\/p>\n
Schrag, though, maintained that the new results did not support the original conclusion. Bik also called for a retraction on the simple grounds that the paper contained tampered work and was therefore unreliable, regardless of what the replication experiment had found. Finally, Ashe informed PubPeer that the editors at Nature had not agreed to the correction and therefore she and all other authors except Lesn\u00e9 had decided to retract the 2006 paper.<\/p>\n
On June 24, 2024, about two and a half years after the first concerns appeared on PubPeer, Nature retracted the study. Undark asked representatives at Nature about this time frame. In an email that Michael Stacey, head of communications for journals with Springer Nature Group asked to be attributed to a spokesperson, he wrote: \u201cOur investigations follow an established process, which involves consultation with the authors and, where appropriate, seeking independent advice from peer reviewers and other external experts. Other factors, such as awaiting the outcome of institutional investigations, where appropriate, can also impact the length of time an investigation takes.\u201d The University of Minnesota, meanwhile, concluded its own review of the paper with no findings of research misconduct.<\/p>\n
Schrag believes that the amyloid cascade hypothesis would have faded from view long ago if science had more integrity. \u201cI think it\u2019s become much more of a political entity than a scientific one,\u201d he said.<\/p>\n
In January 2023, the FDA approved another amyloid-targeting drug, lecanemab, under its Accelerated Approval pathway. Study participants who took the drug for 18 months had moderately less cognitive decline compared to patients who took the placebo, according to the results published in Alzheimer\u2019s Research & Therapy in late 2022.<\/p>\n
But to Schrag, the entry of lecanemab onto the market underscored how dire it is that the field moves on from targeting amyloid beta, he said. The hypothesis, he said, is wrong. A growing number of researchers agree, though many \u2014 including Schrag \u2014 say that amyloid is probably one component of a disease with many contributing factors.\u00a0In January 2024, Biogen announced that it would stop developing and marketing aducanumab, the controversial 2021 approval, to focus its resources on lecanemab. In July 2024, the FDA approved donanemab, which also targets amyloid. Multiple patients on both the lecanemab and donanemab clinical trials experienced brain swelling or bleeding. Three patients on the lecanemab trial died.<\/p>\n
The sleuths have continued to flag issues with long upheld research. Toward the end of 2023, Schrag, Bik, Patrick, and Columbia University neuroscientist Mu Yang sent a lengthy dossier to the NIH detailing problems with the work of famed stroke researcher Berislav Zlokovic. Bik knows the complaint may not much yield much. After all, toward the end of 2023, CUNY halted its investigation of Hoau-Yan Wang, the Alzheimer\u2019s researcher who led many studies of simufilam. (CUNY would not comment on the status of its investigation \u2014 noting only that Wang is on administrative leave \u2014 though a federal grand jury indicted him this summer on charges of fabricating and falsifying data in grant applications.) And regarding the University of Minnesota\u2019s review of the 2006 Nature paper, a spokesperson told Undark that there were \u201cno findings of research misconduct pertaining to these figures,\u201d but could not share more detail due to state law.<\/p>\n
Asked about the university\u2019s conclusion, Bik was incredulous. \u201cI don\u2019t understand how you can come to that conclusion,\u201d she said. \u201cIn my professional opinion and that of several others, these photos have been altered.\u201d\u00a0Bik added that the findings seemed to signal that the issues surrounding the now-retracted paper were not \u201ca big deal.\u201d<\/p>\n
\u201cBut it was,\u201d she said. \u201cIt was a big deal.\u201d<\/p>\n
Still, the sleuths are tenacious in their cause. After gathering in Porto, Portugal, in July 2024, they are now planning a third summer summit in Krakow, Poland.<\/p>\n
UPDATE: This article has been updated to clarify the nature of allegations made by Purdue University biologist David Sanders regarding instances of potential image manipulation\u00a0in some articles by cancer researcher Carlo Croce.\n<\/p>\n
Jane Reza contributed reporting for this story.\n<\/p>\n
![](\"https:\/\/logs-01.loggly.com\/inputs\/4a05953f-1607-4284-825e-7df393822342.gif?postid=87875&title=The-Rise-of-the-Science-Sleuths\"\/)
<\/p>\n
![\"Print](\"https:\/\/cdn.printfriendly.com\/buttons\/print-button-gray.png\")
<\/div>\n<\/div>\n