April 23, 2021

What is Evidenced-Based Medicine?

With the growth of the Internet, we are flooded with information about attention deficit hyperactivity disorder from many sources, most of which aim to provide useful and compelling "facts" about the disorder.  But, for the cautious reader, separating fact from opinion can be difficult when writers have not spelled out how they have come to decide that the information they present is factual. 

My blog has several guidelines to reassure readers that the information they read about ADHD is up-to-date and dependable. They are as follows:

Nearly all the information presented is based on peer-reviewed publications in the scientific literature about ADHD. "Peer-reviewed" means that other scientists read the article and made suggestions for changes and approved that it was of sufficient quality for publication. I say "nearly all" because in some cases I've used books or other information published by colleagues who have a reputation for high-quality science.

When expressing certainty about putative facts, I am guided by the principles of evidence-based medicine, which recognizes that the degree to which we can be certain about the truth of scientific statements depends on several features of the scientific papers used to justify the statements, such as the number of studies available and the quality of the individual studies. For example, compare these two types of studies.  One study gives drug X to 10 ADHD patients and reported that 7 improved.  Another gave drug Y to 100 patients and a placebo to 100 other patients and used statistics to show that the rate of improvement was significantly greater in the drug-treated group. The second study is much better and much larger, so we should be more confident in its conclusions. The rules of evidence are fairly complex and can be viewed at the Oxford Center for Evidenced Based Medicine (OCEBM;http://www.cebm.net/).


The evidenced-based approach incorporates two types of information: a) the quality of the evidence and b) the magnitude of the treatment effect. The OCEBM levels of evidence quality are defined as follows (higher numbers are better:

  1. Mechanism-based reasoning.  For example, some data suggest that oxidative stress leads to ADHD, and we know that omega-3 fatty acids reduce oxidative stress. So there is a reasonable mechanism whereby omega-3 therapy might help ADHD people.
  2. Studies of one or a few people without a control group, or studies that compare treated patients to those that were not treated in the past.

Non-randomized, controlled studies.    In these studies, the treatment group is compared to a group that receives a placebo treatment, which is a fake treatment not expected to work.  

  1. Non-randomized means that the comparison might be confounded by having placed different types of patients in the treatment and control groups.
  2. A single randomized trial.  This type of study is not confounded.
  3. Systematic review and meta-analysis of randomized trials. This means that many randomized trials have been completed and someone has combined them to reach a more accurate conclusion.

It is possible to have high-quality evidence proving that a treatment works but the treatment might not work very well. So it is important to consider the magnitude of the treatment effect, also called the "effect size" by statisticians. For ADHD, it is easiest to think about ranking treatments on a ten-point scale. The stimulant medications have a quality rating of 5 and also have the strongest magnitude of effect, about 9 or 10.Omega-3 fatty acid supplementation 'works' with a quality rating of 5, but the score for the magnitude of the effect is only 2, so it doesn't work very well. We have to take into account patient or parent preferences, comorbid conditions, prior response to treatment, and other issues when choosing a treatment for a specific patient, but we can only use an evidence-based approach when deciding which treatments are well-supported as helpful for a disorder.

Related posts

No items found.

Population Study Links ADHD Medication with Reduced Criminality, Suicides, Automotive Crashes, Substance Abuse

Many studies have shown that ADHD is associated with increased risks of suicidal behavior, substance misuse, injuries, and criminality. As we often discuss in our blogs, treatments for ADHD include medication and non-medication options, such as CBT (Cognitive Behavioral Therapy). While non-drug approaches are often used for young children or mild cases of ADHD, medications – both stimulants and non-stimulants – are common for adolescents and adults. 

Global prescriptions for ADHD drugs have risen significantly in recent years, raising questions about their safety and effectiveness. Randomized controlled trials have demonstrated that medication can help reduce the core symptoms of ADHD. However, research from these trials still offers limited or inconclusive insights into wider and more significant clinical outcomes, such as suicidal behavior and substance use disorder.

An international study team conducted a nationwide population study using the Swedish national registers. Sweden has a single-payer national health insurance system, which covers nearly every resident, enabling such studies. The researchers examined all Swedish residents aged 6 to 64 who received their first ADHD diagnosis between 2007 and 2018. Analyses of criminal behavior and transport accidents focused on a subgroup aged 15 to 64, since individuals in Sweden must be at least 15 years old to be legally accountable for crimes or to drive.

The team controlled for confounding factors, including demographics (age at ADHD diagnosis, calendar year, sex, country of birth, highest education (using parental education for those under 25), psychiatric and physical diagnoses, dispensations of psychotropic drugs, and health care use (outpatient visits and hospital admissions for both psychiatric and non-psychiatric reasons).

Time-varying covariates from the previous month covered diagnoses, medication dispensations, and healthcare use. During the study, ADHD treatments licensed in Sweden included amphetamine, atomoxetine, dexamphetamine, guanfacine, lisdexamphetamine, and methylphenidate.

After accounting for covariates, individuals diagnosed with ADHD who received medication treatment showed better outcomes than those who did not. Specifically:

-Suicidal behaviors dropped by roughly 15% in both first-time and recurrent cases.

-Initial criminal activity decreased by 13%, with repeated offences falling by 25%.

-Substance abuse initiation declined by 15%, while recurring substance abuse was reduced

by 25%.

-First automotive crashes were down 12%, and subsequent crashes fell by 16%.

There was no notable reduction in first-time accidental injuries, and only a marginally significant 4% decrease in repeated injuries.

The team concluded, “Drug treatment for ADHD was associated with beneficial effects in reducing the risks of suicidal behaviours, substance misuse, transport accidents, and criminality, but not accidental injuries when considering first event rate. The risk reductions were more pronounced for recurrent events, with reduced rates for all five outcomes.”

Meta-analysis of Non-invasive Brain Stimulation Finds Limited Evidence of Efficacy

Background: 

Pharmacotherapies, such as methylphenidate, are highly effective for short-term ADHD management, but issues remain with medication tolerability and adherence. Some patients experience unwanted side effects from stimulant medications, leaving them searching for alternative ADHD treatments. Alternative treatments such as cognitive training, behavioral therapies, psychological interventions, neurofeedback, and dietary changes have, so far, shown limited success. Thus, there is a critical need for non-pharmacological options that boost neurocognitive performance and address core ADHD symptoms.

First— What Are NIBS (Non-Invasive Brain Stimulation) Techniques?

Non-invasive brain stimulation (NIBS) techniques, including transcranial direct current stimulation (tDCS), transcranial random noise stimulation (tRNS), transcranial alternating current stimulation (tACS), and repetitive transcranial magnetic stimulation (rTMS) are generating growing attention within the scientific community. 

NIBS techniques are methods that use external stimulation, such as magnets or electrical currents, to affect brain activity without any invasive procedures. In transcranial alternating current stimulation (tACS), for example, small electrodes are placed on the scalp of the patient, and a weak electrical current is administered. 

The theory behind these techniques is that when a direct current is applied between two or more electrodes placed on specific areas of the head, it makes certain neurons more or less likely to fire. This technique has been successfully used to treat conditions like depression and anxiety, and to aid recovery from stroke or brain injury. 

The Study: 

Previous meta-analyses have produced conflicting indications of efficacy. A Chinese research team consisting of sports and rehabilitative medicine professionals has just published a network meta-analysis to explore this further, through direct comparison of five critical outcome domains: inhibitory control, working memory, cognitive flexibility, inattention, hyperactivity and impulsivity.

To be included, randomized controlled trials needed to have participants diagnosed with ADHD, use sham control groups, and assess ADHD symptoms and executive functions – such as inhibitory control, working memory, cognitive flexibility, inattention, hyperactivity, and impulsivity – using standardized tests.

A total of thirty-seven studies encompassing 1,615 participants satisfied the inclusion criteria. It is worth noting, however, that the authors did not specify the number of randomized controlled trials nor the number of participants included in each arm of the network meta-analysis.

Furthermore, the team stated, “We checked for potential small study effects and publication bias by conducting comparison-adjusted funnel plots,” but did not share their findings. They also did not provide information on outcome variation (heterogeneity) among the RCTs.

Results:

Ultimately, none of the interventions produced significant improvements in ADHD symptoms, whether in inattention symptoms or hyperactivity/impulsivity symptoms.  Likewise, none of the interventions produced significant improvements in inhibitory control. Some tDCS interventions enhanced working memory and cognitive flexibility, but details about trial numbers and participants were missing. The team concluded, “none of the NIBS interventions significantly improved inhibitory control compared to sham controls. … In terms of working memory, anodal tDCS over the left DLPFC plus cathodal tDCS over the right DLPFC … and anodal tDCS over the right inferior frontal cortex (rIFC) plus cathodal tDCS over the right supraorbital area ... were associated with significant improvements compared to sham stimulation. For cognitive flexibility, only anodal tDCS over the left DLPFC plus cathodal tDCS over the right supraorbital area demonstrated a statistically significant benefit relative to sham. ... Compared to the sham controls, none of the NIBS interventions significantly improved inattention. ... Compared to the sham controls, none of the NIBS interventions significantly improved hyperactivity and impulsivity.”

How Should We Interpret These Results?

In a word, skeptically.

If one were to read just the study’s abstract, which states, “The dual-tDCS and a-tDCS may be considered among the preferred NIBS interventions for improving cognitive function in ADHD”, it might seem that the takeaway from this study is that this combination of brain stimulation techniques might be a viable treatment option for those with ADHD. Upon closer inspection, however, the results do not suggest that any of these methods significantly improve ADHD symptoms. Additionally, this study suffers from quite a few methodological flaws, so any results should be viewed critically.

October 31, 2025

Meta-analysis of Transcranial Direct Current Stimulation Still Yields Little Sign of Efficacy

Background:

Despite recommendations for combined pharmacological and behavioral treatment in childhood ADHD, caregivers may avoid these options due to concerns about side effects or the stigma that still surrounds stimulant medications. Alternatives like psychosocial interventions and environmental changes are limited by questionable effectiveness for many patients. Increasingly, patients and caregivers are seeking other therapies, such as neuromodulation – particularly transcranial direct current stimulation (tDCS). 

tDCS seeks to enhance neurocognitive function by modulating cognitive control circuits with low-intensity scalp currents. There is also evidence that tDCS can induce neuroplasticity. However, results for ADHD symptom improvement in children and adolescents are inconsistent. 

The Method:

To examine the evidence more rigorously, a Taiwanese research team conducted a systematic search focusing exclusively on randomized controlled trials (RCTs) that tested tDCS in children and adolescents diagnosed with ADHD. They included only studies that used sham-tDCS as a control condition – an essential design feature that prevents participants from knowing whether they received the active treatment, thereby controlling for placebo effects. 

The Results:

Meta-analysis of five studies combining 141 participants found no improvement in ADHD symptoms for tDCS over sham-TDCS. That held true for both the right and left prefrontal cortex. There was no sign of publication bias, nor of variation (heterogeneity) in outcomes among the RCTs.  

Meta-analysis of six studies totaling 171 participants likewise found no improvement in inattention symptoms, hyperactivity symptoms, or impulsivity symptoms for tDCS over sham-TDCS. Again, this held true for both the right and left prefrontal cortex, and there was no sign of either publication bias or heterogeneity. 

Most of the RCTs also performed follow-ups roughly a month after treatment, on the theory that induced neuroplasticity could lead to later improvements. 

Meta-analysis of four RCTs combining 118 participants found no significant improvement in ADHD symptoms for tDCS over sham-TDCS at follow-up. This held true for both the right and left prefrontal cortex, with no sign of either publication bias or heterogeneity. 

Meta-analysis of five studies totaling 148 participants likewise found no improvement in inattention symptoms or hyperactivity symptoms for tDCS over sham-TDCS at follow-up. AS before, this was true for both the right and left prefrontal cortex, with no sign of either publication bias or heterogeneity. 

The only positive results came from meta-analysis of the same five studies, which reported a medium effect size improvement in impulsivity symptoms at follow-up. Closer examination showed no improvement from stimulation of the right prefrontal cortex, but a large effect size improvement from stimulation of the left prefrontal cortex

Interpretation: 

It is important to note that the one positive result was from three RCTs combining only 90 children and adolescents, a small sample size. Moreover, when only one of sixteen combinations yields a positive outcome, that begins to look like p-hacking for a positive result. 

In research, scientists use something called a “p-value” to determine if their findings are real or just due to chance. A p-value below 0.05 (or 5%) is considered “statistically significant,” meaning there's less than a 5% chance the result happened by pure luck. 

When testing twenty outcomes by this standard, one would expect one to test positive by chance even if there is no underlying association. In this case, one in 16 comes awfully close to that. 

To be sure, the research team straightforwardly reported all sixteen outcomes, but offered an arguably over-positive spin in their conclusion: “Our study only showed tDCS-associated impulsivity improvement in children/adolescents with ADHD during follow-ups and anode placement on the left PFC. ... our findings based on a limited number of available trials warrant further verification from large-scale clinical investigations.” 

October 24, 2025