dmspilot said:
You've used this paper to conclude that there is "mixed" evidence to support mask wearing.
You use the word "mixed" while the authors use the word "strongly":
"...fluid dynamics of aerosol spread and international epidemiologic data summarized in this review already strongly support the hypothesis that masks are likely to be effective..."
They're not vague statements, they are being scientifically precise by noting the limitations involved.
That's right. You need to read the whole paper so you can pick up on a few words such as "seem" and use them as an excuse to flip the meaning of the entire paper and make it "seem" like it's concluding the opposite of what it actually is.
I think the authors are being precise by using "may substantially reduce" and "seem to outweigh" in their summary points. This is much weaker than what they could have said. The reason they may have chosen that wording rather than saying simply "substantially reduce" and "outweigh" is that they may recognize that the results of all the randomized trials that are available do not support this idea. And they recognize that observational studies are subject to potential large confounds, especially when looking at small effects. And in-vitro studies on particle dynamics do not account for things like fickle human behavior which occurs in actual populations.
So let's look at the actual evidence which they are dealing with, and as summarized in my initial OP:
In-vitro studies of droplet dynamics: Some fairly good reasons to think that masks interfere with transmission of respiratory droplets of the appropriate size if worn properly. Less clear about droplets when actually worn by people.
Observational studies: Some, such as Lyu & Wehby, have shown an apparent small reduction in R0, which if due to masking, could add up to a sizeable reduction in cases. But attributing causation to such small effect sizes is always tricky and one is often detecting an effect, but due to some other confound.
Randomized trials: The Danmask-19 study shows no significant effect. Interpreted as point estimate, it suggests a modest reduction of 15% however there is also a 25% chance it may have resulted in an increase in cases. Older studies of flu transmission also failed to show a significant reduction in transmission when people wore surgical masks.
It is hard to reconcile all this. It does not point to a consistent story. The randomized trials are the gold standard in clinical work for a reason -- because they avoid the problems with confounds of the observational studies and account for actual human behavior. They should be weighted more heavily in an objective evaluation than other evidence.
It is possible that given droplet dynamics that there is a source effect even though there is no noticeable effect for the wearer. Seems a stretch to me, but it is possible.
I will also note that a similar situation, some nice theory and some strongly suggestive observational work but a failure in actual randomized trials is a common outcome for proposed new treatments in medicine. Happens all the time.
Given that overall, I think "mixed" is a good description. 1/3 of the main categories of data, and the more reliable third, does not support the hypothesis that the general public wearing cloth masks slows the spread of Covid-19. The use of the word "strongly" by the authors pertained only to the other less reliable 2/3. "mixed" is also a good description of the conclusions of prior reviews looking at the effect of masks on transmission (listed on my medical interest page - they were basically 50/50 on whether a recommendation for the general public to wear cloth masks was merited), though these did not include Lyu & Wehby or Bundgaard et al. as they were not yet published.
Now if you want, we can go through and look at the specific randomized and observational studies and evaluate the strength of evidence of each, to see if "mixed" is a good description overall. That could be interesting.
Quibbling over the meaning of "may substantially reduce" versus "substantially reduce" and "seem to outweigh" versus "outweigh" and "mixed" in a brief summary versus one statement containing "clearly" in an entire paper is a perhaps interesting semantic exercise (and I understand you are an attorney so may enjoy that sort of thing) but is considerably less informative of the science than really looking at the data and analyses.
If you are truly interested in the scientific issue, let's examine those studies. You may not like my word choices in one sentence of a brief summary -- so be it. I will not be commenting further on these word choices here.