[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Cohen's Fallacy
Ruth,
Regarding your first question about the inverse association between smoking
and radon. This is the reference (that Jim Muckerheide said I made up) that
reports on the large inverse relationship (8th paragraph below). Dr. Cohen,
I looked for your reply to this correspondence to post, but I did not find
it.
COHEN'S PARADOX
http://www.lww.com/health_physics/0017-90789-99ltrs.html
Dear Editors:
WE APPRECIATE the opportunity to respond to Cohen's letter-to-the-editor
(Cohen 1999a) regarding our rejoinder (Field et al. 1998a). The rejoinder
focused on Cohen's attempts (Cohen 1995,1997) to test the Linear
No-Threshold Theory (LNTT) using ecologic data. In our initial publication
on this topic (Smith et al. 1998), we demonstrated that Cohen erroneously
used the wrong model to test the LNTT. We also demonstrated that when more
valid Iowa county lung cancer rates were regressed on Cohen's mean county
radon levels, the large negative associations Cohen noted between radon
concentrations, obtained from short-term radon measurements, and lung cancer
disappeared for Iowa. This letter addresses several important points that
Cohen either continues to ignore or continues to contest.
Cohen (1999a) continues to challenge scientists to suggest a plausible
explanation to explain the inverse relationship he notes between mean county
residential radon measurements and mean county lung cancer mortality rates.
We will call this inverse relationship "Cohen's Paradox." Cohen (1999a)
states that his challenge is for someone to suggest a "not implausible
model" as a possible explanation and that the burden of proof will be on him
to show that "the explanation is highly implausible." We maintain that even
if additional plausible models are offered, Cohen will likely not be able to
explain his own paradox. Cohen has not accepted the fact that it may be
impossible to explain Cohen's Paradox in definitive analytical terms with
his existing data because it is not always possible to identify empirical
sources of ecologic bias from aggregate (ecologic) data alone (Field et al.
1998a).
Cohen (1999a) states that he has not been able to explain the inverse
relationship (Cohen's Paradox) for his studies even with years of effort. We
are not surprised. Cohen (1999a) continues to miss the point made previously
(Greenland and Robins 1994; Smith et al. 1998; Field et al. 1998a) that
characterizing biases is often extremely difficult in ecologic studies of
geographic regions because of the high probability of interacting covariates
that may differ across these regions. Greenland and Morgenstern (1989) point
out that ecological control of a covariate contributing to ecologic bias
will usually be inadequate to remove the bias produced by the covariate even
in the absence of measurement error. Researchers (Greenland and Robins 1994;
Lubin 1998; Smith et al. 1998; Archer 1998; Goldsmith 1999) have already
presented very plausible theoretical examples of how Cohen's data can
produce incorrect and even contradictory risk estimates. Cohen has rejected
all of these examples.
Lagarde and Pershagen (1999) recently performed concurrent analyses on
individual and aggregated data from a nationwide case-control study of
residential radon and lung cancer in Sweden. The authors reported that the
results confirm that ecologic studies may be misleading in studies of weak
associations. So, are Cohen's negative point estimates a true effect or are
they attributable to bias? To move the explanation beyond the theoretical
level, analyses would require individual level data beyond the quality of
Cohen's aggregate data.
Cohen continues to maintain that his ecologic studies avoided the ecologic
fallacy, because he was testing the BEIR-IV LNTT model (Cohen
1997,1998,1999a). Cohen also continues to deny our assertion (Smith et al.
1998; Field et al. 1998a) that he was not testing the BEIR-IV LNTT model. As
we stated (Smith et al 1998; Field et al. 1998a), Cohen's risk model is not
the BEIR-IV risk model. Cohen attempted to equate his derived LNTT model to
the BEIR-IV model by applying unsupported primary and secondary rigid
assumptions. The assumptions all have both an error associated with them and
a non-linear component, which as previously pointed out, cannot be
quantitatively described. Rather than providing references to support the
validity of his assumptions, Cohen defends his use of these assumptions
(Cohen 1999a) by stating that they are the same assumptions as used in
essentially all case-control studies.
All epidemiologic study designs have their own set of limitations. In fact,
we have pointed out that inadequate measurement data can affect the validity
of case-control studies as well as ecologic studies (Field et al.
1996,1997). The limitations and assumptions of radon case-control
epidemiologic studies, which use individual rather than ecologic data, have
been presented elsewhere (Lubin et al. 1990; Field et al 1996). However, the
nature of potential biases inherent in case-control studies is often quite
different from an ecologic study. For example, case-control studies are not
subject to cross-level bias. While case-control studies have their own
inherent limitations, controlling for potential confounders in a
well-designed case-control study is much easier than dealing with
confounders in an ecologic study.
Many of the assumptions used by Cohen in his ecologic study design are not
required for the case-control study design. For example, Cohen's ecologic
studies assumed that smoking duration and intensity are the same for each
individual within a specified region. Unlike ecologic studies, case-control
studies collect data at the individual level so that detailed smoking
histories can be available to use for adjustments.
We previously showed (Smith et al. 1998) that when Cohen's adjusted smoking
percentages for males and females were regressed on radon levels,
significant (p < 0.00001) negative associations between smoking and radon
were noted for both males and females. In addition, when we (Smith et al.
1998) repeated the regression of lung cancer mortality rates on Cohen's
adjusted smoking percentages, the resulting R2 values indicated that Cohen's
smoking summary data explained very little (23.7% for females; 34.5% for
males) of the variation in lung cancer mortality rates. It is not surprising
Cohen cannot control for these risk factors using aggregate data. In
addition, Cohen's ecologic studies make numerous other assumptions not
required for newer case-control designs (Field et al. 1996).
Cohen (1999a) continues to offer explanations for how the conclusions of
other published ecologic studies can be wrong. We (Field et al. 1998a)
offered the large scale ecologic study by Menotti et al. (1997) as an
example of an inverse relationship between average blood pressure and stroke
mortality rates. Cohen did not have actual data from the study (Menotti et
al. 1997) and therefore could not attempt to explain the paradoxical finding
in definitive analytical terms. However, we would be interested in Cohen's
definitive analytical explanation for why the large negative associations
disappeared for the Iowa data when we regressed the more valid county lung
cancer rates for Iowa on Cohen's own mean county radon levels for Iowa
(Smith et al. 1998).
As we mentioned previously, Iowa serves as an ideal site for a radon
epidemiologic study because it possesses the highest mean radon
concentrations in the United States (White et al. 1992), a population with
low mobility, and a quality cancer registry (Field et al. 1996). In
addition, because of the large number of counties in Iowa (99), Iowa data
provide a finer ecologic breakdown per percent population compared to much
of the rest of the U.S. data set assembled by Cohen. Cohen offers to provide
specific quantitative explanations for why other ecologic studies can give
false results, but he has yet to provide a persuasive argument for our
findings in Iowa (Smith et al. 1998), which predominantly use his aggregate
data.
Cohen (1999b) states, "I have never claimed that our studies support
hormesis, since such an interpretation suffers from the ecologic fallacy."
We agree with that claim by Cohen. However, Cohen has not provided
persuasive evidence to show that his test of the LNTT also does not suffer
from the ecologic fallacy. Cohen attempts to test the LNTT by analyzing
averaged multivariate distributions of aggregate data, followed by analyses
using more county level summaries to correct the potential biases. Because
of the heterogeneity within the county summaries, the aggregate data provide
very little confounder control, especially in the presence of non-linear
dependencies (Field et al. 1998b) and interactions (Greenland and Robins
1994). It is a fallacy to think that Cohen's inferences made from aggregate
level data can be applied to individual level exposure-response
relationships, especially when Cohen is not even testing the BEIR-IV
formula.
Piantadosi (1994) pointed out that "a single result at odds with theory
should not discredit the theory unless the source of data and analysis meet
the most rigorous methodological criteria." Cohen's data, assumptions, and
study design failed to fulfill these criteria. Nobel Laureate, Sir Peter
Medawar (1979) wrote, "I cannot give any scientist of any age better advice
than this: the intensity of the conviction that a hypothesis is true has no
bearing on whether it is true or not. The importance of the strength of our
conviction is only to provide a proportionately strong incentive to find out
if the hypothesis will stand up to critical evaluation." Time will tell if
the LNTT will stand up to critical evaluation or fall. Nevertheless, we
oppose the critical evaluation taking the form of an ecologic study.
R. William Field
Brian J. Smith
Charles F. Lynch
College of Public Health
Department of Epidemiology
N222 Oakdale Hall
University of Iowa
Iowa City, IA 52242
References
1. Archer, V. E. Cohen's home radon-lung cancer data suggests positive
association. Health Physics Society Newsletter June 1998.
2. Cohen, B. L. Test of the linear no-threshold theory of radiation
carcinogenesis for inhaled radon decay products. Health Phys. 68:157-174;
1995.
3. Cohen, B. L. Lung cancer rate vs. mean radon levels in U.S. counties of
various characteristics. Health Phys. 72:114-119; 1997.
4. Cohen, B. L. Response to criticisms of Smith, Field, and Lynch. Health
Phys. 75:23-28; 1998.
5. Cohen, B. L. Response to "Rejoinder" by Field et al. Health Phys.
76:439-440; 1999a.
6. Cohen, B. L. Comment on letter by Straja and Moghissi. 76:318; 1999b.
7. Field, R. W.; Steck, D. J.; Lynch, C. F.; Brus, C. P.; Neuberger, J. S.;
Kross, B. C. Residential radon-222 exposure and lung cancer: exposure
assessment methodology. J. Exposure Analysis and Environmental Epidemiology
6:181-195; 1996.
8. Field, R. W.; Steck, D. J.; Neuberger, J. S. Accounting for random error
in radon exposure assessment. Health Phys. 73:272-273; 1997.
9. Field, R. W.; Smith, B. J.; Lynch, C. F. Ecologic bias revisited, a
rejoinder to Cohen's response to "Residential 222Rn exposure and lung
cancer: testing the linear no-threshold theory with ecologic data". Health
Phys. 75:31-33; 1998a.
10. Field, R. W.; Smith, B. J.; Brus, C. P.; Lynch, C. F.; Neuberger, J. S.;
Steck, D. J. Retrospective temporal and spatial mobility of adult Iowa
women. Risk Analysis: An International Journal 18:575-584; 1998b.
11. Goldsmith, J. R. The residential radon-lung cancer association in U.S.
counties: a commentary. Health Phys. 76:553-557; 1999.
12. Greenland, S.; Morgenstern, H. Ecological bias, confounding, and effect
modification. International J. Epidemiol. 18:269-274; 1989.
13. Greenland, S.; Robins, J. Invited commentary: ecologic studies-biases,
misconceptions, and counterexamples. Am. J. Epidemiol. 139:747-760; 1994.
14. Lagarde, F.; Pershagen, G. Parallel analyses of individual and ecologic
data on residential radon, cofactors, and lung cancer in Sweden. Am. J.
Epidemiol. 149:28-274; 1999.
15. Lubin, J. H.; Samet, J. M.; Weinberg, C. Design issues in epidemiologic
studies of indoor exposure to radon and risk of lung cancer. Health Phys.
59:807-817; 1990.
16. Lubin, J. H. On the discrepancy between epidemiologic studies in
individuals of lung cancer and residential radon and Cohen's ecologic
regression. Health Phys. 75:4-10; 1998.
17. Medawar, P. B. Advice to a young scientist. Reading, MA: Basic Books, A
Subsidiary of Perseus Books, L.L.C.; 1979.
18. Menotti, A.; Blackburn, H.; Kromhout, D.; Nissinen, A.; Karvonen, M.;
Aravanis, C.; Anastasios, D.; Fidanza, F.; Giampaoli, S. The inverse
relation of average blood pressure and stroke mortality rates in the seven
countries study: A paradox. European J. Epidemiol. 13:379-386; 1997.
19. Piantadosi, S. Invited commentary; Ecologic biases. Am. J. Epidemiol.
139:761-764; 1994.
20. Smith, B. J.; Field, R. W.; Lynch, C. F. Residential 222Rn exposure and
lung cancer: testing the linear no-threshold theory with ecologic data.
Health Phys. 75:11-17; 1998.
21. White, S. B.; Bergsten, J. W.; Alexander, B. V.; Rodman, N. F.;
Phillips, J. L. Indoor 222Rn concentrations in a probability sample of
43,000 houses across 30 states. Health Phys. 62:41-50; 1992.
_________________________________________________________________
Get your FREE download of MSN Explorer at http://explorer.msn.com/intl.asp.
************************************************************************
You are currently subscribed to the Radsafe mailing list. To unsubscribe,
send an e-mail to Majordomo@list.vanderbilt.edu Put the text "unsubscribe
radsafe" (no quote marks) in the body of the e-mail, with no subject line. You can view the Radsafe archives at http://www.vanderbilt.edu/radsafe/