COMMON MISTEAKS MISTAKES IN USING STATISTICS: Spotting and Avoiding Them

Introduction        Types of Mistakes        Suggestions        Resources        Table of Contents         About    Glossary    Blog



Inappropriately Designating a Factor as Fixed or Random 

In Analysis of Variance and some other methodologies, there are two types of factors: fixed effect and random effect. Which type is appropriate depends on the context of the problem, the questions of interest, and how the data is gathered. Here are the differences:

Fixed effect factor: Data has been gathered from all the levels of the factor that are of interest.

Example: The purpose of an experiment is to compare the effects of three specific dosages of a drug on the response. "Dosage" is the factor; the three specific dosages in the experiment are the levels; there is no intent to say anything about other dosages.


Random effect factor: The factor has many possible levels, interest is in all possible levels, but only a random sample of levels is included in the data.1

Example: A large manufacturer of widgets is interested in studying the effect of machine operator on the quality final product. The researcher selects a random sample of operators from the large number of operators at the various facilities that manufacture the widgets. The factor is "operator." The analysis will not estimate the effect of each of the operators in the sample, but will instead estimate the variability attributable to the factor "operator".

The analysis of the data is different, depending on whether the factor is treated as fixed or as random. Consequently, inferences may be incorrect if the factor is classified inappropriately. Mistakes in classification are most likely to occur when there  is more than one factor in the study.

Example: Two surgical  procedures are being compared. Patients are randomized to treatment. Five different surgical teams are used. To prevent possible confounding of treatment and surgical team, each team is trained in both procedures, and each team performs equal numbers of surgery of each of the two types. Since the purpose of the experiment is to compare the procedures, the intent is to generalize to other surgical teams. Thus surgical team should be considered as a random factor, not a fixed factor.

Comments:

Additional Comments about Fixed and Random Factors


1. Usage of "random" in this and similar contexts in not uniform. For example, some authors, in discussing hierarchical (multilevel) analysis, may refer to an intercept as "random" when interest is restricted to a finite population with all members present in the data (e.g., the various states of the U. S. A.), but the intercept is allowed to be different for different members of the population. Using the term "variable intercept" can help emphasize that, although the intercept is allowed to vary, interest is only in the finite population, with no implication of inference beyond that population.

Last updated Jan 20, 2013