Consistent, predictable bias that skews results in a known direction. Manageable because you can account for it in interpretation—far better than random, unsystematic error.
Definition: Consistent, predictable bias that skews results in a known direction. Manageable because you can account for it in interpretation—far better than random, unsystematic error.
Systematic Error occurs when your research method consistently skews results in a specific, predictable direction. Your findings show a pattern, but you know that pattern has been shifted by your research decisions.
Imagine the bullseye represents the true insight you are trying to find:
Systematic error is far better than unsystematic error. Because you know where the bias comes from (for example, you only interviewed existing happy customers), you can:
You found a consistent pattern. It is shifted, but it is still a pattern you can reason about.
Unsystematic error—random inconsistency with no pattern—produces data that is effectively useless. You cannot know where the truth lies because there is no consistency to interpret.
This leads to a clear hierarchy: no error is best, but systematic error is far better than unsystematic error. Your primary job is to fight inconsistency through standardization.
Random variation in research data caused by unpredictable factors—participant mood, ambient noise, time of day. Unlike systematic error, it averages out with sufficient sample size.
Systematic deviation from the true value in research findings. Cannot be eliminated, only managed through standardization and awareness. The goal is systematic bias (manageable) over unsystematic bias (chaos).
The consistency of a research method—whether it produces similar results when repeated under the same conditions. About precision, not accuracy. A method can be reliable without being valid.
Whether a research method measures what it claims to measure. About accuracy, not precision. A method can be reliable (consistent) but not valid (accurate) if it consistently measures the wrong thing.
This term is referenced in the following articles: