The consistency of a research method—whether it produces similar results when repeated under the same conditions. About precision, not accuracy. A method can be reliable without being valid.
Definition: The consistency of a research method—whether it produces similar results when repeated under the same conditions. About precision, not accuracy. A method can be reliable without being valid.
Reliability refers to the consistency of a research method. A reliable method produces similar results if repeated under the same conditions. It is about precision: are your measurements consistent and free from random error?
A method can be reliable without being valid—this is a crucial concept:
If your method consistently produces the same answer, it is reliable. But if that answer is consistently wrong, you have reliability without validity. Your darts cluster in the same spot, but it is not the center of the target.
Unreliable methods produce random noise. If the same study run twice gives wildly different results, you cannot trust either outcome. Reliability is the foundation—without it, you cannot even begin to assess validity.
Reliability comes from standardization:
The question to ask: "If someone else ran this study following my protocol, would they get similar results?" If yes, your method is reliable.
Whether a research method measures what it claims to measure. About accuracy, not precision. A method can be reliable (consistent) but not valid (accurate) if it consistently measures the wrong thing.
The degree to which research findings are independent of who conducts the study. If two researchers follow the same protocol and get different results, you have an objectivity problem.
Consistent, predictable bias that skews results in a known direction. Manageable because you can account for it in interpretation—far better than random, unsystematic error.
Systematic deviation from the true value in research findings. Cannot be eliminated, only managed through standardization and awareness. The goal is systematic bias (manageable) over unsystematic bias (chaos).
This term is referenced in the following articles:
Validity is not one thing. It is a family of concepts, each addressing a different way your research can go wrong. A comprehensive guide to study design validity, measurement validity, qualitative trustworthiness, and modern unified frameworks.
Standardized measurement instruments provide benchmarks and comparability. But using them effectively requires understanding what each one actually measures, and what it does not.
You will always introduce bias into your research, that is unavoidable. The goal is not elimination but management. Understanding the difference between systematic and unsystematic error is what makes findings trustworthy.