Objectivity
The degree to which research findings are independent of who conducts the study. If two researchers follow the same protocol and get different results, you have an objectivity problem.
Definition: The degree to which research findings are independent of who conducts the study. If two researchers follow the same protocol and get different results, you have an objectivity problem.
Objectivity means your research findings should not depend on who runs the study. A different moderator, analyst, or evaluator following the same protocol should arrive at the same conclusions.
The Three Levels
- Execution objectivity: Two moderators running the same test protocol should collect comparable data. This requires standardized scripts, consistent task instructions, and controlled moderator behavior
- Analysis objectivity: Two analysts reviewing the same data should reach the same findings. Structured coding frameworks and clear criteria make this possible; unstructured "gut feeling" analysis does not
- Interpretation objectivity: Two stakeholders reading the same report should draw the same conclusions. This depends on how clearly you present evidence and separate findings from recommendations
Why Perfect Objectivity Is Impossible
All research involves human judgment. You decide which quotes to highlight, how to categorize observations, and what counts as a "significant" pattern. These decisions are inherently subjective.
The practical goal is not eliminating subjectivity but making it transparent and manageable. Document your decisions. Use standardized scoring criteria. Have multiple people code the same data and measure agreement.
The Relationship to Reliability
Objectivity is a prerequisite for reliability. If your results depend on who collected them, they cannot be consistent across repeated measurements. When inter-rater agreement is low, fix your protocol before trusting your data.
Related Terms
Reliability
The consistency of a research method—whether it produces similar results when repeated under the same conditions. About precision, not accuracy. A method can be reliable without being valid.
Validity
Whether a research method measures what it claims to measure. About accuracy, not precision. A method can be reliable (consistent) but not valid (accurate) if it consistently measures the wrong thing.
Bias
Systematic deviation from the true value in research findings. Cannot be eliminated, only managed through standardization and awareness. The goal is systematic bias (manageable) over unsystematic bias (chaos).