Evaluation Bias

An Evaluation Bias is a systematic assessment-related cognitive bias that affects judgment accuracy in evaluation processes.

• AKA: Assessment Bias, Judgment Bias, Rating Bias.
• Context:
  • It can typically distort Evaluation Bias Scores through evaluation bias mechanisms.
  • It can typically affect Evaluation Bias Decisions via evaluation bias influences.
  • It can typically compromise Evaluation Bias Validity in evaluation bias assessments.
  • It can typically require Evaluation Bias Detection using evaluation bias tests.
  • It can typically necessitate Evaluation Bias Mitigation through evaluation bias corrections.
  • ...
  • It can often manifest Evaluation Bias Patterns across evaluation bias contexts.
  • It can often correlate with Evaluation Bias Factors in evaluation bias conditions.
  • It can often persist despite Evaluation Bias Awareness of evaluation bias presence.
  • It can often interact with Evaluation Bias Types creating evaluation bias compound effects.
  • ...
  • It can range from being a Subtle Evaluation Bias to being a Severe Evaluation Bias, depending on its evaluation bias magnitude.
  • It can range from being a Conscious Evaluation Bias to being an Unconscious Evaluation Bias, depending on its evaluation bias awareness level.
  • It can range from being a Individual Evaluation Bias to being a Systematic Evaluation Bias, depending on its evaluation bias scope.
  • It can range from being a Correctable Evaluation Bias to being a Persistent Evaluation Bias, depending on its evaluation bias mitigation resistance.
  • ...
  • It can be detected by Evaluation Bias Detection Methods using evaluation bias indicators.
  • It can be measured by Evaluation Bias Metrics through evaluation bias quantification.
  • It can be reduced by Evaluation Bias Mitigation Strategies with evaluation bias interventions.
  • It can be studied in Evaluation Bias Research containing evaluation bias analysis.
  • ...
• Examples:
  • Order-Based Evaluation Biases, such as:
    • Primacy Evaluation Bias favoring primacy evaluation bias first options.
    • Recency Evaluation Bias favoring recency evaluation bias last options.
    • Position Evaluation Bias affected by position evaluation bias presentation order.
  • Content-Based Evaluation Biases, such as:
    • Length Evaluation Bias correlating with length evaluation bias word count.
    • Complexity Evaluation Bias favoring complexity evaluation bias sophisticated content.
    • Familiarity Evaluation Bias preferring familiarity evaluation bias known patterns.
  • Evaluator-Based Evaluation Biases, such as:
    • Confirmation Evaluation Bias seeking confirmation evaluation bias supporting evidence.
    • Anchoring Evaluation Bias influenced by anchoring evaluation bias initial information.
    • LLM-as-Judge Evaluation Bias Type specific to llm-as-judge evaluation bias type ai systems.
  • ...
• Counter-Examples:
  • Random Error, which lacks evaluation bias systematicity.
  • Measurement Noise, which lacks evaluation bias directionality.
  • Sampling Variation, which lacks evaluation bias cognitive origin.
• See: Cognitive Bias, Systematic Bias, Assessment Error, Judgment Error, Bias, Evaluation Error, Rating Error.

---