Risk managers often see ESG rating disagreements as signs of market dysfunction. You might commission reports from multiple providers, find their scores diverging by 20 or 30 points, and conclude the market is flawed. However, you're measuring the wrong thing.
The real issue is deeper than inconsistency. ESG rating providers make strategic choices that limit the information available to you, especially when comprehensive coverage is most needed. Understanding why this happens and how to address it can transform your ESG risk assessment framework.
Why These Mistakes Keep Happening
ESG rating providers face a resource allocation challenge you might not notice. They can either specialize in a narrow set of categories, like climate risk or board diversity, and offer detailed assessments, or generalize across all ESG dimensions, providing less precise information. When two providers specialize in different areas, their ratings complement each other. When both generalize, they duplicate efforts and reduce total information.
Competition should encourage specialization, but it doesn't. If your investment policy requires favorable ratings across multiple ESG categories before committing capital, you inadvertently encourage generalization. A provider focusing solely on environmental performance has limited value alone; you need another provider's social performance rating to complete the picture. By covering both dimensions superficially, the provider makes its rating independently useful, even though this approach reduces overall information quality.
This dynamic intensifies as ESG considerations become more central to your investment decisions. Stronger demand for ESG information can lead to less informative ratings, a counterintuitive outcome that explains why your ESG risk program feels less robust as you expand it.
Mistake 1: Treating Rating Disagreement as Evidence of Dysfunction
Why it happens: You're trained to expect consistency. Credit ratings from different agencies correlate highly because they measure one dimension: default risk. ESG ratings cover unrelated categories. Environmental performance spans climate change, biodiversity loss, and pollution. Social performance includes human capital, product liability, and stakeholder relations. Each category contains further subcategories.
The consequence: You pressure providers for alignment or dismiss ESG ratings as unreliable. Research by Berg, Kölbel, and Rigobon attributes 38% of the discrepancy in category ratings among major ESG rating agencies to differences in the subcategories providers examine. This "scope divergence" reflects specialization, not measurement error.
The fix: Disaggregate the ratings. Don't compare headline ESG scores. Compare category-level assessments and document which subcategories each provider examines. If Provider A specializes in climate risk and water management while Provider B focuses on labor practices and supply chain governance, their overall scores will naturally diverge. That divergence provides complementary information. Map each provider's coverage to your material ESG risks and use specialized ratings where they exist, not generalized scores that average across dimensions you don't care about.
Mistake 2: Requiring Comprehensive ESG Coverage from Each Provider
Why it happens: Your investment policy states that portfolio companies must meet ESG thresholds across environmental, social, and governance dimensions. You translate this into a procurement requirement: every rating provider must assess all three pillars.
The consequence: You've eliminated the incentive for specialization. Providers know you won't pay for a rating that covers only environmental factors, even if that rating is more detailed and accurate than a generalized assessment. They respond by spreading resources across all categories, producing superficial coverage of each.
The fix: Restructure your procurement approach. Contract with multiple providers and explicitly assign different scopes. Designate one provider for environmental risk categories, another for social performance, and a third for governance structures. Pay each provider to go deep in their assigned domain rather than shallow across all domains. This requires integration work on your end, but you'll get materially better information. Document the methodology in your ESG risk assessment policy and explain to the board why you're using multiple specialized sources rather than one generalized vendor.
Mistake 3: Ignoring How Greenwashing Distorts the Rating Market Structure
Why it happens: You treat greenwashing as a disclosure problem: companies manipulate their sustainability reports, and rating providers fail to catch it. You focus on improving verification procedures at the provider level.
The consequence: Greenwashing operates through two channels, and you're only addressing one. The direct channel is obvious: manipulated disclosures make ratings less informative. The indirect channel is structural. As you become more skeptical of favorable ESG ratings, you require positive signals across multiple categories before investing. This reduces the value of a specialized rating on its own and pushes providers toward generalization, which reduces information quality across the market.
The fix: Address greenwashing at the corporate disclosure level, not just at the rating provider level. Push for third-party verification of sustainability metrics in your engagement with portfolio companies. Support regulatory initiatives that require audited ESG disclosures for material risks. When corporate disclosure improves, you can trust specialized ratings again, which restores the incentive for providers to specialize. In the interim, weight your ESG assessments toward categories with harder data, like energy consumption, and discount categories that rely on unverifiable forward-looking commitments.
Mistake 4: Advocating for ESG Rating Standardization
Why it happens: You've seen the credit rating market operate smoothly under standardized methodologies. Rating agencies use comparable approaches to assess default risk, and investors can meaningfully compare ratings across providers. You want the same for ESG.
The consequence: Standardization that goes beyond transparency reduces information diversity. If regulation pushes all providers toward common scopes, methodologies, and data sources, correlations among ratings will rise, but you'll lose the benefit of different providers investigating different dimensions. The market will converge on a consensus view that may miss material risks no one is examining.
The fix: Distinguish between transparency and standardization. Support transparency requirements: providers should disclose which categories they assess, how they weight them, what data sources they use, and how they handle missing information. Oppose standardization mandates that require all providers to use the same scope or methodology. Your risk assessment benefits from methodological diversity. When you understand what each provider measures and how, you can combine their insights intelligently. When they all measure the same thing the same way, you've just bought the same rating multiple times.
Mistake 5: Building Investment Policies That Require ESG Scores Above Arbitrary Thresholds
Why it happens: Your investment policy states that portfolio companies must achieve an ESG rating of 70 or above (on a 100-point scale) to qualify for investment. This feels rigorous and defensible to the board.
The consequence: You've created a binary gate that rewards generalization. A company with exceptional environmental performance (score: 95) but mediocre social performance (score: 60) gets rejected, even though the environmental risk may be material to your portfolio and the social risk may not be. Rating providers respond by offering generalized scores that smooth over category-level variation, because that's what your policy demands.
The fix: Rewrite your investment policy to focus on material ESG risks, not aggregate scores. Identify which ESG categories matter for each sector or asset class. For a utility company, climate risk and environmental compliance are material; product liability and supply chain labor practices are not. Require high performance on material categories and set no threshold for immaterial ones. This approach lets you use specialized ratings where they exist and forces your investment team to articulate why specific ESG risks matter, rather than hiding behind a single number.
Prevention Checklist
- Map each ESG rating provider's coverage to your material risk categories; don't rely on headline scores
- Contract with multiple providers and assign different scopes rather than requiring comprehensive coverage from each
- Disaggregate overall ESG scores into category-level assessments before comparing across providers
- Weight your analysis toward ESG categories with verifiable, quantitative data; discount categories that rely on unverifiable commitments
- Support corporate disclosure improvements and third-party verification requirements to reduce greenwashing
- Advocate for transparency requirements (disclosure of methodology, scope, and data sources) but oppose standardization mandates
- Rewrite investment policies to focus on material ESG risks by category rather than aggregate score thresholds
- Document in your ESG risk assessment policy why you're using multiple specialized sources and how you integrate them
- Review your procurement requirements to ensure you're not inadvertently requiring generalization
- Train your investment committee to interpret rating disagreement as potential evidence of useful specialization, not dysfunction
The ESG ratings market will continue to disappoint if you treat it like the credit ratings market. Credit risk is one-dimensional. ESG risk is not. Your job isn't to find the "right" ESG rating; it's to extract useful information from a market where providers face structural incentives to generalize when you need specialization. Change your procurement approach, your investment policies, and your interpretation of disagreement, and you'll get better information from the same market.
