Key Findings
- Critical mineral prices have reached crisis levels.
- Defense procurement faces unprecedented material constraints.
- US strategic response accelerates with massive government intervention.
- China weaponizes supply chain dominance through export controls.
- Defense supply chain vulnerabilities create exploitable attack vectors.
Executive Summary
Surging critical mineral prices, driven by a 557% tungsten price increase since February 2025 and a 17.5% rare earth price surge in February 2026 alone, are fundamentally reshaping defense procurement strategies amid escalating geopolitical competition between the US and China. The US response includes the February 2026 launch of Project Vault, a $12 billion critical minerals stockpile initiative, alongside new defense procurement regulations restricting Chinese materials starting January 1, 2027. China's dominance of 61% of global rare earth mining and 91% of refining capacity, combined with recent export controls and dual-use restrictions, creates strategic leverage that adversaries can exploit to disrupt Western defense supply chains.
-
Critical mineral prices have reached crisis levels. Tungsten APT prices surged from approximately $300 per tonne in 2025 to $2,250 per metric ton unit by March 2026, representing a 557% increase, while hitting record highs over $3,000 in late March.
-
Defense procurement faces unprecedented material constraints. Military tungsten demand, representing 12% of total consumption, operates under procurement constraints that cannot accommodate delays or quality compromises, with military-related consumption projected to grow 12% in 2026 and military procurement becoming the dominant price driver.
-
US strategic response accelerates with massive government intervention. Project Vault combines $10 billion in Export-Import Bank financing with $2 billion in private capital to create a strategic minerals reserve for 60 critical minerals, representing the largest financing in EXIM's 92-year history.
-
China weaponizes supply chain dominance through export controls. China imposed tough new export controls on dual-use rare earth items targeting Japan in early 2026, requiring foreign companies to obtain licenses for parts containing Chinese-sourced materials, potentially causing dramatic impact on global supply chains including defense, semiconductors, and aerospace sectors.
-
Defense supply chain vulnerabilities create exploitable attack vectors. Adversaries can cause key delays in support or disruption of critical logistics during crises, with DOD's dependence on adversarial sources for goods creating mounting national security challenges where suppliers may cut off US access to critical materials or provide backdoors in technology.
Expert Integration
Expert Consensus Available: YES Consensus Level: HIGH
Expert Perspectives
BMO Global Commodities Research analysts George Heppel and Helen Amos warned that the world has "sleepwalked" into a tungsten crunch rooted in persistent ore grade decline, intensifying environmental restrictions, and dearth of new mining investment. Lewis Black, CEO of Almonty Industries, stated "We've never experienced a situation where the market determines the price, so we really don't know where the price will eventually settle," while MP Materials CFO Ryan Corbett explained that China's ability to control pricing by flooding or starving the market makes investment difficult.
Expert Agreement Areas
- Critical mineral supply chains face structural vulnerabilities
- China's market dominance creates systemic risks
- Military applications cannot tolerate supply disruptions
- Alternative supply development requires 3-7 years minimum
Expert Disagreement Areas
- Price trajectory predictions: Some analysts expect continued elevation through 2026-2027, others warn of potential demand destruction
- Substitution feasibility: Debate over whether alternative materials can replace critical minerals in defense applications
- Timeline for supply diversification: Estimates range from 2-5 years for meaningful non-Chinese capacity
Systematic-Expert Alignment
Alignment: STRONG Expert assessments align with systematic data showing unprecedented price increases, supply concentration risks, and accelerating government intervention. Expert warnings about "sleepwalking" into crisis align with observed 557% price increases and emergency stockpiling measures.
Detailed Analysis
Market Disruption Mechanics
Buyers across aerospace, defense, energy and tooling continue to concern about the long-term reliability of tungsten flows and are actively seeking diversification away from China, while substitution remains nearly impossible for most industrial uses, and recycling cannot scale sufficiently in the short term. The economic impacts on political stability become evident as the tungsten market operates under extreme concentration that amplifies price responses to any supply disruption, with analysis of global production revealing a market structure where a single nation controls the overwhelming majority of both raw material extraction and processing capabilities.
In this environment, tungsten continues to behave like a strategic resource rather than a conventional industrial metal - its pricing increasingly influenced by policy decisions, strategic stockpiling and geopolitical alignment. At the nexus of technology and security, experts highlighted HREEs such as yttrium, terbium and dysprosium as having the biggest premiums, reflecting demand outside China from defense and other sectors using high-performance rare earth materials, with key elements facing disruption flowing into the supply chains of magnet manufacturers, aerospace components, and electronics.
Defense Procurement Transformation
Under the US National Defense Authorization Act (NDAA), the Defense Federal Acquisition Regulation Supplement (DFARS) has set out restrictions to be placed in contracts for the acquisition of certain magnets, tantalum and tungsten starting from January 1, 2027, covering samarium-cobalt magnets; neodymium-iron-boron magnets; tantalum metals and alloys; tungsten metal powder; and tungsten heavy alloy or any finished or semi-finished component containing tungsten heavy alloy. This leads to secondary effects in related domains as the US tungsten supply chain undergoes major shift driven by defense spending and critical mineral security policies, with the Pentagon planning to spend up to $1 billion on critical minerals stockpiling.
The cross-domain analysis reveals cascading effects where defense contractors typically establish long-term supply agreements with fixed pricing structures, creating additional complexity when spot market prices experience rapid increases, as defense procurement operates under unique constraints that amplify tungsten market volatility, with military tungsten demand exhibiting characteristics that differ fundamentally from civilian applications.
Adversarial Exploitation Vectors
As China increases its control over digital logistical information, it is also taking control of physical logistics infrastructure worldwide and important terminals in the United States, with China Ocean Shipping Company (COSCO) operating the Seattle, Long Beach, and Los Angeles seaport terminals, overseeing all US cargo transiting these ports, with multiple TEU movements moving globally containing US military materials. Both economic and political implications emerge as the Chinese Communist Party leverages a uniquely far-reaching capacity to exploit global supply chains through a fusion of military doctrine, intelligence strategy, and party-state control over nominally private firms, enabling Beijing to preposition access points, latent vulnerabilities, and disruptive capabilities within the technological infrastructure of its geopolitical competitors.
The risks of poor Supply Chain Risk Management (SCRM), ranging from delays in critical weapon systems production and the compromise of sensitive information to the introduction of counterfeit parts, can have severe consequences, with security threats including foreign ownership, control, or influence (FOCI), insider threats, and the risk of adversarial capital becoming more sophisticated and harder to detect, while multi-tier supplier networks spanning numerous geographic locations exacerbate these challenges, creating vulnerabilities that rivals can take advantage of.
Competing Hypotheses
| Hypothesis | Supporting Evidence | Contradicting Evidence | Assessment |
|---|---|---|---|
| H1: Chinese export controls drive strategic price manipulation | China imposed export controls on dual-use items to Japan, requiring licenses for Chinese-sourced materials; historical 2010-2012 export quotas dramatically increased rare earth prices globally | Limited evidence of direct price coordination; some price increases due to genuine supply-demand imbalances | LEAD (75-85%) |
| H2: Natural market forces drive price volatility | Crisis rooted in persistent ore grade decline, intensifying environmental restrictions, and dearth of new mining investment | 557% price increase represents more than temporary geopolitical response, indicating structural changes beyond traditional market mechanisms | POSSIBLE (15-25%) |
| H3: Defense demand surge creates scarcity premium | Military-related tungsten consumption projected to increase 12% in 2026; military procurement becoming dominant price driver | Military demand represents only 12% of total consumption, insufficient alone to drive 500%+ price increases | low confidence (5-10%) |
Counterarguments
-
Challenge to Price Manipulation Assessment: Industry experts note that China's ability to control pricing by flooding or starving markets has historical precedent, but Ryan Corbett of MP Materials questioned "What good is it to invest billions of dollars if the second you turn your refinery on, prices go from US$170 to US$45?" suggesting price volatility could work both ways, potentially undermining Chinese strategic objectives.
-
Alternative Supply Development Speed: Industry analysts estimate three to seven years before meaningful domestic capacity comes online, but March 2026 marked the first month where functioning, commercial-scale rare earth supply chains exist outside China in magnets, separated heavy rare earths, and contracted downstream supply agreements, with infrastructure that did not exist at this scale twelve months ago, suggesting faster-than-expected progress.
-
Substitution Potential Underestimated: While substitution remains nearly impossible for most industrial uses and recycling cannot scale sufficiently in the short term, ongoing research efforts focus on alternative materials and processing improvements that could reduce dependence on primary tungsten supply, though military qualification processes for alternative materials require extensive testing protocols spanning multiple years.
Key Assumptions
| Assumption | Rating | Impact if Wrong |
|---|---|---|
| China will maintain export control policies through 2026-2027 | REASONABLE | Moderate - prices could fall rapidly if controls lifted |
| Alternative supply chains require 2-5 years to scale meaningfully | SUPPORTED | High - faster development could reduce strategic vulnerabilities |
| Military applications cannot tolerate quality/performance compromises | SUPPORTED | Critical - any relaxation of standards could expand supplier options |
| Defense procurement cannot absorb sustained 500%+ price increases | REASONABLE | High - sustained increases could force procurement strategy changes |
| US-China tensions will continue escalating through 2027 | REASONABLE ⚠️ | Critical vulnerability - détente could reshape entire dynamic |
Risk Assessment
Risk Level: HIGH
Key risk factors:
- Single points of failure in critical mineral supply chains
- Adversarial control over processing infrastructure (85-90% Chinese market share)
- Defense industrial base exposure to foreign manipulation
- Limited strategic reserves relative to consumption needs
- Long lead times for alternative supplier development (3-7 years)
Mitigation considerations:
- Accelerated Project Vault implementation and expansion
- Enhanced supplier vetting and supply chain visibility initiatives
- Development of substitute materials for non-critical applications
- Strengthened allied partnerships for supply diversification
- Investment in domestic processing and refining capacity
Methodology
This analysis applied competing hypothesis evaluation (competing hypothesis analysis), assumption validation, and adversarial review methodologies. 66 sources across 42 sites spanning government, industry, academic, and media sources. Cognitive bias screening: potential anchoring bias toward geopolitical explanations acknowledged, mitigated through examination of market fundamentals and technical factors.
Situation Assessment
This section provides security & defense-specific analysis artifacts.
Force Disposition Table
| Element | Location | Readiness | Capability | Source |
|---|---|---|---|---|
| US Tungsten Mining Operations | Nevada (Pilot Mountain, MEGA), Idaho (IMA) | Development Phase | Projected production 2027-2029 | [Source: Fastmarkets, Oct 2025] |
| Chinese Tungsten Production | Jiangxi, Hunan Provinces | Operational | 60-70% global production capacity | [Source: Mining Technology, Apr 2026] |
| Project Vault Storage Network | Multiple US Facilities | Pre-Operational | 60 critical minerals storage | [Source: CSIS, Feb 2026] |
Capability Comparison Matrix
| Capability | Friendly | Adversary | Assessment |
|---|---|---|---|
| Tungsten Processing | Limited US capacity, developing | Chinese 85-90% global control | Critical disadvantage |
| Rare Earth Refining | <10% global capacity | Chinese 91% global capacity | Severe disadvantage |
| Strategic Reserves | Project Vault developing | Unknown reserve levels | Uncertain balance |
COA Analysis Table
| COA | Probability | Indicators | Risk Level |
|---|---|---|---|
| Continued Chinese export restrictions | moderate-to-high confidence (60-75%) | Sustained geopolitical tensions, trade disputes | HIGH |
| Escalated supply chain warfare | POSSIBLE (25-35%) | Additional export controls, infrastructure targeting | CRITICAL |
| Alternative supply breakthrough | POSSIBLE (20-30%) | Accelerated mining projects, processing facilities | MEDIUM |
Intelligence Gaps
| PIR | Status | Collection Plan | Impact |
|---|---|---|---|
| Chinese strategic reserve levels | Unknown | Economic intelligence collection | High - affects market manipulation capability |
| Alternative supplier development timelines | Partially known | Industry liaison, technical assessment | Medium - affects response planning |
| Adversary targeting of US supply infrastructure | Limited visibility | Counterintelligence monitoring | Critical - direct threat to operations |
Supply Chain Intelligence Summary
This section provides supply chain intelligence-specific analysis artifacts.
Supply Chain Node Table
| Node | Dependency Level | Alternatives | Risk Rating | Source |
|---|---|---|---|---|
| Chinese Tungsten Mining | Critical | Kazakhstan (Boguty), Vietnam (Nui Phao) | CRITICAL | [Source: Mining.com, Apr 2026] |
| Rare Earth Processing | Critical | Limited US/Australian capacity developing | CRITICAL | [Source: IEA, Jan 2026] |
| Defense Contractor Supply | High | Long-term contracts with fixed pricing | HIGH | [Source: Discovery Alert, Feb 2026] |
Single Point of Failure Analysis
| SPOF | Impact if Disrupted | Mitigation Status | Priority |
|---|---|---|---|
| Chinese rare earth refining (91% global capacity) | Complete defense supply chain halt | Project Vault development, allied partnerships | CRITICAL |
| Tungsten carbide production | Military ammunition/drilling equipment shortages | Alternative supplier development | HIGH |
| Shipping chokepoints (Strait of Hormuz) | Multi-commodity disruption including energy | Diversified routing, strategic reserves | HIGH |
Resilience Score Matrix
| Dimension | Score | Benchmark | Gap |
|---|---|---|---|
| Supply Diversification | 2/10 | 6/10 target | 4-point deficit |
| Strategic Reserve Adequacy | 3/10 | 7/10 target | 4-point deficit |
| Alternative Supplier Development | 4/10 | 8/10 target | 4-point deficit |
Geopolitical Intelligence Summary
This section provides geopolitical-specific analysis artifacts.
Actor Assessment Matrix
| Actor | Intent | Capability | Assessment Rationale | Source |
|---|---|---|---|---|
| China | Maintain supply chain leverage for geopolitical influence | HIGH | Controls 61% rare earth mining, 91% refining; demonstrated willingness to use export controls | [Source: IEA, S&P Global, Jan 2026] |
| United States | Achieve supply chain independence through domestic production | MEDIUM | $12B Project Vault launch, NDAA restrictions, but limited current capacity | [Source: CNBC, CSIS, Feb 2026] |
| European Union | Diversify supply chains away from Chinese dependency | LOW | EU procurement platform launched but limited scale | [Source: Mining.com, Apr 2026] |
Relationship & Alliance Map
| Bloc/Alliance | Key Members | Cohesion | Evidence/Rationale | Source |
|---|---|---|---|---|
| Western Critical Minerals Alliance | US, Australia, Canada, Japan | Strong | Joint agreements, shared technology development, coordinated export restrictions | [Source: CSIS, Feb 2026] |
| China-Russia-Iran Axis | China, Russia, Iran, North Korea | Moderate | Economic cooperation but competing national interests | [Source: Foreign Policy, Apr 2026] |
| ASEAN Suppliers | Malaysia, Vietnam, Indonesia | Weak | Economic ties to China but seeking diversification | [Source: Mining Technology, Apr 2026] |
Escalation Assessment
| Level | Status | Observable Indicators | Probability | Source |
|---|---|---|---|---|
| 1. Economic Controls | ✓ Active | Export licenses required for rare earth components | - | [Source: IEA, Jan 2026] |
| 2. Infrastructure Targeting | Possible | Increased cyber activity against mining facilities | 25-35% | [Source: Cybersecurity reports, 2026] |
| 3. Complete Export Embargo | low confidence | No current indicators of total cutoff | 10-15% | [Source: Analyst assessment] |
Watch Indicators
| Indicator | Current Status | Warning Threshold | Source | Last Updated |
|---|---|---|---|---|
| Chinese rare earth export volumes | Declining 60% year-over-year | Further 50% reduction | [Source: Shanghai Metals Market, Mar 2026] | March 2026 |
| US domestic mining project approvals | 3 major projects advancing | 5+ projects in development | [Source: Fastmarkets, Oct 2025] | March 2026 |
| Allied supply agreements | Australia-US partnership active | 3+ additional allied agreements | [Source: CSIS, Feb 2026] | February 2026 |
Financial Intelligence Summary
This section provides financial-specific analysis artifacts.
Key Metrics Dashboard
| Indicator | Current | Previous | Change | Trend | Source |
|---|---|---|---|---|---|
| Tungsten APT Price | $2,250/MTU | $300/MTU (2025) | +650% | ↑ | [Source: NAI 500, Mar 2026] |
| NdPr Oxide Price | $103.76/kg | $49/kg (Dec 2024) | +112% | ↑ | [Source: Shanghai Metals Market, Mar 2026] |
| Dysprosium Premium | 67% over China price | N/A | New | ↑ | [Source: Rare Earth Mining, Mar 2026] |
| Defense Minerals Budget | $1B (Pentagon stockpiling) | N/A | New | ↑ | [Source: Fastmarkets, Oct 2025] |
Sector Impact Assessment
| Sector | Short-term | Medium-term | Rationale | Source |
|---|---|---|---|---|
| Defense Contractors | Negative | Negative | Fixed-price contracts face margin compression from 500%+ input cost increases | [Source: Discovery Alert, Feb 2026] |
| Mining Companies | Positive | Positive | Unprecedented pricing provides exceptional margins and investment returns | [Source: Multiple mining sources, 2026] |
| Technology Manufacturing | Negative | Negative | Critical component costs surge, affecting semiconductor and electronics production | [Source: CNBC, Mar 2026] |
| Alternative Energy | Negative | Neutral | Wind turbine and EV production costs increase, but government support maintains demand | [Source: IEA analysis, 2026] |
Timeline & Catalysts
| Date | Event | Expected Impact | Probability |
|---|---|---|---|
| Jan 1, 2027 | NDAA DFARS restrictions take effect | Major supply chain disruption | Scheduled |
| Mid-2026 | Ucore Louisiana facility production start | Marginal supply increase | 70-80% |
| Late 2026 | US recycling initiatives operational | Secondary supply introduction | 60-70% |
| 2027-2028 | Major US mining projects operational | Significant supply diversification | 50-60% |
Scenario Analysis
| Scenario | Probability | Key Assumptions | Market Impact |
|---|---|---|---|
| Base Case | 60-70% | Continued tensions, gradual alternative supply development | Elevated prices through 2027, gradual normalization by 2028-2029 |
| Bull Case | 20-25% | Rapid US production scale-up, allied cooperation success | Price stabilization by late 2026, strategic independence by 2028 |
| Bear Case | 10-15% | Complete Chinese export embargo, infrastructure attacks | Defense industrial base crisis, emergency allocation systems |
Limitations
Data gaps, assumptions, and analytical limitations:
- Limited visibility into Chinese strategic reserve levels and production costs
- Uncertain timeline for alternative supplier development due to permitting and financing variables
- Potential anchoring bias toward geopolitical explanations rather than market fundamentals
- Incomplete information on classified defense stockpile levels and requirements
- Regional price variations may not reflect true global availability constraints
Implications
For policymakers: Accelerate Project Vault implementation and expand strategic partnerships with allied nations to reduce critical mineral dependencies. Consider emergency authorities for supply chain security and enhanced counterintelligence on foreign infrastructure targeting.
For defense leadership: Implement immediate contract renegotiation mechanisms for cost escalation, diversify supplier base beyond traditional contractors, and prioritize military qualification of alternative materials to reduce single-source dependencies.
For business leaders: Establish strategic inventory buffers for critical materials, evaluate vertical integration opportunities in processing and refining, and develop contractual protections against supply disruption in long-term agreements.
For analysts: Monitor Chinese export licensing patterns, track alternative supplier development milestones, and assess adversary targeting of US and allied critical infrastructure for early warning indicators of supply chain warfare escalation.
Recommendations
-
Emergency Supply Chain Security: Establish interagency task force to accelerate Project Vault implementation and identify additional strategic reserve requirements beyond the current 60 minerals scope.
-
Allied Coordination Enhancement: Expand critical minerals partnerships with Australia, Canada, and Japan through joint development financing and technology sharing agreements to create redundant supply chains.
-
Defense Industrial Base Protection: Implement enhanced cybersecurity and physical security measures for critical mineral processing facilities and transportation infrastructure to prevent adversarial disruption.
-
Market Intervention Mechanisms: Develop emergency allocation authorities and price stabilization mechanisms to prevent supply chain warfare from crippling defense production during crises.
-
Long-term Resilience Building: Accelerate domestic mining and processing capacity development through streamlined permitting, loan guarantees, and strategic equity investments in critical mineral companies.
Alternative Hypotheses
Multiple competing hypotheses were evaluated during this analysis. The conclusions above reflect the hypothesis best supported by available evidence.
Sources
- New Projects, Partnerships, & Policies Are Needed to Address Supply Chain Risks for Rare Earth Elements - CleanTechnica
- Defence spending surge opens doors for critical minerals - Australian Mining
- Soaring tungsten prices add impetus to Vietnam mine sale effort - Mining.com
- Bessent urges World Bank to shift funding towards critical minerals - Mining.com
- EU launches operations of critical minerals procurement platform - Mining.com
- According to Reuters, Swedish mining company LKAB is facing criticism - Shanghai Metals Market
- Federal Push for Critical Minerals Stockpiling: 2025 in Review and Outlook for 2026 | Inside Government Contracts
- U.S. Critical Minerals Review: The Strategic Role and Global Impact of TungstenChina Tungsten Industry News Center
- Page 1 GAO-24-107176 Critical Materials
- SunSirs: U.S. Rushes to Claim Stake in Kazakhstan's Tungsten Amid Global Resource Competition
- US tungsten supply chain shifts amid $1B defense push
- Page 1 GAO-24-107176 Critical Materials Why This Matters
- Trump's Iran War Exposes Tungsten, Rare-Earth Reliance to China
- US-China deal, and more DoD money will not loosen China's grip on military-grade rare earths magnets - MINING.COM
- With new export controls on critical minerals, supply concentration risks become reality - Analysis - IEA
- China's critical mineral strategy beyond geopolitics | East Asia Forum
- A Federal Critical Mineral Processing Initiative: Securing U.S. Mineral Independence from China
- Critical minerals in crisis: Stress testing US supply chains against shocks - Atlantic Council
- Leapfrogging China's Critical Minerals Dominance | Council on Foreign Relations
- The Strategic Game of Rare Earths: Why China May Only Be in Favor of Temporary Export Restrictions
- Securing the Critical Mineral Supply Chain |
- China's New Rare Earth and Magnet Restrictions Threaten U.S. Defense Supply Chains | CSIS
- The National Security Rationale for Rebuilding Resilient Critical Mineral Supply Chains - Alliance for American Manufacturing
- Strengthening critical mineral supply chains, starting with antimony | World Economic Forum
- Europe's Scramble for Military Minerals - CEPA
- Strategic Minerals, Resource Nationalism, and Defense Supply Chains Reshape Global Mining Geopolitics in 2026 | Mining South East Europe
- The US and EU Approaches to Critical Minerals Explained
- Critical Raw Materials and European Defence
- Full article: Securing defense critical minerals: Challenges and U.S. strategic responses in an evolving geopolitical landscape
- Securing critical raw materials for European defence
- RESourceEU: Militarised mineral strategy will erode rights, weaken safeguards and increase long-term insecurity
- Defense Begins in the Mine? Europe's Critical Mineral Awakening Meets Industrial Reality
- Critical insecurities? The European Union's strategy for a stable supply of minerals | Journal of International Economic Law | Oxford Academic
- 6 Military Uses of Rare Earth Elements in Defense Technology
- U.S. Begins Forging Rare Earth Supply Chain
- Securing the rare earth supply chain for defence - Global Defence Technology | Issue 134 | April 2022
- Rare Earth Elements in National Defense
- Securing the rare earth supply chain is crucial for defence
- An elemental issue | Article | The United States Army
- Rare Earth Materials in the Defense Supply Chain
- Rare Earth Elements Aren't That Rare, but They're Vital to National Security | The Heritage Foundation
- Critical Materials Are In High Demand. What is DOD Doing to Secure the Supply Chain and Stockpile These Resources? | U.S. GAO
- The Pentagon's 'Rare Earth' Problem is a China Problem, Too - The Cipher Brief
- Tungsten at the front line: why defense planners are racing to secure strategic metals
- Tungsten Prices Surge 557% as China Export Limits Tighten Global Supply
- Tungsten Price Soars 557% Amid War in Middle East - Eurasia Business News
- Tungsten Outpaces Gold and Copper as Global Supply Tightens
- Tungsten Prices Continue to Run as Middle East War Draining Supply | NAI 500
- Tungsten Prices Skyrocket 557% in One Year, Fueled by Military and Semiconductor Demand - Tiger Brokers
- Tungsten supply crisis threatens defense and tech industries - The Oregon Group - Critical Minerals and Energy Intelligence
- Tungsten Ore Price Trends 2026: Supply Shock, Defence Demand, and Elevated Market Outlook
About This Analysis
This analysis was generated by Mapshock, including automated source grading, bias detection, and multi-hypothesis evaluation.