- Amazon shut down an internal AI leaderboard called KiroRank on May 29, which had been tracking AI token usage among employees on the company’s internal Kiro developer platform, according to , which confirmed the shutdown with an Amazon spokesperson.
- Amazon has now shifted from raw token counts to a metric it calls normalized deployments, which measures AI-assisted code that actually ships rather than token consumption alone, according to .
- Meta also abolished its own internal AI usage leaderboard, called Claudenomics, which had tracked token usage across 85,000 employees and singled out the top 250, according to .
- Dave Treadwell, Amazon’s senior vice president of engineering, addressed the issue directly. “Please don’t use AI just for the sake of using AI,” he told staff. “Use AI to help you solve customer problems, to help you solve business problems, to innovate.”
- Amazon targeted 80%+ weekly AI usage among developers; it is spending approximately $200 billion in 2026 capital expenditure primarily on AI and data centers, according to .
- Uber’s COO Andrew Macdonald recently said the company has not found a clear relationship between increased AI spending and the delivery of successful products.
- Microsoft licenses across its Experiences and Devices division earlier this month, citing cost concerns.
Amazon's recent shutdown of the KiroRank AI leaderboard signifies a strategic shift in its approach to measuring AI effectiveness among its developers.125
Earlier monitoring relied on AI token usage, but now the company emphasizes “normalized deployments,” a metric focusing on AI-assisted code that actually ships.
According to a spokesperson, this change reflects a desire to improve employee innovation and effectiveness in addressing customer and business problems. Dave Treadwell, Amazon’s senior vice president of engineering, reinforced this by urging staff, “Please don’t use AI just for the sake of using AI.”4
Further context reveals that Amazon has set an ambitious target of over 80% weekly AI usage among its developers and plans to allocate approximately $200 billion in capital expenditure primarily towards AI and data centers by 2026.
This development aligns Amazon's practices with recent trends in tech, such as Meta’s removal of its own AI leaderboard, Claudenomics, which tracked usage among 85,000 employees.3
Additionally, Uber's COO noted that increasing AI spending does not necessarily lead to successful product outcomes, suggesting that the industry is reevaluating its approach to harnessing AI effectively.6
In the same vein, Microsoft has recently altered its licenses in line with cost concerns. With these shifts across major tech companies, the focus has shifted from mere usage metrics to tangible results that can lead to innovation and problem-solving.7
“Amazon has shut down its internal AI leaderboard KiroRank and is focusing on more effective metrics for AI usage among developers. This reflects a wider trend as Meta also abolished its leaderboard, indicating a shift in how tech companies assess AI implementation.”
thestreet.com