[HN Gopher] AI Coding Tools Underperform in Field Study with Exp...
___________________________________________________________________
AI Coding Tools Underperform in Field Study with Experienced
Developers
Author : maxloh
Score : 17 points
Date : 2025-07-21 19:59 UTC (3 hours ago)
(HTM) web link (www.infoq.com)
(TXT) w3m dump (www.infoq.com)
| gnabgib wrote:
| Discussion (771 points, 11 days ago, 487 comments)
| https://news.ycombinator.com/item?id=44522772
|
| Or (37 points, 8 days ago, 39 comments)
| https://news.ycombinator.com/item?id=44549436
| g42gregory wrote:
| I can not evaluate the merits of this study without first
| understanding who funds the organization METR (Model Evaluation &
| Threat Research), performing the research.
|
| It's clearly an NGO/Policy think tank/Lobbying group. I need to
| understand for whom they lobby first.
| suddenlybananas wrote:
| https://metr.org/about
|
| >
|
| METR is funded by donations. Our largest funding to date was
| through The Audacious Project, a funding initiative housed at
| TED. METR has not accepted funding from AI companies, though we
| make use of free compute credits, as noted above. Being
| independently funded has been crucial for our ability to pursue
| the most promising research directions and set standards for
| evidence-based understanding of risks from AI. It is also part
| of how we ensure that our research is as accurate as possible.
___________________________________________________________________
(page generated 2025-07-21 23:01 UTC)