Nearly all software teams admit to shipping AI-generated code as study finds verification ‘has not kept pace with that shift’


Share this article



Join the conversation




Add us as a preferred source on Google





Subscribe to our newsletter



  • The majority of software development teams have merged code with AI contributions that they didn’t understand
  • Some teams (55%) manually review code, while others use one AI model to review another, which has mixed results
  • TestMu AI’s State of AI in Quality Engineering 2026 report has also found that only 13% of teams have an incident response provision for publishing AI-generated errors

Generative AI coding tool shave been wholeheartedly embraced by software development teams, to such an extent that 81% have admitted to merging AI generated code that wasn’t fully understood, new research has claimed.

TestMu AI’s State of AI in Quality Engineering 2026 report also found a mixed approach to reviewing AI code and very few teams employing an incident response procedure in the event of AI generated errors occurring on live projects.

These results raise some questions on how development teams are using AI and what steps are being employed to verify output. While some teams use manual review, others rely on a second LLM to review and judge the code. However, this appears to have increased the likelihood of code no-one understands being published.

Latest Videos FromTechRadar

LLM-as-a-judge

Revealed in the report is the notion of the verification gap, a challenge for teams relying on AI-generated code. Just 41% of teams use automated checks of AI-written code before merging it with existing, often live code. This gap is the beginning of the problem – there is simply too much code to efficiently check.

With 55% of development teams using manual review, or passing to a dedicated QA team (51%), it’s clear that with some teams, important measures are in place.

Employing a second LLM to grade the generated code might seem like a smart move. In terms of fixing issues, it probably is. But the result of this strategy is that teams using LLM-as-a-judge are shipping code they don’t understand at a greater rate – 29%, compared with 15% who don’t use AL grading.

Verify your output

Asad Khan, the Co-founder and CEO of TestMu AI said the key point that verification of AI-generated code is not keeping pace with the volume of output.

“Software teams now rely on AI to write their code, generate their tests, and increasingly determine whether both are ready to ship,” he noted.

“Verification, however, has not kept pace with that shift. We believe any output AI produces should be validated by a system independent of the model that produced it, before it merges and every time it changes.” The development teams that have put in place the procedures to do this are doing better, it seems.

“The teams in our survey that already follow this discipline see fewer defects reach production, and we expect it to become the standard for engineering organizations shipping with AI,” Khan added.


Google logo on a black background next to text reading 'Click to follow TechRadar'

Follow TechRadar on Google News and add us as a preferred source to get our expert news, reviews, and opinion in your feeds.


Don’t miss these tips!

We don’t spam! Read more in our privacy policy

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Hot this week

Oura Ring Adds a Jet Lag Feature for Time Zone Travelers

Traveling to new places is good for the soul,...

Zsela Invites You to The Party With New Album

CommentLoaderSave StorySave this storyCommentLoaderSave StorySave this storyZsela is getting...

Pipilotti Rist Wins MIT’s $100,000 McDermott Award

Pipilotti Rist Wins 2027 Eugene McDermott Award in the...

Over a Third of Gen Z-ers Rely on AI for Friendship

As generational cohorts go, Gen Z has been saddled...

Topics

Zsela Invites You to The Party With New Album

CommentLoaderSave StorySave this storyCommentLoaderSave StorySave this storyZsela is getting...

Oura Ring Adds a Jet Lag Feature for Time Zone Travelers

Traveling to new places is good for the soul,...

ART X Lagos 2026 Art Across Borders: Redefining Value

Exploring human anatomy through sustainable materials: Ghizlane Sahli’s Histoires...

AI Is Thriving at Capital One

If one were making a list of the companies...

Featured Artist | Darrell Black

Darrell Black Frankfurt, Germanyhttp://darrell-black.pixels.com/@definismart My Darrell Urban Black, an American visual...

Related Articles

Popular Categories

News Feed

Grading Each Phase of Wisconsin Football’s 42-10 Domination of Purdue

Following an embarrassing loss to Maryland, Wisconsin’s second brutal defeat in the previous three weeks, a trip to West Lafayette was the perfect opportunity...

CBA breezes into the Class AA state semifinals after routing Valley Central

COLONIE - One carry, one touchdown.A second carry, another touchdown.A third carry, a third touchdown.Then, the offense for the Christian Brothers Academy football team...

Watch: Should Messi have been red carded for this play vs Crew?

The Columbus Crew won Game 1 of their best-of-three playoff series against Inter Miami FC 3-0. Gonzalo Tapia scored twice and Patrick Schulte made...

New report reveals Puka Nacua’s lengthy recovery timeline after MCL surgery

When Sean McVay announced that Puka Nacua decided to have surgery on his knee to repair his MCL, he said the Los Angeles Rams'...

LSU’s Offense Collapses as Tennessee Hands Tigers Third Straight Loss

Even playing with house money the Tigers found a way to walk away in the red.For the last month, LSU has known exatcly what...

Cowboys’ CeeDee Lamb punished by the NFL before Titans game

Cowboys' CeeDee Lamb punished by the NFL before Titans game originally appeared on The Sporting News. Add The Sporting News as a Preferred Source...

Ole Miss Report Card: Grading Every Position Group vs. Wofford

The No. 25 Ole Miss Rebels celebrated Senior Day in style, demolishing Wofford 59-17. The FCS opponent couldn't match the Rebels' size, speed, and...

Colts defender fined by NFL for play vs. Dolphins

Indianapolis Colts defensive tackle Adetomiwa Adebawore was fined by the NFL for a play in last week's win against Miami.According to Mike Chappell of...

Who needs to win ATP Finals more: Carlos Alcaraz or Alexander Zverev?

Carlos Alcaraz and Alexander Zverev will face off for the 2026 ATP Finals trophy in Turin, Italy on Sunday, November 22.Alcaraz has never won...

Messi, Miami stunned by Columbus in MLS playoff opener

Lionel Messi's bid to win back-to-back MLS Cup titles suffered a blow on Saturday as 10-man Inter Miami were thumped 3-0 at home by...

Snap Judgements From Texas A&M’s Brutal Loss to Oklahoma

All the speculation was true. Texas A&M made a quarterback change, and it was one of the day's major storylines in Norman against Oklahoma....

Brayden Burries is starting to gain momentum

It’s only been 17 games into the Milwaukee Bucks season, and rookie Brayden Burries is starting to play some of the best basketball of...

Texas Longhorns Report Card: Grading Every Position Group in dominant win vs. Arkansas

Texas left no doubt on the table of them being a College Football Playoff team after destroying Arkansas, 45-3, at home on Saturday. From...

Horns Up, Horns Down: Texas Stock Report After Blowout Win Against Arkansas

Texas has found plenty of ways to win football games this season. Making it look easy hasn’t always been one of them.Saturday was a...

Kyle Whittingham Addresses Michigan Job Security Following Stunning UCLA Upset

Kyle Whittingham just delivered the biggest victory of his brief tenure as Michigan's head coach, but whether he'll be around to build on it...

Struble and Marchessault lead the Predators to a 4-3 win over the Penguins

NASHVILLE, Tenn. (AP) — Jayden Struble and Jonathan Marchessault each had a goal and an assist to lead the Nashville Predators to a 4-3...

Watch Notre Dame’s Jordan Faison make an acrobatic catch vs SMU

No. 3 Notre Dame found the end zone for the second time against the SMU Mustangs when Fighting Irish quarterback CJ Carr found wide...

Tennessee defense ruins Lane Kiffin’s return to Neyland Stadium | Adams

An imperfect game produced the perfect ending act for Tennessee football in a 27-13 victory over LSU on Nov. 21 at Neyland Stadium.A defense...

No. 5 Duke pulls away from Columbia 71-47 behind Emilee Skinner’s 17 points

NEW YORK (AP) — Emilee Skinner scored 17 points and Toby Fournier added 15 to help No. 5 Duke beat Columbia 71-47 on Saturday...

‘What a play!’: Rutgers stuns Penn State on last-second touchdown

In a season that once seemed lost, Penn State football found new life, winning three consecutive games after a disastrous 3-4 start under first-year...

Texas State photos: Bobcats host Washington State in final home game of 2026 season

Texas State hosts Washington State in the final home game of the Bobcats' first season in the Pac-12.Behind a veteran senior class, the Bobcats...

Popular articles

Grading Each Phase of Wisconsin Football’s 42-10 Domination of Purdue

Following an embarrassing loss to Maryland, Wisconsin’s second brutal defeat in the previous three weeks, a trip to West Lafayette was the perfect opportunity...

CBA breezes into the Class AA state semifinals after routing Valley Central

COLONIE - One carry, one touchdown.A second carry, another touchdown.A third carry, a third touchdown.Then, the offense for the Christian Brothers Academy football team...

Watch: Should Messi have been red carded for this play vs Crew?

The Columbus Crew won Game 1 of their best-of-three playoff series against Inter Miami FC 3-0. Gonzalo Tapia scored twice and Patrick Schulte made...

New report reveals Puka Nacua’s lengthy recovery timeline after MCL surgery

When Sean McVay announced that Puka Nacua decided to have surgery on his knee to repair his MCL, he said the Los Angeles Rams'...

LSU’s Offense Collapses as Tennessee Hands Tigers Third Straight Loss

Even playing with house money the Tigers found a way to walk away in the red.For the last month, LSU has known exatcly what...

Cowboys’ CeeDee Lamb punished by the NFL before Titans game

Cowboys' CeeDee Lamb punished by the NFL before Titans game originally appeared on The Sporting News. Add The Sporting News as a Preferred Source...

Ole Miss Report Card: Grading Every Position Group vs. Wofford

The No. 25 Ole Miss Rebels celebrated Senior Day in style, demolishing Wofford 59-17. The FCS opponent couldn't match the Rebels' size, speed, and...

Colts defender fined by NFL for play vs. Dolphins

Indianapolis Colts defensive tackle Adetomiwa Adebawore was fined by the NFL for a play in last week's win against Miami.According to Mike Chappell of...

Who needs to win ATP Finals more: Carlos Alcaraz or Alexander Zverev?

Carlos Alcaraz and Alexander Zverev will face off for the 2026 ATP Finals trophy in Turin, Italy on Sunday, November 22.Alcaraz has never won...

Messi, Miami stunned by Columbus in MLS playoff opener

Lionel Messi's bid to win back-to-back MLS Cup titles suffered a blow on Saturday as 10-man Inter Miami were thumped 3-0 at home by...

Snap Judgements From Texas A&M’s Brutal Loss to Oklahoma

All the speculation was true. Texas A&M made a quarterback change, and it was one of the day's major storylines in Norman against Oklahoma....

Brayden Burries is starting to gain momentum

It’s only been 17 games into the Milwaukee Bucks season, and rookie Brayden Burries is starting to play some of the best basketball of...

Texas Longhorns Report Card: Grading Every Position Group in dominant win vs. Arkansas

Texas left no doubt on the table of them being a College Football Playoff team after destroying Arkansas, 45-3, at home on Saturday. From...

Horns Up, Horns Down: Texas Stock Report After Blowout Win Against Arkansas

Texas has found plenty of ways to win football games this season. Making it look easy hasn’t always been one of them.Saturday was a...

Kyle Whittingham Addresses Michigan Job Security Following Stunning UCLA Upset

Kyle Whittingham just delivered the biggest victory of his brief tenure as Michigan's head coach, but whether he'll be around to build on it...

Struble and Marchessault lead the Predators to a 4-3 win over the Penguins

NASHVILLE, Tenn. (AP) — Jayden Struble and Jonathan Marchessault each had a goal and an assist to lead the Nashville Predators to a 4-3...

Watch Notre Dame’s Jordan Faison make an acrobatic catch vs SMU

No. 3 Notre Dame found the end zone for the second time against the SMU Mustangs when Fighting Irish quarterback CJ Carr found wide...

Tennessee defense ruins Lane Kiffin’s return to Neyland Stadium | Adams

An imperfect game produced the perfect ending act for Tennessee football in a 27-13 victory over LSU on Nov. 21 at Neyland Stadium.A defense...

No. 5 Duke pulls away from Columbia 71-47 behind Emilee Skinner’s 17 points

NEW YORK (AP) — Emilee Skinner scored 17 points and Toby Fournier added 15 to help No. 5 Duke beat Columbia 71-47 on Saturday...

‘What a play!’: Rutgers stuns Penn State on last-second touchdown

In a season that once seemed lost, Penn State football found new life, winning three consecutive games after a disastrous 3-4 start under first-year...

Texas State photos: Bobcats host Washington State in final home game of 2026 season

Texas State hosts Washington State in the final home game of the Bobcats' first season in the Pac-12.Behind a veteran senior class, the Bobcats...