Best Practice Report

It's Time To Get Really Serious About Testing Your AI

Create A Clear Strategy And Test Automation Approach

May 17th, 2021
Diego Lo Giudice, Vice President, Principal Analyst
Diego Lo Giudice Vice President, Principal Analyst
With contributors:
Srividya Sridharan,Mike Gualtieri,Brandon Purcell,Michele Goetz,Chris Gardner,Martha Bennett,Renee Murphy,Kjell Carlsson, PhD,Andrew Dobak,Kara Hartig

Summary

Part one of this research described how to test AI-infused applications (AIIAs) based on what we know about testing automatic software (i.e., with known outcomes). We also described how data scientists test autonomous software (i.e., with possible uncertainty in outcomes) and presented the integration and performance of the combined automatic and autonomous (the AIIA). In this report, we address the testing of the AI embedded or integrated in the AIIA and its behavior as well as the technology stack needed for automated and continuous testing in an automated delivery pipeline.

Want to read the full report?

Contact us to become a client

This report is available for individual purchase ($1495).

Forrester helps business and technology leaders use customer obsession to accelerate growth. That means empowering you to put the customer at the center of everything you do: your leadership strategy, and operations. Becoming a customer-obsessed organization requires change — it requires being bold. We give business and technology leaders the confidence to put bold into action, shaping and guiding how to navigate today's unprecedented change in order to succeed.