A Test for Evaluating Performance in Human-AI Systems

Abstract excerpt

<title>Abstract</title> <p>Many important uses of AI involve augmenting humans, not replacing them. But there is not yet a widely used and broadly comparable test for evaluating the performance of these human-AI systems relative to humans alone, AI alone, or other baselines. Here we describe such a test and demonstrate its use in three ways. First, in an analysis of 79 recently published results, we find that, su...

Topics

Open a Topic to create a Post that cites this publication.

• Artificial Intelligence
• Communication
• Intelligence
• Language
• Phenotype

Identifiers and source

Literature Corpus work

e2a1a6ff-6cbd-5edd-91f4-e5772f07fcd2

DOI

10.21203/rs.3.rs-2787476/v1