soid: A Tool for Legal Accountability for Automated Decision Making

Samuel Judson*, Matthew Elacqua, Filip Cano, Timos Antonopoulos, Bettina Könighofer, Scott J. Shapiro, Ruzica Piskac

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

Abstract

We present soid, a tool for interrogating the decision making of autonomous agents using SMT-based automated reasoning. Relying on the Z3 SMT solver and KLEE symbolic execution engine, soid allows investigators to receive rigorously proven answers to factual and counterfactual queries about agent behavior, enabling effective legal and engineering accountability for harmful or otherwise incorrect decisions. We evaluate soid qualitatively and quantitatively on a pair of examples, i) a buggy implementation of a classic decision tree inference benchmark from the explainable AI (XAI) literature; and ii) a car crash in a simulated physics environment. For the latter, we also contribute the \soidgui{}, a domain-specific, web-based example interface for legal and other practitioners to specify factual and counterfactual queries without requiring sophisticated programming or formal methods expertise.
Original languageEnglish
Title of host publicationComputer Aided Verification - 36th International Conference, CAV 2024, Proceedings
EditorsArie Gurfinkel, Vijay Ganesh
PublisherSpringer, Cham
Pages233–246
Number of pages14
ISBN (Electronic)978-3-031-65630-9
ISBN (Print)978-3-031-65629-3
DOIs
Publication statusPublished - 2024
Event36th International Conference on Computer Aided Verification: CAV 2024 - Montreal, Canada
Duration: 22 Jul 202427 Jul 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14682 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference36th International Conference on Computer Aided Verification
Abbreviated titleCAV 2024
Country/TerritoryCanada
CityMontreal
Period22/07/2427/07/24

Keywords

  • SMT solving
  • Accountable software systems
  • CS & Law

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'soid: A Tool for Legal Accountability for Automated Decision Making'. Together they form a unique fingerprint.

Cite this