Visualizing and Comparing Machine Learning Predictions to Improve Human-AI Teaming on the Example of Cell Lineage

Jiayi Hong, Ross Maciejewski, Alain Trubuil, Tobias Isenberg

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

We visualize the predictions of multiple machine learning models to help biologists as they interactively make decisions about cell lineage - the development of a (plant) embryo from a single ovum cell. Based on a confocal microscopy dataset, traditionally biologists manually constructed the cell lineage, starting from this observation and reasoning backward in time to establish their inheritance. To speed up this tedious process, we make use of machine learning (ML) models trained on a database of manually established cell lineages to assist the biologist in cell assignment. Most biologists, however, are not familiar with ML, nor is it clear to them which model best predicts the embryo's development. We thus have developed a visualization system that is designed to support biologists in exploring and comparing ML models, checking the model predictions, detecting possible ML model mistakes, and deciding on the most likely embryo development. To evaluate our proposed system, we deployed our interface with six biologists in an observational study. Our results show that the visual representations of machine learning are easily understandable, and our tool, LineageD+, could potentially increase biologists' working efficiency and enhance the understanding of embryos.

Original languageEnglish (US)
Pages (from-to)1956-1969
Number of pages14
JournalIEEE Transactions on Visualization and Computer Graphics
Volume30
Issue number4
DOIs
StatePublished - Apr 1 2024

Keywords

  • Cell lineage
  • comparing ML predictions
  • human -AI teaming
  • machine learning
  • plant biology
  • visual analytics
  • visualization

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'Visualizing and Comparing Machine Learning Predictions to Improve Human-AI Teaming on the Example of Cell Lineage'. Together they form a unique fingerprint.

Cite this