Agentic Connectomic Proofreading

Automated proofreading of a full brain connectome using Neuroglancer with a computer-using agent.


Developing end-to-end pipelines for training computer-using agents/foundation models capable of autonomously proofreading a full brain connectome in Neuroglancer. See here for more (not updated) information on connectomics/proofreading. See here for a Python library (written with Raphaël Levisse) that provides Gym environments for programmatically interacting with Neuroglancer. See here for distributed RL training code.

EM collection and image analysis has enabled the release of a full wiring diagram of a fly brain. Scaling towards full mouse (and potentially human) connectomes will require significant innovation in both image segmentation and proofreading to deal with the petabyte-scale amounts of data involved.

Proofreading - manual verification of neurons and their wirings - is an expensive and time-consuming bottleneck preventing such scaling.