Evaluation of tractogram filtering methods using human-like connectome phantoms

Tractography algorithms are prone to reconstructing spurious connections. The set of streamlines generated with tractography can be post-processed to retain the streamlines that are most biologically plausible. Several microstructure-informed filtering algorithms are available for this purpose, however, the comparative performance of these methods has not been extensively evaluated. In this study, we aim to evaluate streamline filtering and post-processing algorithms using simulated connectome phantoms. We first establish a framework for generating connectome phantoms featuring brain-like white matter fiber architectures. We then use our phantoms to systematically evaluate the performance of a range of streamline filtering algorithms, including SIFT, COMMIT, and LiFE. We find that all filtering methods successfully improve connectome accuracy, although filter performance depends on the complexity of the underlying white matter fiber architecture. Filtering algorithms can markedly improve tractography accuracy for simple tubular fiber bundles (F-measure deterministic- unfiltered: 0.49 and best filter: 0.72; F-measure probabilistic- unfiltered: 0.37 and best filter: 0.81), but for more complex brain-like fiber architectures, the improvement is modest (F-measure deterministic- unfiltered: 0.53 and best filter: 0.54; F-measure probabilistic- unfiltered: 0.46 and best filter: 0.50). Overall, filtering algorithms have the potential to improve the accuracy of connectome mapping pipelines, particularly for weighted connectomes and pipelines using probabilistic tractography methods. Our results highlight the need for further advances tractography and streamline filtering to improve the accuracy of connectome mapping.