help > RE: CONN connectivity results are not reproduced
Mar 26, 2018  07:03 PM | Stephen L. - Coma Science Group, GIGA-Consciousness, Hospital & University of Liege
RE: CONN connectivity results are not reproduced
Dear Ekaterina,

That's right, different machines and different operating systems will produce slightly different results, as shown in this study:

Glatard, Tristan and Lewis, Lindsay B and da Silva, Rafael Ferreira and Adalat, Reza and Beck, Natacha and Lepage, Claude and..., "Reproducibility of neuroimaging analyses across operating systems", Frontiers in neuroinformatics (2015).

This is not specific to one toolbox or even neuroscience, this impacts all domains of computing. Indeed, the underlying low-level libraries doing the calculations, and the processors, have different instructions sets and specifications, and thus introduce slight biases that can have accumulating effects at the macroscopic scale (ie, the end result of an analysis). It's like trying to translate a sentence in multiple languages: the translation might be very close and convey the global meaning, but it will never reflect totally perfectly the original meaning nor style.

A way to reduce this issue is to make a virtual machine and use it to run all your calculations, but even this will not ensure perfect reproducibility.

Threaded View

TitleAuthorDate
Ekaterina Kondrateva Nov 28, 2017
Alfonso Nieto-Castanon Nov 28, 2017
Ekaterina Kondrateva Apr 13, 2018
Alfonso Nieto-Castanon Apr 16, 2018
Ekaterina Kondrateva Apr 19, 2018
Stephen L. Apr 10, 2018
Vasudev Devulapally Nov 28, 2017
Ekaterina Kondrateva Nov 28, 2017
RE: CONN connectivity results are not reproduced
Stephen L. Mar 26, 2018
Ekaterina Kondrateva Apr 10, 2018
Stephen L. Apr 10, 2018
Ekaterina Kondrateva Apr 13, 2018
Stephen L. Apr 13, 2018
Ekaterina Kondrateva Apr 16, 2018
Vasudev Devulapally Nov 28, 2017