Dear NBS team, 


Thank you for your excellent program. 


I am trying to understand the output of test_stat, which I have obtained with 'global nbs' after outputting my result (derived using FDR with a T test).


It is not clear what the numbers in the matrix represent, are they the T values of each edge? Without the significance threshold I am finding it difficult to interpret.

Assuming that they are T values, I have tried to determine the threshold used by NBS for my data, however those with the highest values do not 100% approximate to those edges that nbsview delivered. 


As a side point, despite performing 100000 permutations, I am still receiving slightly varied results, how many permutations would you suggest?


Any help would be much appreciated. 


Kind regards, 

Josh

Hi Josh,

test_stat stores the test statistic for the set of all edges. If you select t-test in the GUI, then the test statistic values represent t statistics.

Significance is based on permutation testing, and thus the test statistic in itself is not enough to determine significance.

For NBS, 5,000 permutations should be enough.

For FDR, a substantially greater number of permutations are required. Perhaps 100,000 or 500,000 to be safe with FDR.

Andrew



Originally posted by joshkr:

Dear Andrew, 



Thank you very much for the prompt and clear reply. 


Kind regards, 


Josh