help > NBS Statistical Test button - One Sample
Showing 1-14 of 14 posts
May 17, 2014 11:05 PM | Teena Moody
NBS Statistical Test button - One Sample
I would like to look at the connectivity within one patient group.
I tried using the one-sample button, with a design matrix of
all ones and a contrast matrix of [1], with the eventual goal of
adding a regressor in a design matrix.
But I get non-signficant results for all thresholds I tried, and max size random and max size actual are both zero.
Can I do a group mean with NBS?
and if so, how do I set things up.
Thanks
But I get non-signficant results for all thresholds I tried, and max size random and max size actual are both zero.
Can I do a group mean with NBS?
and if so, how do I set things up.
Thanks
May 19, 2014 12:05 AM | Andrew Zalesky
RE: NBS Statistical Test button - One Sample
Hi Teena,
It's most likely that a one-sample test is not appropriate in your case, but you will need to provide more details. Are you comparing the patients to a group of controls? What is the null hypothesis that you are wanting to test?
Andrew
Originally posted by Teena Moody:
It's most likely that a one-sample test is not appropriate in your case, but you will need to provide more details. Are you comparing the patients to a group of controls? What is the null hypothesis that you are wanting to test?
Andrew
Originally posted by Teena Moody:
I would like to look at the connectivity within
one patient group. I tried using the one-sample button, with
a design matrix of all ones and a contrast matrix of [1], with the
eventual goal of adding a regressor in a design matrix.
But I get non-signficant results for all thresholds I tried, and max size random and max size actual are both zero.
Can I do a group mean with NBS?
and if so, how do I set things up.
Thanks
But I get non-signficant results for all thresholds I tried, and max size random and max size actual are both zero.
Can I do a group mean with NBS?
and if so, how do I set things up.
Thanks
May 29, 2014 01:05 AM | Juan Pablo Princich - Neurociencias Hospital El Cruce, Buenos Aires
RE: NBS Statistical Test button - One Sample
Dear Teena and Prof. Zalesky;
First things first, thanks for this usefull toolbox! Hope you can help me with some questions...
I think Teena and i are facing similar issues, so i will try to elaborate on my problem and probably you may help both..
I ´ve calculated structural connectivity matrices for a reduced group of normal subjects (n=22), and also individual matrices of (n=21) individual epilepsy patients; were each patient is different from each other.
We would like to test the null hypothesis that each individual epilepsy patient has no connectivity difference compared against our normal sample of 21 subjects.
In other words, is it possible to avoid a group to group comparation in order to test for differences on each single epilepsy patient compared against the control group (n=22) using the NBS toolbox ? In the case it is true, what kind of test should we use and how could the matrix be designed to work properly ?
Hope i was clear enough
Thanks for your time and help
Juan Pablo
First things first, thanks for this usefull toolbox! Hope you can help me with some questions...
I think Teena and i are facing similar issues, so i will try to elaborate on my problem and probably you may help both..
I ´ve calculated structural connectivity matrices for a reduced group of normal subjects (n=22), and also individual matrices of (n=21) individual epilepsy patients; were each patient is different from each other.
We would like to test the null hypothesis that each individual epilepsy patient has no connectivity difference compared against our normal sample of 21 subjects.
In other words, is it possible to avoid a group to group comparation in order to test for differences on each single epilepsy patient compared against the control group (n=22) using the NBS toolbox ? In the case it is true, what kind of test should we use and how could the matrix be designed to work properly ?
Hope i was clear enough
Thanks for your time and help
Juan Pablo
May 29, 2014 02:05 AM | Andrew Zalesky
RE: NBS Statistical Test button - One Sample
Hi Juan,
You can't really test a null hypothesis about a single observation (e.g. a single individual with epilepsy compared to a group of controls). This is not something that is specific to the NBS, but rather general to statistics.
You can only test whether the patient group as a whole has no connectivity differences compared to the controls.
If you are interested about making inference at the level of an individual subject, you might want to consider predicting patients versus controls using something like a support vector machine.
Andrew
Originally posted by Juan Pablo Princich:
You can't really test a null hypothesis about a single observation (e.g. a single individual with epilepsy compared to a group of controls). This is not something that is specific to the NBS, but rather general to statistics.
You can only test whether the patient group as a whole has no connectivity differences compared to the controls.
If you are interested about making inference at the level of an individual subject, you might want to consider predicting patients versus controls using something like a support vector machine.
Andrew
Originally posted by Juan Pablo Princich:
Dear Teena and Prof. Zalesky;
First things first, thanks for this usefull toolbox! Hope you can help me with some questions...
I think Teena and i are facing similar issues, so i will try to elaborate on my problem and probably you may help both..
I ´ve calculated structural connectivity matrices for a reduced group of normal subjects (n=22), and also individual matrices of (n=21) individual epilepsy patients; were each patient is different from each other.
We would like to test the null hypothesis that each individual epilepsy patient has no connectivity difference compared against our normal sample of 21 subjects.
In other words, is it possible to avoid a group to group comparation in order to test for differences on each single epilepsy patient compared against the control group (n=22) using the NBS toolbox ? In the case it is true, what kind of test should we use and how could the matrix be designed to work properly ?
Hope i was clear enough
Thanks for your time and help
Juan Pablo
First things first, thanks for this usefull toolbox! Hope you can help me with some questions...
I think Teena and i are facing similar issues, so i will try to elaborate on my problem and probably you may help both..
I ´ve calculated structural connectivity matrices for a reduced group of normal subjects (n=22), and also individual matrices of (n=21) individual epilepsy patients; were each patient is different from each other.
We would like to test the null hypothesis that each individual epilepsy patient has no connectivity difference compared against our normal sample of 21 subjects.
In other words, is it possible to avoid a group to group comparation in order to test for differences on each single epilepsy patient compared against the control group (n=22) using the NBS toolbox ? In the case it is true, what kind of test should we use and how could the matrix be designed to work properly ?
Hope i was clear enough
Thanks for your time and help
Juan Pablo
May 29, 2014 02:05 AM | Andrew Zalesky
RE: NBS Statistical Test button - One Sample
Hi Juan,
I would like to clarify my previous response.
If you want to compare single individual to the sample of controls, you could use a design matrix of the form:
1 1
1 0
1 0
1 0
1 0
1 0
where the first row is the individual with epilepsy and the other rows correspond to the healthy controls.
Selecting a t-test with the contrast [0 1] will test whether the connectivity in the epilepsy individual is larger than controls. The contrast [0 -1] will test the opposite.
Andrew
Originally posted by Andrew Zalesky:
I would like to clarify my previous response.
If you want to compare single individual to the sample of controls, you could use a design matrix of the form:
1 1
1 0
1 0
1 0
1 0
1 0
where the first row is the individual with epilepsy and the other rows correspond to the healthy controls.
Selecting a t-test with the contrast [0 1] will test whether the connectivity in the epilepsy individual is larger than controls. The contrast [0 -1] will test the opposite.
Andrew
Originally posted by Andrew Zalesky:
Hi Juan,
You can't really test a null hypothesis about a single observation (e.g. a single individual with epilepsy compared to a group of controls). This is not something that is specific to the NBS, but rather general to statistics.
You can only test whether the patient group as a whole has no connectivity differences compared to the controls.
If you are interested about making inference at the level of an individual subject, you might want to consider predicting patients versus controls using something like a support vector machine.
Andrew
Originally posted by Juan Pablo Princich:
You can't really test a null hypothesis about a single observation (e.g. a single individual with epilepsy compared to a group of controls). This is not something that is specific to the NBS, but rather general to statistics.
You can only test whether the patient group as a whole has no connectivity differences compared to the controls.
If you are interested about making inference at the level of an individual subject, you might want to consider predicting patients versus controls using something like a support vector machine.
Andrew
Originally posted by Juan Pablo Princich:
Dear Teena and Prof. Zalesky;
First things first, thanks for this usefull toolbox! Hope you can help me with some questions...
I think Teena and i are facing similar issues, so i will try to elaborate on my problem and probably you may help both..
I ´ve calculated structural connectivity matrices for a reduced group of normal subjects (n=22), and also individual matrices of (n=21) individual epilepsy patients; were each patient is different from each other.
We would like to test the null hypothesis that each individual epilepsy patient has no connectivity difference compared against our normal sample of 21 subjects.
In other words, is it possible to avoid a group to group comparation in order to test for differences on each single epilepsy patient compared against the control group (n=22) using the NBS toolbox ? In the case it is true, what kind of test should we use and how could the matrix be designed to work properly ?
Hope i was clear enough
Thanks for your time and help
Juan Pablo
First things first, thanks for this usefull toolbox! Hope you can help me with some questions...
I think Teena and i are facing similar issues, so i will try to elaborate on my problem and probably you may help both..
I ´ve calculated structural connectivity matrices for a reduced group of normal subjects (n=22), and also individual matrices of (n=21) individual epilepsy patients; were each patient is different from each other.
We would like to test the null hypothesis that each individual epilepsy patient has no connectivity difference compared against our normal sample of 21 subjects.
In other words, is it possible to avoid a group to group comparation in order to test for differences on each single epilepsy patient compared against the control group (n=22) using the NBS toolbox ? In the case it is true, what kind of test should we use and how could the matrix be designed to work properly ?
Hope i was clear enough
Thanks for your time and help
Juan Pablo
May 29, 2014 02:05 PM | Teena Moody
RE: NBS Statistical Test button - One Sample
Hi
Thanks for the reply. I really want to know what the one sample button is for.
I have had success doing t-tests between groups, for example, looking at the NBS results for CON vs PATIENT groups using the contrasts [1,-1] and [-1,1], and for anovas.
Can NBS also be used to identify the "strongest" networks within a single group? I thought perhaps that was what the one sample button was for. I couldn't find this option mentioned in the documentation.
Also is the pair-wise option available?
Thank you!
Thanks for the reply. I really want to know what the one sample button is for.
I have had success doing t-tests between groups, for example, looking at the NBS results for CON vs PATIENT groups using the contrasts [1,-1] and [-1,1], and for anovas.
Can NBS also be used to identify the "strongest" networks within a single group? I thought perhaps that was what the one sample button was for. I couldn't find this option mentioned in the documentation.
Also is the pair-wise option available?
Thank you!
May 30, 2014 09:05 AM | Andrew Zalesky
RE: NBS Statistical Test button - One Sample
Hi Teena Moody,
Regarding the one-sample test, here is the relevant text from the NBS manual:
"The one sample test randomly flips the sign of each data point for each permutation, which corresponds to a one-sided, one-sample t-test. Note that the one sample test always assesses whether the mean is greater than zero, irrespective of the sign of the contrast vector."
Andrew
Originally posted by Teena Moody:
Regarding the one-sample test, here is the relevant text from the NBS manual:
"The one sample test randomly flips the sign of each data point for each permutation, which corresponds to a one-sided, one-sample t-test. Note that the one sample test always assesses whether the mean is greater than zero, irrespective of the sign of the contrast vector."
Andrew
Originally posted by Teena Moody:
Hi
Thanks for the reply. I really want to know what the one sample button is for.
I have had success doing t-tests between groups, for example, looking at the NBS results for CON vs PATIENT groups using the contrasts [1,-1] and [-1,1], and for anovas.
Can NBS also be used to identify the "strongest" networks within a single group? I thought perhaps that was what the one sample button was for. I couldn't find this option mentioned in the documentation.
Also is the pair-wise option available?
Thank you!
Thanks for the reply. I really want to know what the one sample button is for.
I have had success doing t-tests between groups, for example, looking at the NBS results for CON vs PATIENT groups using the contrasts [1,-1] and [-1,1], and for anovas.
Can NBS also be used to identify the "strongest" networks within a single group? I thought perhaps that was what the one sample button was for. I couldn't find this option mentioned in the documentation.
Also is the pair-wise option available?
Thank you!
Jun 6, 2014 01:06 PM | Juan Pablo Princich - Neurociencias Hospital El Cruce, Buenos Aires
RE: NBS Statistical Test button - One Sample
Thanks Professor for the further respose!
Will 5000 permutations and 0.05 significane value be appropiate to test this experiment design?
What is your opinion , will be of interest to test the analysisi using FDR or SPC methods in this particular escenario one patient against a control group ?
Will post results as soon as possible
Thanks again for your time
Will 5000 permutations and 0.05 significane value be appropiate to test this experiment design?
What is your opinion , will be of interest to test the analysisi using FDR or SPC methods in this particular escenario one patient against a control group ?
Will post results as soon as possible
Thanks again for your time
Jun 7, 2014 07:06 AM | Andrew Zalesky
RE: NBS Statistical Test button - One Sample
N=5000 and p<0.05 sounds reasonable to me.
However, as I mentioned before, I don't have any experience in dealing with a sample size of 1.
SPC is not implemented in the current version of the software.
Andrew
Originally posted by Juan Pablo Princich:
However, as I mentioned before, I don't have any experience in dealing with a sample size of 1.
SPC is not implemented in the current version of the software.
Andrew
Originally posted by Juan Pablo Princich:
Thanks Professor for the further respose!
Will 5000 permutations and 0.05 significane value be appropiate to test this experiment design?
What is your opinion , will be of interest to test the analysisi using FDR or SPC methods in this particular escenario one patient against a control group ?
Will post results as soon as possible
Thanks again for your time
Will 5000 permutations and 0.05 significane value be appropiate to test this experiment design?
What is your opinion , will be of interest to test the analysisi using FDR or SPC methods in this particular escenario one patient against a control group ?
Will post results as soon as possible
Thanks again for your time
Jun 9, 2014 05:06 AM | Teena Moody
RE: NBS Statistical Test button - One Sample
Thanks for the information, I should have read the documentation
more carefully.
best
Teena Moody
best
Teena Moody
Jun 29, 2014 07:06 PM | Juan Pablo Princich - Neurociencias Hospital El Cruce, Buenos Aires
RE: NBS Statistical Test button - One Sample
Dear Proffesor, i followed your recomendations and some of the
patients showed connectivity differences.
Now i will try to compare both groups as a hole, but would like to have your advice on how to incorporate a clinical variable for a correlation analysis and how the contrast should be defined.
For instance, i have this design and wants to run a t- test
0 1
0 1
0 1
1 0
1 0
1 0
Will be ok to add a new column directly with the clinical values for each datapoint ? And then how can the contrast be defined ?
Thanks again for your time and help
Juan
Now i will try to compare both groups as a hole, but would like to have your advice on how to incorporate a clinical variable for a correlation analysis and how the contrast should be defined.
For instance, i have this design and wants to run a t- test
0 1
0 1
0 1
1 0
1 0
1 0
Will be ok to add a new column directly with the clinical values for each datapoint ? And then how can the contrast be defined ?
Thanks again for your time and help
Juan
Jun 30, 2014 12:06 AM | Andrew Zalesky
RE: NBS Statistical Test button - One Sample
Adding covariates is discussed in the references manual. In short,
simply add a new column containing the clinical variable. For
example,your design matrix might look like this:
1 0.2
1 0.3
1 0.1
1 0.9
1 0.4
1 0.5
and the contrast [0 1] will test for a correlation between the 2nd column (clinical variable) and your connectivity values.
Originally posted by Juan Pablo Princich:
1 0.2
1 0.3
1 0.1
1 0.9
1 0.4
1 0.5
and the contrast [0 1] will test for a correlation between the 2nd column (clinical variable) and your connectivity values.
Originally posted by Juan Pablo Princich:
Dear Proffesor, i followed your recomendations
and some of the patients showed connectivity differences.
Now i will try to compare both groups as a hole, but would like to have your advice on how to incorporate a clinical variable for a correlation analysis and how the contrast should be defined.
For instance, i have this design and wants to run a t- test
0 1
0 1
0 1
1 0
1 0
1 0
Will be ok to add a new column directly with the clinical values for each datapoint ? And then how can the contrast be defined ?
Thanks again for your time and help
Juan
Now i will try to compare both groups as a hole, but would like to have your advice on how to incorporate a clinical variable for a correlation analysis and how the contrast should be defined.
For instance, i have this design and wants to run a t- test
0 1
0 1
0 1
1 0
1 0
1 0
Will be ok to add a new column directly with the clinical values for each datapoint ? And then how can the contrast be defined ?
Thanks again for your time and help
Juan
Jun 30, 2014 05:06 AM | Juan Pablo Princich - Neurociencias Hospital El Cruce, Buenos Aires
RE: NBS Statistical Test button - One Sample
Thanks for taking the time to explain the details.
Just to clarify, will this design test for connectivity differences between two groups (patients against controls) considering the clinical covariates? or all the subjects will be tested as one group in the regression analysis ?
Just to clarify, will this design test for connectivity differences between two groups (patients against controls) considering the clinical covariates? or all the subjects will be tested as one group in the regression analysis ?
Jun 30, 2014 01:06 PM | Andrew Zalesky
RE: NBS Statistical Test button - One Sample
I will do the latter - all tested as
one group.
The former is described in detail in the reference manual.
Originally posted by Juan Pablo Princich:
The former is described in detail in the reference manual.
Originally posted by Juan Pablo Princich:
Thanks for taking the time to explain the
details.
Just to clarify, will this design test for connectivity differences between two groups (patients against controls) considering the clinical covariates? or all the subjects will be tested as one group in the regression analysis ?
Just to clarify, will this design test for connectivity differences between two groups (patients against controls) considering the clinical covariates? or all the subjects will be tested as one group in the regression analysis ?
