Follow along with the video below to see how to install our site as a web app on your home screen.
Note: This feature may not be available in some browsers.
That’s better.AnaValencia wrote: The p-value is the lowest level of significance at which we can reject H0.
You might reject H0, and you might not. You have to compare p to α. What’s α here?AnaValencia wrote: If H0 is X=0; the p-value is 0.00236 and the t-statistic of X is -3.0565, then why do we not reject H0?
You’re trying to compare a t-statistic to a level of significance. They’re completely different things.AnaValencia wrote: n=500. Its a 2 tailed test. So do we reject H0 because -3.0565 is less than -0.00236 and it is a 2-tailed test?
It’s sad that the CFAI considers a functional definition as an interpretation. Then again, it’s better they’re correct with a definition (correct answer to a different question) instead of interpreting the p-value as a type I error (or the probability the null is true), which they had in the books in prior years (grossly wrong answer to the correct question).S2000magician wrote:
No, you cannot use p to get the critical values. If you did, you’d essentially be comparing p to itself.
The question doesn’t ask whether you will reject H0 or not; it simply asks you to interpret the p-value of 0.00236. The answer is that that is the lowest level of significance (i.e., the lowest α) at which you would reject H0.
Agreed, and agreed.tickersu wrote:
It’s sad that the CFAI considers a functional definition as an interpretation. Then again, it’s better they’re correct with a definition (correct answer to a different question) instead of interpreting the p-value as a type I error (or the probability the null is true), which they had in the books in prior years (grossly wrong answer to the correct question).S2000magician wrote: No, you cannot use p to get the critical values. If you did, you’d essentially be comparing p to itself.
The question doesn’t ask whether you will reject H0 or not; it simply asks you to interpret the p-value of 0.00236. The answer is that that is the lowest level of significance (i.e., the lowest α) at which you would reject H0.
Alpha is an arbitrary threshold. What if I change my threshold to 0.00236 this time instead of 0.05 or 0.005 or whatever is the common threshold for the specified study. Wouldn’t I still able to reject H0? I think yes.tickersu wrote:
It’s sad that the CFAI considers a functional definition as an interpretation. Then again, it’s better they’re correct with a definition (correct answer to a different question) instead of interpreting the p-value as a type I error (or the probability the null is true), which they had in the books in prior years (grossly wrong answer to the correct question).S2000magician wrote:
No, you cannot use p to get the critical values. If you did, you’d essentially be comparing p to itself.
The question doesn’t ask whether you will reject H0 or not; it simply asks you to interpret the p-value of 0.00236. The answer is that that is the lowest level of significance (i.e., the lowest α) at which you would reject H0.
Even without an alpha threshold, you can still make that claim for any p-value.Harrogath wrote:
So, under the most common threshold of 0.05 or whatever, having a p-value of 0.00236 indeed gives me the right to say that lowest threshold possible to choose and still be able to reject H0 would be an alpha = 0.00236.
Functional definition: it’s explaining that you compare alpha and the p-value and if alpha is no smaller than the p-value, you reject the null; if you wanted, you could choose an alpha equal to p-value and still reject the null. This is just explaining how the p-value and alpha are used (and is a disgraceful way of doing so because it implies you can willy nilly change alpha after seeing the p-value– which is improper and doesn’t preserve the Type I Error rate of alpha).Harrogath wrote: Sincerely, didn’t understand the mistake about mixing “functional definition” vs “interpretation”. Perhaps you can share more light over it.
Not jazz.tickersu wrote: The functional definition isn’t an interpretation; it’s like saying “I hear noise” when someone asks for an interpretation of a jazz music piece.
Ok, so, the problem is not saying that the p-value is the lowest possible alpha in order to still be able to reject H0. The mistake resides in that this is not the correct interpretation of a p-value.tickersu wrote:
Even without an alpha threshold, you can still make that claim for any p-value.Harrogath wrote:
So, under the most common threshold of 0.05 or whatever, having a p-value of 0.00236 indeed gives me the right to say that lowest threshold possible to choose and still be able to reject H0 would be an alpha = 0.00236.
I think the problem of mistaking the interpretation of a p-value resides (unluckily) in the definition of alpha and its use with p-value (we compare both to take decisions). As alpha threshold is considered a probability of error type 1, then, as we compare p-values with alpha we mistakenly consider p-values also as probabilities of committing type 1 errors. However, they are not.tickersu wrote:
Functional definition: it’s explaining that you compare alpha and the p-value and if alpha is no smaller than the p-value, you reject the null; if you wanted, you could choose an alpha equal to p-value and still reject the null. This is just explaining how the p-value and alpha are used (and is a disgraceful way of doing so because it implies you can willy nilly change alpha after seeing the p-value– which is improper and doesn’t preserve the Type I Error rate of alpha).Harrogath wrote: Sincerely, didn’t understand the mistake about mixing “functional definition” vs “interpretation”. Perhaps you can share more light over it.
The interpretation of a p-value is NOT saying it’s the lowest alpha that you could choose to reject Ho. A p-value is a probability– what does it mean? It’s the probability of obtaining a summary measure at least as extreme as the observed one if we assume the null hypothesis is true. This tells you it’s a probability, what it’s the probability of, and what assumptions are entailed in this p-value.
The functional definition isn’t an interpretation; it’s like saying “I hear noise” when someone asks for an interpretation of a jazz music piece.
Right. It’s not an interpretation; it’s telling you an (incorrect) way to use a p-value.Harrogath wrote:
Ok, so, the problem is not saying that the p-value is the lowest possible alpha in order to still be able to reject H0. The mistake resides in that this is not the correct interpretation of a p-value.
If you look at the definition of each, there’s no way to mix them up. Poor teaching (CFAI, nonstatisticians) leads to confusion about the two ideas, but even looking at the definitions makes it pretty clear.Harrogath wrote:
I think the problem of mistaking the interpretation of a p-value resides (unluckily) in the definition of alpha and its use with p-value (we compare both to take decisions).
I think this misunderstanding just arises from insufficient or outright incorrect education about the topic (or use silly “explanations” of topics– such as their “interpretation” of a p-value). This is literally covered in undergraduate statistics texts– which is why my issue with the CFAI is that they claim to provide world class education but are heavily goofing up the accuracy of the material.Harrogath wrote: As alpha threshold is considered a probability of error type 1, then, as we compare p-values with alpha we mistakenly consider p-values also as probabilities of committing type 1 errors.
Correct.Harrogath wrote: However, they are not.
Statistics books (written by people with actual degrees in statistics) usually do cover this adequately. It is an incredibly fundamental idea. When you have books written by non statisticians (people with PhD in finance, economics, econometrics from a poor program) then you get this p-value avoidance or incorrect definitions. It may depend on the text, too. If you pick up a regression text they’re going to assume you have adequate knowledge of significance testing, p-value and alpha, confidence intervals and the correct interpretations, so the regression text may not cover this.Harrogath wrote:
Do statistics book used in undergrad cover p-values adequately? I mean I have the impression p-values are just mentioned when we practice regressions, and are not properly explained / defined until the student get advanced statistics books. Perhaps we need to bring down p-values for the pedestrians before keep falling in the mistake of confusing p-values’ conceptual definition.
Quoting Wikipedia’s p-value definition:
“…the p-value or probability value or asymptotic significance is the probability for a given statistical model that, when the null hypothesis is true, the statistical summary (such as the sample mean difference between two compared groups) would be greater than or equal to the actual observed results.”
This definition is hard to be understood when the student have not achieved yet a reasonable level of knowledge :/
I agree that CFAI, at least, shouldn’t use the incorrect interpretation we talked about.