p-value of a test statistic on a two-sided test











up vote
0
down vote

favorite












For coursework, I am doing a two-sided test ($H_0 beta = 0, H_a beta neq 0$). The test itself is a generalized likelihood ratio. The test statistic is the ratio LR:



$$LR=frac{L(beta=0)}{argmax_{beta in R}L(beta)}$$



Where L is the likelihood function.Then $-2ln(LR)$ follows a $chi_1^2$.



I am trying to calculate the p-value for a specific value of LR. Say I look for at a $chi_1^2$ table (or online calc) and find out that



$$ P(chi_1^2 geq -2ln(LR)) = alpha $$



Is $alpha$ my final p-value?



Or do I need to account for the fact that the test is two-sided and set the p-value $= 2*alpha$?



I think I should do the later but I am a bit unsure. Some extra intuition would help.



Edit: added the LR function.










share|cite|improve this question









New contributor




LucasMation is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.




















  • @LinAlg, tks. I realized that in general tests (of a transformation, standardization of X) we need to look at both sides. But in this case, we have a likelihood ratio of a constrained likelihood (in the numerator) divided by an unconstrained likelihood (in the denominator). Thus the smaller the value the greatest the evidence against H0.
    – LucasMation
    Nov 17 at 20:39










  • By the way, I forgot to mention that -2ln(LR) is what has Chi^2 distribution, not LR itself. Will edit that now.
    – LucasMation
    Nov 17 at 20:40










  • @LinAlg, please incorporate my point avobe into your answer so I can mark it as a solution to the question.
    – LucasMation
    Nov 17 at 20:41










  • could you explicitly add what likelihood was in the denominator?
    – LinAlg
    Nov 17 at 21:05












  • @LinAlg see above
    – LucasMation
    Nov 19 at 2:48















up vote
0
down vote

favorite












For coursework, I am doing a two-sided test ($H_0 beta = 0, H_a beta neq 0$). The test itself is a generalized likelihood ratio. The test statistic is the ratio LR:



$$LR=frac{L(beta=0)}{argmax_{beta in R}L(beta)}$$



Where L is the likelihood function.Then $-2ln(LR)$ follows a $chi_1^2$.



I am trying to calculate the p-value for a specific value of LR. Say I look for at a $chi_1^2$ table (or online calc) and find out that



$$ P(chi_1^2 geq -2ln(LR)) = alpha $$



Is $alpha$ my final p-value?



Or do I need to account for the fact that the test is two-sided and set the p-value $= 2*alpha$?



I think I should do the later but I am a bit unsure. Some extra intuition would help.



Edit: added the LR function.










share|cite|improve this question









New contributor




LucasMation is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.




















  • @LinAlg, tks. I realized that in general tests (of a transformation, standardization of X) we need to look at both sides. But in this case, we have a likelihood ratio of a constrained likelihood (in the numerator) divided by an unconstrained likelihood (in the denominator). Thus the smaller the value the greatest the evidence against H0.
    – LucasMation
    Nov 17 at 20:39










  • By the way, I forgot to mention that -2ln(LR) is what has Chi^2 distribution, not LR itself. Will edit that now.
    – LucasMation
    Nov 17 at 20:40










  • @LinAlg, please incorporate my point avobe into your answer so I can mark it as a solution to the question.
    – LucasMation
    Nov 17 at 20:41










  • could you explicitly add what likelihood was in the denominator?
    – LinAlg
    Nov 17 at 21:05












  • @LinAlg see above
    – LucasMation
    Nov 19 at 2:48













up vote
0
down vote

favorite









up vote
0
down vote

favorite











For coursework, I am doing a two-sided test ($H_0 beta = 0, H_a beta neq 0$). The test itself is a generalized likelihood ratio. The test statistic is the ratio LR:



$$LR=frac{L(beta=0)}{argmax_{beta in R}L(beta)}$$



Where L is the likelihood function.Then $-2ln(LR)$ follows a $chi_1^2$.



I am trying to calculate the p-value for a specific value of LR. Say I look for at a $chi_1^2$ table (or online calc) and find out that



$$ P(chi_1^2 geq -2ln(LR)) = alpha $$



Is $alpha$ my final p-value?



Or do I need to account for the fact that the test is two-sided and set the p-value $= 2*alpha$?



I think I should do the later but I am a bit unsure. Some extra intuition would help.



Edit: added the LR function.










share|cite|improve this question









New contributor




LucasMation is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











For coursework, I am doing a two-sided test ($H_0 beta = 0, H_a beta neq 0$). The test itself is a generalized likelihood ratio. The test statistic is the ratio LR:



$$LR=frac{L(beta=0)}{argmax_{beta in R}L(beta)}$$



Where L is the likelihood function.Then $-2ln(LR)$ follows a $chi_1^2$.



I am trying to calculate the p-value for a specific value of LR. Say I look for at a $chi_1^2$ table (or online calc) and find out that



$$ P(chi_1^2 geq -2ln(LR)) = alpha $$



Is $alpha$ my final p-value?



Or do I need to account for the fact that the test is two-sided and set the p-value $= 2*alpha$?



I think I should do the later but I am a bit unsure. Some extra intuition would help.



Edit: added the LR function.







statistics statistical-inference hypothesis-testing p-value






share|cite|improve this question









New contributor




LucasMation is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|cite|improve this question









New contributor




LucasMation is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|cite|improve this question




share|cite|improve this question








edited Nov 19 at 2:43





















New contributor




LucasMation is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked Nov 15 at 16:08









LucasMation

1012




1012




New contributor




LucasMation is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





LucasMation is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






LucasMation is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.












  • @LinAlg, tks. I realized that in general tests (of a transformation, standardization of X) we need to look at both sides. But in this case, we have a likelihood ratio of a constrained likelihood (in the numerator) divided by an unconstrained likelihood (in the denominator). Thus the smaller the value the greatest the evidence against H0.
    – LucasMation
    Nov 17 at 20:39










  • By the way, I forgot to mention that -2ln(LR) is what has Chi^2 distribution, not LR itself. Will edit that now.
    – LucasMation
    Nov 17 at 20:40










  • @LinAlg, please incorporate my point avobe into your answer so I can mark it as a solution to the question.
    – LucasMation
    Nov 17 at 20:41










  • could you explicitly add what likelihood was in the denominator?
    – LinAlg
    Nov 17 at 21:05












  • @LinAlg see above
    – LucasMation
    Nov 19 at 2:48


















  • @LinAlg, tks. I realized that in general tests (of a transformation, standardization of X) we need to look at both sides. But in this case, we have a likelihood ratio of a constrained likelihood (in the numerator) divided by an unconstrained likelihood (in the denominator). Thus the smaller the value the greatest the evidence against H0.
    – LucasMation
    Nov 17 at 20:39










  • By the way, I forgot to mention that -2ln(LR) is what has Chi^2 distribution, not LR itself. Will edit that now.
    – LucasMation
    Nov 17 at 20:40










  • @LinAlg, please incorporate my point avobe into your answer so I can mark it as a solution to the question.
    – LucasMation
    Nov 17 at 20:41










  • could you explicitly add what likelihood was in the denominator?
    – LinAlg
    Nov 17 at 21:05












  • @LinAlg see above
    – LucasMation
    Nov 19 at 2:48
















@LinAlg, tks. I realized that in general tests (of a transformation, standardization of X) we need to look at both sides. But in this case, we have a likelihood ratio of a constrained likelihood (in the numerator) divided by an unconstrained likelihood (in the denominator). Thus the smaller the value the greatest the evidence against H0.
– LucasMation
Nov 17 at 20:39




@LinAlg, tks. I realized that in general tests (of a transformation, standardization of X) we need to look at both sides. But in this case, we have a likelihood ratio of a constrained likelihood (in the numerator) divided by an unconstrained likelihood (in the denominator). Thus the smaller the value the greatest the evidence against H0.
– LucasMation
Nov 17 at 20:39












By the way, I forgot to mention that -2ln(LR) is what has Chi^2 distribution, not LR itself. Will edit that now.
– LucasMation
Nov 17 at 20:40




By the way, I forgot to mention that -2ln(LR) is what has Chi^2 distribution, not LR itself. Will edit that now.
– LucasMation
Nov 17 at 20:40












@LinAlg, please incorporate my point avobe into your answer so I can mark it as a solution to the question.
– LucasMation
Nov 17 at 20:41




@LinAlg, please incorporate my point avobe into your answer so I can mark it as a solution to the question.
– LucasMation
Nov 17 at 20:41












could you explicitly add what likelihood was in the denominator?
– LinAlg
Nov 17 at 21:05






could you explicitly add what likelihood was in the denominator?
– LinAlg
Nov 17 at 21:05














@LinAlg see above
– LucasMation
Nov 19 at 2:48




@LinAlg see above
– LucasMation
Nov 19 at 2:48










1 Answer
1






active

oldest

votes

















up vote
1
down vote













The $p$ value is related to the rejection region, so the answer depends on how you divide $alpha$ over both sides for the test. If you reject H0 when the test statistic is less than $F(alpha/2)$ or more than $F(1-alpha/2)$, then $2alpha$ is the right answer. However, you can use any rejection region $(-infty,a] cup [b,infty)$ as long as $a$ and $b$ satisfy $F^{-1}(b) - F^{-1}(a) = 1-alpha$. For skewed unimodal distributions you can impose $f(a)=f(b)$, which leads to a different answer.



In your example of a generalized likelihood ratio test, the rejection region is an interval $[b,infty)$, even though the test is two sided. So $alpha$ is the p-value.






share|cite|improve this answer























    Your Answer





    StackExchange.ifUsing("editor", function () {
    return StackExchange.using("mathjaxEditing", function () {
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    });
    });
    }, "mathjax-editing");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "69"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    noCode: true, onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });






    LucasMation is a new contributor. Be nice, and check out our Code of Conduct.










     

    draft saved


    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2999881%2fp-value-of-a-test-statistic-on-a-two-sided-test%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes








    up vote
    1
    down vote













    The $p$ value is related to the rejection region, so the answer depends on how you divide $alpha$ over both sides for the test. If you reject H0 when the test statistic is less than $F(alpha/2)$ or more than $F(1-alpha/2)$, then $2alpha$ is the right answer. However, you can use any rejection region $(-infty,a] cup [b,infty)$ as long as $a$ and $b$ satisfy $F^{-1}(b) - F^{-1}(a) = 1-alpha$. For skewed unimodal distributions you can impose $f(a)=f(b)$, which leads to a different answer.



    In your example of a generalized likelihood ratio test, the rejection region is an interval $[b,infty)$, even though the test is two sided. So $alpha$ is the p-value.






    share|cite|improve this answer



























      up vote
      1
      down vote













      The $p$ value is related to the rejection region, so the answer depends on how you divide $alpha$ over both sides for the test. If you reject H0 when the test statistic is less than $F(alpha/2)$ or more than $F(1-alpha/2)$, then $2alpha$ is the right answer. However, you can use any rejection region $(-infty,a] cup [b,infty)$ as long as $a$ and $b$ satisfy $F^{-1}(b) - F^{-1}(a) = 1-alpha$. For skewed unimodal distributions you can impose $f(a)=f(b)$, which leads to a different answer.



      In your example of a generalized likelihood ratio test, the rejection region is an interval $[b,infty)$, even though the test is two sided. So $alpha$ is the p-value.






      share|cite|improve this answer

























        up vote
        1
        down vote










        up vote
        1
        down vote









        The $p$ value is related to the rejection region, so the answer depends on how you divide $alpha$ over both sides for the test. If you reject H0 when the test statistic is less than $F(alpha/2)$ or more than $F(1-alpha/2)$, then $2alpha$ is the right answer. However, you can use any rejection region $(-infty,a] cup [b,infty)$ as long as $a$ and $b$ satisfy $F^{-1}(b) - F^{-1}(a) = 1-alpha$. For skewed unimodal distributions you can impose $f(a)=f(b)$, which leads to a different answer.



        In your example of a generalized likelihood ratio test, the rejection region is an interval $[b,infty)$, even though the test is two sided. So $alpha$ is the p-value.






        share|cite|improve this answer














        The $p$ value is related to the rejection region, so the answer depends on how you divide $alpha$ over both sides for the test. If you reject H0 when the test statistic is less than $F(alpha/2)$ or more than $F(1-alpha/2)$, then $2alpha$ is the right answer. However, you can use any rejection region $(-infty,a] cup [b,infty)$ as long as $a$ and $b$ satisfy $F^{-1}(b) - F^{-1}(a) = 1-alpha$. For skewed unimodal distributions you can impose $f(a)=f(b)$, which leads to a different answer.



        In your example of a generalized likelihood ratio test, the rejection region is an interval $[b,infty)$, even though the test is two sided. So $alpha$ is the p-value.







        share|cite|improve this answer














        share|cite|improve this answer



        share|cite|improve this answer








        edited 2 days ago

























        answered Nov 15 at 18:14









        LinAlg

        7,6141520




        7,6141520






















            LucasMation is a new contributor. Be nice, and check out our Code of Conduct.










             

            draft saved


            draft discarded


















            LucasMation is a new contributor. Be nice, and check out our Code of Conduct.













            LucasMation is a new contributor. Be nice, and check out our Code of Conduct.












            LucasMation is a new contributor. Be nice, and check out our Code of Conduct.















             


            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2999881%2fp-value-of-a-test-statistic-on-a-two-sided-test%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            AnyDesk - Fatal Program Failure

            How to calibrate 16:9 built-in touch-screen to a 4:3 resolution?

            QoS: MAC-Priority for clients behind a repeater