Showing $sum a_iX_i$ and $sum b_iX_i$ are independent iff $sum a_i*b_i=0$ where $X_i's$ are i.i.d N(θ,σ2)











up vote
1
down vote

favorite












Let $X_1, X_2,ldots, X_n$ be i.i.d with the distribution $N(mu, sigma^2)$.

Prove $Y =sum_{i=1}^{n} a_iX_i$ and $Z =sum_{i=1}^{n} b_iX_i$ are independent iff $sum a_ib_i=0$.

I have proved it by Basu's theorem.

I am searching for another methods.
For example, if I could prove that $(Y,Z)sim N(mu_1,mu_2,sigma_1^2,sigma_2^2,rho)$, it seems easier to show their independence.










share|cite|improve this question
























  • That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
    – StubbornAtom
    Nov 15 at 11:28












  • The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
    – Maxius Xu
    Nov 15 at 11:29















up vote
1
down vote

favorite












Let $X_1, X_2,ldots, X_n$ be i.i.d with the distribution $N(mu, sigma^2)$.

Prove $Y =sum_{i=1}^{n} a_iX_i$ and $Z =sum_{i=1}^{n} b_iX_i$ are independent iff $sum a_ib_i=0$.

I have proved it by Basu's theorem.

I am searching for another methods.
For example, if I could prove that $(Y,Z)sim N(mu_1,mu_2,sigma_1^2,sigma_2^2,rho)$, it seems easier to show their independence.










share|cite|improve this question
























  • That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
    – StubbornAtom
    Nov 15 at 11:28












  • The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
    – Maxius Xu
    Nov 15 at 11:29













up vote
1
down vote

favorite









up vote
1
down vote

favorite











Let $X_1, X_2,ldots, X_n$ be i.i.d with the distribution $N(mu, sigma^2)$.

Prove $Y =sum_{i=1}^{n} a_iX_i$ and $Z =sum_{i=1}^{n} b_iX_i$ are independent iff $sum a_ib_i=0$.

I have proved it by Basu's theorem.

I am searching for another methods.
For example, if I could prove that $(Y,Z)sim N(mu_1,mu_2,sigma_1^2,sigma_2^2,rho)$, it seems easier to show their independence.










share|cite|improve this question















Let $X_1, X_2,ldots, X_n$ be i.i.d with the distribution $N(mu, sigma^2)$.

Prove $Y =sum_{i=1}^{n} a_iX_i$ and $Z =sum_{i=1}^{n} b_iX_i$ are independent iff $sum a_ib_i=0$.

I have proved it by Basu's theorem.

I am searching for another methods.
For example, if I could prove that $(Y,Z)sim N(mu_1,mu_2,sigma_1^2,sigma_2^2,rho)$, it seems easier to show their independence.







probability-distributions normal-distribution






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited Nov 15 at 14:47









Davide Giraudo

123k16149253




123k16149253










asked Nov 15 at 11:16









Maxius Xu

113




113












  • That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
    – StubbornAtom
    Nov 15 at 11:28












  • The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
    – Maxius Xu
    Nov 15 at 11:29


















  • That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
    – StubbornAtom
    Nov 15 at 11:28












  • The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
    – Maxius Xu
    Nov 15 at 11:29
















That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
– StubbornAtom
Nov 15 at 11:28






That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
– StubbornAtom
Nov 15 at 11:28














The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
– Maxius Xu
Nov 15 at 11:29




The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
– Maxius Xu
Nov 15 at 11:29










2 Answers
2






active

oldest

votes

















up vote
1
down vote













In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.



To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.



Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.



Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.



First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.





Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.



So it suffices to prove that their covariance equals $0$.



Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$



So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$






share|cite|improve this answer






























    up vote
    0
    down vote













    Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
    begin{align*}
    text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
    &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
    &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
    &=sigma^2 sum_{i=1}^n a_i b_j^ast
    end{align*}



    So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.






    share|cite|improve this answer





















      Your Answer





      StackExchange.ifUsing("editor", function () {
      return StackExchange.using("mathjaxEditing", function () {
      StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
      StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
      });
      });
      }, "mathjax-editing");

      StackExchange.ready(function() {
      var channelOptions = {
      tags: "".split(" "),
      id: "69"
      };
      initTagRenderer("".split(" "), "".split(" "), channelOptions);

      StackExchange.using("externalEditor", function() {
      // Have to fire editor after snippets, if snippets enabled
      if (StackExchange.settings.snippets.snippetsEnabled) {
      StackExchange.using("snippets", function() {
      createEditor();
      });
      }
      else {
      createEditor();
      }
      });

      function createEditor() {
      StackExchange.prepareEditor({
      heartbeatType: 'answer',
      convertImagesToLinks: true,
      noModals: true,
      showLowRepImageUploadWarning: true,
      reputationToPostImages: 10,
      bindNavPrevention: true,
      postfix: "",
      imageUploader: {
      brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
      contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
      allowUrls: true
      },
      noCode: true, onDemand: true,
      discardSelector: ".discard-answer"
      ,immediatelyShowMarkdownHelp:true
      });


      }
      });














       

      draft saved


      draft discarded


















      StackExchange.ready(
      function () {
      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2999556%2fshowing-sum-a-ix-i-and-sum-b-ix-i-are-independent-iff-sum-a-ib-i-0-whe%23new-answer', 'question_page');
      }
      );

      Post as a guest















      Required, but never shown

























      2 Answers
      2






      active

      oldest

      votes








      2 Answers
      2






      active

      oldest

      votes









      active

      oldest

      votes






      active

      oldest

      votes








      up vote
      1
      down vote













      In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.



      To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.



      Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.



      Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.



      First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.





      Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.



      So it suffices to prove that their covariance equals $0$.



      Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$



      So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$






      share|cite|improve this answer



























        up vote
        1
        down vote













        In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.



        To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.



        Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.



        Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.



        First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.





        Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.



        So it suffices to prove that their covariance equals $0$.



        Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$



        So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$






        share|cite|improve this answer

























          up vote
          1
          down vote










          up vote
          1
          down vote









          In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.



          To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.



          Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.



          Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.



          First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.





          Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.



          So it suffices to prove that their covariance equals $0$.



          Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$



          So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$






          share|cite|improve this answer














          In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.



          To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.



          Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.



          Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.



          First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.





          Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.



          So it suffices to prove that their covariance equals $0$.



          Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$



          So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$







          share|cite|improve this answer














          share|cite|improve this answer



          share|cite|improve this answer








          edited Nov 15 at 11:42

























          answered Nov 15 at 11:34









          drhab

          94.2k543125




          94.2k543125






















              up vote
              0
              down vote













              Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
              begin{align*}
              text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
              &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
              &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
              &=sigma^2 sum_{i=1}^n a_i b_j^ast
              end{align*}



              So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.






              share|cite|improve this answer

























                up vote
                0
                down vote













                Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
                begin{align*}
                text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
                &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
                &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
                &=sigma^2 sum_{i=1}^n a_i b_j^ast
                end{align*}



                So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.






                share|cite|improve this answer























                  up vote
                  0
                  down vote










                  up vote
                  0
                  down vote









                  Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
                  begin{align*}
                  text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
                  &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
                  &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
                  &=sigma^2 sum_{i=1}^n a_i b_j^ast
                  end{align*}



                  So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.






                  share|cite|improve this answer












                  Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
                  begin{align*}
                  text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
                  &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
                  &=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
                  &=sigma^2 sum_{i=1}^n a_i b_j^ast
                  end{align*}



                  So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.







                  share|cite|improve this answer












                  share|cite|improve this answer



                  share|cite|improve this answer










                  answered Nov 15 at 11:43









                  P. Quinton

                  1,261213




                  1,261213






























                       

                      draft saved


                      draft discarded



















































                       


                      draft saved


                      draft discarded














                      StackExchange.ready(
                      function () {
                      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2999556%2fshowing-sum-a-ix-i-and-sum-b-ix-i-are-independent-iff-sum-a-ib-i-0-whe%23new-answer', 'question_page');
                      }
                      );

                      Post as a guest















                      Required, but never shown





















































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown

































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown







                      Popular posts from this blog

                      AnyDesk - Fatal Program Failure

                      How to calibrate 16:9 built-in touch-screen to a 4:3 resolution?

                      QoS: MAC-Priority for clients behind a repeater