Showing $sum a_iX_i$ and $sum b_iX_i$ are independent iff $sum a_i*b_i=0$ where $X_i's$ are i.i.d N(θ,σ2)
up vote
1
down vote
favorite
Let $X_1, X_2,ldots, X_n$ be i.i.d with the distribution $N(mu, sigma^2)$.
Prove $Y =sum_{i=1}^{n} a_iX_i$ and $Z =sum_{i=1}^{n} b_iX_i$ are independent iff $sum a_ib_i=0$.
I have proved it by Basu's theorem.
I am searching for another methods.
For example, if I could prove that $(Y,Z)sim N(mu_1,mu_2,sigma_1^2,sigma_2^2,rho)$, it seems easier to show their independence.
probability-distributions normal-distribution
add a comment |
up vote
1
down vote
favorite
Let $X_1, X_2,ldots, X_n$ be i.i.d with the distribution $N(mu, sigma^2)$.
Prove $Y =sum_{i=1}^{n} a_iX_i$ and $Z =sum_{i=1}^{n} b_iX_i$ are independent iff $sum a_ib_i=0$.
I have proved it by Basu's theorem.
I am searching for another methods.
For example, if I could prove that $(Y,Z)sim N(mu_1,mu_2,sigma_1^2,sigma_2^2,rho)$, it seems easier to show their independence.
probability-distributions normal-distribution
That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
– StubbornAtom
Nov 15 at 11:28
The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
– Maxius Xu
Nov 15 at 11:29
add a comment |
up vote
1
down vote
favorite
up vote
1
down vote
favorite
Let $X_1, X_2,ldots, X_n$ be i.i.d with the distribution $N(mu, sigma^2)$.
Prove $Y =sum_{i=1}^{n} a_iX_i$ and $Z =sum_{i=1}^{n} b_iX_i$ are independent iff $sum a_ib_i=0$.
I have proved it by Basu's theorem.
I am searching for another methods.
For example, if I could prove that $(Y,Z)sim N(mu_1,mu_2,sigma_1^2,sigma_2^2,rho)$, it seems easier to show their independence.
probability-distributions normal-distribution
Let $X_1, X_2,ldots, X_n$ be i.i.d with the distribution $N(mu, sigma^2)$.
Prove $Y =sum_{i=1}^{n} a_iX_i$ and $Z =sum_{i=1}^{n} b_iX_i$ are independent iff $sum a_ib_i=0$.
I have proved it by Basu's theorem.
I am searching for another methods.
For example, if I could prove that $(Y,Z)sim N(mu_1,mu_2,sigma_1^2,sigma_2^2,rho)$, it seems easier to show their independence.
probability-distributions normal-distribution
probability-distributions normal-distribution
edited Nov 15 at 14:47
Davide Giraudo
123k16149253
123k16149253
asked Nov 15 at 11:16
Maxius Xu
113
113
That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
– StubbornAtom
Nov 15 at 11:28
The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
– Maxius Xu
Nov 15 at 11:29
add a comment |
That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
– StubbornAtom
Nov 15 at 11:28
The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
– Maxius Xu
Nov 15 at 11:29
That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
– StubbornAtom
Nov 15 at 11:28
That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
– StubbornAtom
Nov 15 at 11:28
The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
– Maxius Xu
Nov 15 at 11:29
The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
– Maxius Xu
Nov 15 at 11:29
add a comment |
2 Answers
2
active
oldest
votes
up vote
1
down vote
In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.
To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.
Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.
Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.
First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.
Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.
So it suffices to prove that their covariance equals $0$.
Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$
So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$
add a comment |
up vote
0
down vote
Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
begin{align*}
text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
&=sigma^2 sum_{i=1}^n a_i b_j^ast
end{align*}
So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.
add a comment |
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
1
down vote
In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.
To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.
Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.
Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.
First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.
Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.
So it suffices to prove that their covariance equals $0$.
Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$
So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$
add a comment |
up vote
1
down vote
In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.
To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.
Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.
Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.
First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.
Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.
So it suffices to prove that their covariance equals $0$.
Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$
So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$
add a comment |
up vote
1
down vote
up vote
1
down vote
In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.
To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.
Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.
Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.
First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.
Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.
So it suffices to prove that their covariance equals $0$.
Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$
So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$
In general if $X_1,dots,X_n$ are independent and all have normal distribution then random vector $mathbf X:=(X_1,dots,X_n)^T$ has normal distribution.
To get light on this realize that there is a common PDF that is the product of the PDF's of the $X_i$.
Then also in general random vector $Amathbf X$ has normal distribution where $A$ is an $mtimes n$ matrix.
Now note that $(Y,Z)^T$ can be written as $Amathbf X$ where $A$ is an $2times n$ matrix.
First row of $A$ is $(a_1,dots, a_n)$ and second row of $A$ is $(b_1,dots, b_n)$.
Here $Y$ and $Z$ have a joint normal distribution and in that case they are independent if they are uncorrelated.
So it suffices to prove that their covariance equals $0$.
Using bilinearity of $mathsf{Cov}$ we find:$$mathsf{Cov}(Y,Z)=sum_{i=1}^nsum_{j=1}^na_ib_jmathsf{Cov}(X_i,X_j)=sigma^2sum_{i=1}^na_ib_i$$
So that $$mathsf{Cov}(Y,Z)=0iffsum_{i=1}^na_ib_i=0$$
edited Nov 15 at 11:42
answered Nov 15 at 11:34
drhab
94.2k543125
94.2k543125
add a comment |
add a comment |
up vote
0
down vote
Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
begin{align*}
text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
&=sigma^2 sum_{i=1}^n a_i b_j^ast
end{align*}
So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.
add a comment |
up vote
0
down vote
Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
begin{align*}
text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
&=sigma^2 sum_{i=1}^n a_i b_j^ast
end{align*}
So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.
add a comment |
up vote
0
down vote
up vote
0
down vote
Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
begin{align*}
text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
&=sigma^2 sum_{i=1}^n a_i b_j^ast
end{align*}
So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.
Since your variables are jointly Gaussian, then the independence of $Y$ and $Z$ is given by their decoration. Observe that
begin{align*}
text{Cov}(Y,Z) &= text{Cov}(sum_{i=1}^n a_i X_i, sum_{j=1}^n b_j X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes text{Cov}( X_i, X_j)\
&=sum_{i=1}^nsum_{j=1}^n a_i b_j^asttimes sigma^2mathbf{1} (i=j)\
&=sigma^2 sum_{i=1}^n a_i b_j^ast
end{align*}
So $X$ and $Y$ are independents if and only if $text{Cov}(Y,Z)=0$ which is if and only if $sum_{i=1}^n a_i b_j^ast=0$.
answered Nov 15 at 11:43
P. Quinton
1,261213
1,261213
add a comment |
add a comment |
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2999556%2fshowing-sum-a-ix-i-and-sum-b-ix-i-are-independent-iff-sum-a-ib-i-0-whe%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
That the distribution of $(Y,Z)$ is bivariate normal can be shown using moment generating functions. So $Y$ and $Z$ are independent iff they are uncorrelated. That condition is precisely $sum a_ib_i=0$ which is to be shown.
– StubbornAtom
Nov 15 at 11:28
The key is that I can't prove that distribution of (Y,Z) is bivariate normal.
– Maxius Xu
Nov 15 at 11:29