Use of law of total expectation without checking integrability
up vote
0
down vote
favorite
$newcommand{E}{mathbb E}$In basic probability classes, people often use the formula, namely the law of total expectation
$$E[X]=E[E[Xmid Y]]$$
without checking integrability of $X$.
I can't get my head around it, because we sometimes use it to check the integrability of $X$... Wow! We don't even know if $E[Xmid Y]$ exists, yet we use it.
Example.
For a simple example, I wanted to do it properly. For instance, consider nonnegative integrable random variables $Z$ and $X_i$ i.i.d. independent of $Z$. We need to check whether $$sum_{i= 1}^ZX_i $$
is integrable. I can do it like this
$$Eleft[sum_{i= 1}^ZX_i right]=Eleft[Eleft[sum_{i= 1}^ZX_imid Zright] right]=Eleft[sum_{i=1}^Z E[X_i] right]=E[Z]E[X_1]$$
But I thought this is cheating, so I considered $Xmathbb I_{X<K}$ for some constant $K>0$, then we have
begin{align}
sum_{i=1}^Z X_imathbb I_{X_i<K} leq ZK
end{align}
This is clearly integrable. So we can apply the same steps as before "legally" to show integrability and then MCT does the rest of the work
begin{align}
Eleft[sum_{i=1}^Z X_iright]stackrel{text{MCT}}{=}lim_{Ktoinfty}Eleft[sum_{i=1}^Z X_imathbb I_{X_i<K} right]=lim_{Ktoinfty}E[X_1mathbb I_{X_1<K}]E[Z]stackrel{text{MCT}}{=}E[X_1]E[Z]
end{align}
Do something similar always works, giving us the reason why people just use it? Indeed, I guess it is boring to repeat these kind of steps if it always works, therefore my question:
Question. Can we actually apply the law of total expectation to show integrability? If the answer is "yes", is there a general proof? If the answer is "no", are there examples where it fails?
probability-theory conditional-expectation expected-value
add a comment |
up vote
0
down vote
favorite
$newcommand{E}{mathbb E}$In basic probability classes, people often use the formula, namely the law of total expectation
$$E[X]=E[E[Xmid Y]]$$
without checking integrability of $X$.
I can't get my head around it, because we sometimes use it to check the integrability of $X$... Wow! We don't even know if $E[Xmid Y]$ exists, yet we use it.
Example.
For a simple example, I wanted to do it properly. For instance, consider nonnegative integrable random variables $Z$ and $X_i$ i.i.d. independent of $Z$. We need to check whether $$sum_{i= 1}^ZX_i $$
is integrable. I can do it like this
$$Eleft[sum_{i= 1}^ZX_i right]=Eleft[Eleft[sum_{i= 1}^ZX_imid Zright] right]=Eleft[sum_{i=1}^Z E[X_i] right]=E[Z]E[X_1]$$
But I thought this is cheating, so I considered $Xmathbb I_{X<K}$ for some constant $K>0$, then we have
begin{align}
sum_{i=1}^Z X_imathbb I_{X_i<K} leq ZK
end{align}
This is clearly integrable. So we can apply the same steps as before "legally" to show integrability and then MCT does the rest of the work
begin{align}
Eleft[sum_{i=1}^Z X_iright]stackrel{text{MCT}}{=}lim_{Ktoinfty}Eleft[sum_{i=1}^Z X_imathbb I_{X_i<K} right]=lim_{Ktoinfty}E[X_1mathbb I_{X_1<K}]E[Z]stackrel{text{MCT}}{=}E[X_1]E[Z]
end{align}
Do something similar always works, giving us the reason why people just use it? Indeed, I guess it is boring to repeat these kind of steps if it always works, therefore my question:
Question. Can we actually apply the law of total expectation to show integrability? If the answer is "yes", is there a general proof? If the answer is "no", are there examples where it fails?
probability-theory conditional-expectation expected-value
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
$newcommand{E}{mathbb E}$In basic probability classes, people often use the formula, namely the law of total expectation
$$E[X]=E[E[Xmid Y]]$$
without checking integrability of $X$.
I can't get my head around it, because we sometimes use it to check the integrability of $X$... Wow! We don't even know if $E[Xmid Y]$ exists, yet we use it.
Example.
For a simple example, I wanted to do it properly. For instance, consider nonnegative integrable random variables $Z$ and $X_i$ i.i.d. independent of $Z$. We need to check whether $$sum_{i= 1}^ZX_i $$
is integrable. I can do it like this
$$Eleft[sum_{i= 1}^ZX_i right]=Eleft[Eleft[sum_{i= 1}^ZX_imid Zright] right]=Eleft[sum_{i=1}^Z E[X_i] right]=E[Z]E[X_1]$$
But I thought this is cheating, so I considered $Xmathbb I_{X<K}$ for some constant $K>0$, then we have
begin{align}
sum_{i=1}^Z X_imathbb I_{X_i<K} leq ZK
end{align}
This is clearly integrable. So we can apply the same steps as before "legally" to show integrability and then MCT does the rest of the work
begin{align}
Eleft[sum_{i=1}^Z X_iright]stackrel{text{MCT}}{=}lim_{Ktoinfty}Eleft[sum_{i=1}^Z X_imathbb I_{X_i<K} right]=lim_{Ktoinfty}E[X_1mathbb I_{X_1<K}]E[Z]stackrel{text{MCT}}{=}E[X_1]E[Z]
end{align}
Do something similar always works, giving us the reason why people just use it? Indeed, I guess it is boring to repeat these kind of steps if it always works, therefore my question:
Question. Can we actually apply the law of total expectation to show integrability? If the answer is "yes", is there a general proof? If the answer is "no", are there examples where it fails?
probability-theory conditional-expectation expected-value
$newcommand{E}{mathbb E}$In basic probability classes, people often use the formula, namely the law of total expectation
$$E[X]=E[E[Xmid Y]]$$
without checking integrability of $X$.
I can't get my head around it, because we sometimes use it to check the integrability of $X$... Wow! We don't even know if $E[Xmid Y]$ exists, yet we use it.
Example.
For a simple example, I wanted to do it properly. For instance, consider nonnegative integrable random variables $Z$ and $X_i$ i.i.d. independent of $Z$. We need to check whether $$sum_{i= 1}^ZX_i $$
is integrable. I can do it like this
$$Eleft[sum_{i= 1}^ZX_i right]=Eleft[Eleft[sum_{i= 1}^ZX_imid Zright] right]=Eleft[sum_{i=1}^Z E[X_i] right]=E[Z]E[X_1]$$
But I thought this is cheating, so I considered $Xmathbb I_{X<K}$ for some constant $K>0$, then we have
begin{align}
sum_{i=1}^Z X_imathbb I_{X_i<K} leq ZK
end{align}
This is clearly integrable. So we can apply the same steps as before "legally" to show integrability and then MCT does the rest of the work
begin{align}
Eleft[sum_{i=1}^Z X_iright]stackrel{text{MCT}}{=}lim_{Ktoinfty}Eleft[sum_{i=1}^Z X_imathbb I_{X_i<K} right]=lim_{Ktoinfty}E[X_1mathbb I_{X_1<K}]E[Z]stackrel{text{MCT}}{=}E[X_1]E[Z]
end{align}
Do something similar always works, giving us the reason why people just use it? Indeed, I guess it is boring to repeat these kind of steps if it always works, therefore my question:
Question. Can we actually apply the law of total expectation to show integrability? If the answer is "yes", is there a general proof? If the answer is "no", are there examples where it fails?
probability-theory conditional-expectation expected-value
probability-theory conditional-expectation expected-value
edited Nov 17 at 15:50
asked Nov 17 at 15:43
Shashi
6,9191527
6,9191527
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
up vote
1
down vote
accepted
All the usual laws of conditional expectation work for nonnegative random variables, integrable or not, if you allow the value $+infty$. For instance, if $X$ is nonnegative, $E[X mid Y]$ will always exist, but potentially could equal $+infty$ with positive probability. And if $X$ is nonnegative and not integrable, then you will get $E[E[X mid Y]] = +infty$ as well (i.e. $E[X mid Y]$ is nonnegative and not integrable). These cases are often left as exercises since it is a little tedious to write out the proofs, but you can show it by considering "cut off" random variables like $X_n = X 1_{X le n}$ and using monotone convergence.
The properties do not necessarily hold for signed random variables that may not be integrable. However, you can determine whether a random variable $X$ is integrable by computing $E[|X| mid Y]$ and seeing if $E[E[|X| mid Y]] < infty$, and if so then you will know that $E[X] = E[E[X mid Y]]$.
So it actually makes sense to use the law of total expectation for checking integrability. Many thanks! I suddenly remember that there is an exercise like that in Rick Durret's book. Silly me that I forgot about it. Thanks again!
– Shashi
Nov 17 at 16:05
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
1
down vote
accepted
All the usual laws of conditional expectation work for nonnegative random variables, integrable or not, if you allow the value $+infty$. For instance, if $X$ is nonnegative, $E[X mid Y]$ will always exist, but potentially could equal $+infty$ with positive probability. And if $X$ is nonnegative and not integrable, then you will get $E[E[X mid Y]] = +infty$ as well (i.e. $E[X mid Y]$ is nonnegative and not integrable). These cases are often left as exercises since it is a little tedious to write out the proofs, but you can show it by considering "cut off" random variables like $X_n = X 1_{X le n}$ and using monotone convergence.
The properties do not necessarily hold for signed random variables that may not be integrable. However, you can determine whether a random variable $X$ is integrable by computing $E[|X| mid Y]$ and seeing if $E[E[|X| mid Y]] < infty$, and if so then you will know that $E[X] = E[E[X mid Y]]$.
So it actually makes sense to use the law of total expectation for checking integrability. Many thanks! I suddenly remember that there is an exercise like that in Rick Durret's book. Silly me that I forgot about it. Thanks again!
– Shashi
Nov 17 at 16:05
add a comment |
up vote
1
down vote
accepted
All the usual laws of conditional expectation work for nonnegative random variables, integrable or not, if you allow the value $+infty$. For instance, if $X$ is nonnegative, $E[X mid Y]$ will always exist, but potentially could equal $+infty$ with positive probability. And if $X$ is nonnegative and not integrable, then you will get $E[E[X mid Y]] = +infty$ as well (i.e. $E[X mid Y]$ is nonnegative and not integrable). These cases are often left as exercises since it is a little tedious to write out the proofs, but you can show it by considering "cut off" random variables like $X_n = X 1_{X le n}$ and using monotone convergence.
The properties do not necessarily hold for signed random variables that may not be integrable. However, you can determine whether a random variable $X$ is integrable by computing $E[|X| mid Y]$ and seeing if $E[E[|X| mid Y]] < infty$, and if so then you will know that $E[X] = E[E[X mid Y]]$.
So it actually makes sense to use the law of total expectation for checking integrability. Many thanks! I suddenly remember that there is an exercise like that in Rick Durret's book. Silly me that I forgot about it. Thanks again!
– Shashi
Nov 17 at 16:05
add a comment |
up vote
1
down vote
accepted
up vote
1
down vote
accepted
All the usual laws of conditional expectation work for nonnegative random variables, integrable or not, if you allow the value $+infty$. For instance, if $X$ is nonnegative, $E[X mid Y]$ will always exist, but potentially could equal $+infty$ with positive probability. And if $X$ is nonnegative and not integrable, then you will get $E[E[X mid Y]] = +infty$ as well (i.e. $E[X mid Y]$ is nonnegative and not integrable). These cases are often left as exercises since it is a little tedious to write out the proofs, but you can show it by considering "cut off" random variables like $X_n = X 1_{X le n}$ and using monotone convergence.
The properties do not necessarily hold for signed random variables that may not be integrable. However, you can determine whether a random variable $X$ is integrable by computing $E[|X| mid Y]$ and seeing if $E[E[|X| mid Y]] < infty$, and if so then you will know that $E[X] = E[E[X mid Y]]$.
All the usual laws of conditional expectation work for nonnegative random variables, integrable or not, if you allow the value $+infty$. For instance, if $X$ is nonnegative, $E[X mid Y]$ will always exist, but potentially could equal $+infty$ with positive probability. And if $X$ is nonnegative and not integrable, then you will get $E[E[X mid Y]] = +infty$ as well (i.e. $E[X mid Y]$ is nonnegative and not integrable). These cases are often left as exercises since it is a little tedious to write out the proofs, but you can show it by considering "cut off" random variables like $X_n = X 1_{X le n}$ and using monotone convergence.
The properties do not necessarily hold for signed random variables that may not be integrable. However, you can determine whether a random variable $X$ is integrable by computing $E[|X| mid Y]$ and seeing if $E[E[|X| mid Y]] < infty$, and if so then you will know that $E[X] = E[E[X mid Y]]$.
answered Nov 17 at 15:58
Nate Eldredge
61.6k680167
61.6k680167
So it actually makes sense to use the law of total expectation for checking integrability. Many thanks! I suddenly remember that there is an exercise like that in Rick Durret's book. Silly me that I forgot about it. Thanks again!
– Shashi
Nov 17 at 16:05
add a comment |
So it actually makes sense to use the law of total expectation for checking integrability. Many thanks! I suddenly remember that there is an exercise like that in Rick Durret's book. Silly me that I forgot about it. Thanks again!
– Shashi
Nov 17 at 16:05
So it actually makes sense to use the law of total expectation for checking integrability. Many thanks! I suddenly remember that there is an exercise like that in Rick Durret's book. Silly me that I forgot about it. Thanks again!
– Shashi
Nov 17 at 16:05
So it actually makes sense to use the law of total expectation for checking integrability. Many thanks! I suddenly remember that there is an exercise like that in Rick Durret's book. Silly me that I forgot about it. Thanks again!
– Shashi
Nov 17 at 16:05
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3002485%2fuse-of-law-of-total-expectation-without-checking-integrability%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown