Does a zero conditional expectation imply pairwise covariance is 0?
$begingroup$
Suppose in econometrics,
$$ y = beta_{0} + beta_{1}x_{1} + beta_{2}x_{2} + ... + beta_{k}x_{k} + u$$
In Gujarati's book, it says that the following equation (1)
$$ E[u | x_{1}, x_{2},..., x_{k}] = E[u] = 0 tag{1}$$
given that
$$ x_{1}, x_{2},..., x_{k}$$are independent from each other
implies (with bilinearity property of covariance)
$$ Cov(u, x_{1} + x_{2} + ... +x_{k}) = cov(u, x_{1}) = cov(u, x_{2}) = ... = cov(u,x_{k}) = 0$$
How can we derive this result?
Book's content:
Thank you very much.
statistics statistical-inference conditional-expectation conditional-probability covariance
$endgroup$
add a comment |
$begingroup$
Suppose in econometrics,
$$ y = beta_{0} + beta_{1}x_{1} + beta_{2}x_{2} + ... + beta_{k}x_{k} + u$$
In Gujarati's book, it says that the following equation (1)
$$ E[u | x_{1}, x_{2},..., x_{k}] = E[u] = 0 tag{1}$$
given that
$$ x_{1}, x_{2},..., x_{k}$$are independent from each other
implies (with bilinearity property of covariance)
$$ Cov(u, x_{1} + x_{2} + ... +x_{k}) = cov(u, x_{1}) = cov(u, x_{2}) = ... = cov(u,x_{k}) = 0$$
How can we derive this result?
Book's content:
Thank you very much.
statistics statistical-inference conditional-expectation conditional-probability covariance
$endgroup$
add a comment |
$begingroup$
Suppose in econometrics,
$$ y = beta_{0} + beta_{1}x_{1} + beta_{2}x_{2} + ... + beta_{k}x_{k} + u$$
In Gujarati's book, it says that the following equation (1)
$$ E[u | x_{1}, x_{2},..., x_{k}] = E[u] = 0 tag{1}$$
given that
$$ x_{1}, x_{2},..., x_{k}$$are independent from each other
implies (with bilinearity property of covariance)
$$ Cov(u, x_{1} + x_{2} + ... +x_{k}) = cov(u, x_{1}) = cov(u, x_{2}) = ... = cov(u,x_{k}) = 0$$
How can we derive this result?
Book's content:
Thank you very much.
statistics statistical-inference conditional-expectation conditional-probability covariance
$endgroup$
Suppose in econometrics,
$$ y = beta_{0} + beta_{1}x_{1} + beta_{2}x_{2} + ... + beta_{k}x_{k} + u$$
In Gujarati's book, it says that the following equation (1)
$$ E[u | x_{1}, x_{2},..., x_{k}] = E[u] = 0 tag{1}$$
given that
$$ x_{1}, x_{2},..., x_{k}$$are independent from each other
implies (with bilinearity property of covariance)
$$ Cov(u, x_{1} + x_{2} + ... +x_{k}) = cov(u, x_{1}) = cov(u, x_{2}) = ... = cov(u,x_{k}) = 0$$
How can we derive this result?
Book's content:
Thank you very much.
statistics statistical-inference conditional-expectation conditional-probability covariance
statistics statistical-inference conditional-expectation conditional-probability covariance
asked Jan 8 at 22:31
commentallez-vouscommentallez-vous
2129
2129
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Argue as follows: For the $i$th variable $x_i$ we have:
$$E(ux_i)stackrel{(a)}=E[E(ux_imid x_1,x_2,ldots,x_k)]stackrel{(b)}=E[x_i E(umid x_1,x_2,ldots,x_k)]stackrel{(1)}=E[x_icdot 0]=0 stackrel{(1)}= E(u)E(x_i)$$
In step (a) we use the tower property of conditional expectation; in (b) we use the fact that $x_i$ is measurable with respect to $sigma(x_1,x_2,ldots,x_k)$, so can be pulled out of the conditional expectation (i.e., we can take out what is known).
Conclude that $E(ux_i)=E(u)E(x_i)$, which implies zero covariance between $u$ and $x_i$.
$endgroup$
$begingroup$
Thank you grand_chat, but I didn't get step (b) that x can be measured by $$sigma(x_{1},x_{2},...,x_{k}$$ so that we can pull it out? Could you please elaborate this a liitle bit? I appreciate it!
$endgroup$
– commentallez-vous
Jan 8 at 22:51
$begingroup$
@commentallez-vous Saying that "$x_i$ is measurable with respect to $sigma(x_1,ldots,x_k)$" means, roughly speaking, that $x_i$ is a function of $x_1,ldots, x_k$, and therefore we can 'take out what is known'. See my edit.
$endgroup$
– grand_chat
Jan 8 at 22:54
$begingroup$
Oh...so it is basically like for a given observation, this particular x is known as a constant, therefore the expected value of a constant is the constant itself, is this understanding right?
$endgroup$
– commentallez-vous
Jan 8 at 22:57
$begingroup$
@commentallez-vous Exactly. If you condition on $x_1,ldots, x_k$ then the value of $x_i$ is known, so $x_i$ can be treated as a constant and "factored out" of $E(ux_imid x_1,ldots,x_k)$.
$endgroup$
– grand_chat
Jan 8 at 22:59
$begingroup$
Thank you so much! This is a really nice proof and you saved my life! Much obliged!
$endgroup$
– commentallez-vous
Jan 8 at 23:13
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3066820%2fdoes-a-zero-conditional-expectation-imply-pairwise-covariance-is-0%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Argue as follows: For the $i$th variable $x_i$ we have:
$$E(ux_i)stackrel{(a)}=E[E(ux_imid x_1,x_2,ldots,x_k)]stackrel{(b)}=E[x_i E(umid x_1,x_2,ldots,x_k)]stackrel{(1)}=E[x_icdot 0]=0 stackrel{(1)}= E(u)E(x_i)$$
In step (a) we use the tower property of conditional expectation; in (b) we use the fact that $x_i$ is measurable with respect to $sigma(x_1,x_2,ldots,x_k)$, so can be pulled out of the conditional expectation (i.e., we can take out what is known).
Conclude that $E(ux_i)=E(u)E(x_i)$, which implies zero covariance between $u$ and $x_i$.
$endgroup$
$begingroup$
Thank you grand_chat, but I didn't get step (b) that x can be measured by $$sigma(x_{1},x_{2},...,x_{k}$$ so that we can pull it out? Could you please elaborate this a liitle bit? I appreciate it!
$endgroup$
– commentallez-vous
Jan 8 at 22:51
$begingroup$
@commentallez-vous Saying that "$x_i$ is measurable with respect to $sigma(x_1,ldots,x_k)$" means, roughly speaking, that $x_i$ is a function of $x_1,ldots, x_k$, and therefore we can 'take out what is known'. See my edit.
$endgroup$
– grand_chat
Jan 8 at 22:54
$begingroup$
Oh...so it is basically like for a given observation, this particular x is known as a constant, therefore the expected value of a constant is the constant itself, is this understanding right?
$endgroup$
– commentallez-vous
Jan 8 at 22:57
$begingroup$
@commentallez-vous Exactly. If you condition on $x_1,ldots, x_k$ then the value of $x_i$ is known, so $x_i$ can be treated as a constant and "factored out" of $E(ux_imid x_1,ldots,x_k)$.
$endgroup$
– grand_chat
Jan 8 at 22:59
$begingroup$
Thank you so much! This is a really nice proof and you saved my life! Much obliged!
$endgroup$
– commentallez-vous
Jan 8 at 23:13
add a comment |
$begingroup$
Argue as follows: For the $i$th variable $x_i$ we have:
$$E(ux_i)stackrel{(a)}=E[E(ux_imid x_1,x_2,ldots,x_k)]stackrel{(b)}=E[x_i E(umid x_1,x_2,ldots,x_k)]stackrel{(1)}=E[x_icdot 0]=0 stackrel{(1)}= E(u)E(x_i)$$
In step (a) we use the tower property of conditional expectation; in (b) we use the fact that $x_i$ is measurable with respect to $sigma(x_1,x_2,ldots,x_k)$, so can be pulled out of the conditional expectation (i.e., we can take out what is known).
Conclude that $E(ux_i)=E(u)E(x_i)$, which implies zero covariance between $u$ and $x_i$.
$endgroup$
$begingroup$
Thank you grand_chat, but I didn't get step (b) that x can be measured by $$sigma(x_{1},x_{2},...,x_{k}$$ so that we can pull it out? Could you please elaborate this a liitle bit? I appreciate it!
$endgroup$
– commentallez-vous
Jan 8 at 22:51
$begingroup$
@commentallez-vous Saying that "$x_i$ is measurable with respect to $sigma(x_1,ldots,x_k)$" means, roughly speaking, that $x_i$ is a function of $x_1,ldots, x_k$, and therefore we can 'take out what is known'. See my edit.
$endgroup$
– grand_chat
Jan 8 at 22:54
$begingroup$
Oh...so it is basically like for a given observation, this particular x is known as a constant, therefore the expected value of a constant is the constant itself, is this understanding right?
$endgroup$
– commentallez-vous
Jan 8 at 22:57
$begingroup$
@commentallez-vous Exactly. If you condition on $x_1,ldots, x_k$ then the value of $x_i$ is known, so $x_i$ can be treated as a constant and "factored out" of $E(ux_imid x_1,ldots,x_k)$.
$endgroup$
– grand_chat
Jan 8 at 22:59
$begingroup$
Thank you so much! This is a really nice proof and you saved my life! Much obliged!
$endgroup$
– commentallez-vous
Jan 8 at 23:13
add a comment |
$begingroup$
Argue as follows: For the $i$th variable $x_i$ we have:
$$E(ux_i)stackrel{(a)}=E[E(ux_imid x_1,x_2,ldots,x_k)]stackrel{(b)}=E[x_i E(umid x_1,x_2,ldots,x_k)]stackrel{(1)}=E[x_icdot 0]=0 stackrel{(1)}= E(u)E(x_i)$$
In step (a) we use the tower property of conditional expectation; in (b) we use the fact that $x_i$ is measurable with respect to $sigma(x_1,x_2,ldots,x_k)$, so can be pulled out of the conditional expectation (i.e., we can take out what is known).
Conclude that $E(ux_i)=E(u)E(x_i)$, which implies zero covariance between $u$ and $x_i$.
$endgroup$
Argue as follows: For the $i$th variable $x_i$ we have:
$$E(ux_i)stackrel{(a)}=E[E(ux_imid x_1,x_2,ldots,x_k)]stackrel{(b)}=E[x_i E(umid x_1,x_2,ldots,x_k)]stackrel{(1)}=E[x_icdot 0]=0 stackrel{(1)}= E(u)E(x_i)$$
In step (a) we use the tower property of conditional expectation; in (b) we use the fact that $x_i$ is measurable with respect to $sigma(x_1,x_2,ldots,x_k)$, so can be pulled out of the conditional expectation (i.e., we can take out what is known).
Conclude that $E(ux_i)=E(u)E(x_i)$, which implies zero covariance between $u$ and $x_i$.
edited Jan 8 at 22:55
answered Jan 8 at 22:41
grand_chatgrand_chat
20.3k11326
20.3k11326
$begingroup$
Thank you grand_chat, but I didn't get step (b) that x can be measured by $$sigma(x_{1},x_{2},...,x_{k}$$ so that we can pull it out? Could you please elaborate this a liitle bit? I appreciate it!
$endgroup$
– commentallez-vous
Jan 8 at 22:51
$begingroup$
@commentallez-vous Saying that "$x_i$ is measurable with respect to $sigma(x_1,ldots,x_k)$" means, roughly speaking, that $x_i$ is a function of $x_1,ldots, x_k$, and therefore we can 'take out what is known'. See my edit.
$endgroup$
– grand_chat
Jan 8 at 22:54
$begingroup$
Oh...so it is basically like for a given observation, this particular x is known as a constant, therefore the expected value of a constant is the constant itself, is this understanding right?
$endgroup$
– commentallez-vous
Jan 8 at 22:57
$begingroup$
@commentallez-vous Exactly. If you condition on $x_1,ldots, x_k$ then the value of $x_i$ is known, so $x_i$ can be treated as a constant and "factored out" of $E(ux_imid x_1,ldots,x_k)$.
$endgroup$
– grand_chat
Jan 8 at 22:59
$begingroup$
Thank you so much! This is a really nice proof and you saved my life! Much obliged!
$endgroup$
– commentallez-vous
Jan 8 at 23:13
add a comment |
$begingroup$
Thank you grand_chat, but I didn't get step (b) that x can be measured by $$sigma(x_{1},x_{2},...,x_{k}$$ so that we can pull it out? Could you please elaborate this a liitle bit? I appreciate it!
$endgroup$
– commentallez-vous
Jan 8 at 22:51
$begingroup$
@commentallez-vous Saying that "$x_i$ is measurable with respect to $sigma(x_1,ldots,x_k)$" means, roughly speaking, that $x_i$ is a function of $x_1,ldots, x_k$, and therefore we can 'take out what is known'. See my edit.
$endgroup$
– grand_chat
Jan 8 at 22:54
$begingroup$
Oh...so it is basically like for a given observation, this particular x is known as a constant, therefore the expected value of a constant is the constant itself, is this understanding right?
$endgroup$
– commentallez-vous
Jan 8 at 22:57
$begingroup$
@commentallez-vous Exactly. If you condition on $x_1,ldots, x_k$ then the value of $x_i$ is known, so $x_i$ can be treated as a constant and "factored out" of $E(ux_imid x_1,ldots,x_k)$.
$endgroup$
– grand_chat
Jan 8 at 22:59
$begingroup$
Thank you so much! This is a really nice proof and you saved my life! Much obliged!
$endgroup$
– commentallez-vous
Jan 8 at 23:13
$begingroup$
Thank you grand_chat, but I didn't get step (b) that x can be measured by $$sigma(x_{1},x_{2},...,x_{k}$$ so that we can pull it out? Could you please elaborate this a liitle bit? I appreciate it!
$endgroup$
– commentallez-vous
Jan 8 at 22:51
$begingroup$
Thank you grand_chat, but I didn't get step (b) that x can be measured by $$sigma(x_{1},x_{2},...,x_{k}$$ so that we can pull it out? Could you please elaborate this a liitle bit? I appreciate it!
$endgroup$
– commentallez-vous
Jan 8 at 22:51
$begingroup$
@commentallez-vous Saying that "$x_i$ is measurable with respect to $sigma(x_1,ldots,x_k)$" means, roughly speaking, that $x_i$ is a function of $x_1,ldots, x_k$, and therefore we can 'take out what is known'. See my edit.
$endgroup$
– grand_chat
Jan 8 at 22:54
$begingroup$
@commentallez-vous Saying that "$x_i$ is measurable with respect to $sigma(x_1,ldots,x_k)$" means, roughly speaking, that $x_i$ is a function of $x_1,ldots, x_k$, and therefore we can 'take out what is known'. See my edit.
$endgroup$
– grand_chat
Jan 8 at 22:54
$begingroup$
Oh...so it is basically like for a given observation, this particular x is known as a constant, therefore the expected value of a constant is the constant itself, is this understanding right?
$endgroup$
– commentallez-vous
Jan 8 at 22:57
$begingroup$
Oh...so it is basically like for a given observation, this particular x is known as a constant, therefore the expected value of a constant is the constant itself, is this understanding right?
$endgroup$
– commentallez-vous
Jan 8 at 22:57
$begingroup$
@commentallez-vous Exactly. If you condition on $x_1,ldots, x_k$ then the value of $x_i$ is known, so $x_i$ can be treated as a constant and "factored out" of $E(ux_imid x_1,ldots,x_k)$.
$endgroup$
– grand_chat
Jan 8 at 22:59
$begingroup$
@commentallez-vous Exactly. If you condition on $x_1,ldots, x_k$ then the value of $x_i$ is known, so $x_i$ can be treated as a constant and "factored out" of $E(ux_imid x_1,ldots,x_k)$.
$endgroup$
– grand_chat
Jan 8 at 22:59
$begingroup$
Thank you so much! This is a really nice proof and you saved my life! Much obliged!
$endgroup$
– commentallez-vous
Jan 8 at 23:13
$begingroup$
Thank you so much! This is a really nice proof and you saved my life! Much obliged!
$endgroup$
– commentallez-vous
Jan 8 at 23:13
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3066820%2fdoes-a-zero-conditional-expectation-imply-pairwise-covariance-is-0%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown