The Matrix Cookbook

Learn / The Matrix Cookbook

06 - Statistics and Probability

Advanced formula selection, assumption checking, and exact application for Statistics and Probability, book pages 34-36.

Learning path

0%

0 of 2 sections marked complete · about 25 minutes

Learning objectives

What you will be able to explain

  • Moment vocabulary
  • Covariance identities
  • Expectation of a linear combination
  • Sums of random vectors
  • Weighted scalar variable
  • Compute a projected variance

Section 01

Moment vocabulary to Expectation of a linear combination

01

Moment vocabulary

Covariance centers the second moment; cross-covariance links two vectors.

Guided checkpoint

Match quantity to definition for random vector xx.

Source: Sec. 6.1, pp. 34-35

02

Covariance identities

Uncorrelated does not imply independent without additional distributional assumptions.

Guided checkpoint

Assume finite second moments.

Source: Secs. 6.1-6.2, pp. 34-36

03

Expectation of a linear combination

Linearity gives 3(1)2(2)+4=113(1)-2(-2)+4=11.

Guided checkpoint

If E[x]=[1,2]TE[x]=[1,-2]^T, compute E[3x12x2+4]E[3x_1-2x_2+4].

Source: Sec. 6.2, p. 35

Section 02

Sums of random vectors to Compute a projected variance

01

Sums of random vectors

Cross terms remain unless uncorrelatedness or independence removes them.

Guided checkpoint

Let z=Ax+By+cz=Ax+By+c.

Source: Sec. 6.2, pp. 35-36

02

Weighted scalar variable

A linear projection turns covariance into a quadratic form.

Guided checkpoint

For scalar y=aTxy=a^Tx, match each result.

Source: Sec. 6.3, p. 36

03

Compute a projected variance

aTSigmaa=211+3=3a^T Sigma a=2-1-1+3=3.

Guided checkpoint

Let Sigma=[[2,1],[1,3]]Sigma=[[2,1],[1,3]] and a=[1,1]Ta=[1,-1]^T. Compute Var(aTx)Var(a^Tx).

Source: Sec. 6.3, p. 36

Knowledge check

Turn understanding into recall.

The quiz now follows the same concepts in scored form. You can return to this lesson from the quiz whenever a gap appears.