The Matrix Cookbook

Learn / The Matrix Cookbook

A - One-dimensional Results

Advanced formula selection, assumption checking, and exact application for One-dimensional Results, book pages 64-65.

Learning path

0%

0 of 2 sections marked complete · about 25 minutes

Learning objectives

What you will be able to explain

  • Scalar Gaussian essentials
  • Second moment from mean and variance
  • Products and completion of the square
  • Sum of independent Gaussians
  • One-dimensional Gaussian mixtures
  • Scalar mixture variance

Section 01

Scalar Gaussian essentials to Products and completion of the square

01

Scalar Gaussian essentials

The scalar formulas specialize the matrix Gaussian identities.

Guided checkpoint

Let xN(mu,sigma2)x\sim N(mu,sigma^2).

Source: Appendix A.1, p. 64

02

Second moment from mean and variance

E[x2]=Var(x)+E[x]2=4+9=13E[x^2]=Var(x)+E[x]^2=4+9=13.

Guided checkpoint

If E[x]=3E[x]=3 and Var(x)=4Var(x)=4, compute E[x2]E[x^2].

Source: Appendix A.1, p. 64

03

Products and completion of the square

Gaussian multiplication is most transparent in natural/precision parameters.

Guided checkpoint

For scalar Gaussian factors.

Source: Appendix A.1, p. 64

Section 02

Sum of independent Gaussians to Scalar mixture variance

01

Sum of independent Gaussians

Independent Gaussian convolution adds means and variances.

Guided checkpoint

If xN(mux,sigmax2)x\sim N(mu_x,sigma_x^2) and yN(muy,sigmay2)y\sim N(mu_y,sigma_y^2) independently, what is x+yx+y?

Source: Appendix A.1, p. 64

02

One-dimensional Gaussian mixtures

Total variance separates within-component and between-component contributions.

Guided checkpoint

For p(x)=sumkpikN(xmuk,sigmak2)p(x)=sum_k pi_k N(x|mu_k,sigma_k^2).

Source: Appendix A.2, p. 65

03

Scalar mixture variance

Mean is zero; within variance is 1 and between-mean variance is 1, totaling 2.

Guided checkpoint

Equal weights combine N(1,1)N(-1,1) and N(1,1)N(1,1). Compute mixture variance.

Source: Appendix A.2, p. 65

Knowledge check

Turn understanding into recall.

The quiz now follows the same concepts in scored form. You can return to this lesson from the quiz whenever a gap appears.