← The Matrix Cookbook

Learn / The Matrix Cookbook

A - One-dimensional Results

Advanced formula selection, assumption checking, and exact application for One-dimensional Results, book pages 64-65.

Learning path

0%

0 of 2 sections marked complete · about 25 minutes

Learning objectives

What you will be able to explain

  • Scalar Gaussian essentials
  • Second moment from mean and variance
  • Products and completion of the square
  • Sum of independent Gaussians
  • One-dimensional Gaussian mixtures
  • Scalar mixture variance

Section 01

Scalar Gaussian essentials to Products and completion of the square

01

Scalar Gaussian essentials

The scalar formulas specialize the matrix Gaussian identities.

Guided checkpoint

Let x∼N(mu,sigma2)x\sim N(mu,sigma^2).

Source: Appendix A.1, p. 64

02

Second moment from mean and variance

E[x2]=Var(x)+E[x]2=4+9=13E[x^2]=Var(x)+E[x]^2=4+9=13.

Guided checkpoint

If E[x]=3E[x]=3 and Var(x)=4Var(x)=4, compute E[x2]E[x^2].

Source: Appendix A.1, p. 64

03

Products and completion of the square

Gaussian multiplication is most transparent in natural/precision parameters.

Guided checkpoint

For scalar Gaussian factors.

Source: Appendix A.1, p. 64

Section 02

Sum of independent Gaussians to Scalar mixture variance

01

Sum of independent Gaussians

Independent Gaussian convolution adds means and variances.

Guided checkpoint

If x∼N(mux,sigmax2)x\sim N(mu_x,sigma_x^2) and y∼N(muy,sigmay2)y\sim N(mu_y,sigma_y^2) independently, what is x+yx+y?

Source: Appendix A.1, p. 64

02

One-dimensional Gaussian mixtures

Total variance separates within-component and between-component contributions.

Guided checkpoint

For p(x)=sumkpikN(x∣muk,sigmak2)p(x)=sum_k pi_k N(x|mu_k,sigma_k^2).

Source: Appendix A.2, p. 65

03

Scalar mixture variance

Mean is zero; within variance is 1 and between-mean variance is 1, totaling 2.

Guided checkpoint

Equal weights combine N(−1,1)N(-1,1) and N(1,1)N(1,1). Compute mixture variance.

Source: Appendix A.2, p. 65

Knowledge check

Turn understanding into recall.

The quiz now follows the same concepts in scored form. You can return to this lesson from the quiz whenever a gap appears.