Quiz dossier / Deep Learning Book

04 - Numerical Computation

Advanced mastery of Chapter 4, Numerical Computation, covering every named section across book pages 80-97.

11 questionsEstimated 60 min0 flagged

Session status

Draft

Question 1

3 point(s)

Stabilize a softmax

To compute $softmax(x)_i=\exp(x_i)/\sum_j\exp(x_j)$ without overflow, which transformation preserves the result?

Subtract

\max_j x_j

from every logit before exponentiating

Divide each logit by its own absolute value

Clip every exponential to exactly 1

Add the maximum logit to every logit