ABCDE
1Main
2Resources
3https://course.fast.ai/Resources/book.html
4https://github.com/fastai/fastbookhttps://www.youtube.com/playlist?list=PL_iWQOsE6TfVmKkQHucjPAoRtIJYt8a5A
5Glossary
6additionaddition is defined for matrices with the same shape (dimension size)
7associativitymatrix multiplication is associative
8broadcastingdeep learning convention of adding a vector repeatedly to a matrix
9commutivitymatrix multiplication is not commutative
10determinant
11distributivematrix multiplication is distributive
12dot productmatrix product of two equal dimension vectors
13element-wise productalso known as the Hadamard product, simple multiplication of individual elements of matrices
14identity matrixthe identity matrix is a matrix that does not change any vector when we multiply that vector by that matrix. All main diagnoal entries in an identity matrix are 1, and all other values are zero
15linear combination
16matrixa 2D array of numbers
17matrix inversethe matrix inverse of A, A^-1, is defined as A(A^-1) = I_n
18matrix productdefined as the sum of A_i,k * B_k,j for all k
19multiplicationmultiplication is defined for a matrix and a scalar, multiplying two matrices is only defined for A_i,j if B_j,k, with product C_i,k. see matrix product.
20scalarmathematical object, often a real/integer in a single dimension
21span
22stochastic differential equation (SDE)
23tensora multi-dimensional array of numbers
24transposemirror image of a matrix across its main diagnoal, defined as A(T)_i,j = A_j,i. the transpose of (AB) is B^t*A^t
25vectora one-dimensional array of numbers
26
27
28
29
30
31Forward diffusion process where X_t is sample condition on X_t-1 using a Gaussian distribution with mean ((1 - B_t)^0.5)*x_t-1 and variance B_t
32B_t is usually predefined and fixed, T is total number of diffusion steps.
33
34
35
36Reverse generative process (denoising) has denoising distribution of P_theta*(x_t-1 | x_t), a Gaussian whose mean is
37defined using a trainable neural network mu_theta(x_t, t), with variance preset
38
39
40
41
42example of fixed forward SDE, transforms sample into noise