diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 00:
05 | Hello everyone and welcome to the second Hello everyone and welcome to the second
lecture of the course principles of lecture of the course principles of lecture of the course principles of
diffusion … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 01:
17 | from scratch. from scratch.
And this lecture is And this lecture is And this lecture is
going to be very important for the going to be very important for the going to be very important for the
subsequ… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 02:
19 | with the understanding of VAS. with the understanding of VAS.
So first we'll take a simple example. So first we'll take a simple example. So first we'll take a simple example.
Imagine that you have co… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 03:
19 | in cursive. Some of us
u don't write in cursive. So there are a u don't write in cursive. So there are a u don't write in cursive. So there are a
lot of different ways in which people lot of different… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 04:
26 | Then another time you press a button.
Another time you get another hello. This Another time you get another hello. This Another time you get another hello. This
time it might be some different student… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 05:
35 | such that or generate a machine such
that the samples drawn from that machine that the samples drawn from that machine that the samples drawn from that machine
are from the probability distribution ar… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 06:
45 | factors that determine the style of the factors that determine the style of the
handwriting. handwriting. handwriting.
So each student handwriting depends on So each student handwriting depends on So … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 08:
03 | So my first intuition is that okay fine So my first intuition is that okay fine
my first job is to figure out all these my first job is to figure out all these my first job is to figure out all these
… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 09:
02 | final shape of the handwriting. final shape of the handwriting.
So once you capture the secret recipe So once you capture the secret recipe So once you capture the secret recipe
for for for
a student … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 09:
57 | machine looks as follows. machine looks as follows.
Secret recipe is given as an input to Secret recipe is given as an input to Secret recipe is given as an input to
the machine. The machine takes thi… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 10:
52 | interesting, right? It it it looks like
okay fine this this it it makes a lot of okay fine this this it it makes a lot of okay fine this this it it makes a lot of
sense. [snorts] sense. [snorts] sense… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 11:
53 | now um in the rest of this lecture we We now um in the rest of this lecture we We
are going to assume that are going to assume that are going to assume that
for the handwriting example that we took fo… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 12:
54 | not know these factors beforehand. That
is why they are called as latent is why they are called as latent is why they are called as latent
variables. variables. variables.
So So
intuitively we think t… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 13:
51 | y-axis is represented by the symbol zed
2. Zed1 stands for slantness of the 2. Zed1 stands for slantness of the 2. Zed1 stands for slantness of the
handwriting and zed2 stands for neatness handwriting… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 14:
48 | below it's it's not neat.
So I have made some spelling mistake So I have made some spelling mistake So I have made some spelling mistake
here. But what I want to show is I want here. But what I want t… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 15:
33 | mapping which I was talking about. For mapping which I was talking about. For
example, if you pick a point here, you example, if you pick a point here, you example, if you pick a point here, you
know … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 16:
31 | in your class. in your class.
So this is also called as the So this is also called as the So this is also called as the
distribution in the latent space of the distribution in the latent space of the … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 17:
37 | typical handwriting typical handwriting
let's say it is divided into 28x 28 let's say it is divided into 28x 28 let's say it is divided into 28x 28
pixels. pixels. pixels.
So there are 784 numbers rig… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 18:
39 | latent space is has a mean of zero and a latent space is has a mean of zero and a
standard deviation of one or any other standard deviation of one or any other standard deviation of one or any other
v… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 19:
27 | So for now what we have seen is that we
have this general architecture for the have this general architecture for the have this general architecture for the
machine which takes the secret recipe as ma… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 20:
34 | another word for this machine which is
called as decoder. called as decoder. called as decoder.
Let us quickly summarize what all we Let us quickly summarize what all we Let us quickly summarize what … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 21:
44 | vary. So here you can see that as the
yellow dot moves around the Latin space, yellow dot moves around the Latin space, yellow dot moves around the Latin space,
the handwriting on the right hand side … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 22:
44 | next. So far we have used the decoder to
generate samples from the latent generate samples from the latent generate samples from the latent
variables. But what is this decoder variables. But what is t… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 23:
55 | we create a latent space with the latent
variables. So just as before we assume variables. So just as before we assume variables. So just as before we assume
that there are two latent variables zed th… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 24:
54 | know. [snorts]
Now let's say we have chosen a point in Now let's say we have chosen a point in Now let's say we have chosen a point in
the Latin space which corresponds to the the Latin space which co… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 25:
56 | we can represent digit 5 as a bunch of we can represent digit 5 as a bunch of
pixels pixels pixels
which are divided as 28 into 28 pixels where some pixels have a value of where some pixels have a val… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 27:
08 | five, if you closely look at it, it it
does look like a five. It's it's it's does look like a five. It's it's it's does look like a five. It's it's it's
almost something like this. Okay. So it looks l… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 28:
08 | is that with this approach we will get a
fixed shape of five every time but we fixed shape of five every time but we fixed shape of five every time but we
will not get variations of it and what will n… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 29:
10 | restricted to zero and one. You are open
to the possibility of to the possibility of to the possibility of
a color which appears in between white a color which appears in between white a color which a… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 30:
08 | the decoder does not give a single value
but for every pixel the decoder gives but for every pixel the decoder gives but for every pixel the decoder gives
the mean the mean the mean
and the standard d… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 31:
13 | deterministic approach only.
So now let us So now let us So now let us
have a simple example to understand how have a simple example to understand how have a simple example to understand how
does the … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 32:
16 | So the decoder is nothing but a neural
network which is trained to take inputs network which is trained to take inputs network which is trained to take inputs
from the latin space and generate from th… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 33:
11 | somewhere towards the right, which means
that it has to be a bit bright and the that it has to be a bit bright and the that it has to be a bit bright and the
pixel value is high. Bright pixels have pi… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 34:
10 | now we have covered now we have covered
one part of the story which explains the one part of the story which explains the one part of the story which explains the
variational autoenccoder. variational… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 35:
10 | part, you will understand that we have
made a major assumption. made a major assumption. made a major assumption.
Remember when we talked about the Remember when we talked about the Remember when we t… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 36:
14 | recipe and then you need to map all
these handwriting styles to the secret these handwriting styles to the secret these handwriting styles to the secret
recipe and make all those points and recipe and… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 37:
13 | the latin space to access to generate the latin space to access to generate
digit five. One option is to access all digit five. One option is to access all digit five. One option is to access all
poss… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 38:
04 | Wouldn't it be better if we knew which
part of the Latin space to access for part of the Latin space to access for part of the Latin space to access for
the type of image we want to generate? the type… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 39:
00 | decoder.
So the overall architecture looks like So the overall architecture looks like So the overall architecture looks like
this. this. this.
First I get let's say you go to any First I get let's sa… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 40:
00 | this architecture is very similar to a
plain autoenccoder where you have an plain autoenccoder where you have an plain autoenccoder where you have an
encoder which compresses the image into encoder wh… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 41:
03 | a dis or or a region which is the most a dis or or a region which is the most
probable region of finding the digit probable region of finding the digit probable region of finding the digit
five instea… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 42:
01 | we are going to look at a nice visual we are going to look at a nice visual
description to understand this much description to understand this much description to understand this much
better. better. … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 43:
12 | individual points. So 99% of these
points, they they produce garbage. So points, they they produce garbage. So points, they they produce garbage. So
your your space your latent space is not your your … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 44:
14 | regions which tell you that this is the
region corresponding to the dog. This is region corresponding to the dog. This is region corresponding to the dog. This is
the region corresponding to the cat e… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 45:
08 | space which is continuous and the space which is continuous and the
garbage gaps are now filled with garbage gaps are now filled with garbage gaps are now filled with
distributions. So now you can saf… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 46:
07 | So the two stories put together form the
variational autoenccoder. variational autoenccoder.
We first looked at the decoder where we We first looked at the decoder where we We first looked at the deco… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 47:
03 | the areas in the latin space? How do you
know which levers to pull in the know which levers to pull in the know which levers to pull in the
decoder? This is given to you by the decoder? This is given … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 48:
08 | uh styles of the students when they uh styles of the students when they
wrote the word hello or the handwritten wrote the word hello or the handwritten wrote the word hello or the handwritten
digits a… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 49:
09 | going to give you the latent space
distribution given the image. So that's distribution given the image. So that's distribution given the image. So that's
why you see the notation kind of flipped why … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 50:
09 | the encoder like this and the decoder the encoder like this and the decoder
going from a smaller line here to a going from a smaller line here to a going from a smaller line here to a
bigger line. In … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 51:
16 | these variational autoenccoders trained.
How do you train these to generate How do you train these to generate How do you train these to generate
images? Let's say you give a sample of images? Let's s… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 52:
05 | and then sample from it. So we are going
to take a real example in the next class to take a real example in the next class to take a real example in the next class
where you will see exactly how deep … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 52:
56 | is not deterministic but rather it is is not deterministic but rather it is
probabilistic. probabilistic. probabilistic.
And finally in your mind I want you to And finally in your mind I want you to A… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 53:
48 | image which is generated at the end.
This is all that is happening in the This is all that is happening in the This is all that is happening in the
variation autoenccoders. variation autoenccoders. va… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 55:
04 | tells you the hidden factors of
variation behind that image. variation behind that image. variation behind that image.
[snorts] The machine tells you the hidden factors The machine tells you the hidde… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 56:
10 | can lie. So it appears to be a very can lie. So it appears to be a very
smart and a clever machine. smart and a clever machine. smart and a clever machine.
Okay. Now you have these hidden factors Okay… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 57:
11 | the final image should be as close as
possible to the original image. So you possible to the original image. So you possible to the original image. So you
can see that there has to be some kind can se… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 58:
10 | encode and the second neural network is
the machine which learns to decode. the machine which learns to decode. the machine which learns to decode.
So somehow we have to train the So somehow we have t… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 59:
20 | a dot like this and you pass it to the a dot like this and you pass it to the
decoder and you get a value of zero decoder and you get a value of zero decoder and you get a value of zero
which which me… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 60:
07 | our predicted distribution which should
match as close as possible to the true match as close as possible to the true match as close as possible to the true
distribution which we do not really distrib… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 61:
19 | points in the latin space which is also
given in this formula. given in this formula. given in this formula.
I I don't want to stress too much on how I I don't want to stress too much on how I I don't… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 62:
21 | the visualization before where we saw
that it's like finding or that it's like finding or that it's like finding or
sampling for from a very giant ocean and sampling for from a very giant ocean and sa… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 63:
17 | that point being real?
And this actually does not even make use And this actually does not even make use And this actually does not even make use
of the encoder. This is all decoder of the encoder. Th… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 64:
26 | Now the question is that what is the Now the question is that what is the
elbow objective? [snorts] elbow objective? [snorts] elbow objective? [snorts]
Well to understand this let's understand Well to… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 65:
25 | I will not get very mathematical here
and I will not focus too much on the and I will not focus too much on the and I will not focus too much on the
derivation but I will provide a link in derivation … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 66:
24 | So this essentially says that
whatever image you're looking at the end whatever image you're looking at the end whatever image you're looking at the end
is that image is that image is that image
uh as… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 67:
33 | in any fashion but
in more realistic settings the in more realistic settings the in more realistic settings the
distribution is more likely to be distribution is more likely to be distribution is more… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 68:
30 | will be average in terms of the will be average in terms of the
slantness, in terms of the neatness etc. slantness, in terms of the neatness etc. slantness, in terms of the neatness etc.
So we are So … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 69:
32 | how likely is the reconstructed
um output. um output. um output.
What is the probability of that? And we What is the probability of that? And we What is the probability of that? And we
want to maximiz… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 70:
35 | our encoder distribution to stay as
close as possible to a gshian which close as possible to a gshian which close as possible to a gshian which
comes from our human intuition that comes from our human… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 71:
38 | want to compress the earth cat into
something which captures the essence of something which captures the essence of something which captures the essence of
the cat. We want to send a secret recipe the… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 72:
30 | objective and we try to maximize the
elbow. elbow. elbow.
So since the true objective is always So since the true objective is always So since the true objective is always
greater than the elbow, maxi… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 73:
27 | want to move our code to the yellow
distribution. We want to move it as distribution. We want to move it as distribution. We want to move it as
close as possible to the normal close as possible to the… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 74:
23 | what remains and it makes sense from an what remains and it makes sense from an
intuitive standpoint because later intuitive standpoint because later intuitive standpoint because later
people forget t… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 75:
20 | going to come together very nicely in
this last practical example. Our task is this last practical example. Our task is this last practical example. Our task is
to train a variation autoenccoder to to… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 76:
21 | hidden factors which we have absolutely hidden factors which we have absolutely
no clue what they are but the encoder is no clue what they are but the encoder is no clue what they are but the encoder … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 77:
13 | So remember our decoder setup looks like
this. It's it it needs to take the this. It's it it needs to take the this. It's it it needs to take the
sample from the latent space and then it sample from t… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 78:
10 | So it should take the latent vector and So it should take the latent vector and
it should generate the reconstructed it should generate the reconstructed it should generate the reconstructed
image. Ri… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 79:
07 | first machine do? The first machine
actually does the reverse. It takes the actually does the reverse. It takes the actually does the reverse. It takes the
image as the input, the real image, and imag… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 80:
13 | region which has the mu of.5 comma.5 and region which has the mu of.5 comma.5 and
the sigma of 2a 2. Right? So you need the sigma of 2a 2. Right? So you need the sigma of 2a 2. Right? So you need
two … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 81:
01 | the GitHub repo in the description the GitHub repo in the description
section. section. section.
[snorts] [snorts]
Okay. So overall the encoder decoder Okay. So overall the encoder decoder Okay. So ov… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 81:
56 | So this is our entire encoder decoder So this is our entire encoder decoder
architecture whatever we discussed as architecture whatever we discussed as architecture whatever we discussed as
this machi… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 82:
51 | This compares every pixel of the input
with the output. If the original pixel with the output. If the original pixel with the output. If the original pixel
is black and the VA predicts white, the is b… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 83:
46 | zero and a standard deviation of one. To
ensure that the mean is zero, we add a ensure that the mean is zero, we add a ensure that the mean is zero, we add a
penalty if the mean deviates from zero. pe… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 84:
40 | because log of a small value is a big uh
number and there is a negative sign number and there is a negative sign number and there is a negative sign
associated with it. So this will always associated … |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 85:
34 | the uh description. But first I just
want to want to want to
describe everything that we have describe everything that we have describe everything that we have
conceptually described in a mathematical… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 86:
26 | for longer duration maybe we'll get an for longer duration maybe we'll get an
even better distribution which is even better distribution which is even better distribution which is
centered at zero and… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 87:
21 | this training proceeds and this is the this training proceeds and this is the
quality of the reconstructions because quality of the reconstructions because quality of the reconstructions because
we ha… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 88:
15 | latin space uh you see that the it's
it's kind of blur in some cases which it's kind of blur in some cases which it's kind of blur in some cases which
we'll come to in in in some time but you we'll co… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 89:
05 | is that it it produces blurry outputs
and there is a very nice reason for it. and there is a very nice reason for it. and there is a very nice reason for it.
I will share the link in the description I… |
diffusion-principles-vizuara |
L9: Lecture 2 - Variational Autoencoders Explained From Scratch | Principles of Diffusion Models | 89:
57 | applications I have seen and uh there
are encoders and distribute and and are encoders and distribute and and are encoders and distribute and and
decoders right so you also have decoders right so you … |