cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 00:
03 | All right. So let's start get started All right. So let's start get started
for the lecture. for the lecture. for the lecture.
Last time we learned DDIM which is like Last time we learned DDIM which i… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 00:
52 | these things can also speed things up or these things can also speed things up or
get better results. Now we go like uh time z Now we go like uh time z
like t minus or time t to tus 10 like t minus or… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 01:
47 | and uh one thing about this design space
things is that I misspoke um last time things is that I misspoke um last time things is that I misspoke um last time
about about about
essentially basically wh… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 02:
32 | medium time steps rather than at the
beginning or at the end. Any questions beginning or at the end. Any questions beginning or at the end. Any questions
here? Okay, cool. All right, so now that we Ok… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 03:
35 | now we haven't talked about anything
about conditional generation yet. So about conditional generation yet. So about conditional generation yet. So
far, everything is unconditional. We far, everything… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 04:
34 | usually what people would do like the
first thing you would try uh is to first thing you would try uh is to first thing you would try uh is to
basically you still have your noise that basically you st… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 05:
17 | conditional um sample based on whatever
the condition that you specified right the condition that you specified right the condition that you specified right
okay so what what is the what is the okay s… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 06:
16 | essentially have another feature from
for example maybe another image or like for example maybe another image or like for example maybe another image or like
some uh maybe another like 3D mesh or some… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 07:
00 | norm like we want dark hair or some norm like we want dark hair or some
different hair? different hair? different hair?
Um, so you mean like basically how would Um, so you mean like basically how woul… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 07:
53 | label condition, right? If if this model
is class label condition then we cannot is class label condition then we cannot is class label condition then we cannot
use it for like say condition on like u… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 08:
45 | like the data collection as we uh may like the data collection as we uh may
know now is like very very expensive know now is like very very expensive know now is like very very expensive
thing. And th… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 09:
27 | um which is that basically if you think
about it right the unconditional model about it right the unconditional model about it right the unconditional model
that we learned already has a lot of that w… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 10:
17 | unconditional model to do conditional unconditional model to do conditional
generation at all? sort of. But there's like a very very sort of. But there's like a very very
simple answer to this. Okay, … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 11:
17 | probability of the label given the model
or the the image. Right? So if you write or the the image. Right? So if you write or the the image. Right? So if you write
it in terms of if you write it in te… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 12:
08 | plus a uh the gradient from a
discriminative model. Yeah, discriminative model. Yeah, discriminative model. Yeah,
>> here influence like both the model >> here influence like both the model >> here in… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 13:
00 | That's it. And you just run your That's it. And you just run your
sampling as normal and you get a sampling as normal and you get a sampling as normal and you get a
conditional sample. conditional sam… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 14:
02 | >> it's a classifier. So it's either like >> it's a classifier. So it's either like
it can be anything. So depending on your it can be anything. So depending on your it can be anything. So depending o… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 14:
46 | training data. You cannot do some
interpolation to generate some other interpolation to generate some other interpolation to generate some other
thing. thing. thing.
>> Um yes uh that is a very great … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 15:
29 | like in painting and this is like
colorization. Yeah. So you can just like colorization. Yeah. So you can just like colorization. Yeah. So you can just like
use the same unconditional model to to use … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 16:
22 | need to actually specifically train this
classifier uh to to be able to recognize classifier uh to to be able to recognize classifier uh to to be able to recognize
a noisy image and and and be able to… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 17:
13 | nodding their head. nodding their head.
Oh, someone someone on online. Is that Oh, someone someone on online. Is that Oh, someone someone on online. Is that
>> Oh, no. >> Oh, no. >> Oh, no.
>> Oh, oka… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 18:
10 | basically just input your um your the
the the less noisy the clean data the the less noisy the clean data the the less noisy the clean data
estimation and the condition that you estimation and the con… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 19:
02 | gradient that you got from your clean
data estimation um and your data estimation um and your data estimation um and your
off-the-shelf classifier off-the-shelf classifier off-the-shelf classifier
uh … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 20:
27 | so, uh, we we took the grade in regards so, uh, we we took the grade in regards
to XT. Uh, but like that's not where the to XT. Uh, but like that's not where the to XT. Uh, but like that's not where t… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 21:
19 | model and one large size model right so
this thing is just going to takes you this thing is just going to takes you this thing is just going to takes you
like a lot of compute that's one thing like a … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 22:
06 | like a ball and then the the the noise
level the manifold for each noise level level the manifold for each noise level level the manifold for each noise level
is just just like layered shells that is … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 22:
56 | distance from the origin. Uh and then
and then like basically we're going to and then like basically we're going to and then like basically we're going to
see that around like 90% of the density see t… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 23:
44 | the manifold at all. So the guided
sample can completely go off the sample can completely go off the sample can completely go off the
manifold and just like wander off and manifold and just like wande… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 24:
30 | these things basically just contribute
to the fact that DPS is really really to the fact that DPS is really really to the fact that DPS is really really
really slow and if you try to reduce the really… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 25:
49 | little bit like how do we is there any little bit like how do we is there any
other ways that we can apply guidance. >> Yeah. Yeah. So basically the first thing >> Yeah. Yeah. So basically the first t… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 26:
36 | expensive thing to do. So because the
because the classifier is usually really because the classifier is usually really because the classifier is usually really
small. So yeah, so the first thing that… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 27:
29 | manifold right so what should we do next manifold right so what should we do next
the other very easy thing to do here is the other very easy thing to do here is the other very easy thing to do here i… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 28:
11 | like a property of the like the low low
dimensional manifold. So basically you dimensional manifold. So basically you dimensional manifold. So basically you
can you can basically just like have a can … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 28:
58 | class or something. Uh but basically you
can actually get access to the data can actually get access to the data can actually get access to the data
manifold via the decoder of an manifold via the dec… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 29:
44 | the like the the yeah the low
dimensional like representation space. dimensional like representation space. dimensional like representation space.
Um so essentially this is like kind of Um so essentia… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 30:
32 | samples and label them with noise
levels, right? Nobody. Nobody would do levels, right? Nobody. Nobody would do levels, right? Nobody. Nobody would do
that. Um but if you that. Um but if you that. Um … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 31:
24 | we have one for clean IM. Oh yes yes uh we have one for clean IM. Oh yes yes uh
you can speak up by the way the the you can speak up by the way the the you can speak up by the way the the
people onlin… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 32:
02 | to assume that we have access to
autoenccoders? Uh we're going to talk autoenccoders? Uh we're going to talk autoenccoders? Uh we're going to talk
about the next class actually but about the next clas… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 32:
52 | uh and you can just uh and and this this
algorithm is applicable to all algorithm is applicable to all algorithm is applicable to all
differentiable guidance or classifiers differentiable guidance or … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 33:
37 | into a text condition model without
training anything by just applying clip training anything by just applying clip training anything by just applying clip
clip guidance to your to to your clip guidan… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 34:
29 | go to your classifier, right? So all you
need to do is to take gradient all the need to do is to take gradient all the need to do is to take gradient all the
way back and that's that gradient will way… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 35:
15 | your uh like your your your image. Say your uh like your your your image. Say
for example you have like a gausian blur for example you have like a gausian blur for example you have like a gausian blur… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 36:
12 | Now that we're in the realm of training Now that we're in the realm of training
free uh guidance, is there any other way free uh guidance, is there any other way free uh guidance, is there any other w… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 37:
15 | nonisotropic noise um uh yeah sort of
basically it's the same thing right I basically it's the same thing right I basically it's the same thing right I
guess Adrian so like uh like basically guess Adr… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 37:
57 | so like B and if your model is really so like B and if your model is really
large the it's like a lot of memory large the it's like a lot of memory large the it's like a lot of memory
requirement righ… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 39:
22 | >> Okay. The classifier cannot be trained, >> Okay. The classifier cannot be trained,
right? They cannot sample, right? You right? They cannot sample, right? You right? They cannot sample, right? You
… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 40:
14 | called like LGD loss guided diffusion or
something um uh that paper that paper something um uh that paper that paper something um uh that paper that paper
was actually done by uh like the same was act… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 40:
56 | actually a great trick that you should
do. create a proxy distribution. This is do. create a proxy distribution. This is do. create a proxy distribution. This is
um that's kind of something that we're… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 41:
37 | generated. Um but the problem is we
don't have what we want to generate yet, don't have what we want to generate yet, don't have what we want to generate yet,
right? Because if we do, why why are we r… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 42:
25 | right? So, this needs to have a
condition in it. condition in it. condition in it.
Okay. Hold on. The people on in person Okay. Hold on. The people on in person Okay. Hold on. The people on in person
… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 43:
07 | a really rough uh or preliminary version a really rough uh or preliminary version
of what we want to generate. But the of what we want to generate. But the of what we want to generate. But the
problem… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 44:
18 | that as x0ero. How about that?
It turns out you can definitely do that. It turns out you can definitely do that. It turns out you can definitely do that.
So say like this is like your input and So say… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 45:
06 | um swapping in as one of the x0 in the um swapping in as one of the x0 in the
middle and just just continue on middle and just just continue on middle and just just continue on
diffusion as if nothing… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 45:
59 | like rough ideas of like what do you
want to generate and then just like want to generate and then just like want to generate and then just like
hijack the the diffusion process by hijack the the diff… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 46:
49 | to your input and and this way it's to your input and and this way it's
going to create something that like kind going to create something that like kind going to create something that like kind
of lo… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 47:
35 | looking image from it based on your
pre-trained diffusion model and say like pre-trained diffusion model and say like pre-trained diffusion model and say like
you dislike the gray sky of um you dislik… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 48:
14 | then the diffusion model can uh the SD
is going to generate something that's is going to generate something that's is going to generate something that's
realistic looking but with the correct realisti… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 48:
59 | this is a very terribly masked uh image this is a very terribly masked uh image
but basically you see how like if you do but basically you see how like if you do but basically you see how like if you … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 49:
34 | better masking skills than I do then
then you would have get a better um then you would have get a better um then you would have get a better um
image. Yeah. like I think similar to image. Yeah. like … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 50:
29 | majority of the the image is going to be
noise right so you just going to noise right so you just going to noise right so you just going to
generate unconditionally like normal but generate unconditio… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 51:
16 | like how abstract I guess your image is, like how abstract I guess your image is,
um essentially you you will need to um essentially you you will need to um essentially you you will need to
adjust lik… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 51:
54 | not never mind um but basically the
reason why this is happening is that um reason why this is happening is that um reason why this is happening is that um
the diffusion process the diffusion process … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 52:
44 | reconstruct the uh the high frequency
details more and more. And this is why details more and more. And this is why details more and more. And this is why
basically based on like how much detail basic… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 53:
31 | like determine like which time step
should I go and stuff like that which is should I go and stuff like that which is should I go and stuff like that which is
what you said I think this is what we wha… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 54:
17 | generation uh if you start at time zero generation uh if you start at time zero
which means that there's no diffusion at which means that there's no diffusion at which means that there's no diffusion … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 55:
11 | people were saying is that like at the people were saying is that like at the
beginning of the diffusion it's like beginning of the diffusion it's like beginning of the diffusion it's like
really chao… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 55:
50 | basically what you can do is say you're basically what you can do is say you're
like unhappy with your uh w with this like unhappy with your uh w with this like unhappy with your uh w with this
partic… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 56:
26 | steps uh in your longriven dynamic for
you to reach the the good part of the of you to reach the the good part of the of you to reach the the good part of the of
the distribution. But yeah, but the di… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 57:
18 | Yeah.
Could you speak to like theoretical like Could you speak to like theoretical like Could you speak to like theoretical like
I understand the concept of a GAN being I understand the concept of a G… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 58:
02 | problem. Yeah, like if you do not train
for this particular task, you just try for this particular task, you just try for this particular task, you just try
to use your pre-trained unconditional to us… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 58:
45 | search based thing like Monte Carlo
research type of type of style type of research type of type of style type of research type of type of style type of
thing or you can use like a like like thing or … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 59:
32 | part or the other the part.
>> Oh, so like masking here meaning that >> Oh, so like masking here meaning that >> Oh, so like masking here meaning that
only the mask only the part that is only the mask… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 60:
26 | learn good information. Uh usually
unconditional models can give you very unconditional models can give you very unconditional models can give you very
good uh image qualities and conditional good uh … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 61:
23 | what you can do is if you do a weighted
average of the two the two distributions average of the two the two distributions average of the two the two distributions
what you can do is you can actually g… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 62:
16 | conditions that is like that everyone conditions that is like that everyone
has, right? So, for example, like say has, right? So, for example, like say has, right? So, for example, like say
you're um … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 63:
00 | score solo you kind of just like do a
weighted mixture of of both. Uh so like weighted mixture of of both. Uh so like weighted mixture of of both. Uh so like
your so basically it's gamma is usually yo… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 64:
01 | have your uh input image and then you have your uh input image and then you
can literally just like specify your can literally just like specify your can literally just like specify your
condition to … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 64:
42 | you'll have to have both the te the
image and then the text and then extract image and then the text and then extract image and then the text and then extract
the feature. But like so this is just to … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 65:
26 | to like map your text into some feature to like map your text into some feature
space and this feature extractor could space and this feature extractor could space and this feature extractor could
be … |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 66:
09 | it's uh it it just gets you like clearer
features and this is why it it actually features and this is why it it actually features and this is why it it actually
just like usually gives you like more u… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 66:
55 | but all right now you know how to turn but all right now you know how to turn
an unconditional model into a an unconditional model into a an unconditional model into a
conditional one. Congratulations… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 67:
39 | Max. Please come to come in person. If Max. Please come to come in person. If
you want to ask questions, it's going to you want to ask questions, it's going to you want to ask questions, it's going to… |
cmu-10799-diffusion-flow |
L6: CMU 10799 S26: Lecture 7 - Guidance & Controllable Generation - Diffusion & Flow Matching | 68:
18 | is not final class but like the the
fourth class in the next two weeks we're fourth class in the next two weeks we're fourth class in the next two weeks we're
going to be hearing from uh Alex who's go… |