cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 00:
04 | Okay. So, previously uh we have learned Okay. So, previously uh we have learned
about fast sampling techniques, right? about fast sampling techniques, right? about fast sampling techniques, right?
And… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 00:
59 | pre-trained model, right? So suppose we
already have a pre-trained diffusion already have a pre-trained diffusion already have a pre-trained diffusion
model like before. Um then what is the model like… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 02:
00 | second time step we do a loss comparison
with the 500 time step. Hey yes very with the 500 time step. Hey yes very with the 500 time step. Hey yes very
very good very good very very good very good ver… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 02:
45 | t and uh how about okay let's just do a
few more steps right how about we'll few more steps right how about we'll few more steps right how about we'll
train a new model such that um like one train a n… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 03:
44 | A So this is like yep
>> exact as >> exact as >> exact as
many as you want essentially. So like many as you want essentially. So like many as you want essentially. So like
log to t I guess. log to t I… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 04:
30 | Right. Right.
>> So if in the first example we took the >> So if in the first example we took the >> So if in the first example we took the
two two two
steps to V1 of my new models step and in steps t… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 05:
11 | way this is the paper that tells you
that you should do V prediction like V that you should do V prediction like V that you should do V prediction like V
prediction is the best parameterization predic… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 05:
59 | >> Oh, why wouldn't it be a good model? I >> Oh, why wouldn't it be a good model? I
guess guess guess
Marco, Marco, Marco,
>> you still have to learn the same amount >> you still have to learn the sam… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 06:
44 | network's job to just take this teeny
tiny Gaussian to that complex version tiny Gaussian to that complex version tiny Gaussian to that complex version
without getting enough. So it's very without get… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 07:
23 | what about like the feasibility of
training this kind of model like how training this kind of model like how training this kind of model like how
about let's just look at uh training a about let's jus… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 08:
17 | to take a very long time and it's like
if you try to scale it up to t time if you try to scale it up to t time if you try to scale it up to t time
steps, right? Uh let me finish maybe. Um steps, right… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 08:
54 | sounds kind of not great. Yeah hold on.
Yeah, Yeah, Yeah,
>> I think the four power could only be for >> I think the four power could only be for >> I think the four power could only be for
the teache… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 09:
31 | just going to become very slow.
So, so do you think that like five total So, so do you think that like five total So, so do you think that like five total
four of the teacher student four of the teach… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 10:
18 | here
>> um and what was the question >> um and what was the question >> um and what was the question
step. step. step.
>> Yeah. >> Yeah.
>> You said you require like four forward >> You said you requi… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 11:
02 | That's your forward pass. That's your forward pass.
>> Yeah but just create a new data set with >> Yeah but just create a new data set with >> Yeah but just create a new data set with
this feature mod… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 11:
37 | yeah. Um, so what do we think? Is it
possible to train a model that goes from possible to train a model that goes from possible to train a model that goes from
t directly xt directly to x0? What do we… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 12:
30 | right even even if you stop red over
there it's not good right okay so anyway there it's not good right okay so anyway there it's not good right okay so anyway
let's take a look at this uh problem let… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 13:
15 | yeah, what does it mean is that
basically for any two points like any basically for any two points like any basically for any two points like any
arbitrary two points on the same OD arbitrary two poin… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 14:
26 | is this the only criteria that we need
for this new model to generate something for this new model to generate something for this new model to generate something
to to generate the correct thing? to t… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 15:
13 | like there it says nothing about the
output, right? Like we have no guarantee output, right? Like we have no guarantee output, right? Like we have no guarantee
about what the output should look like a… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 16:
03 | condition essentially so this is the condition essentially so this is the
thing that's going to like basically thing that's going to like basically thing that's going to like basically
just like make … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 16:
48 | B or something. It's like the when when B or something. It's like the when when
your gradient of the the loss spikes up. your gradient of the the loss spikes up. your gradient of the the loss spikes u… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 17:
42 | consistency model he was at open eye and
then now he's apparently some big name then now he's apparently some big name then now he's apparently some big name
in meta super intelligence lab or in meta … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 18:
26 | DDPM. Yeah. Yeah. So, that guy is also a DDPM. Yeah. Yeah. So, that guy is also a
genius and he's now has his own startup. genius and he's now has his own startup. genius and he's now has his own star… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 19:
15 | green one which is like only one step
away is the one that we're going to use away is the one that we're going to use away is the one that we're going to use
here. So essentially basically what's here… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 20:
01 | next time step that is getting on the
same trajectory solved by our solver. same trajectory solved by our solver. same trajectory solved by our solver.
and the original teacher model. So this and the … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 20:
47 | just going to become a little bit
messier if you if you do not use L2 but messier if you if you do not use L2 but messier if you if you do not use L2 but
in practice in practice in practice
uh percept… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 21:
41 | plus delta t? plus delta t?
>> Ah, that's also another great question. >> Ah, that's also another great question. >> Ah, that's also another great question.
So, uh here everything so this f theta So, … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 22:
24 | that you need to take from the t-shirt
doesn't scale with t. Yeah. Uh, okay. Do doesn't scale with t. Yeah. Uh, okay. Do doesn't scale with t. Yeah. Uh, okay. Do
you want your first you want your firs… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 23:
13 | with the larger jump. We do not update with the larger jump. We do not update
our model with the with the shorter our model with the with the shorter our model with the with the shorter
jump. jump. ju… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 24:
31 | parameterization that we're using sort
of and uh so we are trying to predict of and uh so we are trying to predict of and uh so we are trying to predict
the clean data and um usually it the clean data… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 25:
39 | when t is zero the skip connection is when t is zero the skip connection is
one and then the output the weight is one and then the output the weight is one and then the output the weight is
zero right… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 26:
26 | can be producing garbage. Right now all
this saying is that if my model sees a this saying is that if my model sees a this saying is that if my model sees a
very good image already and also is the ver… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 27:
09 | think I don't I I agree with the thing
that like the loss function on the last that like the loss function on the last that like the loss function on the last
line can if you just do training with lin… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 27:
53 | should not because if we just ask it to
do the same thing at S and T that same do the same thing at S and T that same do the same thing at S and T that same
thing could just be end up predicting thing… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 28:
37 | this. Sorry. The the skip connection
weight is kind of like a schedule. It weight is kind of like a schedule. It weight is kind of like a schedule. It
has a scheduling. It's only one when has a schedu… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 29:
33 | trajectory that's like kind of similar trajectory that's like kind of similar
to what we what we would have got from a to what we what we would have got from a to what we what we would have got from a… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 30:
25 | scale differently essentially. So that scale differently essentially. So that
so that it's like slightly less noisy. so that it's like slightly less noisy. so that it's like slightly less noisy.
Uh th… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 31:
20 | about the previous uh slide, but
>> uh so if we if we already know that the >> uh so if we if we already know that the >> uh so if we if we already know that the
image is close enough to x0 where it's… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 31:
59 | boundary condition. Yeah. Okay. All
right. Any any questions about training right. Any any questions about training right. Any any questions about training
consistency model from scratch? consistency … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 32:
50 | Um and we're not trying to solve it
here. Well we kind of are trying to here. Well we kind of are trying to here. Well we kind of are trying to
solve it here actually. Um solve it here actually. Um so… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 33:
47 | So one step but how do you do multi-step
right? Can you even do multi-step? right? Can you even do multi-step? right? Can you even do multi-step?
>> Yeah like we're turning on a lot of like >> Yeah li… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 34:
20 | >> Why do you want to do that's a great
question. The next slide is going to question. The next slide is going to question. The next slide is going to
answer that. Yeah. answer that. Yeah. answer that… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 35:
04 | or compute that you can afford to do
four step generation say but like this four step generation say but like this four step generation say but like this
model is not trained for that it doesn't model… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 35:
44 | do whatever I guess. Yeah, doesn't do whatever I guess. Yeah, doesn't
really matter anymore. Um yeah so really matter anymore. Um yeah so really matter anymore. Um yeah so
essentially essentially esse… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 36:
50 | >> instead of doing like this one step to >> instead of doing like this one step to
the final noise you can do it like two the final noise you can do it like two the final noise you can do it like two… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 37:
27 | be able to jump to any point from any
point to any point. Um so yeah so this point to any point. Um so yeah so this point to any point. Um so yeah so this
xt is also arbitrary so you should be xt is a… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 38:
20 | >> Like two points on the trajectory then
you saw the you saw the OD between them you saw the you saw the OD between them you saw the you saw the OD between them
and then you essentially just take the… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 39:
04 | meaningful when you're dealing with
clean data. So think about it right the clean data. So think about it right the clean data. So think about it right the
perceptual loss is like something like a per… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 39:
52 | perceptual distance between the final X0 perceptual distance between the final X0
output. Um the only thing that you need output. Um the only thing that you need output. Um the only thing that you nee… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 40:
30 | >> Yeah. Yeah. So like basically so the
this the first part uses solvers so that this the first part uses solvers so that this the first part uses solvers so that
this thing this part is actually on t… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 41:
18 | im style at at noise bag thing right and
and that's still valid actually in the and that's still valid actually in the and that's still valid actually in the
in the paper like we have this thing in th… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 42:
02 | kicked off that
>> uh what do you mean? Oh you mean like >> uh what do you mean? Oh you mean like >> uh what do you mean? Oh you mean like
the the Oh yeah. So so like you mean the the Oh yeah. So so l… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 42:
59 | Yeah. But basically because we do not Yeah. But basically because we do not
always match the end point now we we always match the end point now we we always match the end point now we we
instead of a … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 43:
52 | score right from jumping from T. Now um
you you get your exact log likelihood you you get your exact log likelihood you you get your exact log likelihood
back by because you can take the back by becau… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 44:
43 | change that you're going from a that
you're going from any point should you're going from any point should you're going from any point should
follow the instant like the tangent line follow the instan… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 45:
30 | when S is not equal to T and then score when S is not equal to T and then score
matching loss which is just go from T to matching loss which is just go from T to matching loss which is just go from T … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 46:
13 | >> Uh which one? Uh you're saying that we >> Uh which one? Uh you're saying that we
add like a discriminator to improve FID add like a discriminator to improve FID add like a discriminator to improve … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 47:
17 | otherwise it doesn't make sense I guess.
Yeah. >> Yeah. Oh sorry. Yeah. >> Yeah. Oh sorry. Yeah.
>> How do you weigh the different loss >> How do you weigh the different loss >> How do you weigh the d… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 48:
24 | so I guess someone asked right do Do you so I guess someone asked right do Do you
even need a solver here? Uh the answer even need a solver here? Uh the answer even need a solver here? Uh the answer
i… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 49:
20 | Is it just like all the questions are
like, "Oh, the thing that we're going to like, "Oh, the thing that we're going to like, "Oh, the thing that we're going to
talk about next." Very nice. Okay. talk… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 50:
04 | OD or PD or whatever um and then the
flow maps because we also look at ODEs flow maps because we also look at ODEs flow maps because we also look at ODEs
right especially if If you're doing flow right… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 51:
03 | It's very sad. Anyway, um but how do you
uh build a valid flow map? Actually the uh build a valid flow map? Actually the uh build a valid flow map? Actually the
answer to this question uh can be found… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 51:
49 | prediction of XS. Okay. So flow map is prediction of XS. Okay. So flow map is
the predict prediction of XS the the predict prediction of XS the the predict prediction of XS the
endpoint of the jump. O… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 52:
30 | guess. Uh let's just like take this
analogy. Okay. Yes. analogy. Okay. Yes. analogy. Okay. Yes.
>> Call it progressive. Is that the same >> Call it progressive. Is that the same >> Call it progressive… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 53:
21 | that is flowing down this one river. I that is flowing down this one river. I
can teleport the duck so that the duck's can teleport the duck so that the duck's can teleport the duck so that the duck's… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 54:
00 | get like basically okay. So I guess this
is a better uh uh visualization. So this is a better uh uh visualization. So this is a better uh uh visualization. So this
is generated by nano banana the thin… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 54:
39 | check for you. And then and then the the
cop be like, huh, let's see if there's cop be like, huh, let's see if there's cop be like, huh, let's see if there's
any duck that is like suspicious. Like, an… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 55:
24 | instantaneous jump so that you can fold
the cop and then and then be like, "Oh, the cop and then and then be like, "Oh, the cop and then and then be like, "Oh,
okay. This is a normal duck." Basically,… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 56:
25 | >> Yes.
>> So if you take a langian from S to S >> So if you take a langian from S to S >> So if you take a langian from S to S
plus DT, it should be the same as the is plus DT, it should be the same … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 57:
37 | well for consistency model we don't
really match the the the derivative. I really match the the the derivative. I really match the the the derivative. I
guess that's the problem. guess that's the prob… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 58:
33 | I can do I can be a little bit like I
can essentially be a a little bit um can essentially be a a little bit um can essentially be a a little bit um
like late. I can I I can start the jump like late. … |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 59:
57 | jumping, they should end up at the same jumping, they should end up at the same
place. So, as long as they're following place. So, as long as they're following place. So, as long as they're following
… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 60:
59 | really mention the flow map thing in really mention the flow map thing in
their in their paper. We by we I mean their in their paper. We by we I mean their in their paper. We by we I mean
one of my pa… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 61:
43 | displacement that you're predicting
right so this is like so the right so this is like so the right so this is like so the
displacement that you're predicting is displacement that you're predicting is… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 62:
36 | they call a mean flow identity. they call a mean flow identity.
Okay, that does it make sense for people? that does it make sense for people?
Good. Okay. So why is mean flow a oiler Good. Okay. So why… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 63:
31 | that's it. Um and one nice thing about
the mean flow identity is that uh so in the mean flow identity is that uh so in the mean flow identity is that uh so in
the middle here if you take s equals t th… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 64:
47 | like but an interesting thing is that
CTN was developed in 2023 CTN was developed in 2023 CTN was developed in 2023
and um the the how to train your like and um the the how to train your like and um t… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 65:
43 | think this is the most intuitive one. So
this is literally just saying that uh this is literally just saying that uh this is literally just saying that uh
basically if your flow map jump from S basica… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 66:
44 | How many any of you guys have seen this
model? Shortcut model. No one. No. I model? Shortcut model. No one. No. I model? Shortcut model. No one. No. I
think this is a Peter Ail or something. think thi… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 67:
33 | making sure that your flow oh my god I'm
so sorry we're running out of time but so sorry we're running out of time but so sorry we're running out of time but
let's get let's finish everything uh the l… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 68:
31 | likelihood. Uh so why why is that? Well,
it's basically because yeah because it's it's basically because yeah because it's it's basically because yeah because it's
only jump to in the sampling space a… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 69:
13 | can use the same algorithms to solve
another OD right so this is what we're another OD right so this is what we're another OD right so this is what we're
doing so this is like my new paper doing so th… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 69:
53 | use the same full map method to distill
any OD. So if you have like you know an any OD. So if you have like you know an any OD. So if you have like you know an
interesting OD that is associated with i… |
cmu-10799-diffusion-flow |
L9: CMU 10799 S26: Lecture 10 - Distillation, Consistency Models & Flow Maps - Diffusion & Flow Matching | 70:
40 | He was a PhD student at Stanford. Uh he He was a PhD student at Stanford. Uh he
co-founded something and then got co-founded something and then got co-founded something and then got
acquired by Luma. … |