cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 00:
03 | Cool. Cool. Yeah. Uh and thanks again Cool. Cool. Yeah. Uh and thanks again
for the invite. Um I'm very excited to for the invite. Um I'm very excited to for the invite. Um I'm very excited to
see you… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 00:
44 | done without my fantastic colleagues at
luma. Yeah. luma. Yeah. luma. Yeah.
So um in the past five years or so uh So um in the past five years or so uh So um in the past five years or so uh
diffusion … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 01:
36 | Yeah, there's some jitter. But um yeah, Yeah, there's some jitter. But um yeah,
we we show some samples from our latest we we show some samples from our latest we we show some samples from our latest
… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 02:
26 | uh so to visualize this process you know uh so to visualize this process you know
on a on a simple 2D graph um we show on a on a simple 2D graph um we show on a on a simple 2D graph um we show
that he… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 03:
21 | And these trajectories can be seen as And these trajectories can be seen as
these uh blue lines uh here. And the these uh blue lines uh here. And the these uh blue lines uh here. And the
ground truth … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 04:
13 | and uh ultimately the loss comes down to
a simple L2 loss uh which is extremely a simple L2 loss uh which is extremely a simple L2 loss uh which is extremely
stable and very scalable to large number s… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 05:
10 | naturally it suffers from first uh the
OD simulation error uh and slow OD simulation error uh and slow OD simulation error uh and slow
inference inference inference
so um so um so um
so as a result uh… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 06:
03 | scaling and this can be best uh
represented by the green line here where represented by the green line here where represented by the green line here where
where you know when you have very few where y… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 07:
00 | problem uh with these types of models is
that uh first it it can often suffer that uh first it it can often suffer that uh first it it can often suffer
from training instability. For example, from tra… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 07:
55 | these different tasks we need to do step
step distillation Um and this usually step distillation Um and this usually step distillation Um and this usually
comes after the RL or preference or comes aft… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 08:
43 | today I'll be cover two works that we
did at luma uh which is inductive moment did at luma uh which is inductive moment did at luma uh which is inductive moment
matching uh and terminal velocity match… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 09:
36 | yeah let's first look at uh how we can
achieve efficient inference by design. So to think about efficient inference uh So to think about efficient inference uh
we we first need to look at what makes w… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 10:
35 | your neuronet network taking in XT&T.
And the result the the result of one And the result the the result of one And the result the the result of one
step DDIM uh at time S can be best step DDIM uh at … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 11:
34 | relationship.
Um so we we I I I like to term ter term Um so we we I I I like to term ter term Um so we we I I I like to term ter term
this the capacity problem uh of DDIM. this the capacity problem uh… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 12:
32 | So so that comes with the power that's
uh that's from the um the neuronet uh that's from the um the neuronet uh that's from the um the neuronet
network that that's being injected with network that tha… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 13:
34 | >> Okay. Do you guys have questions
regarding the first part? regarding the first part? regarding the first part?
>> No >> No >> No
question. question. question.
>> Okay. Okay. Yeah. Like I I I told A… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 14:
12 | model on S then we can like s like hope model on S then we can like s like hope
that it learns the OD better. that it learns the OD better. that it learns the OD better.
>> So what about let's say uh … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 15:
03 | neural network you are still trying to
fit the tangent velocity at every single fit the tangent velocity at every single fit the tangent velocity at every single
point. >> I hope that answers the ques… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 16:
00 | few step uh network uh directly from
from scratch. Okay. So the first method uh inductive Okay. So the first method uh inductive
mode matching. So for for this uh for mode matching. So for for this uh… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 17:
05 | and we call the two intermediate
distributions uh QS and QT where where distributions uh QS and QT where where distributions uh QS and QT where where
QS is closer to our data distribution QS is closer… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 18:
00 | to to learn this mapping uh that
transforms QT to QS uh a naive approach transforms QT to QS uh a naive approach transforms QT to QS uh a naive approach
right to learn this mapping uh is is to right t… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 19:
08 | is it is kind of kind of like a GAN but is it is kind of kind of like a GAN but
uh the optimal discriminator is already uh the optimal discriminator is already uh the optimal discriminator is already
… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 20:
12 | And um a second component uh for IM is
the concept of inductive learning. Uh so the concept of inductive learning. Uh so the concept of inductive learning. Uh so
consider the same learning scheme wher… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 21:
01 | that is the case here when QT is very
far away from from QS. Um so naively far away from from QS. Um so naively far away from from QS. Um so naively
matching these two distributions with matching thes… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 21:
58 | QQS.
um and and and learning the model um and and and learning the model um and and and learning the model
learning the model distribution uh learning the model distribution uh learning the model dist… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 22:
54 | So what is the base case here? The base
case is if you take QS. case is if you take QS. case is if you take QS.
Oh uh yeah and here we need to yeah Oh uh yeah and here we need to yeah Oh uh yeah and h… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 23:
55 | true regardless of your theta and even true regardless of your theta and even
when your theta is untrained um that the when your theta is untrained um that the when your theta is untrained um that the… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 24:
53 | is going to be the base case itself. So
this is going to be identically equal to this is going to be identically equal to this is going to be identically equal to
QS. QS. QS.
So what you're matching a… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 25:
51 | >> question. Yeah,
>> about the choice of MMD. I mean uh we >> about the choice of MMD. I mean uh we >> about the choice of MMD. I mean uh we
can formalize the the flow matching as can formalize the t… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 26:
40 | some iterative scheme uh to to actually
optimize uh that objective. So yeah, so optimize uh that objective. So yeah, so optimize uh that objective. So yeah, so
that's part of the reason that we don't … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 27:
31 | RBF and and uh Llas kernel both work in RBF and and uh Llas kernel both work in
our case. our case. our case.
>> Yeah. Yeah. Thank you. >> Yeah. Yeah. Thank you. >> Yeah. Yeah. Thank you.
>> Yeah. Yea… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 28:
20 | target to to train the new the new time target to to train the new the new time
step um the the new model distribution step um the the new model distribution step um the the new model distribution
and… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 29:
11 | and improved consensity training uh in
discrete time. Uh and this is done on discrete time. Uh and this is done on discrete time. Uh and this is done on
imageet. So consensity training imageet. So con… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 30:
14 | transformer size. Uh so so so the more
compute you throw at it, it gets uh compute you throw at it, it gets uh compute you throw at it, it gets uh
better performance in general better performance in g… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 31:
09 | to consistency training as a special
case if our MMD objective uses only one case if our MMD objective uses only one case if our MMD objective uses only one
particle. Uh and instead of using LLAS part… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 32:
04 | and G GMMN can also be seen as a special and G GMMN can also be seen as a special
case of Imm. Uh case of Imm. Uh case of Imm. Uh
you can easily see that when if you set you can easily see that when i… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 32:
53 | essentially in this paper the drift
field for their uh for their model is field for their uh for their model is field for their uh for their model is
also parameterized via uh via MMD also parameteriz… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 33:
53 | per GPU can can usually be as low as per GPU can can usually be as low as
one. uh and in this case you know you one. uh and in this case you know you one. uh and in this case you know you
need to gath… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 34:
45 | distinguish between nearby R&T then it distinguish between nearby R&T then it
it's generally uh harder to scale. it's generally uh harder to scale. it's generally uh harder to scale.
So these are so t… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 35:
36 | so kernels is is a very uh standard um
concept I guess in machine learning um concept I guess in machine learning um concept I guess in machine learning um
it's it it's basically a a similarity it's i… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 36:
34 | to to some um vector where each entry is
like a uh a power of this real number like a uh a power of this real number like a uh a power of this real number
and that is kind of a augmented feature and t… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 37:
28 | the and the and the keys right and this
is sort of like basically we project the is sort of like basically we project the is sort of like basically we project the
query and the keys to some feature sp… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 38:
15 | and also maybe like if you guys have
tried like empirically like how do would tried like empirically like how do would tried like empirically like how do would
you compare the three types of models? y… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 39:
20 | point XR say. Um so what what we found point XR say. Um so what what we found
is that uh because of the correlation is that uh because of the correlation is that uh because of the correlation
through … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 40:
19 | particle for training uh for for for particle for training uh for for for
training the model means that they are training the model means that they are training the model means that they are
ignoring … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 41:
16 | >> uh, yeah, but but for the next work, I
guess it'll be much closer to flow maps. guess it'll be much closer to flow maps. guess it'll be much closer to flow maps.
>> All right. Cool. Cool. >> All ri… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 42:
10 | curved path in space which I'm sure all
of you know um and on the right uh we of you know um and on the right uh we of you know um and on the right uh we
have uh have uh have uh
a a model train trend … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 43:
11 | prior x1.
So the tangent along this OD trajectory So the tangent along this OD trajectory So the tangent along this OD trajectory
is the marginal velocity is the marginal velocity is the marginal velo… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 44:
15 | displacement f theta
uh which we can define um you know as uh uh which we can define um you know as uh uh which we can define um you know as uh
s minus t * capital f where where s minus t * capital f … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 45:
11 | map that directly takes xt to x0 map that directly takes xt to x0
so naively uh what we want to learn oh so naively uh what we want to learn oh so naively uh what we want to learn oh
how How we can le… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 46:
00 | actually want to look at is this
quantity um which which characterizes quantity um which which characterizes quantity um which which characterizes
the the terminal velocity uh the the the the terminal… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 47:
03 | if it happens to match the marginal
velocity at this point then you have velocity at this point then you have velocity at this point then you have
automatically learned this this automatically learned… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 48:
07 | and this is best shown uh in in this
figure uh in the previous slides. Um so figure uh in the previous slides. Um so figure uh in the previous slides. Um so
this is the case when when uh the bound thi… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 49:
06 | these quantities exist but we don't know
that during pre pre-training time so how that during pre pre-training time so how that during pre pre-training time so how
do we so how do we kind of have acce… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 50:
02 | your own network u approximates the the your own network u approximates the the
ground truth velocity at at every single ground truth velocity at at every single ground truth velocity at at every sing… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 50:
56 | that uh TVM loss upper bounds the two that uh TVM loss upper bounds the two
wound distance up to some constant and wound distance up to some constant and wound distance up to some constant and
this is… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 51:
54 | actually not lies continuous because of
the dot product self attention and layer the dot product self attention and layer the dot product self attention and layer
norms and there's actually a lot of n… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 52:
51 | we you know add add RMS norm as uh we you know add add RMS norm as uh
without any parameters uh to the time without any parameters uh to the time without any parameters uh to the time
step modulation … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 53:
53 | and you can do some quick mental math uh
to just take derivative with respect to to just take derivative with respect to to just take derivative with respect to
s on both sides, right? And s on both s… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 54:
49 | have any stop gradient um which means have any stop gradient um which means
that we ideally want to back propagate that we ideally want to back propagate that we ideally want to back propagate
through… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 55:
39 | So this is actually exactly opposite of
meanflow which takes partial on both xt meanflow which takes partial on both xt meanflow which takes partial on both xt
and t. and t. and t.
Yeah. Uh so I will … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 56:
38 | very stable.
And if we track also the norm of the And if we track also the norm of the And if we track also the norm of the
marginal velocity uh for both mean flow marginal velocity uh for both mean f… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 57:
32 | network predicted velocity and uh and um network predicted velocity and uh and um
conditional velocity and there are conditional velocity and there are conditional velocity and there are
additional va… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 58:
34 | >> and yeah um experimentally we achieve
still there one step result on imaget still there one step result on imaget still there one step result on imaget
and it can also surpass uh dn and xit and it … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 59:
27 | scale and this model is is trained with scale and this model is is trained with
pure TVM loss uh closely following what pure TVM loss uh closely following what pure TVM loss uh closely following what
… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 60:
16 | for uh FSTP if you naively call JVP on for uh FSTP if you naively call JVP on
the entire FSTP sharded model the entire FSTP sharded model the entire FSTP sharded model
uh then FSTP will usually error … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 61:
07 | first challenge with uh FSTP with JVP first challenge with uh FSTP with JVP
and the second challenge was is uh is and the second challenge was is uh is and the second challenge was is uh is
writing JV… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 61:
58 | uh I will take some questions. Uh but
before that I will I have also have I before that I will I have also have I before that I will I have also have I
was also given a task of of recruiting. was also… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 62:
51 | reach out to me or to to our our team
and uh also the inventors of DDIM and and uh also the inventors of DDIM and and uh also the inventors of DDIM and
Nerf both both work here. So, the mentor Nerf bo… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 63:
46 | >> may I ask question so I might be wrong
but it seems that when you do the but it seems that when you do the but it seems that when you do the
terminal velocity matching at a specific terminal veloci… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 64:
27 | time team? Oh uh do you mean the
integration integration integration
here? here? here?
>> Yeah. Over a different time. >> Yeah. Over a different time. >> Yeah. Over a different time.
>> Oh yeah. Yeah.… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 65:
17 | the the integration only comes in um if the the integration only comes in um if
you want to measure its relationship you want to measure its relationship you want to measure its relationship
with resp… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 66:
14 | any sweet spot for the NFP like with
four NFP you are getting good quality four NFP you are getting good quality four NFP you are getting good quality
but if you kind of increase it to 50, but if you … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 67:
03 | scratch like it's just a distillation
approach how is it compared to EVM approach how is it compared to EVM approach how is it compared to EVM
>> uh sorry for do you mean comp compared >> uh sorry for… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 67:
56 | your own network then then that's
basically a dissolution technique. Yeah. basically a dissolution technique. Yeah. basically a dissolution technique. Yeah.
>> Thank you. >> Thank you. >> Thank you.
>… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 68:
52 | step sampling and if you spend more more
more compute on on more intermediate more compute on on more intermediate more compute on on more intermediate
step it doesn't give you a huge gain um step it … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 69:
54 | inspired me uh to write this paper was a inspired me uh to write this paper was a
work called um uh physics informed work called um uh physics informed work called um uh physics informed
dissolation f… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 70:
48 | know.
>> Is there any computational overhead >> Is there any computational overhead >> Is there any computational overhead
since we have a much more complex final since we have a much more complex fin… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 71:
50 | objectives at the same at the same time. objectives at the same at the same time.
Um uh so we have observed that if you Um uh so we have observed that if you Um uh so we have observed that if you
opti… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 72:
39 | terms of performance or in terms of like terms of performance or in terms of like
training stabilities like like yeah training stabilities like like yeah training stabilities like like yeah
basically … |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 73:
34 | models in general still has some
advantage in terms of training training advantage in terms of training training advantage in terms of training training
uh uh training simplicity I guess. Um uh uh tra… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 74:
32 | >> no. Uh but that's a great uh I think to
to study uh because for we only used the to study uh because for we only used the to study uh because for we only used the
DDIM uh uh the the the DDM form of… |
cmu-10799-diffusion-flow |
L10: CMU 10799 S26: Lecture 11 - Guest Lecture Linqi (Alex) Zhou from Luma AI - Diffusion & Flow Matching | 75:
28 | out.
>> Yeah, please reach out. Um yeah and Alex >> Yeah, please reach out. Um yeah and Alex >> Yeah, please reach out. Um yeah and Alex
can if you can share with me with the can if you can share with… |