cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 00:
02 | All right. All right.
Right. So, so far what we have learn we Right. So, so far what we have learn we Right. So, so far what we have learn we
have learned about like pretty much have learned about lik… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 00:
56 | to do distillation or uh you know self to do distillation or uh you know self
dissolations or flow maps or consistency dissolations or flow maps or consistency dissolations or flow maps or consistency… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 01:
45 | who, actually, I'll just name who, like
the people from Anthropic have claimed the people from Anthropic have claimed the people from Anthropic have claimed
to me that uh I I believe it's ICML 2024 to… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 02:
37 | uh I mean obviously you know we have
other important modalities right for other important modalities right for other important modalities right for
example like molecules or like DNA example like mole… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 03:
35 | >> Near space and do like a nearest
neighbors type thing to match it. neighbors type thing to match it. neighbors type thing to match it.
>> Uh so diffusion model on a continuous >> Uh so diffusion mo… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 04:
44 | then embedding is what goes through
>> so you first take the text and go to >> so you first take the text and go to >> so you first take the text and go to
embedding embedding existing embedding embed… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 05:
26 | running out of the allergyfree options.
Hold on. Uh sorry. The the allergy Hold on. Uh sorry. The the allergy Hold on. Uh sorry. The the allergy
sensitive option. Okay. Anyway, you're sensitive option… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 06:
19 | And then uh for flow matching is pretty And then uh for flow matching is pretty
much the same thing, but instead of much the same thing, but instead of much the same thing, but instead of
learning the… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 07:
03 | adding noise process is the forward
process and the gradually d noiseis process and the gradually d noiseis process and the gradually d noiseis
process is the reverse process. Right. process is the re… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 08:
09 | version of a tweet from Andre Kapathi uh
so let's identify some of the noise in so let's identify some of the noise in so let's identify some of the noise in
this tweet what do we see this tweet what … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 09:
15 | then you get some weird emojis and you then you get some weird emojis and you
get some like out of place like six, get some like out of place like six, get some like out of place like six,
seven like … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 10:
13 | >> Yeah. Okay.
>> Masking also works. Okay. Uh hold on. Uh >> Masking also works. Okay. Uh hold on. Uh >> Masking also works. Okay. Uh hold on. Uh
do you have allergy? Okay. This is also do you have a… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 11:
23 | from the like original uh clean data to
some random tokens right in the some random tokens right in the some random tokens right in the
vocabulary. So that basically say like vocabulary. So that basic… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 12:
23 | vector. Uh then basically say we have a vector. Uh then basically say we have a
beta chance. This is just a some chance beta chance. This is just a some chance beta chance. This is just a some chance
… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 13:
09 | is why this is like one minus you know is why this is like one minus you know
every everything else has one beta over every everything else has one beta over every everything else has one beta over
th… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 14:
08 | sentences with real vocabulary, it's not sentences with real vocabulary, it's not
necessary that the noise sentence is necessary that the noise sentence is necessary that the noise sentence is
actuall… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 15:
10 | then you know so you just so the first then you know so you just so the first
row is uh I second row is love uh third row is uh I second row is love uh third row is uh I second row is love uh third
ro… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 16:
21 | that by induction we can not only get
like basically it's the same thing as like basically it's the same thing as like basically it's the same thing as
like you know two gausians added like you know t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 17:
11 | this is like literally how to jump this is like literally how to jump
directly from x0 to xt is you just like directly from x0 to xt is you just like directly from x0 to xt is you just like
kind of li… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 18:
24 | as the beta t in uh DDPM. as the beta t in uh DDPM.
>> Yeah. Don't worry. Everything's gonna be Don't worry. Everything's gonna be
simplified later on in this class. right simplified later on in this … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 19:
40 | >> Estimate these points and then Q >> Estimate these points and then Q
transpose. transpose. transpose.
>> Yes, pretty much. And then specifically, >> Yes, pretty much. And then specifically, >> Yes,… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 20:
37 | because you're getting you're marovian
like everything is marovian here. So you like everything is marovian here. So you like everything is marovian here. So you
can ignore the x0 here. So then this c… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 21:
35 | categorical distribution that is defined categorical distribution that is defined
by this black font term here. >> Oh dot is like elementwise >> Oh dot is like elementwise
multiplication. Anyway, hone… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 22:
42 | difficult to define in this case. Right?
What is the other thing? What is the other thing? What is the other thing?
>> Tokens. >> Tokens. >> Tokens.
>> The what >> The what >> The what
>> the probabil… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 23:
30 | prediction right so literally you need
to only you only need to predict the to only you only need to predict the to only you only need to predict the
logist of the final clean output given logist of t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 24:
18 | a D3PM.
All right, any questions about D3PM? Yes, Yes,
>> this won't have like an equivalence to >> this won't have like an equivalence to >> this won't have like an equivalence to
like score matching… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 25:
17 | like discrete diffusion models
>> great question and the answer is Yes. >> great question and the answer is Yes. >> great question and the answer is Yes.
And we're going to talk about it next And we'r… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 26:
33 | fixed length.
>> Yeah it's fixed length. Everything is >> Yeah it's fixed length. Everything is >> Yeah it's fixed length. Everything is
fixed length. Yeah. fixed length. Yeah. fixed length. Yeah.
>> … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 27:
24 | Alrighty. Okay. So h just a reminder
what is a uh what is a continuous score what is a uh what is a continuous score what is a uh what is a continuous score
and why is it weird to think about score an… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 28:
10 | no continuous flow anymore. There's no
gradient like you cannot like really do gradient like you cannot like really do gradient like you cannot like really do
any gradient stuff anymore here, right? a… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 28:
56 | type of thing. Uh which is not a healthy
thing to do but like you know just for thing to do but like you know just for thing to do but like you know just for
the sake of the class anyway um you know t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 29:
41 | basically what people does is that they
define something called uh the concrete define something called uh the concrete define something called uh the concrete
score where it's literally just the scor… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 30:
49 | apparently
uh if you read this particular paper uh if you read this particular paper uh if you read this particular paper
they have some connections to something they have some connections to somethin… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 31:
48 | people actually call it a rate matrix. people actually call it a rate matrix.
So it's a instantaneous rate to jump So it's a instantaneous rate to jump So it's a instantaneous rate to jump
like just j… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 32:
43 | thing, then you're actually basically if thing, then you're actually basically if
you do the math then then then you're you do the math then then then you're you do the math then then then you're
actu… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 33:
27 | everything
well you can represent everything in a well you can represent everything in a well you can represent everything in a
fully connected graph and then assign fully connected graph and then ass… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 34:
22 | So if you want your chain to satisfy
detail balance you're going to get this detail balance you're going to get this detail balance you're going to get this
thing so that your chain is reversible, thi… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 35:
19 | I see everyone's confused by how this
whole thing but we need basically we whole thing but we need basically we whole thing but we need basically we
need a neuronet network to predict this need a neur… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 36:
48 | score versus your uh you know your your score versus your uh you know your your
your your your real score. And you your your your real score. And you your your your real score. And you
literally just … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 37:
47 | non-zero number divided by a non-zero
number or like or sorry non- negative number or like or sorry non- negative number or like or sorry non- negative
number divided by a non- negative number number … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 38:
35 | good. Exactly. That's exactly correct. good. Exactly. That's exactly correct.
Um uh the other thing is that yeah, you Um uh the other thing is that yeah, you Um uh the other thing is that yeah, you
yo… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 39:
20 | like a like a like a like a like a what
we call uh constant so let's just ignore we call uh constant so let's just ignore we call uh constant so let's just ignore
that for now so we basically we can t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 40:
06 | then the person is going to be this
thing, right? So what you do is you thing, right? So what you do is you thing, right? So what you do is you
essentially so K is like you you jump to essentially so … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 40:
54 | then this part becomes one uh s minus r
uh times the sum of all the possible all uh times the sum of all the possible all uh times the sum of all the possible all
the probabilities and then this one i… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 41:
37 | us something that is that has that has
exponential in it and also literally exponential in it and also literally exponential in it and also literally
right the the the easiest right the the the easies… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 42:
20 | right? So you the the S minus the right? So you the the S minus the
likelihood ratio times the log of the likelihood ratio times the log of the likelihood ratio times the log of the
your S. Um so beca… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 43:
12 | calculate the ground truth by literally
the same trick the den noising score the same trick the den noising score the same trick the den noising score
matching. This is just the noising score matching… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 44:
40 | the reverse rate, right? So, you just
replace this concrete score with the replace this concrete score with the replace this concrete score with the
concrete score that you trained. And concrete score… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 45:
39 | >> earlier how are we choosing why do we
just randomly sample any token choices just randomly sample any token choices just randomly sample any token choices
>> yeah based on >> yeah based on >> yeah … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 46:
38 | basically like how about we can only do
masking and unmasking, right? So in the masking and unmasking, right? So in the masking and unmasking, right? So in the
forward process all you can do is you fo… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 47:
20 | like basically the only two columns that
you're going to have non- negative value you're going to have non- negative value you're going to have non- negative value
is the columns on the diagonal and t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 48:
06 | >> But if we go all the way end of the day
everything will be masked. everything will be masked. everything will be masked.
>> Yeah. And it's still a distribution >> Yeah. And it's still a distributio… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 48:
55 | multiplication and stuff anymore. Uh
because we simplified everything, right? because we simplified everything, right? because we simplified everything, right?
So basically what what we're essentially… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 49:
51 | stay unmasked and then with one minus
alpha t uh probability you're going to alpha t uh probability you're going to alpha t uh probability you're going to
stay masked and uh basically if we if stay ma… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 51:
08 | when uh xt equals x0 and x t minus one
also equals x zero um like basically if also equals x zero um like basically if also equals x zero um like basically if
if you have not been masked uh at time t … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 52:
02 | simplified into this really really
simple uh ratio. And similarly simple uh ratio. And similarly simple uh ratio. And similarly
because the only other option for you is because the only other option f… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 53:
11 | over. You should you should have the
same value because it hasn't been same value because it hasn't been same value because it hasn't been
masked. And if XT is masked, then you masked. And if XT is ma… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 54:
23 | times the clean data estimation. times the clean data estimation.
That's it. >> We have that problem because we'll start >> We have that problem because we'll start
with full mask. So if you start wit… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 55:
26 | >> So you're always starting with the full
mask. mask. mask.
>> That's right. >> That's right. >> That's right.
>> So if that one reverse gets you to I >> So if that one reverse gets you to I >> So if… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 56:
12 | actually a good point. Basically, uh the
the the mercury um founder, Inception the the mercury um founder, Inception the the mercury um founder, Inception
Lab founder, Stephano, who is the one of Lab … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 57:
09 | you can also do like continuous time
training with this. You literally just training with this. You literally just training with this. You literally just
take the continuous time limit of the of take … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 57:
58 | >> uh you yes kind of so it's the same
thing it's uh like analogy to you choose thing it's uh like analogy to you choose thing it's uh like analogy to you choose
the number of sampling steps right in … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 58:
42 | this is purely depending on like the the this is purely depending on like the the
model that you got trained but usually model that you got trained but usually model that you got trained but usually
i… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 59:
34 | basically the mask ratio is depending on
this alpha t thing which you set. So you this alpha t thing which you set. So you this alpha t thing which you set. So you
you can you can choose uh but like y… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 60:
34 | the tokens. the tokens.
>> Yeah. >> Yeah.
>> But then in the last you have something >> But then in the last you have something >> But then in the last you have something
like XT equal to M. So like X… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 61:
16 | >> uh what do you mean by latent text well
like so you mean like like so you mean like like so you mean like
a region space for images and then use a region space for images and then use a region spac… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 62:
02 | >> Does it produce something coherent if >> Does it produce something coherent if
all the things are independently getting all the things are independently getting all the things are independently get… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 62:
49 | >> It is pretty much just birth literally
if you think about it. Yeah. if you think about it. Yeah. if you think about it. Yeah.
>> Well, between like >> Well, between like >> Well, between like
>> yo… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 63:
40 | when they when he said like oh we can
correct hallucination but like here we correct hallucination but like here we correct hallucination but like here we
cannot really it's the same as cannot really … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 64:
24 | like a sort of like a like a like a like
a interesting moment in science. But if a interesting moment in science. But if a interesting moment in science. But if
you're one of the authors, you may get,… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 65:
08 | >> very low because it's 2024. Okay. Anyway
um but since like you know people show um but since like you know people show um but since like you know people show
saw the potential of this they have saw… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 65:
55 | say and seems like super compatible uh say and seems like super compatible uh
to comparable to like large language to comparable to like large language to comparable to like large language
models like… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 66:
39 | Please come up and uh can get rich as
well. All right, see you guys next well. All right, see you guys next well. All right, see you guys next
class. |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 00:
03 | Okay, so let's get started. uh so far uh Okay, so let's get started. uh so far uh
our last class we have talked about you our last class we have talked about you our last class we have talked about yo… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 00:
48 | Okay. Uh so this is just like a quick
like reminder of like like reminder of like like reminder of like
what happened next last class. So what happened next last class. So what happened next last clas… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 01:
39 | lastly we talked about like the easiest lastly we talked about like the easiest
way to do discrete diffusion which is way to do discrete diffusion which is way to do discrete diffusion which is
mass d… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 02:
46 | probability path, right? to go from like
some noise or like some the full mass to some noise or like some the full mass to some noise or like some the full mass to
clean data, right? Yeah, basically t… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 03:
32 | let let's look at them in a in the
discrete settings. So last time we kind discrete settings. So last time we kind discrete settings. So last time we kind
of skipped through this part uh or of skipped… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 04:
23 | distribution, right? So the probability
the sum of the probability over all the sum of the probability over all the sum of the probability over all
possible states or all possible tokens possible stat… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 05:
13 | transitions should add up to zero. And
this is like and this is literally just this is like and this is literally just this is like and this is literally just
a con conversation uh conservation of a c… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 06:
09 | likely that you're going to go basically
it's like how how how likely that you're it's like how how how likely that you're it's like how how how likely that you're
going to go jump from this state to … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 07:
03 | It's a velocity, right? Essentially. So It's a velocity, right? Essentially. So
it's basically just saying that like um it's basically just saying that like um it's basically just saying that like um
… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 07:
53 | this is also why we're trying to do
reparameterization trick yeah but that's reparameterization trick yeah but that's reparameterization trick yeah but that's
a great question. All right. Anything a g… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 08:
58 | this state that's it right this is like
super uh very intuitive I hope is super uh very intuitive I hope is super uh very intuitive I hope is
All good. What can we observe here? Can we write What can … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 10:
17 | not equal anymore. So just sum of all
the z all the possible z's and then qzx the z all the possible z's and then qzx the z all the possible z's and then qzx
ptz right and z could be equal to x as ptz… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 11:
21 | oiler, right? So you just get you you
just literally plug everything in here just literally plug everything in here just literally plug everything in here
and then you'll get this thing and the and th… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 12:
15 | like the the core of the the story in
all the discrete diffusion papers is all the discrete diffusion papers is all the discrete diffusion papers is
that like no matter what you do try to that like no… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 13:
03 | just use cross entropy to learn this,
right? Because we have the ground truth right? Because we have the ground truth right? Because we have the ground truth
clean data. So we just need to use cross c… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 14:
01 | flips right. So you start from t t flips right. So you start from t t
equals z which and then you sample from equals z which and then you sample from equals z which and then you sample from
your prior… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 14:
45 | you just increment the time and then you
do it over over again until you reach do it over over again until you reach do it over over again until you reach
the end point. Okay, make sense? This this is… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 15:
42 | things that we developed somehow but
basically there are two discreful basically there are two discreful basically there are two discreful
matching papers uh this time they are matching papers uh this… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 16:
22 | know but anyway it's like really like I
really hope this guy get rich and famous really hope this guy get rich and famous really hope this guy get rich and famous
soon. Uh anyway and then the second o… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 17:
05 | of learn the rate matrix but we don't of learn the rate matrix but we don't
actually learn the rate matrix directly actually learn the rate matrix directly actually learn the rate matrix directly
we w… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 17:
50 | your par paragraph is in order to build
this model and this is just like super this model and this is just like super this model and this is just like super
like not good right this is a very very lik… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 18:
36 | like it's the same problem as the fixed
length thing, right? Yeah. length thing, right? Yeah. length thing, right? Yeah.
>> I heard this from like who's doing >> I heard this from like who's doing >> … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 19:
20 | right. So let's take a look at it. Uh right. So let's take a look at it. Uh
yeah. So essentially variable length you yeah. So essentially variable length you yeah. So essentially variable length you
s… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 19:
57 | like something that we can think about,
right? And it's like now we have like right? And it's like now we have like right? And it's like now we have like
two um like frameworks that like sort of two u… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 20:
56 | >> Yeah. What else? >> Yeah. What else?
>> Inserting at but I saw that you can do >> Inserting at but I saw that you can do >> Inserting at but I saw that you can do
decoding in blocks like you can pr… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 21:
29 | >> Okay, so tatting at the end. So you can >> Okay, so tatting at the end. So you can
discard some of the tokens. Yeah, that discard some of the tokens. Yeah, that discard some of the tokens. Yeah, th… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 22:
15 | paragraph and for the next diffusion
process that paragraph is that one process that paragraph is that one process that paragraph is that one
element for you. You noise the paragraph element for you. … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 23:
09 | the same thing and that this is like
this is corresponding to one paper that this is corresponding to one paper that this is corresponding to one paper that
we're going to talk about but not now we're… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 23:
49 | different tokens in between tokens,
right? I don't need to insert at the right? I don't need to insert at the right? I don't need to insert at the
end. Why do I have to insert at the end? end. Why do … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 24:
31 | >> Does this work in the diffusion case?
>> Good question. I I'm gonna talk about >> Good question. I I'm gonna talk about >> Good question. I I'm gonna talk about
it. Okay. So, how do we even model t… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 25:
15 | you use it to to to essentially
construct construct the the ground truth construct construct the the ground truth construct construct the the ground truth
of like what this like what the full of like … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 25:
57 | right? What is this other thing?
>> The position or the whether to generate >> The position or the whether to generate >> The position or the whether to generate
it between these it between these it b… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 26:
52 | basically if we're missing tokens and basically if we're missing tokens and
like essentially like essentially like essentially
note that like it's more likely or like note that like it's more likely o… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 27:
45 | what you're predicting and then the
second objective from your model is second objective from your model is second objective from your model is
predict what tokens are missing so this predict what tok… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 28:
26 | like I don't know.
>> Yeah. >> Yeah.
>> Yeah. But basically what Okay. So >> Yeah. But basically what Okay. So >> Yeah. But basically what Okay. So
basically what happens in the model or basically wha… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 29:
10 | >> Yeah. Yeah. So basically what's
happening in what's hap what's happening happening in what's hap what's happening happening in what's hap what's happening
in like implementation is that you are in … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 29:
55 | is that is missing out of all the tokens is that is missing out of all the tokens
that are missing? Right. Okay. So these that are missing? Right. Okay. So these that are missing? Right. Okay. So thes… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 30:
48 | missing versus you know how many tokens
you predict to be missing and then the you predict to be missing and then the you predict to be missing and then the
second thing is uh like literally just seco… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 31:
48 | flow
And why is it a flow model? Well, it's And why is it a flow model? Well, it's And why is it a flow model? Well, it's
actually because this thing like the actually because this thing like the actu… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 32:
35 | another thing then you should be doing another thing then you should be doing
this operation where it's a ratio or this operation where it's a ratio or this operation where it's a ratio or
like a rate… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 33:
23 | divergence that is basically just a
generalized version of KL. Uh but this generalized version of KL. Uh but this generalized version of KL. Uh but this
is like too complicated. We're not going is lik… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 34:
11 | actually like already good enough for
whatever you want to do. So you can whatever you want to do. So you can whatever you want to do. So you can
literally just train a insertion based literally just … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 34:
56 | we kind of fixed a veryable
length uh problem with insertion based length uh problem with insertion based length uh problem with insertion based
generation. Uh we have other things to generation. Uh w… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 35:
40 | So like basically this thing is very
nice because you can um like essentially nice because you can um like essentially nice because you can um like essentially
you can do paralyze generation like you … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 36:
20 | that you have generated like in your
previous blocks. The only thing you need previous blocks. The only thing you need previous blocks. The only thing you need
to like do birectional attention to is t… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 37:
00 | people think about this. Um but yeah, so people think about this. Um but yeah, so
this is like a nice way to do you know this is like a nice way to do you know this is like a nice way to do you know
t… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 37:
50 | >> not in the current block but but we can
K catch all the previous blocks. >> No because we don't we haven't generated >> No because we don't we haven't generated
that yet, right? So like the block a… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 38:
29 | of like also like but but but but if you
have too small of a blog then it just have too small of a blog then it just have too small of a blog then it just
Yeah. It doesn't really it just is just Yeah.… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 39:
16 | in I think. Yeah. in I think. Yeah.
>> Do you think the second one is >> Do you think the second one is >> Do you think the second one is
um like it's it's the it's a problem of um like it's it's the … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 40:
11 | That's correct. Yeah.
>> For the for the second case, the mass >> For the for the second case, the mass >> For the for the second case, the mass
diffusion, why can't we do something diffusion, why can… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 40:
57 | Anything else? Yep.
>> Can you overhand why mass diffusion is >> Can you overhand why mass diffusion is >> Can you overhand why mass diffusion is
lower? lower? lower?
>> Uh okay. Who wants to tell who… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 41:
49 | but it doesn't mean that you you cannot
train a good enough diffusion model to train a good enough diffusion model to train a good enough diffusion model to
blm that's not the case it's just that blm … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 42:
45 | the the optimal that you're going to get the the optimal that you're going to get
from whatever algorithm that they from whatever algorithm that they from whatever algorithm that they
develop will loo… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 43:
32 | this is not image and text but like
we're going to look at image and text we're going to look at image and text we're going to look at image and text
later. But for those of you who are in later. But … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 44:
31 | >> What are we cogenerating?
>> So, we're co-generating something uh >> So, we're co-generating something uh >> So, we're co-generating something uh
discreet and something uh continuous at discreet an… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 45:
15 | like alternating between the two that's like alternating between the two that's
pretty much that right and like pretty much that right and like pretty much that right and like
basically And then if yo… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 46:
03 | well right so what you can do is you can well right so what you can do is you can
uh have like just like I think some uh have like just like I think some uh have like just like I think some
someone al… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 46:
50 | >> I mean the problem is like this is a >> I mean the problem is like this is a
research project right so it's like very research project right so it's like very research project right so it's like ve… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 47:
37 | and then the the the image for example
like flower or like cat and then and like flower or like cat and then and like flower or like cat and then and
then the the the the image are going to then the t… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 48:
13 | text and like image at the same time text and like image at the same time
because like you start from nothing and because like you start from nothing and because like you start from nothing and
then y… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 48:
49 | the way to become omni but this is like
just like two two modalities I guess. just like two two modalities I guess. just like two two modalities I guess.
Yeah. Yeah. Omni model just means that Yeah. Y… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 49:
50 | you cannot access the ponapto anymore,
it's still going to be on YouTube. Uh I it's still going to be on YouTube. Uh I it's still going to be on YouTube. Uh I
kind of do some editing uh for the kind o… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 50:
25 | your turn to take what you've learned
into the real world so I will highly into the real world so I will highly into the real world so I will highly
recommend if you are proud of what recommend if you… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 51:
05 | something like that. I think it could be something like that. I think it could be
a good experience if you guys are a good experience if you guys are a good experience if you guys are
interested in ge… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 51:
39 | research slash you know when you go to
the AGI company you know make the AGI a the AGI company you know make the AGI a the AGI company you know make the AGI a
diffusion model please we don't want to d… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 52:
25 | >> padding tokens and tokens after the OS,
right? right?
>> Yeah. >> Yeah.
>> Uh so one thing I implemented for >> Uh so one thing I implemented for >> Uh so one thing I implemented for
homework 3 and… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 53:
06 | I thought that's what they did in I thought that's what they did in
refflow but maybe not. If it's not then refflow but maybe not. If it's not then refflow but maybe not. If it's not then
this is a go… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 53:
42 | than a 2 RF model because the only than a 2 RF model because the only
errors accumulate. errors accumulate. errors accumulate.
>> Yeah. No, that's your homework. Four. >> Yeah. No, that's your homewor… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 54:
19 | in general I think that's a better idea
than the normal the the the way that than the normal the the the way that than the normal the the the way that
they they did. Okay. Any other question? they the… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 55:
03 | >> Yeah. Yeah. So actually there multiple >> Yeah. Yeah. So actually there multiple
uh so the most famous one in the uh so the most famous one in the uh so the most famous one in the
robotics world is… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 55:
49 | gradient you should apply from those
buffer data to your current time to one buffer data to your current time to one buffer data to your current time to one
of the time that you sampled. Um so this of… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 56:
25 | in that framework but you can turn you in that framework but you can turn you
can essentially turn an S OD like a flow can essentially turn an S OD like a flow can essentially turn an S OD like a flow… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 57:
06 | basically is there any other ways that
we can do it besides turning into a SDE we can do it besides turning into a SDE we can do it besides turning into a SDE
um yeah so like let's hope we can get um … |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 57:
58 | essentially you just sort of like uh
they sort of extend the flow map uh uh they sort of extend the flow map uh uh they sort of extend the flow map uh uh
what you call framework into the what you call… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 58:
37 | Uh, so let's see if he actually post it
online this week. Uh, but yeah, I don't online this week. Uh, but yeah, I don't online this week. Uh, but yeah, I don't
actually know how how he did it, but act… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 59:
19 | of similar to uh one of the other
previous uh framework and equilibrium previous uh framework and equilibrium previous uh framework and equilibrium
model. So equilibrium model is something model. So e… |
cmu-10799-diffusion-flow |
L12: CMU 10799 S26: Lecture 13 - Discrete Flow Matching & Edit Flow - Diffusion & Flow Matching | 60:
02 | or the underlying uh, you know, uh, math
is a little bit related, but like this is a little bit related, but like this is a little bit related, but like this
is definitely something new. I think is de… |