cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 00:
02 | All right. All right.
Right. So, so far what we have learn we Right. So, so far what we have learn we Right. So, so far what we have learn we
have learned about like pretty much have learned about lik… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 00:
56 | to do distillation or uh you know self to do distillation or uh you know self
dissolations or flow maps or consistency dissolations or flow maps or consistency dissolations or flow maps or consistency… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 01:
45 | who, actually, I'll just name who, like
the people from Anthropic have claimed the people from Anthropic have claimed the people from Anthropic have claimed
to me that uh I I believe it's ICML 2024 to… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 02:
37 | uh I mean obviously you know we have
other important modalities right for other important modalities right for other important modalities right for
example like molecules or like DNA example like mole… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 03:
35 | >> Near space and do like a nearest
neighbors type thing to match it. neighbors type thing to match it. neighbors type thing to match it.
>> Uh so diffusion model on a continuous >> Uh so diffusion mo… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 04:
44 | then embedding is what goes through
>> so you first take the text and go to >> so you first take the text and go to >> so you first take the text and go to
embedding embedding existing embedding embed… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 05:
26 | running out of the allergyfree options.
Hold on. Uh sorry. The the allergy Hold on. Uh sorry. The the allergy Hold on. Uh sorry. The the allergy
sensitive option. Okay. Anyway, you're sensitive option… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 06:
19 | And then uh for flow matching is pretty And then uh for flow matching is pretty
much the same thing, but instead of much the same thing, but instead of much the same thing, but instead of
learning the… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 07:
03 | adding noise process is the forward
process and the gradually d noiseis process and the gradually d noiseis process and the gradually d noiseis
process is the reverse process. Right. process is the re… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 08:
09 | version of a tweet from Andre Kapathi uh
so let's identify some of the noise in so let's identify some of the noise in so let's identify some of the noise in
this tweet what do we see this tweet what … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 09:
15 | then you get some weird emojis and you then you get some weird emojis and you
get some like out of place like six, get some like out of place like six, get some like out of place like six,
seven like … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 10:
13 | >> Yeah. Okay.
>> Masking also works. Okay. Uh hold on. Uh >> Masking also works. Okay. Uh hold on. Uh >> Masking also works. Okay. Uh hold on. Uh
do you have allergy? Okay. This is also do you have a… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 11:
23 | from the like original uh clean data to
some random tokens right in the some random tokens right in the some random tokens right in the
vocabulary. So that basically say like vocabulary. So that basic… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 12:
23 | vector. Uh then basically say we have a vector. Uh then basically say we have a
beta chance. This is just a some chance beta chance. This is just a some chance beta chance. This is just a some chance
… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 13:
09 | is why this is like one minus you know is why this is like one minus you know
every everything else has one beta over every everything else has one beta over every everything else has one beta over
th… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 14:
08 | sentences with real vocabulary, it's not sentences with real vocabulary, it's not
necessary that the noise sentence is necessary that the noise sentence is necessary that the noise sentence is
actuall… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 15:
10 | then you know so you just so the first then you know so you just so the first
row is uh I second row is love uh third row is uh I second row is love uh third row is uh I second row is love uh third
ro… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 16:
21 | that by induction we can not only get
like basically it's the same thing as like basically it's the same thing as like basically it's the same thing as
like you know two gausians added like you know t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 17:
11 | this is like literally how to jump this is like literally how to jump
directly from x0 to xt is you just like directly from x0 to xt is you just like directly from x0 to xt is you just like
kind of li… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 18:
24 | as the beta t in uh DDPM. as the beta t in uh DDPM.
>> Yeah. Don't worry. Everything's gonna be Don't worry. Everything's gonna be
simplified later on in this class. right simplified later on in this … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 19:
40 | >> Estimate these points and then Q >> Estimate these points and then Q
transpose. transpose. transpose.
>> Yes, pretty much. And then specifically, >> Yes, pretty much. And then specifically, >> Yes,… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 20:
37 | because you're getting you're marovian
like everything is marovian here. So you like everything is marovian here. So you like everything is marovian here. So you
can ignore the x0 here. So then this c… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 21:
35 | categorical distribution that is defined categorical distribution that is defined
by this black font term here. >> Oh dot is like elementwise >> Oh dot is like elementwise
multiplication. Anyway, hone… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 22:
42 | difficult to define in this case. Right?
What is the other thing? What is the other thing? What is the other thing?
>> Tokens. >> Tokens. >> Tokens.
>> The what >> The what >> The what
>> the probabil… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 23:
30 | prediction right so literally you need
to only you only need to predict the to only you only need to predict the to only you only need to predict the
logist of the final clean output given logist of t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 24:
18 | a D3PM.
All right, any questions about D3PM? Yes, Yes,
>> this won't have like an equivalence to >> this won't have like an equivalence to >> this won't have like an equivalence to
like score matching… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 25:
17 | like discrete diffusion models
>> great question and the answer is Yes. >> great question and the answer is Yes. >> great question and the answer is Yes.
And we're going to talk about it next And we'r… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 26:
33 | fixed length.
>> Yeah it's fixed length. Everything is >> Yeah it's fixed length. Everything is >> Yeah it's fixed length. Everything is
fixed length. Yeah. fixed length. Yeah. fixed length. Yeah.
>> … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 27:
24 | Alrighty. Okay. So h just a reminder
what is a uh what is a continuous score what is a uh what is a continuous score what is a uh what is a continuous score
and why is it weird to think about score an… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 28:
10 | no continuous flow anymore. There's no
gradient like you cannot like really do gradient like you cannot like really do gradient like you cannot like really do
any gradient stuff anymore here, right? a… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 28:
56 | type of thing. Uh which is not a healthy
thing to do but like you know just for thing to do but like you know just for thing to do but like you know just for
the sake of the class anyway um you know t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 29:
41 | basically what people does is that they
define something called uh the concrete define something called uh the concrete define something called uh the concrete
score where it's literally just the scor… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 30:
49 | apparently
uh if you read this particular paper uh if you read this particular paper uh if you read this particular paper
they have some connections to something they have some connections to somethin… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 31:
48 | people actually call it a rate matrix. people actually call it a rate matrix.
So it's a instantaneous rate to jump So it's a instantaneous rate to jump So it's a instantaneous rate to jump
like just j… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 32:
43 | thing, then you're actually basically if thing, then you're actually basically if
you do the math then then then you're you do the math then then then you're you do the math then then then you're
actu… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 33:
27 | everything
well you can represent everything in a well you can represent everything in a well you can represent everything in a
fully connected graph and then assign fully connected graph and then ass… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 34:
22 | So if you want your chain to satisfy
detail balance you're going to get this detail balance you're going to get this detail balance you're going to get this
thing so that your chain is reversible, thi… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 35:
19 | I see everyone's confused by how this
whole thing but we need basically we whole thing but we need basically we whole thing but we need basically we
need a neuronet network to predict this need a neur… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 36:
48 | score versus your uh you know your your score versus your uh you know your your
your your your real score. And you your your your real score. And you your your your real score. And you
literally just … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 37:
47 | non-zero number divided by a non-zero
number or like or sorry non- negative number or like or sorry non- negative number or like or sorry non- negative
number divided by a non- negative number number … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 38:
35 | good. Exactly. That's exactly correct. good. Exactly. That's exactly correct.
Um uh the other thing is that yeah, you Um uh the other thing is that yeah, you Um uh the other thing is that yeah, you
yo… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 39:
20 | like a like a like a like a like a what
we call uh constant so let's just ignore we call uh constant so let's just ignore we call uh constant so let's just ignore
that for now so we basically we can t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 40:
06 | then the person is going to be this
thing, right? So what you do is you thing, right? So what you do is you thing, right? So what you do is you
essentially so K is like you you jump to essentially so … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 40:
54 | then this part becomes one uh s minus r
uh times the sum of all the possible all uh times the sum of all the possible all uh times the sum of all the possible all
the probabilities and then this one i… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 41:
37 | us something that is that has that has
exponential in it and also literally exponential in it and also literally exponential in it and also literally
right the the the easiest right the the the easies… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 42:
20 | right? So you the the S minus the right? So you the the S minus the
likelihood ratio times the log of the likelihood ratio times the log of the likelihood ratio times the log of the
your S. Um so beca… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 43:
12 | calculate the ground truth by literally
the same trick the den noising score the same trick the den noising score the same trick the den noising score
matching. This is just the noising score matching… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 44:
40 | the reverse rate, right? So, you just
replace this concrete score with the replace this concrete score with the replace this concrete score with the
concrete score that you trained. And concrete score… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 45:
39 | >> earlier how are we choosing why do we
just randomly sample any token choices just randomly sample any token choices just randomly sample any token choices
>> yeah based on >> yeah based on >> yeah … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 46:
38 | basically like how about we can only do
masking and unmasking, right? So in the masking and unmasking, right? So in the masking and unmasking, right? So in the
forward process all you can do is you fo… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 47:
20 | like basically the only two columns that
you're going to have non- negative value you're going to have non- negative value you're going to have non- negative value
is the columns on the diagonal and t… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 48:
06 | >> But if we go all the way end of the day
everything will be masked. everything will be masked. everything will be masked.
>> Yeah. And it's still a distribution >> Yeah. And it's still a distributio… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 48:
55 | multiplication and stuff anymore. Uh
because we simplified everything, right? because we simplified everything, right? because we simplified everything, right?
So basically what what we're essentially… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 49:
51 | stay unmasked and then with one minus
alpha t uh probability you're going to alpha t uh probability you're going to alpha t uh probability you're going to
stay masked and uh basically if we if stay ma… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 51:
08 | when uh xt equals x0 and x t minus one
also equals x zero um like basically if also equals x zero um like basically if also equals x zero um like basically if
if you have not been masked uh at time t … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 52:
02 | simplified into this really really
simple uh ratio. And similarly simple uh ratio. And similarly simple uh ratio. And similarly
because the only other option for you is because the only other option f… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 53:
11 | over. You should you should have the
same value because it hasn't been same value because it hasn't been same value because it hasn't been
masked. And if XT is masked, then you masked. And if XT is ma… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 54:
23 | times the clean data estimation. times the clean data estimation.
That's it. >> We have that problem because we'll start >> We have that problem because we'll start
with full mask. So if you start wit… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 55:
26 | >> So you're always starting with the full
mask. mask. mask.
>> That's right. >> That's right. >> That's right.
>> So if that one reverse gets you to I >> So if that one reverse gets you to I >> So if… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 56:
12 | actually a good point. Basically, uh the
the the mercury um founder, Inception the the mercury um founder, Inception the the mercury um founder, Inception
Lab founder, Stephano, who is the one of Lab … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 57:
09 | you can also do like continuous time
training with this. You literally just training with this. You literally just training with this. You literally just
take the continuous time limit of the of take … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 57:
58 | >> uh you yes kind of so it's the same
thing it's uh like analogy to you choose thing it's uh like analogy to you choose thing it's uh like analogy to you choose
the number of sampling steps right in … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 58:
42 | this is purely depending on like the the this is purely depending on like the the
model that you got trained but usually model that you got trained but usually model that you got trained but usually
i… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 59:
34 | basically the mask ratio is depending on
this alpha t thing which you set. So you this alpha t thing which you set. So you this alpha t thing which you set. So you
you can you can choose uh but like y… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 60:
34 | the tokens. the tokens.
>> Yeah. >> Yeah.
>> But then in the last you have something >> But then in the last you have something >> But then in the last you have something
like XT equal to M. So like X… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 61:
16 | >> uh what do you mean by latent text well
like so you mean like like so you mean like like so you mean like
a region space for images and then use a region space for images and then use a region spac… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 62:
02 | >> Does it produce something coherent if >> Does it produce something coherent if
all the things are independently getting all the things are independently getting all the things are independently get… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 62:
49 | >> It is pretty much just birth literally
if you think about it. Yeah. if you think about it. Yeah. if you think about it. Yeah.
>> Well, between like >> Well, between like >> Well, between like
>> yo… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 63:
40 | when they when he said like oh we can
correct hallucination but like here we correct hallucination but like here we correct hallucination but like here we
cannot really it's the same as cannot really … |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 64:
24 | like a sort of like a like a like a like
a interesting moment in science. But if a interesting moment in science. But if a interesting moment in science. But if
you're one of the authors, you may get,… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 65:
08 | >> very low because it's 2024. Okay. Anyway
um but since like you know people show um but since like you know people show um but since like you know people show
saw the potential of this they have saw… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 65:
55 | say and seems like super compatible uh say and seems like super compatible uh
to comparable to like large language to comparable to like large language to comparable to like large language
models like… |
cmu-10799-diffusion-flow |
L11: CMU 10799 S26: Lecture 12 - Discrete Diffusion & Masked Diffusion - Diffusion & Flow Matching | 66:
39 | Please come up and uh can get rich as
well. All right, see you guys next well. All right, see you guys next well. All right, see you guys next
class. |