– Implicit function(00:11:59 - 00:15:53) - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Implicit function(00:11:59 - 00:15:53)
05L – Joint embedding method and latent variable energy based models (LV-EBMs)

Course website: http://bit.ly/DLSP21-web
Playlist: http://bit.ly/DLSP21-YouTube
Speaker: Yann LeCun

Chapters
00:00:00 – Welcome to class
00:00:39 – Predictive models
00:02:25 – Multi-output system
00:06:36 – Notation (factor graph)
00:07:41 – The energy function F(x, y)
00:08:53 – Inference
00:1...
Course website: http://bit.ly/DLSP21-web
Playlist: http://bit.ly/DLSP21-YouTube
Speaker: Yann LeCun

Chapters
00:00:00 – Welcome to class
00:00:39 – Predictive models
00:02:25 – Multi-output system
00:06:36 – Notation (factor graph)
00:07:41 – The energy function F(x, y)
00:08:53 – Inference
00:11:59 – Implicit function
00:15:53 – Conditional EBM
00:16:24 – Unconditional EBM
00:19:18 – EBM vs. probabilistic models
00:21:33 – Do we need a y at inference?
00:23:29 – When inference is hard
00:25:02 – Joint embeddings
00:28:29 – Latent variables
00:33:54 – Inference with latent variables
00:37:58 – Energies E and F
00:42:35 – Preview on the EBM practicum
00:44:30 – From energy to probabilities
00:50:37 – Examples: K-means and sparse coding
00:53:56 – Limiting the information capacity of the latent variable
00:57:24 – Training EBMs
01:04:02 – Maximum likelihood
01:13:58 – How to pick β?
01:17:28 – Problems with maximum likelihood
01:20:20 – Other types of loss functions
01:26:32 – Generalised margin loss
01:27:22 – General group loss
01:28:26 – Contrastive joint embeddings
01:34:51 – Denoising or mask autoencoder
01:46:14 – Summary and final remarks

#PyTorch #NYU #Yann LeCun #Deep Learning #neural networks
– Welcome to class - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Welcome to class

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:00:00 - 00:00:39
– Predictive models - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Predictive models

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:00:39 - 00:02:25
What are the research papers from Facebook mentioned around ? - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

What are the research papers from Facebook mentioned around ?

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:01:30 - 01:51:31
– Multi-output system - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Multi-output system

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:02:25 - 00:06:36
– Notation (factor graph) - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Notation (factor graph)

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:06:36 - 00:07:41
– The energy function F(x, y) - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– The energy function F(x, y)

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:07:41 - 00:08:53
– Inference - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Inference

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:08:53 - 00:11:59
– Implicit function - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Implicit function

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:11:59 - 00:15:53
– Conditional EBM - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Conditional EBM

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:15:53 - 00:16:24
– Unconditional EBM - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Unconditional EBM

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:16:24 - 00:19:18
and 50:43 => Unconditional model is when the input is partially observed but you dont know exactly what part.- What is test/inference in these unconditional EBM models? Is there a proper split between training and inference/test in the unconditional models?- How does models like PCA or K-means fit here, what are the partially observed inputs Y? For example in K-MEans you receive all the components of Y, I dont see that they are partially observed - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

and 50:43 => Unconditional model is when the input is partially observed but you dont know exactly what part.- What is test/inference in these unconditional EBM models? Is there a proper split between training and inference/test in the unconditional models?- How does models like PCA or K-means fit here, what are the partially observed inputs Y? For example in K-MEans you receive all the components of Y, I dont see that they are partially observed

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:16:34 - 00:25:10
– EBM vs. probabilistic models - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– EBM vs. probabilistic models

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:19:18 - 00:21:33
– Do we need a y at inference? - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Do we need a y at inference?

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:21:33 - 00:23:29
– When inference is hard - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– When inference is hard

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:23:29 - 00:25:02
– Joint embeddings - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Joint embeddings

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:25:02 - 00:28:29
and 1:01:50 => With the joint embedding architecture- What would be inference with this architecture, inferring a Y from a given X minimizing the cost C(h, h')? I know that you could run gradient descent to the Y backward the Pred(y) network but it is not clear to me the purpose of inferring Y given X in this architecure.- What does the "Advange: no pixel-level reconstruction" in green means? (I suspect that this may have something to do with my just above question)- Can this architecture also be trained as a Latent Variable EBM? or it is always trained in a Contrastive way - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

and 1:01:50 => With the joint embedding architecture- What would be inference with this architecture, inferring a Y from a given X minimizing the cost C(h, h')? I know that you could run gradient descent to the Y backward the Pred(y) network but it is not clear to me the purpose of inferring Y given X in this architecure.- What does the "Advange: no pixel-level reconstruction" in green means? (I suspect that this may have something to do with my just above question)- Can this architecture also be trained as a Latent Variable EBM? or it is always trained in a Contrastive way

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:25:10 - 01:51:31
– Latent variables - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Latent variables

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:28:29 - 00:33:54
– Inference with latent variables - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Inference with latent variables

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:33:54 - 00:37:58
– Energies E and F - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Energies E and F

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:37:58 - 00:42:35
– Preview on the EBM practicum - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Preview on the EBM practicum

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:42:35 - 00:44:30
– From energy to probabilities - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– From energy to probabilities

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:44:30 - 00:50:37
– Examples: K-means and sparse coding - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Examples: K-means and sparse coding

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:50:37 - 00:53:56
– Limiting the information capacity of the latent variable - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Limiting the information capacity of the latent variable

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:53:56 - 00:57:24
– Training EBMs - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Training EBMs

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
00:57:24 - 01:04:02
– Maximum likelihood - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Maximum likelihood

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:04:02 - 01:13:58
I spent some time to derive the step mention in . I made my best effort to get the final result. But, I am not sure if my steps are correct. I hope my fellow students can help to point out my mistakes. Due to the lack of LaTex support in Youtube comment, I try my best to make my steps as clear as possible. I use partial derivative for log to get to the second step. Then, I use Leibniz integral rule to move the partial derivative inside the integral in the third step. The rest is pretty straightforward, hopefully. Thank you! - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

I spent some time to derive the step mention in . I made my best effort to get the final result. But, I am not sure if my steps are correct. I hope my fellow students can help to point out my mistakes. Due to the lack of LaTex support in Youtube comment, I try my best to make my steps as clear as possible. I use partial derivative for log to get to the second step. Then, I use Leibniz integral rule to move the partial derivative inside the integral in the third step. The rest is pretty straightforward, hopefully. Thank you!

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:07:44 - 01:51:31
I tried to calculate the derivative Yann said (), but probably I am missing something because in my final result I don't have the integral (only -P_w(.) ...). Is there any supplementary material with these calculations?Thanks again for your amazing and hard work! - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

I tried to calculate the derivative Yann said (), but probably I am missing something because in my final result I don't have the integral (only -P_w(.) ...). Is there any supplementary material with these calculations?Thanks again for your amazing and hard work!

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:07:45 - 01:51:31
– How to pick β? - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– How to pick β?

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:13:58 - 01:17:28
– Problems with maximum likelihood - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Problems with maximum likelihood

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:17:28 - 01:20:20
– Other types of loss functions - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Other types of loss functions

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:20:20 - 01:26:32
– Generalised margin loss - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Generalised margin loss

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:26:32 - 01:27:22
– General group loss - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– General group loss

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:27:22 - 01:28:26
– Contrastive joint embeddings - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Contrastive joint embeddings

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:28:26 - 01:34:51
Am I missing something, or in this lecture there is no "non-contrastive joint embeddings" methods Yann was talking about at   ? I also briefly checked the next lectures but didn't find something related to this. Could you please point me out? 😇Thank you for the video, btw, brilliant as always :) - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

Am I missing something, or in this lecture there is no "non-contrastive joint embeddings" methods Yann was talking about at ? I also briefly checked the next lectures but didn't find something related to this. Could you please point me out? 😇Thank you for the video, btw, brilliant as always :)

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:34:40 - 01:51:31
– Denoising or mask autoencoder - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Denoising or mask autoencoder

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:34:51 - 01:46:14
– Summary and final remarks - 05L – Joint embedding method and latent variable energy based models (LV-EBMs)

– Summary and final remarks

05L – Joint embedding method and latent variable energy based models (LV-EBMs)
2021年07月28日 
01:46:14 - 01:51:31

Alfredo Canziani

※本サイトに掲載されているチャンネル情報や動画情報はYouTube公式のAPIを使って取得・表示しています。

Timetable

動画タイムテーブル