The presentation is an introduction to AI (deep learning). The key to success with AI is “asking good questions.” The talk was given in "Seminar in Information Systems and Applications" at National Tsing Hua University in Taiwan. During this talk, we discussed what a good question ...
The presentation is an introduction to AI (deep learning). The key to success with AI is “asking good questions.” The talk was given in "Seminar in Information Systems and Applications" at National Tsing Hua University in Taiwan. During this talk, we discussed what a good question is, how we use design thinking process to improve our question, and how can we “answer” the question by deep learning.
Size: 8.93 MB
Language: en
Added: May 09, 2018
Slides: 117 pages
Slide Content
Deep Learning
Yen-lung Tsai
Department of Mathematical Sciences
National Chengchi University
and
SeminarinInformationSystemsandApplications
Design Thinking
NTHU2018
When a neural network structure is determined
and activation functions are also determined,
it can be adjusted by weights, biases. We call
the set of these parameters θ, each of which
defines a function, and we treat it as a set.
TheFunctionSpaceofourNN
!53
Wearelookingfor
Makes theclosesttotheobjective
function
!54
!101
25525201
23404215
43135543
53450215
23111013
44115114
23220424
05453414
3527
filter
Move to the right
Samematrix
asbefore!
W=
!102
25525201
23404215
43135543
53450215
23111013
44115114
23220424
05453414
352744323638
363637363643
373723261735
292522181427
272524212432
313827342540
filter
All the way to the end
W=
!121
PANDARUS:
Alas, I think he shall be come
approached and the day
When little srain would be attain'd into
being never fed,
And who is but a chain and subjects of
his death,
I should not sleep.
Second Senator:
They are away this miseries, produced
upon my soul,
Breaking and strongly should be
buried, when I perish
The earth and thoughts of many states.
“Shakespeare”
!163
GenerativeAdversarial
Network
YannLeCunsaidGNNisthe
mostpromisingmodel
GAN
!164
There are many interesting recent
development in deep learning…
The most important one, in my opinion, is
adversarial training (also called GAN for
Generative Adversarial Networks).
”
“
—YanLeCun(楊⽴昆),2016
!170
Karrasetal.NVIDIAteam,(ICLR2018)
“Progressive Growing of GANs for Improved Quality, Stability, and Variation”
ProgressiveGAN
https://arxiv.org/abs/1710.10196