๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

A PIECE OF DATA/๐Ÿ• ๋”ฅ๋Ÿฌ๋‹

(4)
[๋”ฅ๋Ÿฌ๋‹ ๊ธฐ์ดˆ] ๋จธ์‹ ๋Ÿฌ๋‹ ๊ธฐ์ดˆโ‘ฃ(ReLU, Vanishing gradient, dropout, ensemble) * ๋”ฅ๋Ÿฌ๋‹ session์€ Sung Kim๋‹˜์˜ ๊ฐ•์˜ (์œ ํŠœ๋ธŒ)๋ฅผ ์š”์•ฝ/์ •๋ฆฌํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ** Sung Kim๋‹˜์˜ ๊ฐ•์˜์™€ ์ž๋ฃŒ๋Š” ์•„๋ž˜์˜ ์ž๋ฃŒ๋ฅผ ์ฐธ๊ณ ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. - Andrew Ng's ML class - Convolutional Neural Networks for Visual Recognition - Tensorflow - Srivastava, Nitish, et al. โ€Dropout: a simple way to prevent neural networks from overfittingโ€ CONTENTS ReLU(Rectified Linear Unit, ReLU) Vanishing gradient(๊ธฐ์šธ๊ธฐ ์†Œ์‹ค) dropout ensemble 10-1. ReLU: Better non-linearity..
[๋”ฅ๋Ÿฌ๋‹ ๊ธฐ์ดˆ] ๋จธ์‹ ๋Ÿฌ๋‹ ๊ธฐ์ดˆโ‘ข(Neural Nets for XOR) * ๋”ฅ๋Ÿฌ๋‹ session์€ Sung Kim๋‹˜์˜ ๊ฐ•์˜ (์œ ํŠœ๋ธŒ)๋ฅผ ์š”์•ฝ/์ •๋ฆฌํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ** Sung Kim๋‹˜์˜ ๊ฐ•์˜์™€ ์ž๋ฃŒ๋Š” ์•„๋ž˜์˜ ์ž๋ฃŒ๋ฅผ ์ฐธ๊ณ ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. - Andrew Ng's ML class - Convolutional Neural Networks for Visual Recognition - Tensorflow CONTENTS ๋‰ด๋Ÿด๋„คํŠธ์›Œํฌ,Neural Nets(NN) for XOR XOR๋ฌธ์ œ ํ‘ธ๋Š” ๋ฐฉ๋ฒ• ์—ญ์ „ํŒŒ์˜ค๋ฅ˜, Backpropagation 09-1. Neural Nets(NN) for XOR AND๋ฌธ์ œ๋ž€? 0, 1์ผ ์ค‘ ๋‘˜ ๋‹ค 1์ผ ๋•Œ๋งŒ +์ด๊ณ  ํ•˜๋‚˜๋ผ๋„ 0์ด๋ฉด -์ด๋‹ค. (0 0) โ†’ - (1, 0) โ†’ - (0 1) โ†’ - (1, 1) โ†’ + OR๋ฌธ์ œ๋ž€? 0, 1์ผ ์ค‘ ๋‘˜ ๋‹ค 0์ผ ๋•Œ๋งŒ ..
[๋”ฅ๋Ÿฌ๋‹ ๊ธฐ์ดˆ] ๋จธ์‹ ๋Ÿฌ๋‹ ๊ธฐ์ดˆโ‘ก(logistic regression, Multinomial classification, learning rate * ๋”ฅ๋Ÿฌ๋‹ session์€ Sung Kim๋‹˜์˜ ๊ฐ•์˜ (์œ ํŠœ๋ธŒ)๋ฅผ ์š”์•ฝ/์ •๋ฆฌํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ** Sung Kim๋‹˜์˜ ๊ฐ•์˜์™€ ์ž๋ฃŒ๋Š” ์•„๋ž˜์˜ ์ž๋ฃŒ๋ฅผ ์ฐธ๊ณ ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. - Andrew Ng's ML class - Convolutional Neural Networks for Visual Recognition - Tensorflow CONTENTS Logistic(regression) classification Logistic(regression) classification cost function & gradient decent Softmax classification: Multinomial classification Learning rate, data preprocessing, overfitting 05-1...
[๋”ฅ๋Ÿฌ๋‹ ๊ธฐ์ดˆ] ๋จธ์‹ ๋Ÿฌ๋‹ ๊ธฐ์ดˆโ‘ (linear regression, Cost function, Multivariable linear regression) * ๋”ฅ๋Ÿฌ๋‹ session์€ Sung Kim๋‹˜์˜ ๊ฐ•์˜ (์œ ํŠœ๋ธŒ)๋ฅผ ์š”์•ฝ/์ •๋ฆฌํ•œ ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค. ** Sung Kim๋‹˜์˜ ๊ฐ•์˜์™€ ์ž๋ฃŒ๋Š” ์•„๋ž˜์˜ ์ž๋ฃŒ๋ฅผ ์ฐธ๊ณ ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. - Andrew Ng's ML class - Convolutional Neural Networks for Visual Recognition - Tensorflow ๋ชฉํ‘œ ๊ธฐ์ดˆ์ ์ธ ๋จธ์‹ ๋Ÿฌ๋‹ ์•Œ๊ณ ๋ฆฌ์ฆ˜์˜ ์ดํ•ด - Linear regression, Logistic regression(classification) - Neural networks, Convolutional Neural Network, Recurrent Neural Network 01. Machine Learning Basics ๋จธ์‹ ๋Ÿฌ๋‹์ด๋ž€? ๋จธ์‹ ๋Ÿฌ๋‹์€ ์‚ฌ๋žŒ์ด ๋ชจ๋“  ๊ทœ์น™์„ ๋งŒ๋“ค์–ด๋‚ผ ์ˆ˜ ์—†๋‹ค๋Š”..