210 likes | 369 Views
Demystifying Deep Learning & AI Lightning talk on classifying monets with a CNN
E N D
Show Me the Monet Samuel E Bozek
Why Monet? • Impressionism was a Driving Force in Art • Leading Artist in the Movement • Wide Subject Matter, Landscapes, Portraits, Cityscapes • Difference in Styles from Early to Late Work
A Little CNN Game • Following are Three Monet Images. • Look To See Key Features • Will Then Show How Model Predicted The Input Images
Most/Least Monet Paintings • Predicted Probabilities of Hold Out Set • Gives Overview of What Model Perceives as Monet/Not Monet • For Both Monet Images and Not Monet Images
99.65% Probability of Being Monet Atkinson Grimshaw London Bridge at Half Tide
99.00% Probability of Being Monet Claude Monet Farmyard in Normandy 1863
0.5% Probability of Being Monet Jan Sluyther Portrait of a Dancer
0.67% Probability of Being Monet Claude Monet The Grand Creuse at Pont de Vervy 1889
Beyond Classification • During my initial classification work came across ANeural Algorithm of Artistic Style • Art historian senses tingling. • Programming senses nervous. • Chemist senses ambivalent.
Beyond Classification • The only math I’ll throw in: • ℒtotal(p, a, x) = 훼ℒcontent(p, x) + βℒstyle(a, x) • Using Structure Outlined in Paper Created a 3 layer style transfer network to
Sources • A Neural Algorithm of Artistic Style: https://arxiv.org/abs/ 1508.06576 • More Sophisticated Style Transfer: https://github.com/ fchollet/keras/blob/master/examples/ neural_style_transfer.py