SlideShare a Scribd company logo
1 of 23
Download to read offline
CREATIVE AI MEETUP - 18.04.18
"Can you make this image more neoclassical?"
Practical uses of Style Transfer in the creative industry
Marco Marchesi
Head of Technology
Happy Finish
CREATIVE AI MEETUP - 18.04.18
Summary
● So far…
● Yinka Shonibare VR
● Other approaches: GAN’s
● Deep Retouching
● This year
● Conclusions
from “Come Swim” (2017)
CREATIVE AI MEETUP - 18.04.18
So far...
Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015).
https://harishnarayanan.org/writing/artistic-style-transfer
CREATIVE AI MEETUP - 18.04.18
So far...
Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
CREATIVE AI MEETUP - 18.04.18
Royal Academy - Yinka Shonibare VR
“The Townley Venus”
(1-2 century AD)
Shonibare’s
“Townley Venus”
(2017)
Gavin Hamilton’s “Venus
giving Helen to Paris as his
wife” (1782-1784)
CREATIVE AI MEETUP - 18.04.18
Royal Academy - Yinka Shonibare VR
CREATIVE AI MEETUP - 18.04.18
Texture Synthesis
Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint
arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
CREATIVE AI MEETUP - 18.04.18
First Tests
Test 1 Test 2 Test 3
Style Mask
Mask Content
CREATIVE AI MEETUP - 18.04.18
Image Analogy...
Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768
(2016).https://github.com/DmitryUlyanov/fast-neural-doodle
Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017).
https://github.com/awentzonline/image-analogies
CREATIVE AI MEETUP - 18.04.18
...that actually makes art!
CREATIVE AI MEETUP - 18.04.18
Our Process
CONTENT
TEXTURE IMAGE
STYLE
IMAGE
CONTENT
MASK
STYLE
MASK
NEURAL STYLE TRANSFER
TARGET
IMAGE
CONTENT
MASK
TARGET
TEXTURE IMAGE
video
CREATIVE AI MEETUP - 18.04.18
Final Result
video
CREATIVE AI MEETUP - 18.04.18
Another Approach: Generative Adversarial Networks
Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017).
https://github.com/junyanz/CycleGAN
Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT
CycleGAN (2017) MUNIT (2018)
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
This year: Deep Painterly Harmonization
(Cornell U., Adobe, 2018)
Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
CREATIVE AI MEETUP - 18.04.18
This year: Fast Photo Style (NVIDIA, 2018)
Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
CREATIVE AI MEETUP - 18.04.18
The semantic limitations of style transfer
CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
CREATIVE AI MEETUP - 18.04.18
Conclusions
Patent Pending
● Semantically consistent results
● Really Hi-Res
● More content transformation
What’s next?
www.happyfinish.com Everything is possible.
Marco Marchesi| Head of Technology
marco.marchesi@happyfinish.com

More Related Content

Similar to Marco Marchesi - Practical uses of style transfer in the creative industry

UXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin TrederUXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin Trederuxpin
 
Roadmap - SiriusCon2016
Roadmap - SiriusCon2016Roadmap - SiriusCon2016
Roadmap - SiriusCon2016Cédric Brun
 
Using AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationUsing AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationFITC
 
Exploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approachExploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approachJukka Huhtamäki
 
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityLeveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityMarco Aurelio Gerosa
 

Similar to Marco Marchesi - Practical uses of style transfer in the creative industry (6)

UXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin TrederUXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin Treder
 
Resume
ResumeResume
Resume
 
Roadmap - SiriusCon2016
Roadmap - SiriusCon2016Roadmap - SiriusCon2016
Roadmap - SiriusCon2016
 
Using AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationUsing AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic Creation
 
Exploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approachExploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approach
 
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityLeveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
 

More from Luba Elliott

Luba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV ConferenceLuba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV ConferenceLuba Elliott
 
Luba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - OxfordLuba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - OxfordLuba Elliott
 
Luba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML PragueLuba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML PragueLuba Elliott
 
Three Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetupThree Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetupLuba Elliott
 
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity WorkshopAI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity WorkshopLuba Elliott
 
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity WorkshopCreativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity WorkshopLuba Elliott
 
Seen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC ArchiveSeen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC ArchiveLuba Elliott
 
Luba Elliott AI art overview
Luba Elliott AI art overview Luba Elliott AI art overview
Luba Elliott AI art overview Luba Elliott
 
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetupNatasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetupLuba Elliott
 
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetupSander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetupLuba Elliott
 
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to SkyHooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to SkyLuba Elliott
 
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetupLucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetupLuba Elliott
 
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...Luba Elliott
 
Luba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through ArtLuba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through ArtLuba Elliott
 
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetupGeorgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetupLuba Elliott
 
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...Luba Elliott
 
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...Luba Elliott
 
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetupDaghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetupLuba Elliott
 
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetupMartin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetupLuba Elliott
 

More from Luba Elliott (20)

Luba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV ConferenceLuba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV Conference
 
Luba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - OxfordLuba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - Oxford
 
Luba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML PragueLuba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML Prague
 
Three Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetupThree Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetup
 
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity WorkshopAI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
 
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity WorkshopCreativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
 
Seen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC ArchiveSeen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC Archive
 
Luba Elliott AI art overview
Luba Elliott AI art overview Luba Elliott AI art overview
Luba Elliott AI art overview
 
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetupNatasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
 
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetupSander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
 
Design in AI
Design in AIDesign in AI
Design in AI
 
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to SkyHooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
 
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetupLucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
 
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
 
Luba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through ArtLuba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through Art
 
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetupGeorgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
 
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
 
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
 
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetupDaghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
 
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetupMartin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
 

Recently uploaded

Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality AssuranceInflectra
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesThousandEyes
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 

Recently uploaded (20)

Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 

Marco Marchesi - Practical uses of style transfer in the creative industry

  • 1. CREATIVE AI MEETUP - 18.04.18 "Can you make this image more neoclassical?" Practical uses of Style Transfer in the creative industry Marco Marchesi Head of Technology Happy Finish
  • 2. CREATIVE AI MEETUP - 18.04.18 Summary ● So far… ● Yinka Shonibare VR ● Other approaches: GAN’s ● Deep Retouching ● This year ● Conclusions from “Come Swim” (2017)
  • 3. CREATIVE AI MEETUP - 18.04.18 So far... Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015). https://harishnarayanan.org/writing/artistic-style-transfer
  • 4. CREATIVE AI MEETUP - 18.04.18 So far... Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
  • 5. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR “The Townley Venus” (1-2 century AD) Shonibare’s “Townley Venus” (2017) Gavin Hamilton’s “Venus giving Helen to Paris as his wife” (1782-1784)
  • 6. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR
  • 7. CREATIVE AI MEETUP - 18.04.18 Texture Synthesis Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
  • 8. CREATIVE AI MEETUP - 18.04.18 First Tests Test 1 Test 2 Test 3 Style Mask Mask Content
  • 9. CREATIVE AI MEETUP - 18.04.18 Image Analogy... Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768 (2016).https://github.com/DmitryUlyanov/fast-neural-doodle Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017). https://github.com/awentzonline/image-analogies
  • 10. CREATIVE AI MEETUP - 18.04.18 ...that actually makes art!
  • 11. CREATIVE AI MEETUP - 18.04.18 Our Process CONTENT TEXTURE IMAGE STYLE IMAGE CONTENT MASK STYLE MASK NEURAL STYLE TRANSFER TARGET IMAGE CONTENT MASK TARGET TEXTURE IMAGE video
  • 12. CREATIVE AI MEETUP - 18.04.18 Final Result video
  • 13. CREATIVE AI MEETUP - 18.04.18 Another Approach: Generative Adversarial Networks Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017). https://github.com/junyanz/CycleGAN Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT CycleGAN (2017) MUNIT (2018)
  • 14. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 15. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 16. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 17. CREATIVE AI MEETUP - 18.04.18 This year: Deep Painterly Harmonization (Cornell U., Adobe, 2018) Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
  • 18. CREATIVE AI MEETUP - 18.04.18 This year: Fast Photo Style (NVIDIA, 2018) Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
  • 19. CREATIVE AI MEETUP - 18.04.18 The semantic limitations of style transfer
  • 20. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  • 21. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  • 22. CREATIVE AI MEETUP - 18.04.18 Conclusions Patent Pending ● Semantically consistent results ● Really Hi-Res ● More content transformation What’s next?
  • 23. www.happyfinish.com Everything is possible. Marco Marchesi| Head of Technology marco.marchesi@happyfinish.com