4/10 - Cut & paste your surroundings to Photoshop
Code: github.com/cyrildiagne/ar
Book: @HOLOmagazine
Garment: SS17 by
Type: Sainte Colombe by
Technical Insights: ↓
#ML #AR #AI #AIUX #Adobe #Photoshop
Conversation
Replying to
The secret sauce here is BASNet (Qin et al, CVPR 2019) for salient object detection and background removal.
The accuracy and range of this model are stunning and there are many nice use cases so I packaged it as a micro-service / docker image: github.com/cyrildiagne/ba
11
169
1,335
And again, the OpenCV SIFT trick to find where the phone is pointing at the screen.
I also packaged it as a small python library: github.com/cyrildiagne/sc
Send a camera image + a screenshot and you get accurate x, y screen coordinates!
6
89
627
I wrote the mobile app using as I wanted to try the platform. A few rough edges with Android support but the dev workflow is impressively smooth.
Could become an ideal ML interaction design research platform if it could run #TFLite models without ejecting.
5
48
366
Right now, latency is about ~2.5s for cut and ~4s for paste.
There are tons of ways to speed up the whole flow but that weekend just went too fast 🤷🏿♂️
Anyway that’s it for now. Let me know if you have any question. Otherwise see you next week for another AI+UX prototype!
31
151
1,164
Thanks everyone! The response has been truly phenomenal…
*Many* of you want to use this tool. So and I are now turning it into an app anyone can use: arcopypaste.app
Great progress already, get in touch for early access to beta!
48
251
884
Mon bon Monsieur vous êtes fort. Très fort.
1
13
Eh bien merci! Vous êtes trop aimable 🤵🏿
2
2
57
This is really cool! Good job man
Can I use the video on my SM pages with credit to your Twitter account?
1