Shipped, 2022, Shipping generative remove and find distractions at MAX 2024
Syashi as a lead designer for Desktop and web versions of Remove tool
Remove tool
A proud moment for me as "Find distractions" got released to the public in the Remove tool.
Also check out other You Tube coverage-
Challenge
Photoshop has multiple tools for retouching -Spot healing tool, healing tool, clone stamp tool, pattern-stamp, red-eye tool, content-aware move tool, and patch tool. But none of these tools can easily remove things from an image. For a user removing bigger objects, replicating background textures can take hours of work.
Additionally, if a user starts with selections there is no easy brushing interaction to select an area to retouch.
Case study on Remove tool
Link- Figma
Password: edge-quick-track-nature
Technology
Collaborated with researchers and scientists to understand their latest GAN-based technology and how to present it to users. Ensured the design could adapt to future improvements and upgrades in the technology.
Initial research
Initial research focused on understanding:
- Users' retouching flows
- Interaction with other retouching tools and common problems
- How this new technology could supplement existing tools
- Competitor analysis
- Timeline for implementing the technology
Ideation & conceptualization
- Designed the MVP version, starting with the Spot Healing Tool, and iterated it into a new tool.
- Led two user testing studies to finalize the tool's name, placement, and icon.
- Released a pre-release version to test hypotheses and review the technology.
Live Product Demo
In the current live version, users can:
- Remove areas using a brush tool.
- Precisely control the removal area by employing add and subtract brushes.
- Seamlessly outline areas for removal without needing to precisely brush the exact area.
In this latest implementation, Design Prototype
A user can
- Use firefly to remove distractions
- Access remove from selections
- Now work with firefly + orginal CM GAN to remove areas without a worry.
Internally as a logic to the engineering implementation we try to use firefly for removing complex areas while we use CM GAN for removing smaller areas.
Remove tool on the web
I also shipped Remove tool on the web version of the Photoshop. The screenshot is from the live product- https://photoshop.adobe.com/
Endorsements
"With new features like Generate Image, Generate Fill with Reference Image and the Remove Tool (including "Remove People Distractions", a personal favourite), the limits are shrinking on what you can use generative AI for in Photoshop – these tools will be useful for a host of creatives and will save you time and help with ideation processes."
- https://www.creativebloq.com/news/adobe-photoshop-gen-ai