• Skip to main content
  • Skip to primary sidebar
  • Skip to footer

Matt Doyle | Elated Communications

Web and WordPress Development

  • About Me
  • Blog
    • Design & Multimedia
      • Photoshop
      • Paint Shop Pro
      • Video & Audio
    • Online Marketing
      • E-Commerce
      • Social Media
    • Running a Website
      • WordPress
      • Apache
      • UNIX and Linux
      • Using FTP
    • Web Development
      • HTML
      • CSS
      • JavaScript
      • PHP
      • Perl and CGI Scripting
  • Portfolio
  • Contact Me
  • Hire Me
Home / Blog / Design & Multimedia / Photoshop / Adobe’s Jaw-Dropping Content-Aware Fill

Adobe’s Jaw-Dropping Content-Aware Fill

24 March 2010 / 19 Comments

Just as Adobe gears up to launch version 5 of their Creative Suite, they drop this little bombshell on us β€” Content-Aware Fill:

Watch the video above to see what Content-Aware Fill can do. Removing the bits of trash and the tree is impressive enough, but wait till you see the road being removed at 3:53, and the extra sky and clouds appearing at 4:44! To paraphrase Arthur C Clarke, this technology is so advanced it’s almost like magic.

Okay, you’ve gotten over the initial “wow” factor and managed to close your mouth again. How does this tool work exactly?

Content-Aware Fill is new Photoshop feature that resembles the Patch tool on steroids. It uses a very smart texture synthesis algorithm to sample image data from around the the area to patch, then reconstruct a texture based on the sampled data in order to patch the area.

Will it be in CS5?

Possibly. John Nack from Adobe cryptically talks about it appearing in a future version of Photoshop, which might mean CS5, or it might not. On the other hand, this video appears to demonstrate Content-Aware Fill – AKA “PatchMatch” β€” in an early version of CS5 (codename: “White Rabbit”):

I know one thing for certain though β€” if this is in CS5 I’ll be upgrading for sure. πŸ™‚

Will it live up to the hype?

The demo video mainly shows Content-Aware Fill working on landscapes, which tend to have large depth of field and fairly predictable, uniform textures. It’ll be interesting to see if it can work equally well with scenes containing lots of contrast and detail, such as removing these urns from this shot of the Palace of Fine Arts in San Francisco:

Urns and Columns

That said, even if Content-Aware Fill has its limits, it will still be a massive help when it comes to retouching photos.

What effect will this have on the design industry?

Some might say that this feature will take away a lot of the skill of Photoshopping. I disagree. It will end the tedious process of painstakingly removing unwanted objects from a photo, which frees the designer or photographer to concentrate more on the creative side of using Photoshop. This can only be a good thing in the long run.

On the negative side, Content-Aware Fill will make it much easier to remove watermarks from stock photo comps, which may have an impact on stock libraries’ sales figures. (Hopefully not.)

For me, the irony with Content-Aware Fill is that you’ll finally be able to use Photoshop to remove lens flares. πŸ˜‰

Filed Under: Photoshop Tagged With: content-aware fill, PatchMatch, photoshop CS5, texture synthesis

Reader Interactions

Comments

  1. mauco says

    25 March 2010 at 9:34 pm

    Thanks Matt, for this very interesting piece of information. It’s truly magical and jaw-dropping!

    I’m sure a lot of Photoshop users would be more than happy to have this feature. But as you’ve mentioned, let’s hope it would also work well on pictures that have a lot of contrast and users don’t use it negatively to remove watermarks from other peoples photos.

    – mauco

    Reply
  2. BShingle says

    25 March 2010 at 10:42 pm

    This is absolutely blowing my mind. Great work!

    Reply
  3. matt says

    25 March 2010 at 11:49 pm

    Yes, it really is stunning isn’t it. I can see this making a big difference in the design world. Can’t wait to use it!

    Reply
  4. simon says

    26 March 2010 at 4:15 am

    It really is immense. I wonder how well it works really, when you can get up close to the images?

    If it works, a massive timesaver.

    Simon

    Reply
  5. thetaphoto says

    26 March 2010 at 7:05 am

    It sure looks great!!

    Apparently a plugin for GIMP already exists that does the same thing. Haven’t tried it yet but I’ll give it a go!

    Reply
  6. katiewalker1995 says

    26 March 2010 at 7:13 pm

    I use GIMP. Love it by the way. What’s this plug-in? It’d be so helpful to have.

    Reply
  7. thetaphoto says

    26 March 2010 at 7:18 pm

    The plugin is called Resynthesizer. Not sure how well it works. Here’s the link: http://www.logarithmic.net/pfh/resynthesizer

    Reply
  8. thetaphoto says

    26 March 2010 at 7:20 pm

    Here’s a video I found on youtube with Gimp and resynthesizer:

    http://www.youtube.com/watch?v=hLtYPmRMYRE

    Reply
  9. najobskalf says

    27 March 2010 at 12:31 pm

    Has it occurred to anyone that April Fool’s Day (April 1st) is very near? I was much impressed by this “magical” tool, until someone made that comment. Now I am not so sure. Why would the same demonstration be used for a (hypothetical) tool in Photoshop and for Gimp? Nice idea, though …

    Reply
  10. thetaphoto says

    27 March 2010 at 9:33 pm

    I’m assuming you’re referring to my comment.

    Well, all you have to do is download Gimp and the plugin from the link I posted and you’ll see it for yourself! The point for the same demo was probably to show that Gimp can do now and for free what PS promises to do in the future for megabucks? Just a guess! πŸ™‚ You’re right about one thing though… it is “magical”!

    I just tested it with Gimp 2.6 on Mint Linux and it works great! You just need to use Synaptic Package Manager and search for Resynthesizer to install (for those like me who are not used to the Linux way of things! πŸ˜‰ ).

    Reply
  11. najobskalf says

    28 March 2010 at 2:50 am

    What I still don’t understand is that the Elated forum uses demonstration video(s) that are identical
    to ones used elsewhere that are attributed to Gimp.

    Reply
  12. matt says

    28 March 2010 at 4:32 am

    @thetaphoto: Thanks for the Resynthesizer info. I just tried it out on GIMP 2.6 on Ubuntu and it’s pretty impressive!

    I grabbed the images from Adobe’s vid and tried it out (Filters > Enhance > Smart Remove Selection). Here are the results:

    Tree:

    Original: http://img185.imageshack.us/i/treek.png/
    Result 1: http://img214.imageshack.us/i/treeresynthtry1.png/
    Result 2: http://img337.imageshack.us/i/treeresynth.png/

    Road:

    Original: http://img97.imageshack.us/i/road.png/
    Result: http://img222.imageshack.us/i/roadresynth.png/

    Panorama:

    Original: http://img27.imageshack.us/i/panoa.png/
    Result: http://img153.imageshack.us/i/panoresynth.png/

    As you can see, the tree removal failed the first time, and included bits of the background trees. When I selected a smaller area that missed out some bits of the original tree, it worked much better.

    The road worked really well – just as good as Adobe’s version in fact.

    The panorama wasn’t as good as Adobe’s though – mainly because it missed the ground!

    But anyway – amazing stuff. πŸ™‚ This takes the shine off Adobe’s announcement somewhat!

    The GIMP developers should shout about this plugin more – I’d certainly never heard of it, and it’s very impressive indeed.

    @najobskalf: I’d imagine the creator of the Resynthesizer YouTube vid simply grabbed the images from Adobe’s demo vid, as I did.

    Cheers,
    Matt

    Reply
  13. thetaphoto says

    28 March 2010 at 5:15 am

    Pretty good results. I did find that it needs a bit of tinkering with the selection to get the desired effect, but in combination with the stamp tool and healing brush gets you there faster and in certain situations it’s a one stop fix!

    We need some coding wizard to step in and take the plug-in further. As I understand it from the Resynthesizer website, it is not being actively developed. Perhaps someone could improve it. Having said that, well done to Dr Paul Harrison for developing this for his PhD Thesis!

    Reply
  14. najobskalf says

    28 March 2010 at 9:39 am

    Content-Aware plugins for Adobe Photoshop are clearly the future of photography – not to mention graphics in general.
    The possibilities are limitless. It would seem that the Adobe version is more advanced in development and more powerful
    than the Gimp version. Just look at the following mindblowing demos:

    http://videosift.com/video/Seam-Carving-for-Content-Aware-Image-Resizing-wow

    http://videosift.com/video/More-on-Photoshop-Content-Aware-fill

    The second one is most impressive. How can I have ever doubted that this is the real thing!

    Reply
  15. matt says

    29 March 2010 at 6:04 pm

    @thetaphoto: Yes, clever chap. I wonder if he patented it?!

    @najobskalf: Ha ha, that second one is brilliant! πŸ™‚

    Reply
  16. DigitalSea says

    21 April 2010 at 7:12 pm

    I’ve got a copy of Photoshop CS5 and to answer your question whether it removes those vases from the image you posted, yes. I only did a quick remove, but it worked really well.

    See for yourself:
    http://ilikekillnerds.com/NoVases.jpg

    Reply
  17. simon says

    22 April 2010 at 5:23 am

    @DigitalSea That’s pretty good. The left column’s a bit shot though! Still, with some tidying that’d work…

    Simon

    Reply
  18. matt says

    24 April 2010 at 11:19 pm

    @DigitalSea: Impressive stuff – thanks for posting that. I love how it’s managed to fill in the space on the right by repeating the rectangles from below it. With a bit of tidying up you’d never know the urns had been there!

    Reply
  19. DigitalSea says

    26 April 2010 at 10:44 pm

    No problem guys. I was honestly surprised how well it worked given the complexities of the image itself. With a little time and polish on it, you could get it close to perfect.

    You’d have to use the spot healing brush set to a really small brush size and set to content aware to properly remove elements like that from images.

    Reply

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

To include a block of code in your comment, surround it with <pre> ... </pre> tags. You can include smaller code snippets inside some normal text by surrounding them with <code> ... </code> tags.

Allowed tags in comments: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong> <pre> .

Primary Sidebar

Hire Matt!

Matt Doyle headshot

Need a little help with your website? I have over 20 years of web development experience under my belt. Let’s chat!

Matt Doyle - Codeable Expert Certificate

Hire Me Today

Call Me: +61 2 8006 0622

Stay in Touch!

Subscribe to get a quick email whenever I add new articles, free goodies, or special offers. I won’t spam you.

Subscribe

Recent Posts

  • Make a Rotatable 3D Product Boxshot with Three.js
  • Speed Up Your WordPress Website: 11 Simple Steps to a Faster Site
  • Reboot!
  • Wordfence Tutorial: How to Keep Your WordPress Site Safe from Hackers
  • How to Make Awesome-Looking Images for Your Website

Footer

Contact Matt

  • Email Me
  • Call Me: +61 2 8006 0622

Follow Matt

  • E-mail
  • Facebook
  • GitHub
  • LinkedIn
  • Twitter

Copyright © 1996-2023 Elated Communications. All rights reserved.
Affiliate Disclaimer | Privacy Policy | Terms of Use | Service T&C | Credits