Object removal test.

rgbii
rgbii Posts: 965 Just Starting Out
Occasionally you need to remove something from your footage. You should always try to avoid the 'fix it in post' mentality, but sometimes it happens, so I've been playing with various tools and techniques. For fun, I wanted to see what it would take to remove the hand/phone coming into this BTS shot on a cell phone. No real need to remove it, other than curiosity.
The bulk of the removal was done with Mocha Pro, however, it left artifacts on 11 frames. I'm new to Mocha, so it's possible it could have handled it, but I couldn't get it to do it.
I used Twixtor to recreate those 11 frames based on the two good frames at either end that Mocha created, then used Hitfilm to track the shake in the original, and apply it to the frames Twixtor created.
I spent a lot of time 'playing' around with this, mostly trying to get Mocha to do the whole thing, which didn't work out, so it's hard to say how long something like this would take to do, but just guessing, if I was to start from scratch, it would probably take about 30 minutes, plus some render time.
https://vimeo.com/93340397

Comments

  • StormyKnight
    StormyKnight Posts: 2,722 Ambassador
    Well, I couldn't tell from the 'after' clip that the phone had ever been there. Great job!
  • Triem23
    Triem23 Posts: 20,585 Ambassador
    And that was a tricky removal, since that phone occluded a moving actor! Excellent job!
  • Spectralis
    Spectralis Posts: 12
    edited May 2014
    That's really great work and if it took only 30 mins that's even more encouraging.  I wouldn't have attempted something like this thinking it might take many hours of work.  I don't own Twixtor so if there's some way to do it all in Mocha then that would be very useful.
  • Triem23
    Triem23 Posts: 20,585 Ambassador
    Actually, since Twixtor is generally a time-remap tool, I have to say, it's pretty *profanity* clever to use it's interpolation functions as frame-patching. Way to think outside the box on that!
  • rgbii
    rgbii Posts: 965 Just Starting Out
    That's really great work and if it took only 30 mins that's even more encouraging.  I wouldn't have attempted something like this thinking it might take many hours of work.  I don't own Twixtor so if there's some way to do it all in Mocha then that would be very useful.

    As I mentioned, I spent a lot of time playing with it, trying to learn the ins and outs of Mocha.  The 30 minutes is just a guess of how long it would take if I'd have known what I was doing before hand :)
    Now that I know more about it, future stuff *should* be faster.
     

  • rgbii
    rgbii Posts: 965 Just Starting Out
    Actually, since Twixtor is generally a time-remap tool, I have to say, it's pretty *profanity* clever to use it's interpolation functions as frame-patching. Way to think outside the box on that!

    I wish I could take full credit for it.  I remembered seeing a tutorial somewhere on twixtor of someone fixing a frame where a flash had gone off. Having also spent time 'playing' with twixtor, I was pretty sure it could handle it.
    After fixing it with twixtor, it looked odd since all of the footage was shaky, except for the smooth 1/3 of a second twixtor fixed.  Took no time at all to track the shakiness with Hitfilm and match it up.

  • rgbii
    rgbii Posts: 965 Just Starting Out
    That's really great work and if it took only 30 mins that's even more encouraging.  I wouldn't have attempted something like this thinking it might take many hours of work.  I don't own Twixtor so if there's some way to do it all in Mocha then that would be very useful.

    Meant to mention, in most of my other tests that are not as extreme as this, Mocha Pro does an impressive job of removing things.
    Here's what it looked like with just Mocha. There was a light change behind the one puppet (I think from the owner of the hand & phone) from before and after the phone coming into frame, plus the puppet moved a bit.
    Between those two things, Mocha left some artifacts.  It has a more advanced mode called interpolate that is supposed to do a much better job, but I could never get it to cooperate at all, plus it increased the render time a LOT.
    https://vimeo.com/93448947
    Getting it to that point in Mocha Pro would take 10-15 minutes.

  • CalebK
    CalebK Posts: 435
    WOW It is so scary what we can do now of days.... now i need to get me a copy of mocha pro! Waiting for a 99$ deal! (yes I'm a student)
  • Triem23
    Triem23 Posts: 20,585 Ambassador
    I've never seen a $99 deal--best I saw was last year for $299--when I jumped on it.
  • KirstieT
    KirstieT Posts: 1,187 Staff
    Wow rgbii - great technique and a near flawless result. Getting the scene to continue seamlessly with a moving actor having been obscured is a huge challenge - and to hear you could do it in just 30 minutes is really encouraging. 
    Keep experimenting - I'll be interested to see what you discover next!
  • SimonKJones
    SimonKJones Posts: 4,448 Enthusiast
    Impressive, most impressive.
  • MatthiasClaflin
    MatthiasClaflin Posts: 674 Just Starting Out
    Very interesting and very impressive. Looks very good.
  • spydurhank
    spydurhank Posts: 3,193 Expert
    Very, very cool.  :) 
  • ivanhurba
    ivanhurba Posts: 26 Just Starting Out*
    That is simply astounding! I can't imagine getting a clean result like that and on that short amount of time. Congratulations!
  • rigomrtsfx
    rigomrtsfx Posts: 2 Just Starting Out*
    cool nice work!