Announcement

Collapse
No announcement yet.

keying dv footage - not vray but may be useful for someone

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • keying dv footage - not vray but may be useful for someone

    Heya Folks,

    someone was asking about shooting greenscreen stuff with dv on another site and I posted a reply about some of the issues associated with it - It may be useful for someone else here so I thought I'd stick it up here.

    Make sure you use progressive scan mode on the camera - it'll make your pictures look better and be handier for effects work later.

    Short answer:

    Dv is bad for greenscreen because of the way ot stores colour - the colour is low quality so it gives you bad edges unless you use a keyer that can take this dv problem into account - get a copy of dv matte pro from dv garage and it'll work nicely.

    Long answer:

    The bad pixelated edges you're seeing isn't down to the lighting, it'd an inherent problem in dv in the first place. When you deal with digital images, the information is stored in 3 different colour channels, red, green and blue or rgb. When you shoot stuff on tape, the information is stored as brightness and two seperate colour channels - this is commonly known as yuv.

    The problem with dv is what quality the information in each channel is stored at. If you've ever heard the term 4:2:2 then that's what is relevant here. The numbers are a ratio to indicate the quality that the three different video channels are stored at so it goes brightness : colour : colour in this case. The number 4 at the start means full quality which means your brightness channel is stored at full resolution (720 x 576 in pal land). The second number 2 is half of 4 so that's indicating that the colour channel is stored at half the resolution of the brightness channel which gives us an active resolution of 360 x 288. Again the last 2 is the exact same half resolution.

    So this means if a video format saves in 4:2:2 you get full quality brigtness information and half res colour.

    Here's our major problem. DV is 4:1:1 so it means that the colour channels are quarter resolution. It's not a problem in most cases as people dont often shoot for green screen on dv. If you do however, keying is largely based on the difference between the uniform background colour and the colours present in the foreground and since the quality of the colour information is so blocky and pixelated in dv, you get crisp detail in the footage but a really pixelated edge which is often confusing for people.

    There are a few ways around this which are dependant on your compositing program. What they normally do is apply a small blur to the colour channels to remove the pixelation before trying to key the background which will make the edge of the final key a little less blocky. In a program like shake this is easy enough as you can work in yuv space quite happily but in something like after effects you can so you'll need a keyer that can do the internal conversion for you. There are three that I know of, dvmatte pro from dv garage, primatte 3 from red giant software and ultimatte advantedge. Dv matte pro is specifically for dv and the cheapest of the lot - it's fairly friendly to use and gives good results. Primatte and ultimatte are both generaly purpose keyers and give a tonne of control and really high quality results - they aren't aimed directly at dv footage but they do have a preprocessing function to sort out the dv colour problem.

    interlaced vs progressive scan

    Here's a boring explanation of progressive vs interlaced and why it makes a difference based on that:

    If you are sizing the video down at the end of the day then it counteracts the quality problems somewhat but if you were going back out to dv after doing all of the effects at the same size you started with you have to be a lot more careful.

    The progressive mode is always a benefit as it'll make the footage look a lot more filmic for one main reason. When video records footage, it can store the images in one of two ways, interlaced or progressive. Interlaced is the more common format and available on all video cameras. Pal video is 25fps pr 25 full pictures per second but that isn't necessarily the way that the pictures are stored. Old displays weren't quick enough at redrawing images to make video look smooth so to counteract that, video broke each full picture into the odd lines and the even lines. If you take a standard pal frame, it's resolution is 720 x 576 so 576 horizontal lines make up the picture. With interlacing, this full picture is split up into the odd numbered lines and even numbered lines as shown in the picture below. So in the first field, lines number 1,3,5,7,9,11 etc are saved and in the second field, lines 2 4 6 8 10 12 etc are saved. When displayed, the screen alternates between the two fields quickly and your eye blends the two together to get a smooth motion.



    Progressive scan is far more modern and since newer tvs can refresh images much faster, it's able to store full images rather than pairs of odd and even lines which means the end result looks a lot more flickery but far cripser and thus more like 24fps full frame film. Another benefit of progressive scan is for effects work.

    Here's an interlaced frame:



    Now, if you look at the horizontal lines, that's what an interlaced picture looks like - almost like two different images ghosted across each other. For starters, the fine lines are a pain in the ass to key and if you end up using blurs etc, it'll make a mess of it. Second of all, if your footage isn't good enough to key off and you still need to seperate it, you have to resort to rotoscoping.



    Above is a small frame from star wars where someone is drawing a mask around a stick to be made into a light sabre. this is fine since it's a solid shape with an obvious outline. Say for example though if you had a fielded image like the one above - you'll have to do some kind of soft falloff to take into account those lines sticking out of the guys head which will generally never look any good. When you mix in motion blur like in the stick in the image below and add fielding on top of that it makes your life very very very very very very difficult to mask out or key succesfully



    Lastly, when you resize the video, factors divisible by 2 are alwasy good but if you use anything odd like 47.63% smaller, it may have conflict with the alternating lines of fields and make your edges look a little weird.

    Bottom line - progressive has cripser more filmic images and are easier to post produce.

    Oh also - turn off any kind of edge enhancement in the camera - it'll make your life harder when keying.[img][/img]

  • #2
    What are good formats to shoot on? The only good looking non-digital format I can think of is beta, and that's so bulky and expensive :/

    Does this apply to HD formats as well? I really know nothing about them.

    Thanks for the writeup, this was very helpful
    Austin Watts
    Render Media

    Blurring more than 20,000 cars since May, 2001.

    Comment


    • #3
      not sure but i think that HD at its normal size is i frame and to get it into p frame you need to use 720p and on some cameras is doesnt look good. i believe panasonic came out with a 24p digital camera a while back that was nice

      ---------------------------------------------------
      MSN addresses are not for newbies or warez users to contact the pros and bug them with
      stupid questions the forum can answer.

      Comment


      • #4
        Yeah the Panasonic 24p cam has great results, but it shoots to miniDV, which I believe stores the data as rgb.
        Austin Watts
        Render Media

        Blurring more than 20,000 cars since May, 2001.

        Comment


        • #5
          Yeah beta isn't bad from a colour point of view it's less compressed, digi is better again. but I don't know of a camera that'll shoot progressive so your pictures will be smooth and tv like. The tape format itself dictates how the colour is stored rather than the sensor in the camera so no matter what, dv will always be yuv - quite like photoshops lab colour space.

          Comment


          • #6
            Well, the answer to our problems comes from panasonic :

            http://www.dvxuser.com/articles/HVX200/

            Betacam does provide a crappy video quality, so newsgatheringish.
            I guess our best choice would be DVCPRO HD in progressive mode, with 4:2:2 (stored in a solid-state memory card, like the p2, so sweet). The camera above mentioned is under 6000 dollars. For the moment only available in NTSC format, but it should be in Europe by 2nd quarter of 2006 in PAL.

            The ideal condition, a varicam with 4:4:4 is far away from our budget

            I was looking for alternative ways to chromakey, like the www.reflecmedia.com thing, but i wasn´t sure about it. Any experience with it?
            My Youtube VFX Channel - http://www.youtube.com/panthon
            Sonata in motion - My first VFX short film made with VRAY. http://vimeo.com/1645673
            Sunset Day - My upcoming VFX short: http://www.vimeo.com/2578420

            Comment


            • #7
              Haven't tried it so far. What was fun though was a few friends of mine shot a trailer for a film on a new jvc hd camera which records in 4:4:4 and uses panavisions lenses - proper dof and exposure

              Anything with a bigger footprint than pal / ntsc is probably good as you can downsample to remove some of the bad colour problems with dv.

              Comment


              • #8
                well there is a sony camera thats HDV which is pretty nice quality

                ---------------------------------------------------
                MSN addresses are not for newbies or warez users to contact the pros and bug them with
                stupid questions the forum can answer.

                Comment


                • #9
                  Absolutely - they're getting far better all the time so this little faq thingie is gonna hopefully be obsolete for most people in the next year or so...

                  Comment


                  • #10
                    If im not mistaken, hdv is mpeg2 compressed...no good no good....
                    My Youtube VFX Channel - http://www.youtube.com/panthon
                    Sonata in motion - My first VFX short film made with VRAY. http://vimeo.com/1645673
                    Sunset Day - My upcoming VFX short: http://www.vimeo.com/2578420

                    Comment


                    • #11
                      thanks Joconnell for that little explenation. I had always wondered why i couldn't pull a great key off my footage. I will be much wiser and watching from now on about how a camera records.

                      Now all i need tis the $6000 to buy one of theses cameras. still a lot cheaper that $100000
                      ONLY TRUST A COMPUTER YOU CAN THROUGHT OUT A WINDOW

                      Comment


                      • #12
                        Originally posted by panthon
                        Well, the answer to our problems comes from panasonic :

                        http://www.dvxuser.com/articles/HVX200/

                        Betacam does provide a crappy video quality, so newsgatheringish.
                        I guess our best choice would be DVCPRO HD in progressive mode, with 4:2:2 (stored in a solid-state memory card, like the p2, so sweet). The camera above mentioned is under 6000 dollars. For the moment only available in NTSC format, but it should be in Europe by 2nd quarter of 2006 in PAL.

                        The ideal condition, a varicam with 4:4:4 is far away from our budget

                        I was looking for alternative ways to chromakey, like the www.reflecmedia.com thing, but i wasn´t sure about it. Any experience with it?
                        A buddy of mine has the first beat of that camera and it is pretty amazing.

                        Comment


                        • #13
                          betacam in the wrong hands can have crappy quality. 35mm in the wrong hands can as well. our camera man where i used to work was reeealy good with his filters and his lighting and always gave us really nice quality

                          ---------------------------------------------------
                          MSN addresses are not for newbies or warez users to contact the pros and bug them with
                          stupid questions the forum can answer.

                          Comment


                          • #14
                            That panasonic looks really impressive - Will be very interested to see a pal version...

                            Comment


                            • #15
                              just as a side note: as far as i know the PAL version of DV has better chroma sampling than NTSC DV
                              I could be wrong tho'

                              In my experience a lot of keying-related problems arise from bad lighting. Unless you have a huge studio its very difficult to seperate the lighting of the green/blue screen and the lighting of the action. You just dont have enough space between the actors and the screen. This leads to blue/green light being reflected back on the actors.

                              cu mike

                              Comment

                              Working...
                              X