Due to coronavirus and the cancelation of all social gatherings, Summa Fashion College had to be creative and experiment with its annual graduation show. Together with 4DR Studios and Dutch Rose Media the students were able create an AR fashion show with volumetric video. The fashion show is accessible to everyone that downloads the Crafted AR app and they can view the models walking on their tabletop or right beside them. The app is available in the App Store and Google Play.
For those of you who might not be familiar with the way volumetric video is filmed, the studio is completely green. The software creates the 3D digital twin by removing the background from the footage. In order to do so, the colour green is removed from the footage itself. If the colour of the clothing of the person being filmed is green or has a green tint, two problems might occur – holes in the outfit or colour change to brown or blue. Usually during pre-production, we advise our clients regarding clothing colours and fabrics so that we can ensure the best possible outcome. However, during this project all outfits were pre-determined, and alternations were not possible. Therefore, we came across a few challenges with outfits that had green tint. When the settings are in default, the software assumes that spots on the outfit are part of the background. So, when the background is removed, parts of the clothes are being removed as well and so holes appear.
To fix this we used the settings available and changed them from default, specifically we changed the background threshold. The default setting is 100%, when this is increased then more is removed and when it is decreased then less green is removed. Looking through all frames and finding the ones that have error is a step of the process. After that, errors are being fixed by lowering the amount of green removed from the footage and finding a value that will ensure all frames are error free. Even though the work is quite time consuming, six seconds could take 3 hours to edit, it is possible to work it out. For some clients that are stricter with the true colour of clothes this solution might not work that well. However, during this project we learned that sometimes green, in its dark shades, can work pretty well with appropriate preparations.
We learned a lot about colours and fabrics throughout this project, which is very valuable for our future productions. Also, we gained experience for future reference in our upcoming projects. We have a wide array of examples to show to our clients to showcase how different clothes and colours perform in volumetric.