Year 4, Semester 1 summary - Krokodi - New Orleans town environment

My specialist skills are rigging, blendshapes and animation, however, due to a forced reschedule of production at the beginning of 4^th year, I have not yet had an opportunity to put them into practice on Krokodi. I have researched these skills as much as possible as a parallel task so that when I do put them into practice I will be prepared to carry them out efficiently, creatively and to a high standard. My primary task this semester has been to work on the New Orleans ‘town’ environment for Krokodi – as I did most of the research for this environment last semester, I was the most suited to be working on it. Even though this task does not involve any of my chosen specialist skills, it has allowed me to evolve my generalist skills, including 3D modelling, UV mapping, texturing, lighting, rendering and compositing. 

Here is a summary of the production process I have gone through this Semester to create the New Orleans town environment which features in the first half of the 'Krokodi' film.

3D Modelling

To begin, I started off by blocking out the layout of the town:

I tried to add in a quirkiness, off-balance and uneven quality to the models to add a bit more character to the buildings:

I used my original concept artwork I did for the environment as a guide to the style/design of the buildings. Mainly though, I used a bank of reference photos I had gathered as a guide for extra detail specific to New Orleans:

I added in lots of railings, balcony's and window shutters to make sure the town had a New Orleans feel to it:

 The buildings surround the "picnic area" where most of the action will  be going on:

UV-mapping and Texturing

These are the props for the town that 'Krokodi' group member Ben modelled. I learned how to UV-map and apply textures by doing these first before the environment buildings:

 As I realized there were going to be many UV-maps and texture-maps to keep track of, I produced a layout key. Each building has a colour and a number, which I have used as part of all naming conventions for files relating to the environment:

I used my concept artwork and research from last year to determine the colours I used for the buildings:

Examples of textured UV-maps for the walls of two of the buildings, I digitally painted the textures in Photoshop;  applying a base colour, then adding paint strokes on to it to add some more detail:

Final textures applied to the buildings:

I had initial trouble with the UV-mapping process, however I now have a firm understanding of it and UV-mapped the whole environment, ready for texturing. To begin with I was taking one building at a time, UV-mapping it then texturing it, and I found that this was a slow process. Therefore I changed my approach and done all of the UV-mapping first before the texturing, which was a a much faster process. The texturing is still in progress as I was just concentrating on getting the part of the town done that was needed done by the Christmas review.

Lighting
Lighting for a 3D environment was a relatively new thing for me to learn. First I read up on the basics of lighting and the best types of light for different purposes. The time of day during the town scenes is early evening. I took some pictures from the windows of my house of the sky at this time of day for reference:

Looked awesome! But the colours are too lava-like for 'Krokodi's' town environment

These colours work much better, hints of pinks and oranges hitting the edges of the clouds

Here is a screenshot of the lights I added into the environment:

I used a Spotlight to shine over the buildings and hit the top of the orange building like the sun would do when   setting in the evening in an urban environment. I also added in a digital painting of the sky in the background. I used Area lights sparingly, to added highlights on the roof of the orange building, and to add in evening purple hues to the front of the buildings in the foreground. I also added a few Directional lights for overall lighting of the scene.

I also started to make use of Light-Linking, a process of adjusting what objects in a scene a light is affecting, to allow for a more creative and customisable shot. Learning how to use Light-linking also reminded me of the importance of having a tidy Outliner, in which all objects and geometry in the scene are named properly, as the Outliner is used to select the objects that are affected by an individual light.

Rendering

I learned through tutorials and trial and error how to create and render out an Ambient Occlusion pass using Mental Ray, which adds shadow to the models:

I then rendered out the Master Layer using Maya Software. I took both passes into Photoshop. Made the AO pass into an overlay and adjust the opacity to create the image below. I think the AO pass has really helped add form and presence to my 3D environment:

I tested out creating this colourful ID pass, which can help in the compositing stage, as it allows you to select separate areas of the shot to edit:

Now that I had tested out the rendering and compositing process with my shot of the environment, I asked Carlo to send me the current Burger Van model he has been working on, and I also had Ben send me the most up-to-date rigged character 'Dee'. I imported them into the environment, scaled them to the right size within the environment and posed Dee to how she would be in shot 1 of 'Krokodi'. The weight painting is still not final which is why for example her shoulder has gone through the shoulder strap of her vest top.

 I rendered out the Ambient Occlusion layer. The AO pass made the interior of the van quite dark.

 I composited the AO and master layer together to produce this final image. More lighting will be needed to light the interior of the van to light our main character. Also learning how to add a depth pass to create blurring in the distance and focus on the action in the scene:

The next step for the environment is to finish the textures of the other buildings which have already been UV-mapped, set up cameras for all the shots in the environment and light each of these shots as if it is its own film set, to achieve the right lighting and look for each shot.

VFX penguin project Report

So I know it's been a few weeks since the deadline but here is a report of how the Visual Effects Module went...

First, here is the final footage Sarah Rettie and myself submitted for the deadline - We basically pulled all of this together in 2 days, there are obvious mistakes in it (eg, the floating penguin when he bounces along the pavement) but for a first attempt ever at VFX - we were pretty happy with what we achieved:

Sarah worked on modelling, uv-mapping and texturing the 3D penguin before adding a very simple rig for animating:

We then went back to the original filming site to take some photos for Image-Based-Lighting (IBL). Which didn't start off too well, we had waited a while until the weather and lighting was similar to the original filmed footage, and when we got there a postman had left his bright red trolley thing padlocked to a lamp post right next to the site - which cast all this red light onto our scene! And to further add to this complication, men in fluorescent yellow vests were working on the bus stop electric board right next to us! Which would mean they would be clearly visible in the IBL photos we were taking! So after leaving it for about 2 hours we headed back and all was clear so we were good to go:

We balanced the chrome ball on the wall in the spot where we wanted our 3D penguin to be. As the weather conditions were slightly windy, some of our photos came out a bit blurry, due to the chrome ball moving slightly in the wind. The next stage was to combine the photos together to get a 360 photo and then erase the camera and us from it. This was achieved by using Photoshop followed by Nuke:

Taking the 3D penguin into our scene for the first time after matchmoving the footage, penguin looking rather dark here:

Build part of the wall and added an ambient occulsion layer for the shadows cast by the 3D penguin onto the wall:

Here is a breakdown of the shots - each shot took around 2 hours to render out. To put the rendered layers together we composited in Nuke:

I feel I learnt a lot about the stages of vfx in a very short time. It was also a good exercise and practise on rendering out a scene and compositing it all together.