Here it is! Just released:
Enemies
A short film we’ve been working on for a while now on the Demo Team, here at Unity.
Some notes on rendering in the 🧵
youtu.be/eXYUNrgqWUU #unity #gamedev
Pinned Tweet
70
526
1,711
Show this thread
Follow
rob cupisz
@robcupisz
Tech Lead at Unity Demo Team. Rendering, lighting, VFX. Enemies, The Heretic, Adam
rob cupisz’s Tweets
mesh-to-sdf relies on AMD’s initial voxelization step.
This work by AMD’s is next level, though - and clearly functionality that an engine should provide:
Quote Tweet
there seems to be quite a bit of interest for this so thought I’d do a small breakdown:) twitter.com/guitio2002/sta…
Show this thread
4
15
Show this thread
Releasing the tool like this because it can already be useful to folks.
The idea though is to make it built-in, under a unified interface with the VFX Graph offline sdf baker.
1
10
Show this thread
Sparky uses the VFX Graph’s Collide with SDF node, just inverted.
1
6
Show this thread
The pink character samples its SDF in the VFX Graph for spawning the particles and making them follow the surface, more or less.
Adam (remember that old demo of ours? 😄) is surrounded by some fun raymarched SDF sphere things, cutting away his soft-blended SDF shape.
2
9
Show this thread
I’ve also published a project with examples of how to use the output SDF for visual effects.
That’s the video from the top there: dynamic SDFs being used by two VFX Graph effects, and a raymarching shader.
github.com/robcupisz/mesh
2
3
28
Show this thread
More recently we used it for hair-to-character collisions in the Enemies demo and the released hair package.
hair package: github.com/Unity-Technolo
getting started: learn.unity.com/project/gettin
1
4
20
Show this thread
I initially wrote it to animate Boston in its owl and golem form in The Heretic demo.
It would generate an SDF for the owl and golem (and Gawain inside it) skinned meshes, and the wires would crawl over the combined dynamic character SDFs and static environment SDFs.
2
8
48
Show this thread
I’ve just released mesh-to-sdf for Unity!
A light and fast real-time SDF generator, primarily for animated characters.
The dynamic SDF output can be used for all sorts of VFX 💥 It also enables hair-to-character collisions in the new hair package.
github.com/Unity-Technolo
26
371
1,910
Show this thread
Quote Tweet
We’ve just released the Enemies demo executable!
unity.com/demos/enemies
Show this thread
0:10
23.4K views
1
10
Show this thread
Quote Tweet
Unity hair! Real-time sim and rendering.
Wide range of realistic hair types and styles. Fur! Alembic groom import and procedural grooms.
Clustering/LODs for scalability.
Show this thread
0:54
13.7K views
1
9
Show this thread
A thread with some high-level technical notes:
Quote Tweet
Here it is! Just released:
Enemies
A short film we’ve been working on for a while now on the Demo Team, here at Unity.
Some notes on rendering in the 
youtu.be/eXYUNrgqWUU #unity #gamedev
youtu.be/eXYUNrgqWUU #unity #gamedevShow this thread
1
12
Show this thread
Here’s Silvia showing the demo running on an xbox to .
She starts off her keynote segment introducing our team and talking a bit about some key tech we work on.
2
12
Show this thread
- win 10/11, directx12
- a high-end gpu for running it on ultra/high settings
- or a mid-range discrete gpu for medium/low settings
- 16GB RAM, 8GB VRAM
1GB download
3
1
11
Show this thread
Quote Tweet
Here's a breakdown of our work for Enemies, the real-time cinematic demo we've had the pleasure of working on with the amazingly talented Unity Demo Team! Narrated by @matt_ostertag #unity3d
Show this thread
1:35
10.3K views
2
8
Show this thread
From the Unity projects, Book of the Dead was the last one that used the Built-in Render Pipeline in the beginning, before switching to HDRP. This is one of the very early tests from 2016
5
46
We need a better verb for referring to using AI art tools.
“I made art with” is not it, my dude.
“I commissioned art via” is better, but suggests a symbiotic relationship with the artists the ML trained on, while in actuality being
parasitic.
11
3
17
Ah sweet, some company called CACI I hadn’t heard about in the gaming news, I wonder what do they d…
1
4
Available now! 🎉
Quote Tweet
Happy to announce that the strand-based hair system developed alongside and featured in Unity's 'Enemies' is now available via GitHub. :) Been working on this system for a while now -- looking forward to see what people will make with it: github.com/Unity-Technolo
Show this thread
7
Show this thread
Unity hair! Real-time sim and rendering.
Wide range of realistic hair types and styles. Fur! Alembic groom import and procedural grooms.
Clustering/LODs for scalability.
5
68
425
Show this thread
Update: The system is also responsible for the real-time hair and fur simulation in the recently announced 'Lion' demo. Check it out. :)
2
3
22
Show this thread
The hair sim system Lasse developed for Enemies is out!
Quote Tweet
Happy to announce that the strand-based hair system developed alongside and featured in Unity's 'Enemies' is now available via GitHub. :) Been working on this system for a while now -- looking forward to see what people will make with it: github.com/Unity-Technolo
Show this thread
2
11
64
Perfection
Quote Tweet
LOVE, DEATH & ROBOTS Vol 3 
take a look behind-the-scenes at the new Alberto Mielgo short JIBARO #GeekedWeek
take a look behind-the-scenes at the new Alberto Mielgo short JIBARO #GeekedWeek
5:22
185.1K views
15
And I would also add that on the diffuse shading side the Modified Lambertian model is a must ...
twitter.com/inciprocal/sta
Most of the real-world surfaces that exhibit a fair amount of sub-surfaces scattering are non-lambertian. Simple dot(N, L) doesn't fit.
Quote Tweet
Working on the latest @unity's Demo team Enemies demo was a blast. On our end a result of many years of advancing photometric processing to enable photo-realistic rendering in real-time. On the left is Unity HDRP vs one of the real photos under the same lighting condition. (1/4)
Show this thread
1
7
38
#WhatAGameDevLooksLike ?
Here’s one!
A rendering programmer and tech artist, really enjoying working with light and organic patterns emerging from elegant rule sets. ^_^
Wears shirts only when absolutely necessary, otherwise it’s climbing shorts or wetsuits.
18
Vess always with his artisan, small batch screenshots
*shakes fist*
Quote Tweet
16
Special thanks to:
The entire Unity R&D team, for actually making the tools we use!
(@Tuatara_VFX) for the smoke and flame vfx art :)
for his 4D scanning studio and expertise.
Everyone else who contributed! Full credits:
unity.com/demos/enemies#
3
36
Show this thread
.
art director and 3D artist
anim director
tech anim
tech art
more programming
Petter Flood - more 3D art
Jörn Großhans - additional art consulting
Aleksander Karshikoff - producer
Silvia Rasheva - manager
1
41
Show this thread
Team intro!
We're a small team, and kinda like it that way :) On this production these were our roles:
as usual, as a writer and director, also on cinematography and lighting.
as a tech director.
Yours truly👋, Mikko Alaluusua and on programming.
1
37
Show this thread
the main depth buffer, to get occlusion from the bishop and the hand.
Then a blur with a simplified DoF kernel with a fixed CoC size, and composite with the main colour buffer - after the regular DoF (and moblur) pass.
Easy with HDRP's custom pass and custom post-process.
2
43
Show this thread
Smoke and flame.
Transparencies don't play nice with DoF in a rasterization renderer, and here we have close-ups of in-focus smoke/flame over out-of-focus face, and vice versa.
To get around that, we're rendering them into an off-screen buffer, but still depth-test against
3
5
79
Show this thread
Random screenshot intermission
2
1
61
Show this thread
Lookdev scene for comparing against light stage photos
2
4
83
Show this thread
Improvements to skin shading, hair shading (Marschner), eye caustics, tearline (the wet interface between the eyelids and the eye).
Most of these already shipping in HDRP. Remaining digital human features mentioned earlier shipping in Q2 as an updated Digital Human package.
2
7
83
Show this thread
Skin attachments.
Eyebrows, eyelashes, tearline, peach fuzz/vellus hair(!), etc. need to follow skin deformation.
We've developed a system for handling that through jobs for The Heretic, now moved to gpu.
Some attachments still resolved on cpu, like the teeth occlusion polygon
2
6
83
Show this thread
Skin tension.
Calculates edge length relative to the rest pose, to identify stretching and contraction, which allows us to drive wrinkle and blood flow maps.
In The Heretic we needed a facial rig just for that. This is much more convenient.
10
38
365
Show this thread
We will migrate Enemies from 4D to Ziva in the coming weeks.
3
2
50
Show this thread
Ziva allows for full body performance while recording facial performance with HMC - in our old workflow matching 4D with the body is hard, and the actor performs differently with their head fixed.
It is also effectively an efficient compression, allows for interactivity, etc.
1
3
46
Show this thread
Facial animation is still a 4D capture. We've improved our workflow and quality, but 4D would still be impractical for any larger production.
The future of our productions is Ziva, where we only train the system with 4D, but final performance is captured even with and HMC.
3
7
68
Show this thread