codec avatars from Zucky

Meta used MUGSY, a specialized setup that included 171 high-resolution cameras to create the life-like avatars but with the advancements that have been made, the front-facing depth sensor of a smartphone, like an iPhone with FaceID, is all that is needed to create the avatar.

To create the Codex Avatars, the phone has to be panned across the neutral face and then repeat the process with a series of 65 facial expressions. This creates a life-like avatar that can depict more subtleties like raising the eyebrows, squinting, widening the eyes, or scrunching the nose, which will add more life to them.

Researchers have also added that the scanning process takes about three to three and a half minutes and even if it is titled as “instant”, users will have to wait four another six hours for the avatar to be processed. An AI machine with four high-end GPUs is used to create the avatar and depict it in full detail. Even after the product is made available to the public, it will probably not use the GPU on the user’s device but would rather use the cloud GPU for the process.