AI that can map facial expressions

2019-11-28

Recently, the AI-generated human face simulation incident caused a stir. And now, a company in South Korea has developed an interesting tool called "Puppet" that can realistically simulate the facial features of historical figures or politicians using only a webcam and images. Puppet is a facial reconstruction tool that can synthesize facial animations generated by human movements while preserving the appearance of the target face. The reason why this tool can achieve such magical "magic" with simple equipment mainly relies on cutting-edge machine learning technology. Researchers claim that even in cases where the task target is extremely different from the facial contour of the person, the tool can still produce results that surpass the baseline standards in the field. This is not a new idea, but what sets Puppet apart is that it does not require any training data or repeated presets. It mainly enhances the artistic level by integrating three new elements: image attention blocks, target feature alignment, and landmark transformers. Attention blocks allow the model to focus on the relevant positions of the mapped physical features, while target feature alignment can alleviate artifacts, distortions, and distortions. Finally, the landmark transformer enables it to adapt the geometric structure of the action to the target geometric structure without the need for any labeled data. Researchers tested the model using celebrity photos and open-source video databases, and the results showed that Puppet almost surpassed all other models. In another user study, 100 volunteers were asked to choose the most realistic image from two images generated by different models, and Puppet still won by a large margin. In a preprint paper, the researchers wrote, "Our proposed method does not require any additional fine-tuning stage to adapt to the target character, which greatly increases the practicality of the model in field deployment. A series of experiments have well demonstrated the superiority of Puppet." The significance of this research is that it allows cinematographers to create animated characters at low cost without motion tracking devices. However, the downside is that it may also be abused to create highly realistic deepfakes, providing opportunities for malicious individuals. According to a survey by the Pew Center, the number of DeepFake videos on the internet has increased by 84% in less than a year, and among them, 57% of the videos with news characteristics are of questionable authenticity. This indicates that it is better to be cautious about tools like "Puppet". Of course, it doesn't mean that it is bad, but rather, it requires strict regulations to ensure that they are not used for criminal purposes and do not cause adverse consequences.

RECENT AI NEWS

RECENT AI TOOLS