On the sixth day of the "OpenAI 12 Days" event, OpenAI announced the addition of video input and screen sharing capabilities to its ChatGPT platform, along with the limited-time introduction of the Santa mode in celebration of Christmas. These new features aim to enhance user experience and expand the application scenarios of ChatGPT.
It has been reported that the advanced voice mode of ChatGPT will include video and screen sharing functionalities. Within the upcoming days, most ChatGPT Plus and Pro users, along with all Team users, will have access to these features. Enterprise and educational users are expected to receive access in January. By utilizing smartphone cameras or webcams, ChatGPT can identify objects and interact with the content displayed on the user's computer or phone screen.
Users can access the new features by following these steps: in the ChatGPT application, click the voice icon near the chat bar, then select the video icon at the bottom left to enable video input; alternatively, choose the "Share Screen" option from the menu to initiate screen sharing.
In OpenAI's demonstration, researchers utilized the screen sharing feature to allow ChatGPT to provide real-time feedback on graphic design projects. ChatGPT was able to recognize elements such as colors, layouts, and text on the screen, offering suggestions to improve the design.
The video input functionality operates similarly. When users permit camera access on their device, ChatGPT processes the video stream in real-time, identifying and analyzing objects, actions, and context, then providing relevant information or instructions, such as hardware identification in technical setups or step-by-step guidance for repairs.
Additionally, OpenAI launched the Santa mode, which allows users to interact with ChatGPT in a festive atmosphere. In this mode, ChatGPT's voice bubble is transformed into a snowball, and the voice button becomes a snowflake icon. This mode is available globally and will run until early January. All interactions are temporary and do not affect users' chat histories. During demonstrations, ChatGPT's Santa voice delivered personalized holiday stories and answered questions about Christmas traditions.
However, these new features have also raised security concerns. In response, OpenAI stated that protective measures are in place to safeguard user data. For video and screen sharing, data is processed locally as much as possible to ensure sensitive information remains private. Furthermore, any data shared with the cloud is encrypted and not stored beyond the duration of the session.
Currently, these new features are being rolled out to ChatGPT Plus and enterprise users, with plans for a broader release in early next year. Free users will not have access to video input and screen sharing functionalities, as OpenAI aims to focus on generating revenue from its premium products.
