ChatGPT Advanced Voice Mode Gets Visual with New Interactive Features

OpenAI has recently introduced wonderful updates to ChatGPT, launching the advanced voice with video feature on the sixth day of its “12 Days of OpenAI” event. This new feature allows users to interact with ChatGPT not just through voice commands but also with video inputs, thus changing the way users interact with AI every day.

Besides this, as we are approaching the festive season, they also introduced Santa Mode for all users. Let’s understand these exciting features and how they will benefit users.

The Power of Video in Advanced Voice Mode

The advanced voice with video feature will completely change the way users interact with ChatGPT. Earlier, ChatGPT offered voice interactions through audio input; however, now, using OpenAI’s multimodal GPT-4o model, ChatGPT possesses screen sharing and visual capabilities. This means users can show objects or specific scenes to ChatGPT, and the tool will converse well; it looks like you are having a real-life interaction.

The company also teased this feature with the introduction of GPT-4o back in May 2024. However, it has now been released publicly. The feature is excellent for any creative task or problem-solving. For instance, you can share cooking ingredients with ChatGPT through video and request the tool for recipe suggestions or ask for assistance for any task in real-time.

When this Feature Will be Accessible to Users of Different Tiers?

As of now, the advanced voice with video feature will be available for ChatGPT Plus and Pro subscribers. This feature will be available only to users who want to leverage ChatGPT’s incredible capabilities by paying the $20 monthly subscription fee. OpenAI, the company behind ChatGPT, will launch these features for Plus and Pro users anytime soon. However, Enterprise and Educational users can expect the video feature in January 2025.

ChatGPT Welcomes the Holidays with Fun Santa Mode Feature

Apart from the Advance Voice with Vision, OpenAI has released a bonus feature known as Santa Mode during the festive season. Using this feature, users can interact with ChatGPT in a holiday-themed voice, resulting in a whimsical atmosphere for conversations. Santa Mode is available to all ChatGPT users (free or paid). Additionally, whenever you want to have a conversation with Santa, your limit gets reset despite your limit being over in the free tier.

To access the Santa Mode, users need to click on the snowflake next to the microphone icon. Whether you want gift ideas or what to ask Santa about festival traditions, the mode delivers you with fun and engaging answers.

What are Some Practical Applications of these New Features?

There are many practical applications of the voice-with-video feature. Let’s look at them in detail.

• Cooking Assistance: By presenting the ingredients or the cooking tools to the ChatGPT via Video, they can obtain different recipe suggestions and even streamline guides for making any recipe.
• Document Analysis: Users can upload images of documents in ChatGPT, which allows ChatGPT to analyze and summarize the content effectively.
• Creative Analysis: Users can have a deep conversation with ChatGPT by sharing attractive visuals and receiving real-time feedback.
• Learning Support: Students can share visuals, such as diagrams or graphs, and ask ChatGPT for correct answers, thus improving their understanding of various topics.

In the demo video shared by OpenAI, the speaker asked ChatGPT to provide the recipe for brewing coffee, showcasing the tools and ingredients in the video. The ChatGPT offered verbal insights and directions for making a great coffee. The example showcases the AI’s ability to understand tasks visually and even its potential as an interactive learning tool.

Future Impact of Advanced Voice with Video

The new-age video interaction feature will completely transform how users interact with AI by allowing real-time visual engagement. It gives ChatGPT the power to identify various objects, understand simple to complex contexts, and offer personalized responses according to the visuals. As AI technology becomes bigger and better, we can expect that it will have applications in different industries, such as education, finance, automotive, and more.

To stay ahead of the curve for AI advancements, subscribe to our newsletter to get the latest insights, trends, and updates related to ChatGPT and everything around AI.