Category: New Videos

At Adobe MAX 2024, Adobe announced many new AI features which include:

Adobe Firefly Video Model (Beta): Adobe expanded its Firefly family of generative AI models to include video, enabling creators to generate videos from text and image prompts. This model is designed to be commercially safe and is integrated into Premiere Pro, offering features like Generative Extend to seamlessly add frames to video clips .

Photoshop Enhancements: Photoshop received several AI-driven updates:

• Distraction Removal: Automatically identifies and removes elements like people, wires, and poles from images.
• Generative Workspace (Beta): Allows designers to ideate and iterate concepts simultaneously using generative AI.
• Substance 3D Viewer (Beta): Enables viewing and editing 3D objects within Photoshop.
• Premiere Pro Enhancements:  Premiere Pro introduces Generative Extend, allowing editors to seamlessly add frames to video clips using AI.
• Adobe Express:  Adobe Express introduces new AI capabilities to simplify content creation, such as campaign creation, animation, and one-click brand setup.

HeyGen has introduced an innovative feature that allows users to integrate AI-powered avatars into Zoom meetings, enhancing virtual interactions. These Interactive Avatars can join multiple Zoom sessions simultaneously, operating 24/7, and are designed to look, sound, and behave like the user, making real-time decisions based on provided knowledge bases. https://www.heygen.com/

Key Features:

• Real-Time Interaction: The avatars engage in dynamic conversations, responding promptly to participants using OpenAI’s real-time voice integration. This ensures natural and efficient interactions during meetings.
• Versatility: Suitable for various applications such as online coaching, customer support, sales calls, and interviews, these avatars can handle repetitive tasks, allowing users to focus on more critical aspects of their work.
• Personalization: Users can create custom avatars that mirror their appearance and voice, and how they speak, providing a consistent and authentic presence in virtual meetings. Additionally, users can create up to 100 different “looks” for their avatar, enabling variations in backgrounds, outfits, and camera angles to keep the virtual presence engaging and versatile.

While it is definitely getting better all the time, the avatars still look and sound fake to me – almost there, but not quite.

RunwayML introduced Act-One, an extraordinary way to add fully controllable facial expressiveness to any face – real or animated – in a video. Instead of trying to explain all that it does, check it out here: https://runwayml.com/research/introducing-act-one

Stability AI released the open source Stable Diffusion 3.5 – with improved photorealism of people and much better rendering of hands.

Alibaba’s MIMO – Alibaba’s got a new AI tool called MIMO  that can swap out people in videos using just a single photo reference, and change them into whatever characters you like, doing whatever you wish. It eliminates the need for complicated stuff like multi-camera setups or motion capture.

Leonardo in Canvas – Canva has launched Dream Lab which incorporates Leonardo in its text to image creations. The new Dream Lab tool can generate up to 19 different types of graphics, including 3D renders and illustrations, and can also reference other images to fine-tune outputs, making its outputs more reliable. It’s also capable of generating multi-subject images and photorealistic portraits.

Wonder Dynamics, the folks who enabled us to drop animated CGI characters into our videos, and who I featured in in many of my seminars, have now introduced WonderAnimation, which turns any footage that you shoot into fully rendered 3D animated scenes that you have full post-production control over!

You can literally shoot a scene with any camera, (or phone) in any location, and turn the sequence into an animated scene with CG characters in a 3D environment – even with shots from multiple angles!

You can read about it at https://adsknews.autodesk.com/en/news/autodesk-launches-wonder-animation-video-to-3d-scene-technology/

You can see it in action at https://www.youtube.com/watch?v=xad1ajxln28

RunWayML has added advanced camera controls the give ultraprecise, and much easier to use camera controls when you are generating your videos.

You can check these out at https://www.youtube.com/watch?v=0buDtZKLDJ8

Google just announced Veo 2 which produces another advance in video quality, out-performing even OpenAI’s Sora. They also announced Imagen 3, an upgraded image model also offering state-of-the-art quality.

While video models frequently “hallucinate” unwanted details—such as extra fingers or unexpected objects—Veo 2 minimizes these occurrences, resulting in more realistic outputs.

Additionally, Veo 2 embeds an invisible SynthID watermark in its videos, allowing them to be identified as AI-generated. This helps mitigate risks of misinformation and misattribution.

VisitGoogle Labs to sign up for the waitlist. They also plan to expand Veo 2 to YouTube Shorts and other products next year.

Read more about it at https://blog.google/technology/google-labs/video-image-generation-update-december-2024

Imagen 3 outperformed all models, including Midjourney, Flux, and Ideogram, in human evaluations for preference, visual quality, and prompt adherence. The model is now available through Google Labs’ ImageFX.

You can now make a lip-syncing talking Custom AI Avatar for free in Capcut!

CapCut’s AI avatar generator is completely free to use. You can create and personalize your avatar without any subscriptions or hidden fees, allowing you to explore your creativity without breaking the bank.

From Capcut’s promo:

“Key Features of CapCut’s AI Avatar Generator

• Diverse Avatar Styles: Explore a library of unique styles, from bold and graphic to soft and whimsical, tailored to your vision.
• User-Friendly Interface: Create avatars effortlessly with intuitive tools, perfect for beginners and pros alike.
• Extensive Customization: Personalize avatars with detailed features, sound effects, and backgrounds to reflect your individuality.

Benefits of Using CapCut’s AI Avatar Generator

• Free Creativity: Design avatars at no cost, eliminating the need for expensive software or subscriptions.
• Pre-Designed Templates: Start with diverse character templates that inspire and simplify the creative process.
• Seamless Video Integration: Easily incorporate custom avatars into videos with CapCut’s editing tools.

Creative Applications of AI Avatars

• Gaming & Entertainment: Enhance gameplay commentary or skits with unique character avatars.
• Marketing & Advertising: Create memorable campaigns featuring custom avatars to elevate your brand.
• Reaction & Review Videos: Add personality and engagement to your content with visually captivating avatars.”

Learn more on how to use CapCut AI avatar generator here: https://www.capcut.com/tools/free-avatar-creator

Pika Labs has introduced Pika 2.0, a fun and user-friendly AI video generator designed for everyday creators, not just big studios. One of its standout features is the Scene Ingredients tool, which lets you upload your own characters, props, and settings to mix with AI-generated content. Whether it’s a dragon flying over a castle or a cat surfing through space, you get more control to bring your ideas to life.

Unlike traditional text-prompt-based video tools, Pika 2.0 has improved text alignment for better results and upgraded motion rendering for smoother, more natural movements. It’s made with small creators and social media users in mind, making it perfect for TikToks, marketing clips, or just having fun with creative video projects.

Available for both free and paid users, Pika 2.0 is all about making video creation accessible and enjoyable for “actual people,” as they put it.

Big news from InVideo – their latest update, V3, is a game-changer for video creation. You can now create entire videos—script, footage, voiceovers, music, subtitles, animations, the whole package—just by typing a single text prompt. No editing skills or juggling multiple tools needed!

This means anyone, whether you’re a creator, marketer, or entrepreneur, can easily produce professional-quality videos to tell your story, promote a product, or create engaging content for social media. Imagine whipping up a polished video ad or even translating existing videos with just a few clicks!

If you’ve ever felt intimidated by video editing, this might be the perfect time to give it a try here.