Stability AI has unveiled a new AI model named Stable Virtual Camera, which the company asserts can convert 2D images into "immersive" videos featuring realistic depth and perspective.
Stable Virtual Camera, as mentioned by the company, was an initiative aimed at integrating generative AI into virtual camera technology for digital filmmaking and 3D animation. This integration was intended to provide enhanced control and customization during real-time scene capturing and navigation. blog post .
The Stable Virtual Camera creates "new perspectives" of a scene using one or multiple images (up to 32 altogether) based on specific camera angles chosen by the user. It has the capability to produce video sequences that follow dynamic camera trajectories or predefined settings such as "Spiral," "Dolly Zoom," "Move," and "Pan."
The current version of Stable Virtual Camera, a research preview, can generate videos in square (1:1), portrait (9:16), and landscape (16:9) aspect ratios up to 1,000 frames in length. Stability warns the model may produce lower-quality results in certain scenarios, however, particularly with images featuring humans, animals, or “dynamic textures” like water.
“Highly ambiguous scenes, complex camera paths that intersect objects or surfaces, and irregularly-shaped objects can cause flickering artifacts,” Stability notes in its blog post, “especially when target viewpoints differ significantly from the input images.”
Stable Virtual Camera is available for research use under a non-commercial license. It can be downloaded from the AI dev platform Hugging Face.
Stability, the beleaguered firm behind the popular image generation model Stable Diffusion , secured additional funds in the past year As investors such as Eric Schmidt and Napster creator Sean Parker aimed to revitalize the company, Emad Mostaque, who was Stability’s co-founder and former CEO, allegedly mishandled the firm’s finances, driving it towards bankruptcy. This led to key employees leaving, plans for a collaboration with Canva being abandoned, and stakeholders becoming increasingly worried about the organization's future.
Over the past several months, Stability has brought aboard a new CEO, added "Titanic" filmmaker James Cameron to its board of directors, and unveiled multiple new image creation models Earlier this March, the firm teamed up with chipmaker Arm to bring an AI model that can generate audio including sound effects to mobile devices running Arm chips.
© 2024 Nation Daily News. All rights reserved. For personal use only.
Post a Comment