Stability AI, developer of the Stable Diffusion image generating software, has released its text-to-animation AI software Stable Animation SDK.
According to Stability AI, the tool was designed for “artists and developers to implement the most advanced Stable Diffusion models to generate stunning animations.” The company announced in February that it had partnered with Krikey.ai to develop a text-to-animation tool.
“With the Stable Animation SDK, we are giving users a new way to unleash their creativity and imagination using generative AI,” Stability AI CEO Emad Mostaque said in a statement. “We are excited to see what amazing things people will create with this tool.”
Stable Animation SDK can be used with all Stable Diffusion models, including Stable Diffusion 2.0 and Stable Diffusion XL. The tool provides three methods of generating animation:
- Text to animation: Users input a text prompt (as with Stable Diffusion) and tweak various parameters to produce an animation.
- Text input + initial image input: Users provide an initial image that acts as the starting point of their animation. A text prompt is used in conjunction with the image to produce the final output animation.
- Input video + text input: Users provide an initial video to base their animation on. By tweaking various parameters, they arrive at a final output animation that is additionally guided by a text prompt.
For more information, visit Stability’s website. They have also released an animation handbook that shows how various parameters in the animation tool can be tweaked to achieve various motion effects.
