Skip to content

Shelly Palmer - OpenAI Launches Text-to-Video Model Sora

Shelly Palmer has been named LinkedIn’s “Top Voice in Technology,” and writes a popular daily business blog.
shellypalmerfriday

Greetings from NBA All-Star Weekend in Indianapolis. OpenAI has launched Sora, a text-to-video AI model capable of generating up to one-minute videos from text prompts. This model distinguishes itself by creating realistic scenes that include complex interactions, multiple characters, and detailed backgrounds. Designed to simulate the physical world in motion, Sora will service real-world applications that require dynamic visual content.

Sora's model allows for the generation of emotionally expressive characters and the maintenance of consistent style and character presence across multiple video shots. It also offers the capability to animate still images or extend existing videos with new frames.

Despite its innovative approach, Sora faces challenges with complex physics, accurate cause/effect representation, and maintaining precise spatial/temporal details. OpenAI is conducting adversarial testing to mitigate risks (such as misinformation and bias) and is developing tools to detect AI-generated video content.

Currently, Sora is available to a select group of researchers, artists, and policymakers, reflecting OpenAI's cautious approach towards its deployment and the emphasis on responsible AI development.

Here's the prompt:

"Drone view of waves crashing against the rugged cliffs along Big Sur’s Gamboa Point Beach. The crashing blue waters create white-tipped waves, while the golden light of the setting sun illuminates the rocky shore. A small island with a lighthouse sits in the distance, and green shrubbery covers the cliff’s edge. The steep drop from the road down to the beach is a dramatic feat, with the cliff’s edges jutting out over the sea. This is a view that captures the raw beauty of the coast and the rugged landscape of the Pacific Coast Highway."

Here's the video. It's mind blowing!

As always your thoughts and comments are both welcome and encouraged. Just reply to this email. -s

sp@shellypalmer.com

ABOUT SHELLY PALMER

Shelly Palmer is the Professor of Advanced Media in Residence at Syracuse University’s S.I. Newhouse School of Public Communications and CEO of The Palmer Group, a consulting practice that helps Fortune 500 companies with technology, media and marketing. Named LinkedIn’s “Top Voice in Technology,” he covers tech and business for Good Day New York, is a regular commentator on CNN and writes a popular daily business blog. He's a bestselling author, and the creator of the popular, free online course, Generative AI for Execs. Follow @shellypalmer or visit shellypalmer.com