https://x.com/TUPACABRA2/status/1953835512978088366/video/1
This might be the best AI video I've ever made... 🤯
The story was breaking all over the internet but it was missing a visual component so I set out to make the definitive video.
Here’s a breakdown of how I made it in less than ONE WEEK with MidJourney. (prompt included) 👇🏼🧵
Inspiration + ChatGPT
After seeing Mr. Ballen's video I was blown away by the story. I committed to bringing the story to life.
I grabbed the transcript and pasted it to chat GPT to get a quick shot list together.
After settling on a structure I went to MidJourney.
Photorealism 👉 Animation with @midjourney
I started prompting with realism in mind but quickly realized that trying to maintain quality and consistency would delay the project significantly. So I tried out animation.
After some experimentation I landed on a combo of a new moodboard + adding this phrase to the end of the prompt itself.
• Moodboard -
--p m7351727690958766120
• Prompt Phrase -
"Makoto Shinkai style, high saturation, fresh style, cinematic detail, moody atmosphere"
Starting the edit
I took the basic shots from midjourney and the original Mr. Ballen video and began to piece it all together. I was able to cut down his 15min segment to 4min.
The next step was to refine the shots and fill any empty spaces.
Sound FX.
Even though Mr. Ballen's audio would be heard throughout the video it would still feel hollow without the Sound FX.
Finding the sounds is the easy part. The hard part is knowing what sounds to look for. Don't underestimate room tone, ambient sound, and proper audio levels.
Most Complicated Shot
From a single image I was able to make the entire intro and outro for the video. Manual Extend offers a chance to direct new events in chronological order.
• INTRO
"Library of a small Mexican town"
"A postman on a moped drives towards the camera"
"A postman grabs a mailbag and walks into building"
• OUTRO
"Looking up to clouds and blue sky, ufos appear" I reversed this shot so it would loop with the beginning.
$ Budget Breakdown + Tips
• Pro MidJourney - $60/month
• Additional credits - $20
• 90% Relaxed mode
• 100% 480p (I started the project before HD Mode dropped)
Tips & Tricks
• Plan your story
• Strategize your work flow
• Don't bite off more than you can chew
• Experiment
