Week 6: Automated AI Video Workflows

Week 6 Resources: Automated AI Video Workflows

Required Software & Accounts

Before starting, ensure you have access to the following tools and extensions used in this week’s lesson.

• Video Download Helper: Chrome extension for downloading videos from various sites.
  • Chrome Web Store  (Search for “Video Download Helper”)
• Cobalt.tools: A web-based tool for downloading media from platforms like Instagram and TikTok without watermarks.
  • Visit Cobalt.tools 
• Midjourney: High-quality AI image generation tool.
  • Visit Midjourney 
• MiniMax (H3): AI video generation model used for text/image-to-video.
• Seedance (2.0 Mini): Alternative AI video generation model used for fly-throughs and animations.
• CapCut (Optional): For final video editing, adding music, or making minor adjustments.
  • Download CapCut 

Class Prompts

You can copy and paste these prompts directly into your AI agent or workflow builder to replicate the video analysis and generation process.

1. Video Analysis & Prompt Extraction

Extracting prompts from a reference video:

Use your video analysis tool to generate:
1. an image prompt for the first frame
2. a video prompt for animating the video from the first frame

Alternative detailed extraction:

Use your video analysis tool to create a prompt to create this video. It should include a step by step outline of what happens from moment to moment.

2. Image Generation

Generating the base image:

Use mid journey to generate the image

(Alternatively, you can instruct the agent to use “GPT Image 2” or other available image models).

3. Video Generation

Animating the generated image (MiniMax):

Now use that as a first frame and generate the video using minimax h3. 7 seconds.

Refining camera movement:

The video doesn't show the camera moving like the original. Try again, but make it more like a fly through.

I want the camera to actually fly around the house, not just down the centerline. Try again.

4. Workflow Automation Prompts

Categorizing videos for automated routing:

Use your video analysis tool to get a high level description of the video, especially whether the video should be categorized as:
1. Luxury Living
2. Luxury Travel
3. Cute Couple Animation
4. Cooking
5. Anime Vibes
6. Fantasy Art

Defining Workflow Steps (Example for Artistic Video):

1. Use your video analysis tool to generate an outline describing the shots, dialog, and actions from [video]
2. Create a prompt to generate the same video. The prompt should look like [template]
3. Generate the video from the image and seedance 2.0 mini

Setting up a Dry Run (Testing workflows without spending credits):

DRY RUN categorize the video, but don't actually create any images or videos. Follow dependent workflows up to the point of analysis and report back the prompts.