Seedance Storyboard for Claude Code

repository·main·Indexed 43 days ago

https://github.com/elementsix/elementsix-skills

A Claude Code skill designed to transform ideas into professional, structured storyboard prompts for the Seedance 2.0 multimodal AI video generation model. It provides a guided process to define style, camera shots, and sound, and supports the @asset-name syntax for referencing images, videos, and audio assets. The skill includes advanced prompt patterns for video extension, plot reversal, and one-take sequences for use on the Jimeng platform.

Tokens
6.5K
Snippets
25
Records
35
Agent score
53%

What's inside Seedance Storyboard

  1. Reference multimodal assets using @ syntax

    main

    Seedance 2.0 supports multimodal inputs (images, videos, audio, and text). Use the @asset_name syntax within your prompts to reference specific files provided in the context.

    Supported Asset Types & Limits:

    • Images: jpeg, png, webp, bmp, tiff, gif (up to 9 images, < 30 MB each)
    • Videos: mp4, mov (2-15s, up to 3 videos, < 50 MB each)
    • Audio: mp3, wav (up to 3 files, < 15s each, < 15 MB each)
    • Text: Natural language
    • Mixed Limit: Maximum of 12 files total per request.
    @图片1 作为首帧
    @图片2 作为角色形象参考
    @视频1 参考运镜方式
    @音频1 用于配乐
  2. Reference multimodal assets in prompts using @ syntax

    main

    When generating prompts for Seedance 2.0, use the @asset-name syntax to reference specific multimodal assets (images, videos, or audio) provided in your workflow.

    @image1 as first frame
    @image2 as character reference
    @video1 reference camera movement
    @audio1 for background music
  3. How to use multimodal references with @syntax

    main

    When generating prompts for Seedance 2.0, you must use the @filename syntax to specify the purpose of your uploaded assets. This allows the AI to understand how to apply the reference material to the video generation.

    Common usage patterns:

    • First Frame: @image1 作为首帧 (Use @image1 as the first frame)
    • Character Reference: @image1 作为角色形象参考 (Use @image1 as character reference)
    • Camera Movement: @video1 参考运镜/动作 (Reference @video1 for camera movement/action)
    • Audio Reference: @audio1 用于配乐/对白参考 (Use @audio1 for music/dialogue reference)
    • Combined usage: @image1 作为首帧,参考@video1 的运镜 (Use @image1 as the first frame and reference @video1 for camera movement)
  4. Reference assets using @ syntax

    main

    Seedance 2.0 uses the @ symbol to reference multimodal assets (images, videos, or audio) within your prompt. This allows you to specify how each asset should influence the generation:

    • @ImageName as the first frame (首帧)
    • @ImageName as the last frame (尾帧)
    • @ImageName as a character reference (角色形象参考)
    • @VideoName to reference camera movement (参考运镜方式)
    • @VideoName to reference action rhythm (参考动作节奏)
    • @AudioName for background music (用于配乐)
    @图片1 作为首帧
    @图片2 作为尾帧
    @图片3 作为角色形象参考
    @视频1 参考运镜方式
    @视频2 参考动作节奏
    @音频1 用于配乐
  5. Reference multimodal assets in Seedance prompts

    main

    When generating or using prompts for Seedance 2.0, you can reference specific multimodal assets (images, videos, or audio) using the @asset_name syntax. This allows you to specify how each asset should be used in the generation process.

    @图片1 作为首帧
    @图片2 作为角色形象参考
    @视频1 参考运镜方式
    @音频1 用于配乐
  6. Install the Seedance Storyboard plugin for Claude Code

    main

    The Seedance Storyboard plugin converts ideas into professional Seedance 2.0 storyboard prompts for Jimeng (Jianying). You can install it using one of three methods.

    Important: After installation, you must exit and re-enter Claude Code for the /seedance-storyboard command to become available.

    ### Method 1: Via Marketplace (Recommended)
    
    ```bash
    # 1. Add Marketplace
    /plugin marketplace add elementsix/claude-seedance-plugin
    
    # 2. Install Plugin
    /plugin install seedance-storyboard@elementsix-skills
    
    # 3. Restart Claude Code (Important!)
    # Exit Claude Code and re-enter for the /seedance-storyboard command to work

    Method 2: Local Installation

    # Clone to Claude Code plugins directory
    git clone https://github.com/elementsix/claude-seedance-plugin.git \
      ~/.claude/plugins/seedance-storyboard
    
    # Exit and re-enter Claude Code to make the command effective

    Method 3: Manual Copy

    # Copy SKILL.md to your project skills directory
    cp -r seedance-storyboard ~/.claude/skills/
    
    # Exit and re-enter Claude Code to make the command effective
  7. Structure of a professional Seedance 2.0 prompt

    main

    To get the best results from Seedance 2.0, follow this structured prompt template. It ensures the model understands the overall style, the specific timeline of shots, the sound design, and how to use your uploaded assets.

    Prompt Template:

    【Overall Description】Style + Duration + Aspect Ratio + Overall Atmosphere
    
    【Shot Descriptions】
    0-X seconds: [Camera movement], [Visual content], [Subject action], [Lighting/Effects]
    X-Y seconds: [Camera movement], [Visual content], [Subject action], [Lighting/Effects]
    ...
    
    【Sound Instructions】Music style/Sound effects/Dialogue
    
    【Reference Asset Instructions】(If applicable)
    @image1 as first frame/character reference
    @video1 reference camera movement/action
    @audio1 for music/dialogue reference

    Writing Principles:

    1. Use a clear timeline with specific second ranges.
    2. Define camera language explicitly (e.g., push, pull, pan, tilt, orbit, dolly, Hitchcock zoom).
    3. Describe actions concretely to avoid ambiguity.
    4. Use the @asset_name format for multimodal references.
    5. For video extension, specify "Extend Xs" and choose the corresponding generation length.
    【Overall Description】Style + Duration + Aspect Ratio + Overall Atmosphere
    
    【Shot Descriptions】
    0-X seconds: [Camera movement], [Visual content], [Subject action], [Lighting/Effects]
    X-Y seconds: [Camera movement], [Visual content], [Subject action], [Lighting/Effects]
    ...
    
    【Sound Instructions】Music style/Sound effects/Dialogue
    
    【Reference Asset Instructions】(If applicable)
    @image1 as first frame/character reference
    @video1 reference camera movement/action
    @audio1 for music/dialogue reference
  8. Use the /seedance-storyboard command

    main

    Once installed and Claude Code has been restarted, run the following command to start the step-by-step guided process for generating professional Seedance 2.0 storyboard prompts:

    /seedance-storyboard

    Claude will guide you through these stages:

    1. Understand Idea: Defining the core story.
    2. Deep Dive: Detailing style, camera shots, actions, and sound.
    3. Build Storyboard: Breaking down shots along a timeline.
    4. Generate Prompts: Outputting professional prompts ready for use.
    5. Optimization Suggestions: Providing advice for improvement and multimodal assets.
  9. Structure a Seedance 2.0 storyboard prompt

    main

    When creating prompts for Seedance 2.0, use a structured format that defines the overall style, a time-coded sequence of actions, sound requirements, and visual references. This ensures the AI understands the pacing, atmosphere, and specific visual assets to use.

    Prompt Components:

    • Global Settings: Define style (e.g., 电影级写实风格), duration (e.g., 15秒), aspect ratio (e.g., 2.35:1), and atmosphere.
    • Timeline (0-X seconds): Provide specific camera movements (e.g., 中景跟随镜头, 特写) and character actions for each time segment.
    • Sound (【声音】): Specify music genre and environmental sound effects.
    • References (【参考】): Use @ syntax to link specific assets like @图片1 (images), @视频1 (videos), or @图1 (character/scene references).
    电影级写实风格,15秒,2.35:1电影宽屏,温馨家庭氛围
    
    0-3秒:中景跟随镜头,男人疲惫地走在走廊,脚步逐渐变缓,最后停在家门口
    3-5秒:脸部特写,男人深呼吸,调整情绪,收起负面情绪,表情变得轻松
    ...
    
    【声音】轻缓的钢琴配乐,环境音效(脚步声、开门声、孩子的笑声)
    【参考】@图片1 男人形象,@图片2 女儿形象,@图片3 宠物狗形象
  10. Apply advanced video editing techniques

    main

    You can perform specific video manipulations using these patterns:

    Video Extension (视频延长) Extend a video by specifying the new duration and ensuring the new content connects seamlessly. 将@视频1延长X秒(生成长度选X秒) 0-X秒:[新内容],与前视频无缝衔接

    Plot Twist (剧情颠覆) Edit an existing video by defining what to keep and what to change. 基于@视频1进行编辑:【保留】原视频的_____ 【修改】[具体改动]

    Character Replacement (角色替换) Swap a character while maintaining the original motion and camera work. 将@视频1中的人物换成@图片1 保持@视频1的运镜和动作

    Music Sync (音乐卡点) Align visual content changes with the rhythm of an audio asset. 参考@视频1的节奏 0-2秒:[内容] 2-4秒:音乐重拍,[内容]

    将@视频1延长5秒(生成长度选5秒)
    0-5秒:主角跑向远方,与前视频无缝衔接
  11. Use the Seedance 2.0 Prompt Formula

    main

    To generate high-quality video content, structure your prompt using the following formula which covers style, timeline, sound, and multimodal references:

    【Style】 [Style], [Duration]s, [Aspect Ratio], [Atmosphere]

    【Timeline】

    • 0-X seconds: [Shot Type] + [Visuals] + [Action] + [Effects]
    • X-Y seconds: [Shot Type] + [Visuals] + [Action] + [Effects]

    【Sound】 [Music] + [Sound Effects] + [Dialogue]

    【References】 @[Asset Name] [Description]

    【风格】写实风格,5秒,16:9,史诗氛围
    
    【时间轴】
    0-3秒:推镜头,森林深处,树木随风摇摆,丁达尔效应
    3-5秒:拉镜头,主角背影,缓缓回头,光影闪烁
    
    【声音】史诗交响乐 + 风声 + 无对白
    
    【参考】@图片1 森林环境,@图片2 主角形象
  12. Update the Seedance Storyboard skill

    main

    To update the skill to the latest version within Claude Code:

    1. Run the /plugin command.
    2. Use the arrow keys or Tab to switch to the Marketplaces tab.
    3. Select elementsix-skills.
    4. Select Update marketplace.

    You can also select Enable auto-update to automatically fetch the latest version every time you start Claude Code.