Runway MCP Server for ChatGPT
By Runway AI, Inc.
Overview
Runway lets users generate and edit images, videos, and audio directly from ChatGPT using their Runway account. Users can create images from text or edit an uploaded photo, animate images into video, make targeted edits to existing footage, expand videos to new aspect ratios, build multi-shot story videos and product marketing ads, localize an existing ad into another language, remove backgrounds, upscale media, convert video to HDR, generate music, sound effects, and spoken voiceover, author and run saved Runway workflows, browse recent assets, and check remaining credits and plan. All results are stored privately in the user's connected Runway workspace and rendered inline with a media viewer; purchases are completed on runway.com, never inside the chat.
How to connect
- ChatGPT: Open the Runway listing in the ChatGPT app directory and choose Connect. ChatGPT listing Runway exposes 52 tools here.
Tools
cancel_agent_run
ChatGPTcancel_pro_trial
ChatGPTcomplete_upload
ChatGPTinit_upload. parts is REQUIRED — even for single-part uploads. Each entry corresponds to one PUT response and carries the ETag from that response's etag header (strip surrounding quotes if present). Returns the asset URL to use as startFrame / endFrame / referenceImages[].url in the generation tools, or referenceVideo.url in edit_video.convert_video_to_hdr
ChatGPTgenerate_video or edit_video. CREDIT MODE: Runway account availability is checked against the currently connected workspace. WHEN TO USE: - The user wants an HDR master or HDR delivery of a clip they already have ("make this HDR", "convert to HDR10", "give me an HLG version", "HDR ProRes for my edit"). WHEN NOT TO USE: - To restyle, edit or regenerate the footage → generate_video / edit_video. - To raise resolution or sharpen → upscale_video. SOURCE VIDEO CONSTRAINTS: at most 30 seconds. Cost: 20 credits per second of source video, or 40 credits per second above 4 megapixels (roughly above 4K). Pass video.durationSeconds when known so an over-long clip is rejected before any upload. OUTPUT FORMATS: - hdr10 (default) — HDR10 master, the safest general-purpose delivery. - hlg — Hybrid Log-Gamma, for broadcast-style delivery. - hdr_prores — HDR ProRes .mov for editorial. Most browsers CANNOT play this file: tell the user to download it and open it in an editor or player, and do not describe it as viewable inline. proresProfile (422, 422 HQ, 4444) applies only to this format. AVAILABILITY: account-gated. If the call comes back saying HDR conversion is not enabled, or that the plan does not include HDR output, this workspace does not have access — tell the user instead of retrying or switching format. HANDLING USER ATTACHMENTS: - Claude/Cursor/local agents: upload local files first via init_upload -> curl -> complete_upload, then pass the returned asset URL as video.url. - ChatGPT: pass an uploaded video as videoFile; the tool imports it server-side. NEVER pass local paths such as /mnt/data/file.mp4 as video.url. Pass the duration alongside it as video: {durationSeconds}. USER-FACING REPLIES: Talk about the result ("converting your clip to HDR10"), not the underlying engine. Do not mention the model unless the user explicitly asks. Parameters: - video: {url?, durationSeconds?, assetId?} — the source video. URL must be a Runway-hosted /datasets URL (from complete_upload) or a public HTTPS video URL; omit it only when passing videoFile. - videoFile: ChatGPT-only uploaded video file param {download_url, file_id, mime_type, file_name}. - outputFormat: Optional, default hdr10. One of hdr10, hlg, hdr_prores. - proresProfile: Optional, only valid with outputFormat: 'hdr_prores'. One of 422, 422 HQ, 4444.create_ad
ChatGPTcreate_workflow
ChatGPTlist_workflows then get_workflow include_graph: true and copy nodes/edges. If a similar workflow already exists in the workspace, update that one instead of creating a duplicate. Use the fewest necessary nodes and set non-overlapping nodeProps.position coordinates: inputs left, processing (including system prompt + LLM + JSON Parse) center, outputs right. Never tell the user to implement the graph themselves. Call validate_workflow_graph first. Response includes an editor URL and validation errors/warnings even when saved. To run it, call run_workflow next. Do not invent graph JSON. list_workflows → get_workflow include_graph: true and copy nodes/edges. Read runway://docs/workflows/authoring before composing or changing a graph, runway://docs/workflows/examples for the API shape, and runway://docs/workflows/models before image/video chains.edit_video
ChatGPTshow_plans_and_credits with gatedCapability) and do not retry. Tell the user that editing video needs a paid plan rather than naming the model. Do not guess a fallback from this schema. WHEN TO USE THIS vs generate_video: - USE edit_video (this tool) for targeted, surgical edits of existing footage where preservation matters: "make the sneakers red", "change the outfit to a yellow fur coat", "remove the items on the wall behind her", "add graffiti on the wall", "change the season to winter", "relight the scene", "make it dark anime style" — or whenever the user mentions Aleph or Edit Studio. - USE generate_video with referenceVideo (seedance-2) when the source video is more of a loose reference: motion transfer, using the clip as style/structure inspiration, or heavy re-imagining where preserving the original isn't the point. Also fall back to it when the source violates Aleph's constraints (see below), or when an Aleph result was unsatisfying — and suggest edit_video when a seedance v2v edit changed more than the user wanted. - USE expand_video to change the video's ASPECT RATIO by outpainting beyond the frame edges ("make it vertical", "uncrop", "convert to 21:9") — this tool edits content within the frame, expand_video grows the frame. SOURCE VIDEO CONSTRAINTS (Aleph 2.0): 2-30 seconds, up to 1080p, up to 30fps, at most 10 cuts/shot changes, conventional aspect ratio. Cost: 28 credits/second of source (56 credit minimum), so a wasted submission is expensive — that's why the keyframe preview checkpoint below is the default. HOW THE WORKFLOW WORKS (a keyframe-driven edit is much higher quality than a text-only one): 1. CANDIDATES — call with promptText + video only (video.durationSeconds required for this stage). The tool extracts ~4 evenly spaced frames from the video and returns them inline with their timestamps. LOOK at the frames and pick the one that most clearly shows the edit target (e.g. the widest shot for a background change; a close-up of the subject for a detail change). You may also pick your own timestamp if none fit. 2. KEYFRAME PREVIEW — call again with the SAME arguments plus keyframeTimestampSeconds. The tool extracts that exact frame, edits it with an image model to apply your change, and returns the edited keyframe inline. SHOW it to the user and ask if they're happy before continuing (this is the default checkpoint). If they want a different look, re-call with a refined promptText or a different timestamp. 3. SUBMIT — once approved, call again with keyframeImage.url set to the edited keyframe URL and the SAME keyframeTimestampSeconds. The tool submits the Aleph 2.0 video edit task; the result arrives via the inline viewer / get_task. SHORTCUTS: - If the user has said they want to skip the preview/approval step, pass skipPreview: true at step 2 — the tool generates the keyframe AND submits the video edit in one call. - If the user supplies their own already-edited frame, pass it directly as keyframeImage.url with the timestamp it came from. - textOnly: true submits a text-prompt-only edit with no keyframe — lower quality, but a valid fallback when frame extraction or the keyframe edit fails. PROMPTING (Aleph 2.0 guide): simple, targeted prompts work best — an action verb (add, remove, change, replace, re-light, re-style) plus the desired transformation, e.g. "change the outfit and bag to soft yellow". Because Aleph only changes what you ask for, precise language beats long descriptions. Use extraMotionPrompt ONLY for motion that isn't implied by the keyframe or the original video (e.g. "fire begins to…enhance_frame_rate
ChatGPTgenerate_video, edit_video or upscale_video. CREDIT MODE: Runway account availability is checked against the currently connected workspace. WHEN TO USE: - The user needs a clip at a specific delivery frame rate: broadcast (25 or 59.94 fps), an editing timeline (25 or 30 fps), a client spec, or smoother high-frame-rate playback (48, 60, 120 fps). Runway generations are 24 fps, so "make this 30fps", "I need 59.94 for broadcast", "convert to 60fps" all belong here. WHEN NOT TO USE: - To raise resolution or sharpen → upscale_video. - To restyle, edit, extend or regenerate the footage → generate_video / edit_video / expand_video. - To grade into HDR → convert_video_to_hdr. - For a frame rate that is not in the list above: there is no custom fps. Offer the nearest preset instead. SOURCE VIDEO CONSTRAINTS: at most 300 seconds (5 minutes), up to 4K (3840x2160 in either orientation), aspect ratio at most 4:1. Standard (SDR) sources only — HDR inputs are not supported yet. Cost: 1 credit per 2 seconds of source video (minimum 1 credit), so a 60s clip costs 30 credits. Pass video.durationSeconds when known so an over-long clip is rejected before any upload. TARGET FRAME RATE: targetFrameRate is required. Common picks — 25 (PAL broadcast / EU timelines), 29.97 or 30 (NTSC / US timelines, social), 59.94 (US broadcast HFR), 48, 50, 60, 120 (smooth / slow-motion sources). 23.98 and 24 are also available for conforming footage that is not already 24 fps. AVAILABILITY: paid plans only, and account-gated. If the call comes back saying the feature is not enabled or requires a paid plan, tell the user instead of retrying or switching frame rate. DEFAULT MODEL (enhance-frame-rate): the limits and cost above. Prefer it for broadcast and timeline conversions, and when the user does not name a model. AI MEDIAKIT MODELS (optional model values): - mediakit-frame-interpolation (AI MediaKit Frame Interpolation): pick for smoother motion from a source with a known frame rate, raising it up to 4x (for example 24 to 60 fps). The default model converts between broadcast rates and handles slow-motion presets. Source: up to 300s, at most 4320px on the short side and 7680px on the long side. Output: the same clip at the target frame rate, rounded to 0.1 fps (59.94 becomes 59.9, 29.97 becomes 30). Cost: about 15 credits per minute for a source up to 720p and output up to 30 fps; x2 for a 1080p source, x4 for 2K, x8 for 4K, x16 above 4K, x32 for 8K; x2 above 30 fps and x4 above 60 fps output (a 1080p clip to 60 fps is about 60 credits per minute); each task rounds up to whole credits. MediaKit needs a paid plan and is not enabled on every workspace: only pass one of these models when whoami lists it in availableVideoToolModels.enhance_frame_rate. On a model_unavailable result, tell the user and offer the default model. Do not retry the MediaKit model. REUSING A VIDEO FROM THIS CHAT: if the source is a video a Runway tool generated earlier in this conversation, pass its task ID as video.taskId (no url, no videoFile). The server looks up the URL and duration. Do NOT ask the user to upload or download it. HANDLING USER ATTACHMENTS: - Claude/Cursor/local agents: upload local files first via init_upload -> curl -> complete_upload, then pass the returned asset URL as video.url. - ChatGPT: pass an uploaded video as videoFile; the tool imports it server-side. NEVER pass local paths such as /mnt/data/file.mp4 as video.url. Pass the duration alongside it as video: {durationSeconds}. USER-FACING REPLIES: Talk about the result ("converting your clip to 59.94 fps"), not the underlying engine. Do not mention the model unless the user explicitly asks. Parameters: - video:…enhance_video_draft
ChatGPTgenerate_video using model: "seedance-2.5" and draft: true. The enhanced video keeps the draft's prompt, references, aspect ratio, duration and audio. CREDIT MODE: Runway account availability is checked against the currently connected workspace. COST: billed as a full Seedance 2.5 render: 68 credits/output-second at 1080p, or 110 credits/output-second at 4k, plus 34 or 57 credits/input-video-second respectively when the draft used video references. The draft's cost is not credited back. Only choose 4k for an explicit 4K request. WHEN TO USE: - The user liked a draft and wants the full-quality version ("make this one in HD", "enhance it", "render that at 1080p"). Use resolution: "4k" only when they specifically ask for 4K. - Call this tool directly when the user asks in chat to enhance, upscale or finish a draft. The viewer's Enhance button is an optional shortcut that asks for the same action; no button click is required. WHEN NOT TO USE: - To change anything about the shot (prompt, framing, length): make a new draft with generate_video instead. Enhancement cannot change the content. - For videos that were not generated as drafts, including normal seedance-2.5 renders: use upscale_video to sharpen an existing video. RULES: - Pass the draft's task ID as taskId. The draft must have finished and be less than 7 days old. - Enhance each draft once. Calling this again for the same draft creates, and bills, a second render. USER-FACING REPLIES: Talk about the result ("rendering your draft in full quality"), not the underlying engine.expand_video
ChatGPTshow_plans_and_credits with gatedCapability) and do not retry. Tell the user that expanding video needs a paid plan rather than naming the model. Do not guess a fallback from this schema. WHEN TO USE THIS: - The user wants to change a video's aspect ratio WITHOUT cropping: "make this vertical for TikTok/Reels", "convert 16:9 to 9:16", "make it cinematic 21:9", "uncrop this video", "expand the frame". - NOT for content edits (use edit_video) and NOT for generating new footage (use generate_video). This tool only grows the canvas. SOURCE VIDEO CONSTRAINTS (Aleph 2.0): 2-30 seconds, up to 1080p, up to 30fps, at most 10 cuts/shot changes. Cost: 28 credits/second of source (56 credit minimum). HANDLING USER ATTACHMENTS: - ChatGPT: pass an uploaded video as videoFile; the tool imports it server-side. NEVER pass local paths like /mnt/data/... as video.url. - Claude/Cursor/local agents: upload local files first via init_upload -> curl -> complete_upload, then pass the returned asset URL as video.url. - ALWAYS pass video.durationSeconds when you know it (from file metadata) — it makes credit accounting accurate. USER-FACING REPLIES: Talk about the reframe (what ratio the video is becoming and what will fill the new space), not the model or task machinery. Do not mention model names unless the user asks. Parameters: - targetRatio: Required. The aspect ratio to expand to. One of 16:9, 9:16, 1:1, 4:3, 3:4, 21:9, 2:3, 3:2, 4:5, 5:4, 5:3, 3:5. Pick a ratio DIFFERENT from the source video's — expanding to the same ratio is a no-op. - video: {url, durationSeconds} — source video. URL must be a Runway-hosted /datasets/ asset URL (from complete_upload) or a public HTTPS video URL. - videoFile: ChatGPT-only uploaded video file param {download_url, file_id, mime_type, file_name}. - promptText: Optional. What should appear in the newly generated regions (e.g. "a sandy beach extends to both sides"). Omit to let the model continue the existing scene — that is the right default for most requests.feedback
ChatGPTgenerate_3d_model
ChatGPTgenerate_image
ChatGPTreferenceImages[0] to edit it. CREDIT MODE: Runway account availability is checked against the currently connected workspace. For creative product ad videos from a product URL or product image, use generate_product_marketing_video instead. It handles product-image extraction, storyboard generation, and final video creation. For video generation/editing, use generate_video (single shot) or generate_multishot_video (3-5 connected scenes). MODES: 1. Text-to-image — pass promptText only. The model creates a new image from scratch. Example: "a corgi astronaut floating in a nebula, cinematic lighting". 2. Image edit / transform — pass the source image as referenceImages[0] (give it a tag like "input" or "cat") and describe the change in promptText. Example: referenceImages: [{url: ..., tag: "cat"}], promptText: "@cat on a beach at sunset". Use for: background swaps, style transfer, object additions/removals, restyling, photo retouching. 3. Composite from multiple references — pass 2+ referenceImages each with a distinct tag, then reference them by tag in the prompt. Example: referenceImages: [{url: ..., tag: "person"}, {url: ..., tag: "room"}], promptText: "@person standing in @room". HANDLING USER ATTACHMENTS: If the user attached an image, run init_upload -> curl -> complete_upload first to get a Runway-hosted asset URL, then pass it as referenceImages[].url. REUSING ASSETS: URLs returned by other Runway tools (image outputs from prior generate_image calls, complete_upload outputs) are stable, hosted asset URLs. Pass them directly into referenceImages[].url — never re-upload. STYLE SAFETY: Do not include names of artists, directors, photographers, studios, or other living creators as style anchors. If the user asks for a named style, translate it into neutral visual descriptors such as camera language, palette, lighting, genre, era, composition, and material texture before calling the tool. USER-FACING REPLIES: Pick the right model internally, but DO NOT mention the model name to the user (e.g. "using Nano Banana Pro", "with GPT Image 2") unless they explicitly ask which model was used. Talk about the image content — subject, style, composition — not the engine. MODELS: | model | tier | best for | |------------------|--------|-----------------------------------------------------------------------------------------| | nano-banana-pro | any | DEFAULT. Photo-real images, character consistency, edits/composites with references. | | gpt-image-2 | paid | Readable text in images, charts/infographics, strict adherence to complex instructions. | | gen-4 | any | Fast, low-cost general-purpose Runway model. | Picking heuristic: - nano-banana-pro (DEFAULT) — photo-realistic images, edits, multi-image composites. - gpt-image-2 — pick when the image needs readable text, charts, infographics, or strict adherence to a long instruction list. - gen-4 — pick for speed, or when the user explicitly wants to continue with the current account settings. ASPECT RATIOS: - nano-banana-pro: auto, 21:9, 16:9, 4:3, 1:1, 3:4, 9:16 - gpt-image-2: 21:9, 16:9, 4:3, 1:1, 3:4, 9:16, plus 5:3, 3:5, 7:6, 6:7, 5:4, 4:5 - gen-4: 16:9, 9:16, 1:1, 4:3, 3:4, 21:9 Parameters: - model: One of nano-banana-pro, gpt-image-2, gen-4. Default: nano-banana-pro. - promptText: Required. Descriptive prompt. For edits, describe the change ("make the background neon"). For composites, reference tagged images ("@cat sitting on @couch"). - ratio: Aspect ratio. See per-model list above. - count: Number of images to generate in one go. Options: 1, 2, 3, 4. Default: 1. - referenceImages: Optional array of {url, tag} — for edits and composites. tag is the alias used in the prompt (e.g. tag: "cat" lets you write "@cat" in promptText). URLs come from prior Runway tool outputs, complete_upload, or any public https URL.generate_multishot_video
ChatGPTmodel parameter — resolution selects the engine. CREDIT MODE: Runway account availability is checked against the currently connected workspace. Use this when the user wants a short narrative or sequence: - "a 10-second mini-story about a cat finding a friend" - "a multi-scene product ad: closeup, lifestyle, hero shot" - "transition through 3 environments: forest -> desert -> beach" For a single continuous shot, use generate_video instead. For editing/restyling an existing video, also use generate_video (with referenceVideo). MODES: 1. auto (DEFAULT) — Pass a single storyPrompt and the workflow plans the shots for you. Best when the user describes the story not the individual scenes. Example: mode: "auto", storyPrompt: "a barista discovers their cafe has been frozen in time". 2. custom — Pass per-shot prompts as shots: [{prompt}, ...] (3-5 shots). Total duration is divided evenly across them. Best when the user has specific ideas for each scene. Example: mode: "custom", shots: [{prompt: "wide shot of cafe"}, {prompt: "barista looks up, surprised"}, {prompt: "close on a frozen droplet of coffee"}]. Optional firstSceneImage anchors the opening frame for either mode. Availability is checked against the current Runway workspace. Multi-shot tasks routinely take 5-10 minutes. USER-FACING REPLIES: DO NOT mention the underlying engine (Kling 3.0 / Pro) to the user unless they explicitly ask which model was used. Talk about the multi-shot story — the scenes, transitions, and overall narrative — not the engine. Parameters: - mode: 'auto' (default) or 'custom'. - storyPrompt: Required for mode='auto'. Full story / overall scene description. - shots: Required for mode='custom'. Array of {prompt}, 3-5 entries. - duration: Total seconds as a STRING (not a number) — '5' | '10' (default) | '15'. - aspectRatio: '16:9' (default) | '1:1' | '9:16'. - resolution: '720p' (default, Kling 3.0 Standard) | '1080p' (Kling 3.0 Pro). - sound: Boolean, generate audio (default true). - firstSceneImage: Optional {url} to anchor the first frame. URL from generate_image, complete_upload, or any public https URL.generate_music
ChatGPTpromptText. CREDIT MODE: Runway account availability is checked against the currently connected workspace. MODELS (pick with model; default lyria-3-pro): - lyria-3-pro (8 credits): Full-length music — songs, scores, instrumentals. Use for a complete track or soundtrack. - lyria-3-clip (4 credits): Short music clips — stings, loops, background beds, jingles. Use for intros, transitions, or a bed under a short video. Output length is fixed per model — there is no duration parameter. Use lyria-3-clip for short beds/stings and lyria-3-pro for a full track. WHEN TO USE: - "make me a song about…", "write a lo-fi beat", "background music for my video", "an orchestral score that builds", "a 10-second jingle". - NOT for speech/voiceover, NOT for sound effects, NOT for adding a soundtrack to an existing video (generate the music here, then combine externally). PAID PLAN REQUIRED: music generation is not available on free Runway workspaces. On a free workspace this tool returns paid_plan_required without creating a task — follow the NEXT line in that result (show_plans_and_credits with gatedCapability) and do not retry. Tell the user that generating music needs a paid plan rather than naming the model. whoami does not list music models; do not treat an empty availableVideoModels as a music signal. AVAILABILITY: some workspaces have this model disabled by an admin. If the result is an account_limitation with reason admin_disabled_model, tell the user and stop — do not retry with the other model. PROMPTING TIPS: lead with genre and mood, then instrumentation and tempo, then structure ("intro, verse, chorus, outro"). For songs with vocals, include the lyrics or the theme and vocal style. For instrumental beds say "instrumental, no vocals". Max 5000 characters. USER-FACING REPLIES: Talk about the music (genre, mood, what it's for), not the model or task machinery. Do not mention Lyria or Google unless the user asks. The output is an MP3 the viewer plays inline; headless agents get the URL from get_task. Parameters: - promptText: Required. What the music should sound like. Max 5000 characters. - model: Optional. lyria-3-pro (default, full track) or lyria-3-clip (short clip). - name: Optional. Display name for the track in the user's Runway library. Defaults to the prompt.generate_product_marketing_video
ChatGPTcreative_ad_video. Workflow: 1. Get the exact product image from productImages[0] or extract the best high-resolution product image from productUrl. 2. Use optional referenceImages as character, scene, mood, or world references. 3. Internally generate a 3x3 storyboard image, preferring GPT Image 2 for paid workspaces and falling back to Nano Banana Pro otherwise. 4. Use that storyboard as sequential shot guidance for Seedance 2, along with the product image and references, to create the final video. Inputs: - productUrl: Product landing page URL. The tool will scrape metadata and rank image candidates, preferring high-resolution product/gallery images. - productImages: Product image URLs from uploads, recent assets, or previous generations. Preferred over productUrl extraction. - productImageFile: ChatGPT-only uploaded product image file. Use this when ChatGPT provides a user-uploaded product image. - referenceImages: Optional character/scene/mood/world references. - promptText: Required creative campaign idea. If the user requests a named artist/director/photographer/studio style, describe the visual qualities instead and do not include the name. - duration: 10 by default; use 15 only when the user asks for a longer ad. STYLE SAFETY: Do not include names of artists, directors, photographers, studios, or other creators anywhere in prompts submitted to Runway tasks. When style direction is needed, translate it into camera language, palette, lighting, genre, era, composition, and material texture. USER-FACING REPLIES: DO NOT mention internal model names unless asked. Do not mention the intermediate storyboard unless useful. Tell the user the creative ad video is generating and the viewer will update when ready.generate_sound_effect
ChatGPTpromptText. CREDIT MODE: Runway account availability is checked against the currently connected workspace. COST: 1 credit per second of requested duration (rounded up); 2 credits when duration is omitted and the model picks the length. Durations run 0.5–30 seconds. WHEN TO USE: - "a door creaking open", "rain on a tin roof, 10 seconds", "sci-fi laser blast", "a looping crackling campfire", "footsteps on gravel", "a notification chime". - NOT for music (use generate_music), NOT for speech or voiceover (use generate_speech), NOT for adding sound to an existing video (generate the effect here, then combine externally). AVAILABILITY: sound effects are behind a workspace feature flag. If the API rejects the task type, tell the user the feature is not enabled on their workspace and stop — do not retry. PROMPTING TIPS: name the source first ("heavy wooden door"), then the action ("slams shut"), then the space ("in a stone hallway, long reverb tail"). Mention pacing for longer effects ("starts quiet, builds to a roar"). Set loop: true for ambience or beds meant to repeat seamlessly. Max 450 characters. USER-FACING REPLIES: Talk about the sound (what it is, how long, what it's for), not the model or task machinery. Do not mention ElevenLabs unless the user asks. The output is an MP3 the viewer plays inline; headless agents get the URL from get_task. Parameters: - promptText: Required. What the sound effect should be. Max 450 characters. - duration: Optional. Length in seconds, 0.5–30. Omit to let the model choose. - loop: Optional. true to design the effect to loop seamlessly (ambience, beds). Default false. - name: Optional. Display name for the asset in the user's Runway library. Defaults to the prompt.generate_speech
ChatGPTtext and pick a voice by name. CREDIT MODE: Runway account availability is checked against the currently connected workspace. COST: 1 credit per 50 characters of text, rounded up (minimum 1). Max 5000 characters per call — split longer scripts into several calls. MODELS (pick with model; default eleven_v3): - eleven_v3: Most expressive. Understands inline delivery tags in the text such as [whispers], [laughs], [sighs], [excited]. Best for dialogue, characters, and emotive narration. - eleven_multilingual_v2: Steadier and more predictable; ignores delivery tags. Best for long neutral narration, product voiceover, and non-English text. VOICES (pick with voice; default Leslie). Choose by the user's description ("deep male narrator", "cute cartoon voice", "British woman, calm"); do not ask the user to pick from the full list unless they want to browse: - Maya: feminine, young, african american accent, chill (conversational) - Arjun: masculine, middle aged, indian accent, intense (narrator) - Serene: feminine, young, american accent, calm (narrator) - Bernard: masculine, middle aged, american accent, confident (animated) - Billy: masculine, middle aged, american accent, hyped (animated) - Mark: masculine, middle aged, american accent, excited (animated) - Clint: masculine, middle aged, american accent, husky (animated) - Mabel: feminine, middle aged, us southern accent, relaxed (narrator) - Chad: masculine, young, american accent, excited (animated) - Leslie: feminine, middle aged, american accent, professional (narrator) - Eleanor: feminine, middle aged, canadian accent, classy (narrator) - Elias: masculine, old, american accent, calm (narrator) - Elliot: masculine, middle aged, american accent, anxious (animated) - Grungle: masculine, middle aged, american accent, raspy (animated) - Brodie: masculine, young, american accent, chill (animated) - Sandra: feminine, middle aged, american accent, sassy (conversational) - Kirk: masculine, middle aged, british accent, rough (animated) - Kylie: feminine, young, australian accent, confident (influencer) - Lara: feminine, young, american accent, confident (influencer) - Lisa: feminine, young, german accent, casual (conversational) - Malachi: masculine, middle aged, american accent, confident (animated) - Marlene: feminine, middle aged, british accent, classy (narrator) - Martin: masculine, middle aged, american accent, rough (animated) - Miriam: feminine, middle aged, british accent, calm (narrator) - Monster: masculine, old, american accent, deep (animated) - Paula: feminine, middle aged, british accent, calm (conversational) - Pip: feminine, young, american accent, cute (animated) - Rusty: masculine, old, british accent, raspy (animated) - Ragnar: masculine, middle aged, american accent, deep (animated) - Xylar: neutral, middle aged, american accent, modulated (animated) - Maggie: feminine, young, american accent, calm (narration) - Jack: masculine, old, irish accent, sailor (video games) - Katie: feminine, young, american accent, soft (news) - Noah: masculine, young, american accent, calm (meditation) - James: masculine, middle aged, australian accent, casual (conversational) - Rina: feminine, young, american accent, calm (meditation) - Ella: feminine, young, american accent, emotional (narration) - Frank: masculine, young, american accent, deep (narration) - Claudia: feminine, young, british-swedish accent, seductive (characters) - Niki: feminine, middle aged, american accent, friendly (narration) - Vincent: masculine, old, australian accent, calm (news) - Tom: masculine, middle aged, british accent, authoritative (news) - Wanda: feminine, middle aged, american accent, pleasant (interactive) - Benjamin: masculine, middle aged, american accent, deep (narration) - Kiana: feminine, young, american accent, whisper (audiobook) - Rachel: feminine, young, english-swedish accent, childish (animation) WHEN TO USE: - "read this aloud", "voiceo…generate_video
ChatGPTreferenceVideo to edit/restyle it. CREDIT MODE: Runway account availability is checked against the currently connected workspace. For creative product ad videos from a product URL or product image, use generate_product_marketing_video instead. It handles product-image extraction, cinematic storyboard generation, and the final ad video. For multi-shot videos (one prompt drives 3-5 connected scenes), use generate_multishot_video instead. MODES: 1. Text-to-video — pass promptText only. Most models support this directly. gen-4-turbo auto-generates a starting frame first, then animates it. Example: "aerial drone shot, slow push forward over misty mountains at sunrise". 2. Image-to-video — pass startFrame.url (or ChatGPT's startImageFile) plus promptText to animate a still image. Use this when you want to bring a specific image to life. Example: a product photo + "slow 360 orbit around the bottle". 3. Video-to-video (edit/restyle) — pass referenceVideo.url plus a promptText describing the desired change. Use this to modify an existing video while preserving motion and composition: remove or replace backgrounds, remove unwanted objects/people, add new objects, swap backgrounds, change lighting, restyle scene, alter weather/time-of-day. Only seedance-2 (DEFAULT for v2v) and kling-o3-pro support this mode. Example: an existing dance video + "remove the background and place the dancer on a clean white studio backdrop". VIDEO EDITING REQUESTS: - If the user asks to remove a background, remove an object/person, clean up a scene, add something to an existing video, or otherwise edit footage, DO NOT say Runway MCP cannot do it. Use video-to-video: pass the source clip as referenceVideo / referenceVideoFile, default to seedance-2, and describe the edit in promptText. - For background removal, ask for or use the input video as referenceVideo and prompt for the desired replacement/background treatment, e.g. "remove the background and isolate the subject on a plain neutral studio backdrop" or "replace the background with a clean white seamless studio". DURATION DEFAULTS (the tool sets these automatically when you OMIT duration): - Text-to-video & image-to-video → 10s (or the model's largest supported value <= 10s; veo-3.1 → 8s). - Video-to-video WITH referenceVideo.durationSeconds → largest model-supported value <= source. (e.g. 20s source with kling-o3-pro {5,10,15} → 15s; 8s source with seedance-2 {4..15} → 8s.) - Video-to-video WITHOUT referenceVideo.durationSeconds → model's MAX supported duration (15s for seedance/kling) so the edit doesn't get accidentally truncated. DURATION FOR V2V — IMPORTANT: Always pass referenceVideo.durationSeconds when you know it (read it from the file metadata you uploaded). It's the only way the tool can know how much of the source to edit. - DO NOT pass duration: 5 for a 20-second source video — that will silently clip the edit to the first 5 seconds. Just OMIT duration and pass referenceVideo.durationSeconds instead, and the tool will pick the right output length. - Only set duration explicitly when the user asks for a shorter clip ("just make me a 5-second teaser of this 20-second video"). DO NOT use this tool to edit a still image → use generate_image and pass the image as referenceImages[0]. HANDLING USER ATTACHMENTS: - ChatGPT: if it supplies an uploaded image as startImageFile, pass it directly. This tool will download the temporary ChatGPT file server-side, upload it to Runway, and use it as startFrame.url. - ChatGPT: if it supplies an uploaded video as referenceVideoFile, pass it directly for video-to-video edits. This tool will download the temporary ChatGPT file server-side, upload it to Runway, and use it as referenceVideo.url. - ChatGPT: NEVER pass local paths such as /mnt/data/file.png or /mnt/data/file.mp4 as startFrame.url or referenceVideo.url; the remote MCP server cannot read them. Use startImageFile / referenceVideoFile instead. - Claude/Cursor/local agents: if the user attached a local image or video, run init_upload -> curl -> complete_upload first to get a Runway-hosted asset URL, then pass it as startFrame.url, endFrame.url, referenceImages[].url, or referenceVideo.url. REUSING ASSETS: URLs returned by other Runway tools (image outputs from generate_image, the asset URL from complete_upload) are stable, hosted asset URLs. Pass them directly into the relevant field — never re-upload. Note: outputs of generate_video itself are NOT yet usable as referenceVideo (re-upload via init_upload if needed). USER-FACING REPLIES: Pick the right model internally, but DO NOT mention the model name to the user (e.g. "using Veo 3.1", "with Seedance 2") unless they explicitly ask which model was used. Talk about the video content — subject, motion, mood — not the engine. MODELS (* = auto-generates starting frame from text): | model | tier | t2v | i2v | v2v | end | refs | audio | durations | |--------------|------|-----|-----|-----|-----|------|-------|------------| | seedance-2 | paid | Y | Y | Y | Y | Y | Y | 4-15 | | kling-o3-pro | paid | Y | Y | Y | Y | Y | Y | 5, 10, 15 | | kling-3-pro | paid | Y | Y | - | Y | - | Y | 5, 10, 15 | | gen-4.5 | paid | Y | Y | - | - | - | Y | 2-10 | | veo-3.1 | paid | Y | Y | - | Y | - | Y | 4, 6, 8 | | gen-4-turbo | any | | Y | - | - | - | - | 5, 10 | Legend: t2v = text-to-video, i2v = image-to-video (startFrame), v2v = video-to-video (referenceVideo, edit/restyle existing video), end = end-frame target, refs = reference images. * for gen-4-turbo means it auto-generates a starting frame from text. * for gen-4.5 means audio is t2v-only. Picking heuristic: - seedance-2 (DEFAULT for t2v/i2v/v2v) — best general-purpose, including existing-footage edits like removing/replacing backgrounds, removing objects/people, and adding new elements. Pick this unless you have a reason not to. - kling-o3-pro — pick when consistency matters: character/product must look identical across shots, brand or serialized content, or when v2v needs to preserve identity. Best for ads, episodic content, and product storytelling. Optimized for 1-2 main subjects. - kling-3-pro — pick when prompt fidelity matters more than reference-driven consistency: complex multi-character scenes (3+ people), crowded environments, experimental scripts, rapid ideation without reference assets. (No v2v support.) - veo-3.1 — pick when photorealism and natively-generated audio matter (Veo invents dialogue spoken by characters in-frame, plus ambient sound matched to the scene). (No v2v support.) - gen-4.5 — pick for keyframe-driven storytelling (provide a startFrame and the model anchors at timestamp 0). (No v2v support.) - gen-4-turbo — free-plan accessible option. Use it when the user explicitly wants to continue with the current account settings. (No v2v support.) Parameters: - model: One of seedance-2, kling-o3-pro, kling-3-pro, gen-4.5, veo-3.1, gen-4-turbo. Default for t2v/i2v: seedance-2. Default for v2v (when referenceVideo is set): seedance-2. Free-plan accessible option: gen-4-turbo. - promptText: Required. For t2v/i2v, describe the motion/style. For v2v, describe the edit ("remove the background", "remove the person in the left background", "add a floating logo above the table", "make it nighttime", "snow falling", "cyberpunk neon"). - ratio: Aspect ratio (16:9, 9:16, 1:1, plus 4:3, 3:4, 21:9 on some models). Ignored for v2v — the model preserves the source video's ratio. - duration: Seconds (model-dependent — see table). USUALLY OMIT — defaults to 10s for t2v/i2v, and to the largest model-supported value <= source for v2v. See DURATION DEFAULTS above. Only set explicitly when the user asks for a non-default length. - startFrame: {url} — i2v only. Animate this image. URL must be public HTTPS or a Runway-hosted asset URL. Do NOT use ChatGPT local paths like /mnt/data/...; use startImageFile for ChatGPT uploads. - startImageFile: ChatGPT-only uploaded image file param {download_url, file_id, mime_type, file_name}. Use this instead of startFrame only when ChatGPT provides a user-uploaded file. - endFrame: {url} — i2v only. Final-frame target. Requires startFrame. (seedance-2, kling-o3-pro, kling-3-pro, veo-3.1.) - referenceImages: Array of {url, tag} — i2v style/subject anchors. (seedance-2, kling-o3-pro only.) - referenceVideo: {url, durationSeconds?} — v2v source video for editing/restyling existing footage, including removing/replacing backgrounds, removing objects/people, and adding elements. URL must be a Runway-hosted /datasets/<UUID>.<ext> URL from complete_upload. Do NOT use ChatGPT local paths like /mnt/data/...; use referenceVideoFile for ChatGPT uploads. Pass durationSeconds from your file metadata when known so the model picks an appropriate output length. - referenceVideoFile: ChatGPT-only uploaded video file param {download_url, file_id, mime_type, file_name}. Use this instead of referenceVideo only when ChatGPT provides a user-uploaded video. - generateAudio: Whether to generate native audio (model-dependent; default true for audio-capable models). For v2v with kling-o3-pro, controls whether to keep the original audio. - resolution: Override default resolution (seedance: 480p/720p/1080p; veo: 720p/1080p — 1080p requires 8s).get_ad_run_status
ChatGPTget_agent_run
ChatGPTget_brand_kit
ChatGPTget_skill
ChatGPTmood-board: Create a mood board that sets the visual direction for a project — use when the user asks for a mood board, or wants to see a collection of reference images presented together in a single composed output rather than as separate standalone images. - social-thumbnail: Create a thumbnail or cover image for social media — a single still designed to grab attention with a readable headline and at most one line of subtext. Not for motion video or multi-shot pieces (use generate_video or generate_multishot_video), nor for plain illustrative stills with no headline or layout intent (use generate_image directly).get_task
ChatGPTgenerate_image, generate_video, generate_multishot_video, edit_video) return immediately with a task_pending status and a task ID; call this tool to poll for completion. Suggested cadence: wait 30-60s for image tasks, 60-120s for video tasks, then call once. If status is still PENDING/RUNNING/THROTTLED, wait another 30-60s and try again. When status is SUCCEEDED the response includes the asset URL and renders the result inline.get_workflow
ChatGPTinclude_graph: true to also load the saved graph. Optional version loads a specific version instead of latest. The graph JSON is for your next tool call — summarize the pipeline for the user; do not dump node IDs or ASCII diagrams unless they ask how it is wired. Do not invent graph JSON. list_workflows → get_workflow include_graph: true and copy nodes/edges. Read runway://docs/workflows/authoring before composing or changing a graph, runway://docs/workflows/examples for the API shape, and runway://docs/workflows/models before image/video chains.init_upload
ChatGPTfile, pass it directly. This tool will download the temporary ChatGPT file server-side, upload it to Runway, complete the upload, and return the final asset URL. Do not ask the user to run curl. CHATGPT: Do NOT call this tool with only filename, fileSize, and mimeType; that only returns curl instructions and cannot upload bytes from ChatGPT. For image-to-video, call generate_video with startImageFile. For video-to-video, call generate_video with referenceVideoFile. DO NOT USE THIS FOR: - URLs returned by generate_image, generate_video, generate_multishot_video, or edit_video. Those URLs are already stable Runway-hosted assets — pass them directly as startFrame.url / referenceImages[].url / referenceVideo.url. Re-uploading wastes a turn and creates a duplicate asset. - Any https:// URL the user pasted that is publicly fetchable. Pass it through directly. CLAUDE/CURSOR/LOCAL WORKFLOW: 1. Get the file size and MIME type using bash: ``bash wc -c < "/absolute/path/to/your/file" | tr -d ' ' file --mime-type -b "/absolute/path/to/your/file" ` 2. Call this tool with the filename, fileSize, and mimeType. 3. Use bash/curl to upload the file to the presigned URL(s). The curl commands this tool returns include -D - so the response headers (including ETag) are written to stdout. 4. Capture the ETag header from each PUT response (it looks like etag: "abc123..."; strip the surrounding quotes). 5. Call complete_upload with the uploadId AND the parts array — parts is required even for single-part uploads. 6. Use the returned assetUrl as startFrame.url / referenceImages[].url / referenceVideo.url in the generation tools. Parameters: - file: ChatGPT-only uploaded file param {download_url, file_id, mime_type, file_name}`. If present, the server completes the upload and returns an asset URL directly. - filename: Name for the uploaded file (e.g., "video.mp4") - fileSize: Size in bytes (from wc -c) - mimeType: MIME type (from file --mime-type). Supported: image/jpeg, image/png, image/webp, image/gif, video/mp4, video/quicktime, video/webmlist_brand_kits
ChatGPTget_brand_kit only after a kit is selected or when there is a single clearly applicable kit. An empty list means this workspace has no visible Brand Kits.list_recent
ChatGPTlist_workflows
ChatGPTget_workflow with include_graph: true to inspect. If a similar workflow already exists, reuse it (get_workflow / save_workflow_version / run_workflow) instead of creating a duplicate. Do not invent graph JSON. list_workflows → get_workflow include_graph: true and copy nodes/edges. Read runway://docs/workflows/authoring before composing or changing a graph, runway://docs/workflows/examples for the API shape, and runway://docs/workflows/models before image/video chains.list_workspaces
ChatGPTlocalize_ad
ChatGPTgenerate_image with referenceImages), NOT for upscaling (upscale_image). IMAGES ONLY: there is no video ad localization. If the user asks to localize a video ad, say that isn't supported yet rather than trying edit_video — Aleph rewrites frames and will not reliably retype on-screen copy. SOURCE AD REQUIREMENTS: the image must contain readable on-screen text. If it has none, the task fails with "No translatable text found in the reference image" — when that happens, tell the user the ad has no detectable copy to translate instead of retrying. High-resolution sources with clear typography localize far more reliably than heavily stylized layouts. COST: flat 21 credits per call. OUTPUT: a single localized image. HANDLING USER ATTACHMENTS: - ChatGPT: pass an uploaded image as imageFile; the tool imports it server-side. NEVER pass local paths like /mnt/data/... as image.url. - Claude/Cursor/local agents: upload local files first via init_upload -> curl -> complete_upload, then pass the returned asset URL as image.url. Outputs of generate_image can be passed directly as image.url. USER-FACING REPLIES: Talk about the localized ad and the language, not the model or task machinery. Parameters: - image: {url} — the source ad to localize. Must be a Runway-hosted asset URL (from complete_upload or generate_image) or a public HTTPS image URL. - imageFile: ChatGPT-only uploaded image file param {download_url, file_id, mime_type, file_name}. - targetLanguage: Required. ISO-style code or English name. Supported: ar (Arabic), zh (Chinese (Simplified)), zh-Hant (Chinese (Traditional)), nl (Dutch), en (English), fr (French), de (German), el (Greek), hi (Hindi), id (Indonesian), it (Italian), ja (Japanese), ko (Korean), pl (Polish), pt (Portuguese), ru (Russian), es (Spanish), sv (Swedish), th (Thai), tr (Turkish), uk (Ukrainian), vi (Vietnamese). Regional variants collapse to the base language (e.g. pt-BR -> Portuguese); zh is Simplified and zh-Hant is Traditional Chinese.message_agent_run
ChatGPTopen_3d_file
ChatGPTremove_image_background
ChatGPTgenerate_image with referenceImages), NOT for upscaling (upscale_image). For videos use remove_video_background. SOURCE IMAGE CONSTRAINTS: at most 4096px per side. Cost: 1 credit per image. If the subject can't be found in the image the task fails with "No detections found" — rephrase the subject and retry once, then tell the user what couldn't be found. OUTPUT: a PNG with an alpha channel (true transparency). HANDLING USER ATTACHMENTS: - ChatGPT: pass an uploaded image as imageFile; the tool imports it server-side. NEVER pass local paths like /mnt/data/... as image.url. - Claude/Cursor/local agents: upload local files first via init_upload -> curl -> complete_upload, then pass the returned asset URL as image.url. Outputs of generate_image can be passed directly as image.url. USER-FACING REPLIES: Talk about the cutout (what's being isolated and that the background becomes transparent), not the model or task machinery. Do not mention SAM3 unless the user asks. Parameters: - subject: Required. What to KEEP, described in a few words (e.g. "the person", "the sneaker", "the dog on the left"). Max 200 characters. - image: {url} — source image. URL must be a Runway-hosted asset URL (from complete_upload or generate_image) or a public HTTPS image URL. - imageFile: ChatGPT-only uploaded image file param {download_url, file_id, mime_type, file_name}.remove_video_background
ChatGPTinvert: true to do the opposite: cut the subject OUT and keep the background. CREDIT MODE: Runway account availability is checked against the currently connected workspace. WHEN TO USE THIS: - "remove the background", "cut out the person", "green-screen this video", "isolate the product", "make the background transparent". - NOT for replacing the background with new content (use edit_video — it can restyle or swap backgrounds in place), NOT for content generation (generate_video), NOT for sharpening (upscale_video). SOURCE VIDEO CONSTRAINTS: at most 60 seconds (~1800 frames at 30fps). Cost: 1 credit/second of input video. video.durationSeconds is REQUIRED — the task is billed by duration and the backend rejects sources without one. OUTPUT: a .webm file with an alpha channel. Warn the user that some players show transparent regions as black/gray; the transparency is real and works in editors and compositing tools. AVAILABILITY: account-gated. If the task is rejected with an "Unknown task type" error, this workspace does not have access yet — tell the user the feature isn't enabled for their account instead of retrying. HANDLING USER ATTACHMENTS: - ChatGPT: pass an uploaded video as videoFile; the tool imports it server-side. NEVER pass local paths like /mnt/data/... as video.url. Still pass video.durationSeconds (from file metadata). - Claude/Cursor/local agents: upload local files first via init_upload -> curl -> complete_upload, then pass the returned asset URL as video.url. USER-FACING REPLIES: Talk about the cutout (what's being isolated and that the background becomes transparent), not the model or task machinery. Do not mention SAM3 unless the user asks. Parameters: - subject: Required. What to KEEP, described in a few words (e.g. "the person", "the red car", "the dog on the left"). Max 200 characters. - video: {url?, durationSeconds, assetId?} — source video. URL must be a Runway-hosted /datasets/ asset URL (from complete_upload) or a public HTTPS video URL; omit it only when passing videoFile. durationSeconds is ALWAYS required. - videoFile: ChatGPT-only uploaded video file param {download_url, file_id, mime_type, file_name}. Pass the duration alongside it as video: {durationSeconds}. - keepSound: Optional, default true. Keep the source audio track in the output. - invert: Optional, default false. Remove the SUBJECT and keep the background instead.run_workflow
ChatGPTget_task to poll when no inline viewer is present or the user asks for status. Optional node_ids runs only those workflow nodes (upstream must already have succeeded). Optional node_outputs overrides constant/asset values for this run without saving a new version. Use get_workflow with include_graph: true first if you need node ids. Runway account availability is checked against the currently connected workspace. Do not invent graph JSON. list_workflows → get_workflow include_graph: true and copy nodes/edges. Read runway://docs/workflows/examples for the API shape; runway://docs/workflows/models before image/video chains.save_3d_view
ChatGPTsave_workflow_version
ChatGPTget_workflow — not { type, config }. Keep the graph minimal and its nodeProps.position layout readable: inputs left, processing center, outputs right, with no overlaps. Optional expected_version guards against stale edits (must be within 1 of latest). Response includes an editor URL. Validate first with validate_workflow_graph. Do not invent graph JSON. list_workflows → get_workflow include_graph: true and copy nodes/edges. Read runway://docs/workflows/authoring before composing or changing a graph, runway://docs/workflows/examples for the API shape, and runway://docs/workflows/models before image/video chains.search_asset_mentions
ChatGPTsearch_voices
ChatGPTgenerate_speech). Returns voices with a voiceId to pass to generate_speech with model: "eleven_v4", either as voiceId or as a dialogue line's voiceId. Free: does not spend credits. WHEN TO USE: the user wants a voice the preset list does not cover ("an old Scottish fisherman", "a Brazilian Portuguese news anchor"), or asks to browse voices. Otherwise use the preset voice names. Filters match the library's lowercase labels exactly; if a filtered search returns nothing, retry with fewer filters or with query alone. AVAILABILITY: not enabled on every workspace yet. If it is not enabled, use preset voices instead.send_moderation_feedback
ChatGPTtaskId of the blocked task. If the user said what they were trying to make, pass it as comment in their own words; ask them rather than writing it yourself.show_agent_run
ChatGPTshow_plans_and_credits
ChatGPTcreditsNeeded (the approximate credit cost of that generation, from the failed tool's cost notes) to render a shortfall card. After a generation fails because the plan does not allow it, call it with gatedCapability set to the phrase from that error to render an upgrade card. Purchases are completed on runway.com; the card only links out. When the inline card renders, keep your reply to one short sentence — the card already shows the numbers and buttons.start_credits_checkout
ChatGPTstitch_videos
ChatGPTgenerate_video shots of a story) and wants them as one video: "put these together", "combine the clips", "make it one video", "join them into a 30s ad". - The user has their own clips and wants them assembled in a specific order. WHEN NOT TO USE: - To generate a new multi-scene video from a story → generate_multishot_video. - To make one clip longer by generating more footage → expand_video / generate_video. - Side-by-side / split-screen layouts, trimming, text overlays or adding music are not supported by this tool. CLIPS: clips is the ordered list of sources. For each clip: - A video a Runway tool generated earlier in this conversation → pass {taskId} only. The server looks up the video and its duration. Do NOT ask the user to download or re-upload it. - Any other video → pass {url, durationSeconds}. durationSeconds is REQUIRED for URL clips (the stitch checks the total length against the files). Local agents: read it with ffprobe; upload local files first via init_upload -> curl -> complete_upload. - Clips should share an aspect ratio; mixed ratios are stitched but will not fill the frame consistently. TRANSITIONS: transition is cut (default, hard cuts) or crossfade. crossfadeSeconds (0.1-4.9, default 0.5) sets the overlap; each crossfade shortens the result by that amount. LIMITS & COST: total length at most 60 minutes. Cost: 1 credit per 20 seconds of total input (minimum 1 credit), so three 10s clips cost 2 credits. Paid Runway plans only — on a free workspace this returns an account-limitation result without creating a task; do not retry. USER-FACING REPLIES: Talk about the result ("joining your 3 clips into one 30s video"), not the underlying processing. Parameters: - clips: Required. 2-20 items in play order, each {taskId} or {url, durationSeconds, assetId?}. - transition: 'cut' (default) | 'crossfade'. - crossfadeSeconds: Crossfade length in seconds when transition is 'crossfade'.track_home_interaction
ChatGPTtrack_media_viewer_event
ChatGPTupscale_image
ChatGPTgenerate_image with referenceImages. CREDIT MODE: Runway account availability is checked against the currently connected workspace. PAID PLAN REQUIRED: This upscaler is not available on free Runway workspaces. If the connected workspace is on a free plan the task will be rejected with an account-limitation message — tell the user image upscaling isn't available in their current workspace and do not retry. There is no free upscaling alternative; do NOT try to fake an upscale with generate_image. WHEN TO USE: - The user wants a low-res / soft / blurry / grainy image made crisper or larger (e.g. "upscale this to 4x", "make this image higher resolution", "enhance / denoise this photo"). - The user has a finished image (their own upload, or an output from generate_image) and wants a higher-fidelity version of the exact same image. WHEN NOT TO USE: - To restyle, edit, remove/replace backgrounds or objects, or otherwise change the content → use generate_image with referenceImages[0]. - To generate a brand-new image → use generate_image. - To upscale a video → use upscale_video. INPUT: - Provide the source image as image.url: a Runway-hosted URL (from complete_upload or a generate_image output) or a public HTTPS image URL. The tool imports it into Runway automatically. - Pass image.width/image.height when known so scale-factor limits can be checked before submitting. The input must be at least 300x300px, and the output (width scaleFactor x height scaleFactor) must stay under ~25 megapixels — e.g. a 4000x3000 image only supports 1 step of 2x. FLAVOR / SCALE RULES: - flavor sublime (DEFAULT — artistic/illustrated images, smooth gradients, vibrant colors): scaleFactor 2, 4, 8, or 16. - flavor photo (photographic images, natural colors, realistic detail): scaleFactor 2 only. - flavor photo_denoiser (noise reduction for low-light/grainy photos): scaleFactor 2 only. HANDLING USER ATTACHMENTS: - Claude/Cursor/local agents: if the user attached a local image, run init_upload -> curl -> complete_upload first, then pass the returned URL as image.url. - ChatGPT: if it supplies an uploaded image as imageFile, pass it directly. NEVER pass local paths such as /mnt/data/file.png as image.url; use imageFile instead. USER-FACING REPLIES: Talk about the result ("upscaling your image 4x"), not the underlying engine. Do not mention the model/provider unless the user explicitly asks. Parameters: - image: { url, width?, height? } — the source image to upscale. URL must be public HTTPS or Runway-hosted. Do NOT use ChatGPT local paths like /mnt/data/...; use imageFile for ChatGPT uploads. - imageFile: ChatGPT-only uploaded image file param {download_url, file_id, mime_type, file_name}. - scaleFactor: 2, 4, 8, or 16. Default: 2. Factors above 2 require flavor sublime. - flavor: sublime | photo | photo_denoiser. Default: sublime. Pick photo for photographs, photo_denoiser for grainy/low-light photos. - sharpen: 0-100. Default: 10. Higher = crisper edges. - smartGrain: 0-100. Default: 10. Adds natural film-like grain to avoid a plasticky look. - ultraDetail: 0-100. Default: 30. Higher = more invented micro-detail (can drift from the source).upscale_video
ChatGPTgenerate_video (video-to-video). CREDIT MODE: Runway account availability is checked against the currently connected workspace. WHEN TO USE: - The user wants a low-res / soft / blurry video made crisper or larger (e.g. "upscale this to 4K", "make this video higher resolution", "enhance the quality of this clip"). - The user has a finished clip (their own upload, or an output from another tool that they re-uploaded) and wants a higher-fidelity version of the exact same video. WHEN NOT TO USE: - To restyle, edit, remove/replace backgrounds, remove objects, or otherwise change the content → use generate_video with referenceVideo. - To generate a brand-new video → use generate_video. INPUT: - Provide the source video as video.url. This must be a Runway-hosted /datasets/<UUID>.<ext> URL returned by complete_upload, OR a public HTTPS video URL (the tool imports it into Runway automatically). - Pass video.durationSeconds when known. Videos must be under 40 seconds. HANDLING USER ATTACHMENTS: - Claude/Cursor/local agents: if the user attached a local video, run init_upload -> curl -> complete_upload first to get a Runway-hosted asset URL, then pass it as video.url. - ChatGPT: if it supplies an uploaded video as videoFile, pass it directly. This tool will download the temporary ChatGPT file server-side, upload it to Runway, and use it as the source. NEVER pass local paths such as /mnt/data/file.mp4 as video.url; use videoFile instead. REUSING ASSETS: A URL from complete_upload is a stable, hosted asset URL — pass it directly as video.url, never re-upload. Note: outputs of generate_video are NOT yet usable as video.url here (re-upload via init_upload if needed). USER-FACING REPLIES: Talk about the result ("upscaling your video to 4K"), not the underlying engine. Do not mention the model/provider unless the user explicitly asks. Parameters: - video: { url, durationSeconds? } — the source video to upscale. URL must be public HTTPS or a Runway-hosted /datasets URL. Do NOT use ChatGPT local paths like /mnt/data/...; use videoFile for ChatGPT uploads. - videoFile: ChatGPT-only uploaded video file param {download_url, file_id, mime_type, file_name}. Use this instead of video only when ChatGPT provides a user-uploaded file.validate_workflow_graph
ChatGPTcreate_workflow or save_workflow_version. Returns task deprecations for model steps. Tell the user about upcoming sunsets and ask before switching a retired model. Graph must be API JSON (UUID node ids, nodeType, nodeOutputs) — copy from get_workflow include_graph, do not invent { type, config }. Set estimate_cost: true to also fetch a credit estimate for the graph. Do not invent graph JSON. list_workflows → get_workflow include_graph: true and copy nodes/edges. Read runway://docs/workflows/authoring before composing or changing a graph, runway://docs/workflows/examples for the API shape, and runway://docs/workflows/models before image/video chains.view_3d_model
ChatGPTwhoami
ChatGPTmultipleWorkspacesAvailable is true, the user belongs to other Runway workspaces — call list_workspaces to see them. To switch the active workspace, the user must disconnect and reconnect the MCP from their client.Capabilities
Example Prompts
Click any prompt to copy it.
Links
Similar Apps
Listed on MCP App Store
Add this badge to your site or README. It links to this page.
HTML
<a href="https://mcp-app-store.keenethics-labs.com/app/runway"><img src="https://mcp-app-store.keenethics-labs.com/badges/listed-on-mcp-app-store.svg" alt="Listed on MCP App Store" width="220" height="44"></a>
Markdown
[](https://mcp-app-store.keenethics-labs.com/app/runway)






