analyze_image
ChatGPTGenerate a structured analysis of an image (content, style, brand fit). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
analyze_reference_video
ChatGPTGenerate a production brief extracted from a reference video ("make one like this"). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
analyze_voice_delivery
ChatGPTGenerate acting direction extracted from a voice track (for avatar performance). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
animate_image
ChatGPTGenerate a video clip animated from a still image (identity-locked consistency recipe). REQUIRES confirmCredits: call estimate_animate_image first, tell the user the price, and pass it back — the run is refused if the live estimate exceeds it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
assemble_video
ChatGPTA final video assembled from ordered clips with optional voiceover, music and transition local). BYO path: get_assembly_materials returns the EDL + clip links instead — local processing, no credits). Returns a jobId to poll with job_status.
blend_images
ChatGPTGenerate multiple images blended into one composition. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
boomerang
ChatGPTA boomerang (forward-reverse loop, local) — local processing, no credits). Returns a jobId to poll with job_status.
brand_assets
ChatGPTGenerate a brand asset set (profiles, covers, watermarks). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
cancel_post
ChatGPTTake a QUEUED post off the publish queue so it never goes out (it leaves the calendar). Published posts cannot be cancelled. Needs userConfirmed: true — the user asked, in this chat, to cancel THIS post. To change only the time, use reschedule_post instead.
caption_copy
ChatGPTGenerate social caption copy. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
caption_video
ChatGPTGenerate captions for a video — burned-in render, or transcript materials for your own renderer. REQUIRES confirmCredits: call estimate_caption_video first, tell the user the price, and pass it back — the run is refused if the live estimate exceeds it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
capture_frame
ChatGPTA single frame grabbed from a video at a timestamp local) — local processing, no credits). Returns a jobId to poll with job_status.
carousel
ChatGPTGenerate a social carousel (multi-slide). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
carousel_from_ref
ChatGPTGenerate a carousel styled after a reference. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
change_voice
ChatGPTGenerate the same words spoken in a different voice, keeping the timing and delivery. Use only a target voice that belongs to the user or to someone who has agreed to it; never a public figure's voice. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
character_sheet
ChatGPTGenerate a character sheet that locks an identity for reuse across scenes. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
cinematic_image
ChatGPTGenerate a cinematic marketing image (photo register). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
cinematic_video
ChatGPTGenerate a cinematic video clip. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
clean_audio
ChatGPTGenerate a cleaned-up audio track (noise/hum reduction). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
clone_voiceover
ChatGPTGenerate a voiceover in the user's own cloned voice (or the stock SoeMind voice when no reference is given). REQUIRES confirmCredits: call estimate_clone_voiceover first, tell the user the price, and pass it back — the run is refused if the live estimate exceeds it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
compare_video_providers
ChatGPTGenerate a comparison of which video engine fits a brief (advisory read). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
concat_audio
ChatGPTOrdered audio clips stitched into one track local) — local processing, no credits). Returns a jobId to poll with job_status.
confirm_upload
ChatGPTStep 2 after PUTting the bytes: registers the uploaded object and returns its fileId for transcribe_media, clone_voiceover, caption_video, dub_video, trim_clip and the rest.
content_gaps
ChatGPTTopics the audience keeps asking about that recent posts have not covered — plan the next pieces from these.
cover_image
ChatGPTGenerate a social cover image. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
create_keyframe_image
ChatGPTGenerate a keyframe image composed from the reference images you attach, ready to animate into video. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
create_project
ChatGPTCreate a new SoeMind project (brand workspace) and return its slug — every generation targets a project. Give the brand context fields when known; they seed the project brief.
create_talking_clip
ChatGPTGenerate a short talking clip (~4-15s): the character in your image speaks the dialogue you write, with a generated voice and matching lip movement. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
create_video_from_references
ChatGPTGenerate a video guided by the references you give it: reference images, a first or last frame, a reference video for motion, or reference audio. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
detect_speakers
ChatGPTGenerate speaker segmentation of an audio/video track. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
dub_video
ChatGPTGenerate a dubbed version of a video (translated script, timed voice, remixed audio). BYO path: use transcribe_media + clone_voiceover and mux yourself. REQUIRES confirmCredits: call estimate_dub_video first, tell the user the price, and pass it back — the run is refused if the live estimate exceeds it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
edit_image
ChatGPTGenerate an image edited or restyled from reference image(s) — product shots, character consistency, logo placement. REQUIRES confirmCredits: call estimate_edit_image first, tell the user the price, and pass it back — the run is refused if the live estimate exceeds it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
elevenlabs_music
ChatGPTGenerate an ElevenLabs music track. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
elevenlabs_sfx
ChatGPTGenerate a sound effect. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
elevenlabs_voiceover
ChatGPTGenerate an ElevenLabs voiceover. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
estimate_animate_image
ChatGPTCredit cost of a video clip animated from a still image (identity-locked consistency recipe) before running it. Returns the credits animate_image will require as confirmCredits.
estimate_caption_video
ChatGPTCredit cost of captions for a video — burned-in render, or transcript materials for your own renderer before running it. Returns the credits caption_video will require as confirmCredits.
estimate_clone_voiceover
ChatGPTCredit cost of a voiceover in the user's own cloned voice (or the stock SoeMind voice when no reference is given) before running it. Returns the credits clone_voiceover will require as confirmCredits.
estimate_dub_video
ChatGPTCredit cost of a dubbed version of a video (translated script, timed voice, remixed audio). BYO path: use transcribe_media + clone_voiceover and mux yourself before running it. Returns the credits dub_video will require as confirmCredits.
estimate_edit_image
ChatGPTCredit cost of an image edited or restyled from reference image(s) — product shots, character consistency, logo placement before running it. Returns the credits edit_image will require as confirmCredits.
estimate_frame_edit
ChatGPTCredit cost of a template-style edit of the user's OWN photos/clips (reveals, wipes, cut-outs, typography, grids) cut to a song or preset, 1 cr per output second with a 10 cr minimum, charged on the measured result. Every word on screen must be the user's own (text / texts / auto.words / auto.cta_text): never invent captions or calls to action. Song-driven edits: run plan_frame_edit first and pass its spec here. Text too long for the style at that size, or Burmese/Thai script, is refused with the exact reason before running it. Returns the credits frame_edit will require as confirmCredits.
estimate_image
ChatGPTEstimate the credit cost of generating a marketing image before you run it. Returns the credits that generate_image will require you to confirm.
estimate_music
ChatGPTEstimate the credit cost of generating a background music track before you run it. Returns the credits that generate_music will require you to confirm.
estimate_pipeline
ChatGPTWork out the credit price of a multi-step job (up to 8 steps, e.g. storyboard, then clips, then voiceover, then the final edit) with a per-step breakdown. Spends nothing. Tell the user this price before run_pipeline.
estimate_transcribe_media
ChatGPTCredit cost of a timestamped transcript of an audio or video file before running it. Returns the credits transcribe_media will require as confirmCredits.
estimate_video
ChatGPTEstimate the credit cost of generating a short marketing video before you run it. Returns the credits that generate_video will require you to confirm.
estimate_voiceover
ChatGPTEstimate the credit cost of generating a voiceover before you run it. Returns the credits that generate_voiceover will require you to confirm.
forget
ChatGPTDelete a saved rule by its memoryKey (project scope needs projectSlug; user scope with scope:"user").
frame_edit
ChatGPTGenerate a template-style edit of the user's OWN photos/clips (reveals, wipes, cut-outs, typography, grids) cut to a song or preset, 1 cr per output second with a 10 cr minimum, charged on the measured result. Every word on screen must be the user's own (text / texts / auto.words / auto.cta_text): never invent captions or calls to action. Song-driven edits: run plan_frame_edit first and pass its spec here. Text too long for the style at that size, or Burmese/Thai script, is refused with the exact reason. REQUIRES confirmCredits: call estimate_frame_edit first, tell the user the price, and pass it back — the run is refused if the live estimate exceeds it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
generate_hooks
ChatGPTGenerate scroll-stopping hook options. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
generate_image
ChatGPTGenerate a marketing image in one of your SoeMind projects. TEXT-TO-IMAGE ONLY — to put a real person/product/logo in the image, or to pass a reference photo, use edit_image (it takes referenceFileIds); this tool has no reference input and ignoring one silently would waste the spend. REQUIRES confirmCredits: call estimate_image first, tell the user the price, and pass it back as confirmCredits — the run is refused if the live estimate exceeds it. Billing, moderation and plan limits are enforced on your account. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
generate_music
ChatGPTGenerate a background music track in one of your SoeMind projects. REQUIRES confirmCredits: call estimate_music first, tell the user the price, and pass it back as confirmCredits — the run is refused if the live estimate exceeds it. Billing, moderation and plan limits are enforced on your account. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
generate_storyboard
ChatGPTGenerate a storyboard (keyframe set) for a multi-scene piece. Decide framing per scene NOW via pose/cameraView keys (get_presets) instead of improvising later. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
generate_text
ChatGPTGenerate marketing text/copy. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
generate_video
ChatGPTGenerate a short marketing video in one of your SoeMind projects. REQUIRES confirmCredits: call estimate_video first, tell the user the price, and pass it back as confirmCredits — the run is refused if the live estimate exceeds it. Billing, moderation and plan limits are enforced on your account. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
generate_voiceover
ChatGPTGenerate a voiceover in one of your SoeMind projects. REQUIRES confirmCredits: call estimate_voiceover first, tell the user the price, and pass it back as confirmCredits — the run is refused if the live estimate exceeds it. Billing, moderation and plan limits are enforced on your account. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
get_assembly_materials
ChatGPTBYO-rendering alternative to assemble_video: returns an EDL (ordered clips + transition) and short-lived download URLs for each clip, so the user cuts in their OWN editor instead of SoeMind rendering. Free.
get_content_calendar
ChatGPTA project's content calendar (dated plan entries + backups list).
get_file_url
ChatGPTShow one file to the user (image, video or audio play inline) and get a short-lived link to view or download it, by its file id. The preview already shows the file: do not paste the link as a markdown image.
get_presets
ChatGPTTested preset libraries — use these EXACT keys in tool args instead of describing things longhand: camera_moves (one per clip -> animate_image.cameraMove), product_shots (-> edit_image.productShot), poses and camera_views (-> edit_image), art_styles, voices. Unknown keys are rejected before any spend. Free.
get_prices
ChatGPTThe live credit price book as {"sku/unit": credits} — e.g. "seedance-2/second": 26 means 26 credits per second of Seedance 2.0 720p video.
grade_clip
ChatGPTThe clip color-graded / LUT / grain / speed local) — local processing, no credits). Returns a jobId to poll with job_status.
grid_video
ChatGPTClips arranged into a grid / split-screen local) — local processing, no credits). Returns a jobId to poll with job_status.
highlight_covers
ChatGPTGenerate Instagram highlight covers. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
image_options
ChatGPTGenerate several cheap image options to pick from before an expensive render. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
image_video_with_voiceover
ChatGPTGenerate an image animated to video with a voiceover. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
import_attachment
ChatGPTBring a file the user ATTACHED in this chat (image, video or audio) into a SoeMind project, and get its fileId for edit_image, animate_image, caption_video, dub_video, transcribe_media, clone_voiceover, vectorize_image and the rest. Use this whenever the user attaches a file and wants SoeMind to use it; do not ask them to upload it elsewhere. Free (storage counts toward their quota). Pass the project to attach it to.
isolate_voice
ChatGPTGenerate the voice isolated from background noise/music. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
job_status
ChatGPTStatus of one generation job by jobId: queued / running / succeeded / failed, outputs when done.
kinetic_reel
ChatGPTA kinetic-text reel Remotion) — local processing, no credits). Returns a jobId to poll with job_status.
lipsync_own_voice
ChatGPTGenerate lip-sync to the user's OWN recorded audio (InfiniteTalk — keep clips ≤60s). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
lipsync_video
ChatGPTGenerate an existing video lip-synced to a new audio track. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
list_assets
ChatGPTA project's registered assets (characters, products, logos, voices, styles) with their names, categories and fileIds — reuse these by name for consistency.
list_projects
ChatGPTThe user's projects, personal AND workspace (team) ones. Every generation targets one project via projectSlug (its slug, or its id when two projects share a slug). The project decides the wallet: orgId set = a workspace project that spends the workspace pool; orgId null = personal, spends the user's own credits. Say which wallet when you quote a price.
list_recent_outputs
ChatGPTRecent generations (videos, images, voiceovers) with ids, prompts, models and output file ids. Optionally scoped to one project by projectId.
list_sfx
ChatGPTThe free sound-effect catalog (metadata + when-to-use) for place_sfx. Free.
list_social_accounts
ChatGPTConnected social accounts (Facebook pages, Instagram, TikTok) available for publishing.
list_social_posts
ChatGPTThe user's publish queue and history across connected accounts. Defaults to the 20 most recent; filter by status or narrow with limit. Returns slim rows (full caption truncated) so the result stays small — read one post's full detail by its id if needed.
list_text_fx
ChatGPTAvailable text in/out/loop animations (for text_motion elements). Free.
list_transitions
ChatGPTAvailable clip transitions (for assemble_video / revise_assembly). Free.
list_uploads
ChatGPTThe user's uploaded media library (fileId, mime, size) — inputs for the fileId tools.
mix_audio
ChatGPTAudio mixed/muxed onto a video local) — local processing, no credits). Returns a jobId to poll with job_status.
multi_speaker_voiceover
ChatGPTGenerate a multi-speaker voiceover (dialogue between distinct voices). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
omni_clip
ChatGPTGenerate a Gemini Omni clip (precise instruction-following, art styles, edit task). duration MUST be exactly 4, 6, 8 or 10 seconds — no other value is accepted. artStyle must be a preset KEY (get_presets kind=art_styles) and the user picks it, never chosen silently. Omni speaks in Gemini’s own voice (rough Burmese) — for a cloned/own voice, generate silent then run change_voice or infiniteTalk lipsync. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
openai_image
ChatGPTGenerate an image from GPT Image (strong text rendering). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
overlay_media
ChatGPTOne media overlaid on another (logo bug, PiP, local) — local processing, no credits). Returns a jobId to poll with job_status.
package_content
ChatGPTOutputs packaged to platform export specs — local processing, no credits). Returns a jobId to poll with job_status.
place_sfx
ChatGPTSound effects placed on a video at timestamps local) — local processing, no credits). Returns a jobId to poll with job_status.
plan_frame_edit
ChatGPTA FREE plan of which clip plays at which second for a template edit of the user's photos/clips (song beats, energy sections and drops, or a preset). Nothing renders. Show the user the plan, apply their changes to the returned spec, then run frame_edit with that spec and the same song. Read the job's JSON output for clips[] (start/end/style/media index/text), spec, musicProfile + profileReason, song — local processing, no credits). Returns a jobId to poll with job_status.
profile_image
ChatGPTGenerate a profile picture. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
read_guide
ChatGPTRead a SoeMind production playbook BEFORE writing prompts — the playbooks carry tested rules; do not improvise. Call read_guide("index") first for the full topic map (~60 guides with when-to-use). Free.
reframe_image
ChatGPTGenerate the image reframed to a new aspect ratio. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
reframe_video
ChatGPTGenerate the video reframed to a new aspect ratio. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
register_asset
ChatGPTPromote an uploaded/generated file into a NAMED, typed project asset (the consistency registry the guides describe). Use this so a cloned voice, a locked character, a product or logo can be reused by name across pieces instead of re-passing a raw fileId. category 'voice' answers the saved-voice ask; 'character' locks a face. Pass the sourceFileId and a short name.
remember
ChatGPTSave a standing user rule the way the in-app director does: every correction ('always 4:5', 'logo on top', 'no supporting text') is a RULE, not one-off feedback. Use a stable memoryKey so repeats UPDATE instead of piling up. Scope 'project' needs projectSlug; scope 'user' applies everywhere.
remove_image_bg
ChatGPTGenerate the image with its background removed (transparent PNG). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
remove_video_bg
ChatGPTGenerate the video with its background removed. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
render_captions
ChatGPTCaptions burned from YOUR cue list Remotion render). cues come from transcribe_media timings — local processing, no credits). Returns a jobId to poll with job_status.
render_edit
ChatGPTA full timeline edit document rendered to video Remotion) — the power tool behind the Cut editor — local processing, no credits). Returns a jobId to poll with job_status.
render_lottie
ChatGPTGenerate a Lottie animation rendered to video (.webm keeps alpha and plays in the app; .mov = ProRes master for editors; .mp4/.gif flatten). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
render_scenes
ChatGPTScene compositions rendered Remotion) — local processing, no credits). Returns a jobId to poll with job_status.
render_title_template
ChatGPTGenerate an animated title with alpha (.webm) from a preset (bounce-words, typewriter, fade-up, tracking-in, drop-lines, blur-in, scramble, jitter). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
request_upload
ChatGPTStep 1 of bringing the user's own media into SoeMind (a voice reference, a video to caption/dub/trim). Returns a short-lived presigned PUT url and a storage key: PUT the raw file bytes to the url (Content-Type = the same mime), then call confirm_upload with the key. Type/size limits and storage quota are enforced.
reschedule_post
ChatGPTChange when a draft or queued post goes out (ids from list_social_posts). Only draft/queued posts can move; published or mid-publish ones cannot. Moving a QUEUED post changes when it really publishes, so it needs userConfirmed: true — the user asked, in this chat, to move THIS post. Use this to re-time a plan; never re-create a queued post to move it (both would publish).
review_image_prompt
ChatGPTGenerate a pre-spend review of an image prompt. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
review_script
ChatGPTGenerate a pre-spend review of a script (pacing, restrictions). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
review_thumbnail
ChatGPTGenerate a pre-spend review of a thumbnail plan. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
review_video_prompt
ChatGPTGenerate a pre-spend review of a video prompt. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
revise_assembly
ChatGPTThe assembly re-cut from a revised EDL local). NEVER re-cut an assembled output - revise the EDL and re-assemble from sources — local processing, no credits). Returns a jobId to poll with job_status.
run_pipeline
ChatGPTRun a multi-step job (up to 8 steps, e.g. storyboard, then clips, then voiceover, then the final edit) in the user's project as one background job. Spends credits only when confirmCredits covers the estimate_pipeline price the user approved; otherwise it returns the price and runs nothing. Returns a jobId for job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
schedule_post
ChatGPTCreate a social post. DEFAULTS TO A DRAFT on the Social calendar — drafts can never publish by accident and a human presses post in the app. status 'queued' REALLY PUBLISHES to the user's audience (at scheduledAt, or ~now without it) and is allowed ONLY when the human in this chat explicitly asked to post THIS content — attest that with userConfirmed: true, and never infer it. Media must be the user's own fileIds. TikTok accounts take video/reel only and are delivered to the creator's TikTok INBOX: the user finishes the post in the TikTok app (privacy, TikTok's music terms, caption - paste it, TikTok's inbox takes none). There is nothing to confirm here for TikTok; never ask the user to agree to music terms on their behalf.
screen_guide
ChatGPTA screen-guide walkthrough render — local processing, no credits). Returns a jobId to poll with job_status.
search_stock
ChatGPTSearch licensed Pexels stock photos and video B-roll — free, no credits, the cheap alternative to generating generic footage. Returns candidates with preview, downloadUrl, dimensions and REQUIRED photographer attribution. Pick one, then call use_stock.
seedance_image_video
ChatGPTGenerate a Seedance image-to-video clip. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
seedance_multi_ref
ChatGPTGenerate a Seedance clip locked to multiple reference images. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
seedance_multi_shot
ChatGPTGenerate a multi-shot Seedance sequence. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
seedance_text_video
ChatGPTGenerate a Seedance text-to-video clip (integrated audio). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
separate_stems
ChatGPTAudio split into stems (vocals / music) — local Demucs — local processing, no credits). Returns a jobId to poll with job_status.
slide_still
ChatGPTA designed slide still Remotion) — local processing, no credits). Returns a jobId to poll with job_status.
social_insights_audience
ChatGPTAudience growth and composition for connected accounts.
social_insights_overview
ChatGPTAccount-level performance overview (views, reach, engagement, follower growth) for the user's connected accounts over 7/30/90 days.
social_insights_posts
ChatGPTPer-post metrics read against the account baseline — what actually worked. Feed this into the next plan.
speaking_video
ChatGPTGenerate a speaking-character video (the engine voices the script). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
speaking_video_from_image
ChatGPTGenerate a speaking-character video from a still image. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
stock_attribution
ChatGPTThe Pexels attribution lines required for stock used in a project — local processing, no credits). Returns a jobId to poll with job_status.
suggest_text_design
ChatGPTGenerate a vision-advised text/overlay design for a frame. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
suggest_text_placement
ChatGPTGenerate vision-advised safe text placement for a frame. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
suggest_voice_settings
ChatGPTGenerate voice-delivery settings suggested for a script (advisory LLM read). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
talking_avatar
ChatGPTGenerate a talking avatar video from a still + audio. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
text_motion
ChatGPTAn animated text/graphics overlay video Remotion). wordByWord/letterByLetter strip per-span colors — use rise/fadeUp for multi-color text; read_guide topic caption_direction first — local processing, no credits). Returns a jobId to poll with job_status.
thumbnail
ChatGPTGenerate a click-optimized video thumbnail. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
transcribe_media
ChatGPTGenerate a timestamped transcript of an audio or video file. REQUIRES confirmCredits: call estimate_transcribe_media first, tell the user the price, and pass it back — the run is refused if the live estimate exceeds it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
transform_video
ChatGPTA video transform (crop/rotate/mirror/speed, local) — local processing, no credits). Returns a jobId to poll with job_status.
trim_audio
ChatGPTA trimmed audio section local) — local processing, no credits). Returns a jobId to poll with job_status.
trim_clip
ChatGPTA trimmed section of a video local cut) — local processing, no credits). Returns a jobId to poll with job_status.
use_stock
ChatGPTImport one chosen Pexels result into a project (free) so other tools can use it — pass the downloadUrl and mime exactly as search_stock returned them. Keep the attribution with any published use.
vectorize_image
ChatGPTGenerate a clean SVG traced from a raster logo or icon (flat-logo mode by default; auto-color for photo-like art). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
video_from_keyframe
ChatGPTGenerate a clip animated from one approved keyframe. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
video_from_keyframes
ChatGPTGenerate a clip that travels FROM a first frame TO a last frame (first+last keyframe control). PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
video_from_refs
ChatGPTGenerate full-control image-to-video: asset references (up to 3: character sheet / environment / prop), optional useAsFirstFrame, optional last frame — the raw engine behind animate_image. State each reference image’s ROLE in the prompt. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
video_to_gif
ChatGPTThe clip converted to a GIF local) — local processing, no credits). Returns a jobId to poll with job_status.
video_with_voiceover
ChatGPTGenerate a video generated together with a voiceover. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
whoami
ChatGPTThe connected SoeMind account: email, PERSONAL credit balance, available credits (after holds), daily spend, and every WORKSPACE the user belongs to with its shared pool. Which wallet pays is decided by the project: a workspace project spends the workspace pool (within the member's monthly budget), a personal project spends the user's own credits. Call this first to confirm the connection.
write_script
ChatGPTGenerate a video/voiceover script. PRICED: first call WITHOUT confirmCredits to get the credit quote (nothing runs, nothing is spent), tell the user, then retry with confirmCredits covering it. Returns a jobId to poll with job_status. BLOCKED (do not attempt): named or clearly identifiable celebrities, politicians and other public figures (also refused by the video providers); sexual or nude content, anything sexualizing a minor; a real person shown humiliated, arrested or in a false/defamatory scene; deepfake/face-swap/"make him say" requests; fraud material (fake IDs, bank pages, invoices). For a person from a reference photo, say whose photo it is in the prompt ("Reference 1 is the user's own portrait, uploaded by them"). On MODERATION_BLOCKED stop and tell the user, never retry: 3 blocks in 24h pause all generation.
