createFeature
ChatGPTCreate a new feature based on a URL. Checks for an existing feature with the same URL first and notifies create only if the user approved the duplication. Returns: created feature details to share with the user.
Developer Tools
Overview
Testifly helps developers, QA engineers, and product teams validate websites and web applications with automated end-to-end (E2E) testing, website checks, and UI validation directly from a URL. Run browser-based tests to verify user flows, page behavior, redirects, availability, performance, accessibility, and overall site health without any setup. Whether you're testing a production site, staging environment, preview deployment, or local environment, Testifly quickly identifies issues before they reach users. Testifly is especially valuable for AI-assisted and vibe coding workflows, where code is generated rapidly by AI coding agents. As development accelerates, automated end-to-end validation is critical to ensure features actually work in the browser. Testifly provides an independent verification layer that catches broken user flows, regressions, UI issues, and deployment problems that AI-generated code or unit tests may miss. Integrated with ChatGPT, Testifly lets you create, run, and analyze end-to-end tests using natural language. It works alongside AI development tools such as Claude Code, Cursor, GitHub Copilot, Windsurf, and other coding agents, enabling developers to verify changes continuously without writing test code. Generate structured test reports, validate bug fixes, monitor regressions, and confidently ship high-quality web applications.
Tools
createTests
ChatGPTCreate tests for a project based on the provided data. Returns: Array<{ _id: string, title: string }>
editFeature
ChatGPTEdit a feature overview and definition for a project. Returns: "OK" on success.
editTest
ChatGPTEdit a test for a project based on the provided data. Returns: "OK" on success.
getAllFeatures
ChatGPTGet all features in the project with their name, URL and overview. Returns: Array<{ featureId: string, name: string, url: string, overview: string }>
getAllTests
ChatGPTGet all tests in the project. Prefer calling getTestsByFeatureId() tool over this function as it may return tests that you don't need. Returns: Array<{ _id: string, name: string, title: string, description: string, status: string }>
getFeatureDetails
ChatGPTGet the overview and definition of a feature in the project. Returns: { featureId: string, overview: string, definition: string }
getFeatureUIComponents
ChatGPTGet the UI Components of a feature in the project. Returns: Array<{ componentId: string, name: string, description: string, elementType: string }>
getLatestRunOfTestSuites
ChatGPTGet the last run statistics for every test suite in the project. Returns an array where each entry has testRunId, testSuiteId, testSuiteName, lastRunAt, runStatus, durationMS. and counts of: totalTests, testsPassed, testsFailed, testsSkipped, testsAwaitingUserFeedback. Suites with no runs will not be returned
getPresentationGuidance
ChatGPTMUST be called at the start of every new session before any other tool. Returns guidance on how to present Testifly data to the user, including formatting rules, tone, and display conventions. Call this once per session and follow the returned instructions throughout.
getProjects
ChatGPTGet all Testifly projects the authenticated user has access to. Call this first when using OAuth authentication to discover available project IDs. Returns: Array<{ id: string, name: string, url: string }>
getTestDetails
ChatGPTGet the details of a test in the project. Returns: { name: string, title: string, status: string, description: string, collectedUiComponents: any[], steps: {description:string, expected:string}[], prerequisiteNames: any[] }
getTestRunsAndResults
ChatGPTGet the test runs of a test in the project. Returns: Array<object> (structure depends on getRunsOfTest, but typically includes run details and results)
getTestSuites
ChatGPTGet the test suites of a project. Returns: Array<{ name: string, description: string }>
getTestsByFeatureId
ChatGPTGet the tests of a feature in the project. Returns: Array<{ _id: string, name: string, title: string, description: string, status: string }>
getUIComponentsSummaryByFeature
ChatGPTGet only the name, description and elementType of UI Components for a feature. Returns: Array<{ name: string, description: string, elementType: string }>
