Skip to main content

Creating Custom Tests

J
Written by Jaquez Hodo
Updated this week

Feature availability: This article discusses Custom Tests, which may require an upgrade or add-on. Refer to Vanta Plans and Pricing for details.

With Custom Tests, Vanta users can use Vanta-built tests or create their own and map them to controls and frameworks. If the option to create custom tests is unavailable to you, alternative methods such as using the Documents page can serve similar purposes.

Ways to Create Custom Tests

All of the options below are part of the Custom Tests feature. You can create custom tests in one of three ways:

  • Configure a test parameter (on select Vanta-built tests)

  • Copy an existing test (Vanta-built or custom)

  • Create a Custom Test

Configure a Test Parameter

Some Vanta-built tests allow you to customize a parameter like the number of days before an account should be deactivated or the branch name for production repositories.

  1. Go to the Tests page

  2. Open the test you’d like to configure

  3. Select the Evidence tab (formerly called Source Data)

  4. Adjust the available field(s) to match your policy

Please note: Only a limited set of Vanta-built tests support configurable parameters. If you think a test would benefit from customization, you can provide feedback to your Customer Success team.

Copy an Existing Test

Some Vanta-built and custom tests can be copied and modified to suit your needs.

  1. From the Tests page, select the test you want to copy

  2. Click the Evidence tab (formerly called Source Data)

  3. Choose Copy test

  4. Edit the name, logic, and details to create a new test

You can also copy your own existing custom tests to make variants.

Please note: When you copy a test in Vanta, there are a few important things to keep in mind. The new test won’t carry over any control mappings, so you’ll need to manually add those after copying. You’ll also need to assign an SLA category and test owner. And because custom tests can’t be edited after they’re created, any future changes will require making a new copy of the test.

Creating a Custom Test

  • From the Tests page, select + Create custom test

Screenshot 2025-03-06 at 4.26.06 PM.png
  • Add:

    • Test name

    • Description

    • How to fix/remediate instructions

  • From the drop-down, select the integration the custom test will be associated with, you cannot currently create a custom test that is not tied to an integration

Screenshot 2024-06-28 at 3.02.39 PM.png
  • Use the simple logic builder to build the test

  • Select Create

Mapping the Test to Controls

  • From the Tests page, select the Custom tab

  • Search for your test

Screenshot 2024-06-28 at 3.09.03 PM.png
  • Select the test

  • Open the Controls tab

Screenshot 2024-06-28 at 3.10.57 PM.png
  • Select Add control

  • Choose the controls you would like mapped to this test, and click Add

Screenshot 2024-06-28 at 3.12.04 PM.png

Finalizing and Managing Custom Tests

After creating or copying a test, be sure to:

  • Map it to controls (this is not automatic)

  • Assign an SLA category

  • Assign test owners

  • Deactivate the original test if you no longer need it

These final steps ensure the test integrates into your program and is monitored properly.

Please note: Custom tests can now support both automated checks and manual inputs. This feature allows creating unique tests to validate security program elements either automatically or through manual evidence when required.