Skip to main content

AI Test Automation

To test the AI, you can upload a list of questions and an answer will be generated for each question. The answer is generated by the process as configured in the BPMN model. This includes the GPT Gateway and all GPT and other modules. The answers can be downloaded as a CSV file and evaluated.

Since the AI tests are specific to the process, you can only test the AI of a specific process. To upload test questions, navigate to the Knowledge tab of the process and click on the AI Test Automation button.

Upload file format​

The file should be a CSV or XLSX file with the following columns:

  • question: The question that should be answered by the AI.
  • locale: The locale in which the question should be answered. This is important for the language model to generate the correct answer. The locale should be in the format en, de, etc. Please note: Only locales configured in the experience are supported.

Example file content:

|----------|--------| | question | locale | |----------|--------| | What is the capital of France? | en | | Was ist die Hauptstadt von Deutschland? | de | | Suche ein Produkt mit einer Bewertung über 4 Sternen. | de | |----------|--------|