JAICP updates in December 2023
New
- New tool for bot testing: quality evaluation on dialog sets.
- Integration with any classifier available on the Caila platform.
Changes
- Google Assistant is no longer supported in JAICP and Aimylogic.
Bot quality evaluation on dialog sets
Bot quality evaluation is a new tool that allows you to test a bot on dialog sets.
Each dialog contains user requests and expected bot reactions. During a test, the tool compares the received bot reactions with the expected ones.
You can upload a CSV file with a dialog set and run tests in the JAICP interface.
Comparison with automated tests
| Bot quality evaluation | Automated tests | |
|---|---|---|
| Display of results | The interface displays the test history and the percentage of successful checks for each test. You can also download detailed reports. | The interface displays notifications about test results. |
| Bot deployment | Tests run in the background and do not affect deployment. | Different modes are available: tests can block the deployment or can run in the background. |
| Checking bot reactions | You can check text responses and bot states. | You can check any reaction types. Mock objects for HTTP requests and integrations are supported. |
Integration with any Caila classifier
Earlier this year, JAICP introduced the Transformer classifier algorithm. The service that powers this algorithm runs on the Caila platform.
Now you can connect any other classifier available on the Caila platform to your JAICP project. This can be a service from the public catalog or a service of your own. To do this:
- Select the Transformer classifier in the project settings.
- Provide the parameters of the required Caila service in the advanced settings.
End of Google Assistant support
Google shut down Conversational Actions in June 2023.
The Google Assistant channel is no longer supported in JAICP and Aimylogic.
The articles on configuring Google Assistant and the htmlResponse response type were removed from the documentation.