Skip to main content

Idea: A/B Testing Chatbot paths

  • March 28, 2025
  • 0 replies
  • 12 views

jason
Forum|alt.badge.img+8

Given that fields like IP Address and Current Hour are available when building chatbot Dynamic Variables, you can utilize these to route visitors arbitrarily to one of a couple of paths. 

This example shows using the last part of a user’s IP address (a number from 0-255) to route the user through path A or B;

Example of A/B testing chatbot paths

If their IP ends in 128-255 - sent them through Path A, otherwise (0-127) it’s Path B - this gives us a ~50-50 split.


Why do this?

You might want to test a new iteration of a path and check it’s performance with a small group of visitors (maybe limit it to 10%) before rolling out the change more widely.