Nextmv
Solutions
Model & solve
Applications
PricingAbout
Learn
Blog
Documentation
Videos
Log inContact usTry Nextmv
Solutions
Model & solve
Applications
Pricing
About
Learn
Blogs
Documentation
Videos
Log in
Contact usTry Nextmv
Videos
Tutorial
January 23, 2024

Switchback testing decision models: Demo using Nextmv

January 23, 2024
•

Use Nextmv to compare two decision models operating in production while accounting for network effects. Create a switchback test and analyze results in the Nextmv console.

Learn more:

https://www.nextmv.io/blog/what-is-switchback-testing-for-optimization-models-and-decision-algorithms

https://medium.com/@DoorDash/switchback-tests-and-randomized-experimentation-under-network-effects-at-doordash-f1d938ab7c2a

https://doordash.engineering/2019/02/20/experiment-rigor-for-switchback-experiment-analysis/

https://arxiv.org/abs/2009.00148https://towardsdatascience.com/how-to-optimize-your-switchback-a-b-test-configuration-791a28bee678

https://www.nextmv.io/docs/reference/experiments/switchback

Presented by
Dirk Schumacher
Decision scientist
•

Up next...

Tutorial
How to perform an acceptance test for decision algorithms
Renuka Gough
•
July 26, 2023

Define the metrics that matter to your organization, run an acceptance test, and get easy-to-share results that guide your team down the path to production with confidence.

Tutorial
Determining decision model readiness using shadow tests and acceptance tests
Dirk Schumacher
•
September 14, 2023

How do you feel about the decision model updates you ship to production? Acceptance and shadow testing are two ways to gain confidence across model performance for business KPIs and stability indicators. We’ll show you how.

Feature
Decision model testing for routing, assignment, order fulfillment, and shift scheduling
Carolyn Mooney
•
June 29, 2023

Four decision algorithms, multiple experiments, one platform. Explore recently released batch testing capabilities for evaluating model changes to compare output metrics, KPIs, and prepare for acceptance and scenario tests.

Solutions
Model and solveTest and iterateDeploy and managePricingGet started free
Applications
Vehicle RoutingSchedulingPackingPrice optimization
Company
AboutCareersContact
Learn
BlogVideosForumDocumentation
Newsletter signup
© nextmv.io inc. 2024
Privacy policy
Terms of use
Cloud status