Tiffany Bogich

Product Manager
Technical product manager, research scientist, and co-founder of open-source publishing platform.‍
What is switchback testing for decision models?

It’s time to understand the behavioral impacts of a new decision model under real-world conditions compared to a production model. Switchback testing enables this, helping build confidence in a new model’s rollout in a safe and measured way.

What is shadow testing for optimization models and decision algorithms?

You’re pretty sure your staging model is ready for production. Pretty sure... But you want to test it under real-world conditions without real-world impact. Shadow testing gives your “understudy” algorithm the stage to prove its mettle.

What is scenario testing for optimization models?

Welcome to the what-if wonderland of parallel universes. What if you expand your delivery region? Or fulfill orders from stores and distribution centers? Or hire more staff? Scenario tests help provide the answers. And, no, it’s not the same as simulation.

What is acceptance testing for optimization models?

You’ve got a production decision model and an updated decision model. Should you ship the new model to prod? Will the new model meet your acceptable KPI thresholds? Acceptance testing provides the answers by delivering a documented, repeatable decision-making process.

How to optimize route operations in multiple market locations

Whether you operate in multiple market locations or want to expand into new ones, simple scenario testing can help you make decisions about vehicle fleet size, composition, and capabilities.

Determining decision model readiness using shadow tests and acceptance tests

How do you feel about the decision model updates you ship to production? Acceptance and shadow testing are two ways to gain confidence across model performance for business KPIs and stability indicators. We’ll show you how.

Build decision models with confidence: Working with testing in optimization

Optimization model testing plays a key role in ensuring smooth yet improving business operations. But the testing universe is big and sometimes unwieldy. Learn how to get started with a unified decision model testing framework.

Tools for benchmarking and testing in the optimization space

Which solver or algorithm performs better for your use case? How does your model perform under stress? See a preview of how the Nextmv platform can streamline benchmarking instances, testing scenarios, and more.

Roadmap preview: Integrations, scenario planning, and custom decision automation

Join our team for a techtalk video as they dive into the latest routing optimization features and chat about what’s coming soon to Nextmv in the decision automation space.