A Minimax-MDP Framework with Future-imposed Conditions for Learning-augmented Problems
Research paper by Xin Chen and collaborators. arXiv record dated 2025-05-02. Research area: Machine learning.
Resource information
- Authors
- Xin Chen, Yuze Chen, Yuan Zhou
- Research area
- Machine learning
- Application domain
- General AI research
- AI methods
- Machine learning
- Research topics
- cs.LG, math.OC
- arXiv record date
- 2025-05-02
- Publication
- arXiv
- Upstream last modified
- May 5, 2025
- Last record update
- Nov 4, 2026
Abstract
We study a class of sequential decision-making problems with augmented predictions, potentially provided by a machine learning algorithm. In this setting, the decision-maker receives prediction intervals for unknown parameters that become progressively refined over time, and seeks decisions that are competitive with the hindsight optimal under all possible realizations of both parameters and predictions. We propose a minimax Markov Decision Process (minimax-MDP) framework, where the system state consists of an adversarially evolving environment state and an internal state controlled by the decision-maker. We introduce a set of future-imposed conditions that characterize the feasibility of minimax-MDPs and enable the design of efficient, often closed-form, robustly competitive policies. We illustrate the framework through three applications: multi-period inventory ordering with refining demand predictions, resource allocation with uncertain utility functions, and a multi-phase extension of the minimax-MDP applied to the inventory problem with time-varying ordering costs. Our results provide a tractable and versatile approach to robust online decision-making under predictive uncertainty.