EcoSta 2024: Start Registration
View Submission - EcoSta2024
A0720
Title: Online outcome weighted learning with general loss functions Authors:  Aoli Yang - Zhejiang Normal University (China)
Jun Fan - Hong Kong Baptist University (Hong Kong)
Daohong Xiang - Zhejiang Normal University (China)
Daohong Xiang - Zhejiang Normal University (China) [presenting]
Abstract: The pursuit of individualized treatment rules in precision medicine has generated significant interest due to its potential to optimize clinical outcomes for patients with diverse treatment responses. One approach that has gained attention is outcome-weighted learning. However, traditional offline learning algorithms, which process all available data at once, face limitations when applied to high-dimensional electronic health records data due to their sheer volume. Additionally, the dynamic nature of precision medicine requires that learning algorithms can effectively handle streaming data that arrives in a sequential manner. To overcome these challenges, a novel framework is presented that combines outcome-weighted learning with online gradient descent algorithms, aiming to enhance precision medicine practices. The framework provides a comprehensive analysis of the learning theory associated with online outcome-weighted learning algorithms, taking into account general classification loss functions. The convergence of these algorithms is established for the first time, providing explicit convergence rates while assuming polynomially decaying step sizes with (or without) a regularization term. Findings present a non-trivial extension of online classification to online outcome-weighted learning, contributing to the theoretical foundations of learning algorithms tailored for processing streaming input-output-reward type data.