An Online Multi-task Learning Framework for Google Feed Ads Auction Models

Citations Over TimeTop 13% of 2022 papers

Abstract

In this paper, we introduce a large scale online multi-task deep learning framework for modeling multiple feed ads auction prediction tasks on an industry-scale feed ads recommendation platform. Multiple prediction tasks are combined into one single model which is continuously trained on real time new ads data. Multi-tasking ads auction models in real-time faces many real-world challenges. For example, each task may be trained on different set of training data; the labels of different tasks may have different arrival time due to label delay; different tasks will interact with each other; combining the losses of each task is non-trivial. We tackle these challenges using practical and novel techniques such as multi-stage training for handling label delay, Multi-gate Mixture-of-Experts (MMoE) to optimize model interaction and an auto-parameter learning algorithm to optimize the loss weights of different tasks. We demonstrate that our proposed techniques can lead to quality improvements and substantial resource saving compared to modeling each single task independently.

Related Papers

• → A Comprehensive Analysis of Machine Learning Techniques in Biomedical Image Processing Using Convolutional Neural Network(2022)18 cited
• → Efficient Disease Risk Prediction based on Deep Learning Approach(2022)10 cited
• → A Survey on Deep Learning Models Embed Bio-Inspired Algorithms in Cardiac Disease Classification(2022)4 cited
• → Skin Disease Diagnostic techniques using deep learning(2022)2 cited
• → Machine Learning and Deep Learning applications-a vision using the SPSS Method(2020)