DRL4IR: The 2nd Workshop on Deep Reinforcement Learning for Information Retrieval at SIGIR'21

July 15 - 16, 2021

Zoom Link

Zoom Link (backup)

INTRO

Information retrieval (IR) techniques, such as search, recommendation and online advertising, satisfying users’ information needs by suggesting users personalized objects (information or services) at the appropriate time and place, play a crucial role in mitigating the information overload problem. Since the widely use of mobile applications, more and more information retrieval services have provided interactive functionality and products. Thus, learning from interaction becomes a crucial machine learning paradigm for interactive IR, which is based on reinforcement learning. With recent great advances in deep reinforcement learning (DRL), there have been increasing interests in developing DRL based information retrieval techniques, which could continuously update the information retrieval strategies according to users’ real-time feedback, and optimize the expected cumulative long-term satisfaction from users.

Our workshop is a full-day workshop DRL4IR at SIGIR 2021, with the aim to provide a venue, which can bring together academia researchers and industry practitioners (i) to discuss the principles, limitations and applications of DRL for information retrieval, and (ii) to foster research on innovative algorithms, novel techniques, and new applications of DRL to information retrieval.

PROGRAM

Session 1 (Jul 15, 2021)

Zoom Link

Zoom Link (backup)

5:00am-8:00am, LA time     8:00am-11:00am, New York Time

1:00pm-4:00pm, London Time      8:00pm-11:00pm, Beijing Time

  • [Openning for the 1st Session]
  • Weinan Zhang (Shanghai Jiao Tong University)
  • [Keynote 1] Online Learning to Rank with Click Models: An Overview [Slides]
  • Shuai Li (Shanghai Jiao Tong University)
  • [Invited Talk 1] Offline reinforcement learning for recommendation [Slides]
  • Xin Xin (University of Glasgow)
  • [Paper Talk 1] Hierarchical Reinforcement Learning for Aggregated Search [PDF] [Slides]
  • Pu Yang and Yin Zhang (Zhejiang University)
  • [Paper Talk 2] Hierarchical Multi-Agent Reinforcement Learning for Allocating Guaranteed Display Ads [PDF] [Slides]
  • Lu Wang, Lei Han, Wei Zhang, Xinru Chen, Chengchang Li, Weinan Zhang, Xiaofeng He and Dijun Luo (East China Normal University, Tencent and SJTU)
  • [Invited Talk 2] Towards More Realistic User Long Term Engagement Modeling in Recommender Systems [Slides]
  • Xu Chen (Renmin University)
  • [Paper Talk 3] Imitation from Learning-based Oracle for Universal Order Execution in Quantitative Finance [PDF] [Slides]
  • Yuchen Fang, Kan Ren, Weiqing Liu, Dong Zhou, Weinan Zhang and Yong Yu (SJTU and MSRA)




  • Session 2 (Jul 15 or 16, 2021)

    Zoom Link

    Zoom Link (backup)

    5:00pm-8:00pm (15 Jul), LA time      8:00pm-11:00pm (15 Jul), New York Time

    1:00am-4:00am (16 Jul), London Time      8:00am-11:00am (16 Jul), Beijing Time

  • [Review and Openning for the 2nd Session]
  • Grace Hui Yang (Goergetown University)
  • [Invited Talk 3] Information Retrieval and AI
  • Grace Yang (Goergetown University)
  • [Keynote 2] Off-policy Evaluation and Learning for Interactive Systems [Slides]
  • Yi Su (Cornell University)
  • [Paper Talk 4] DeepQAMVS: Query-Aware Hierarchical Pointer Networks for Multi-Video Summarization [PDF] [Slides]
  • Safa Messaoud, Ismini Lourentzou, Assma Boughoula, Mona Zehni, Zhizhen Zhao, Chengxiang Zhai and Alexander Schwing (UIUC)
  • [Invited Talk 4] Ranking Policy Gradient [Slides]
  • Kaixiang Lin (Michigan State University)
  • [Paper Talk 5] Balancing Accuracy and Fairness for Interactive Recommendation with Reinforcement Learning [PDF] [Slides]
  • Weiwen Liu and Ruiming Tang (Huawei Noah's Ark Lab)
  • [Invited Talk 5] Model-based Reinforcement Learning and its Potential Use in IR [Slides]
  • Weinan Zhang (Shanghai Jiao Tong University)
  • ORGANIZERS

    Image

    Weinan Zhang Shanghai Jiao Tong University

    Image

    Xiangyu Zhao City University of Hong Kong

    Image

    Li Zhao Microsoft Research Asia (MSRA)

    Image

    Dawei Yin Baidu

    Image

    Grace Hui Yang Georgetown University