The Eighth Dialog System Technology Challenge


May 25, 2020 - Call for IEEE/ACM TASLP Special Issue Papers is now online.

March 10, 2020 - DSTC9 website in online.

January 27, 2020 - DSTC9 Track Proposals are available here.

January 15, 2020 - Workshop Program is now online.

December 10, 2019 - AAAI-20 online registration is open by January 10, 2020 (Early registration by December 13, 2019)

November 25, 2019 - We are looking for sponsors for DSTC8 workshop. More details can be found here.

November 25, 2019 - Call for DSTC9 Track Proposals is now online.

November 17, 2019 - DSTC8 overview paper is now online.

November 15, 2019 - Paper submission deadline has been extended to Nov 17, 2019.

November 5, 2019 - DSTC8 workshop will be held on Feb 8, 2020 at AAAI-20.

October 28, 2019 - 'Multi-domain Task Completion' track results are available here.

October 22, 2019 - 'NOESIS II' track results are available here.

October 21, 2019 - 'Schema-Guided Dialogue State Tracking' track results are available here.

October 14, 2019 - Paper Submission is now open.

August 16, 2019 - DSTC8 workshop will be held at AAAI-20.

June 21, 2019 - The detailed timelines are available at Important Dates.

June 19, 2019 - 'NOESIS II: Predicting responses, identifying success, and managing complexity in task-oriented dialogue' track resources are available here.

June 18, 2019 - 'Audio Visual Scene-Aware Dialog' track resources are available here.

June 17, 2019 - 'Schema-Guided Dialogue State Tracking' track details are available here.

June 17, 2019 - 'Multi-domain Task Completion' track resources are available here.

June 13, 2019 - All the track websites are now online. Click here to find the links.

June 11, 2019 - Challenge registration has opened! Please fill out this form.

April 23, 2019 - Now we have a new timeline starting the challenge period on Jun 17, 2019. [Details]

April 2, 2019 - A new DSTC mailing list launched [Details]

April 1, 2019 - DSTC8 website launched

Background and Motivation

Starting as an initiative to provide a common testbed for the task of Dialog State Tracking, the first Dialog State Tracking Challenge (DSTC) was organized in 2013, followed by DSTC2&3 in 2014, DSTC4 in 2015, and DSTC5 in 2016. Given the remarkable success of the first five editions, and understanding both, the complexity of the dialog phenomenon and the interest of the research community in a wider variety of dialog related problems, the DSTC rebranded itself as "Dialog System Technology Challenges" for its sixth edition. Then, DSTC6 and DSTC7 have been completed in 2017 and 2018, respectively.

In this eighth challenge, the call for task proposals has resulted into the following four different tracks: (1) Multi-domain Task Completion, (2) NOESIS II: Predicting Responses, Identifying Success, and Managing Complexity in Task-Oriented Dialogue, (3) Audio Visual Scene-Aware Dialog Track, and (4) Scalable Schema-Guided Dialogue State Tracking. The objective of these tracks is to invite interested organizations conduct dialog related challenges in specific areas of research and under the umbrella of the DSTC.

DSTC8 Organizations

The 8th Dialog System Technology Challenge (DSTC8) is supported by Microsoft Research, IBM Research, and Amazon Alexa AI.

Workshop Sponsors