Qualitative illustration using STORL. Teacher* represents the output of teacher model given clean input. Red colored texts indicate either unpredicted or mispredicted user dialogue acts.
| Goal ID: 304 | |
| User: | I would just like to find a train first, and get the info. I need to leave after 14:15. I would like to leave on Friday. I would like to depart from Cambridge. |
| User DA: | [[‘Inform’, ‘Train’, ‘none’, ‘none’], [‘Inform’, ‘Train’, ‘Leave’, ‘14:15’], [‘Inform’, ‘Train’, ‘Day’, ‘Friday’], [‘Inform’, ‘Train’, ‘Departure’, ‘Cambridge’]] |
| BERT Predicted DA: | [[‘Inform’, ‘Train’, ‘Leave’, ‘14:15’], [‘Inform’, ‘Train’, ‘Day’, ‘Friday’], [‘Inform’, ‘Train’, ‘Departure’, ‘Cambridge’]] |
| System (Teacher*): | What is your destination? |
| System (Teacher): | There is a train leaving at 15:00 would you like me to book this? What station would you like to arrive at? |
| System (STORL): | What is your destination? |
| Goal ID: 357 | |
| User: | I would just like to find a train first, and get the info. I’m looking to travel on Thursday. Can you tell me when that train will be arriving in Norwich? I also need a train departing from Cambridge. |
| User DA: | [[‘Inform’, ‘Train’, ‘none’, ‘none’], [‘Inform’, ‘Train’, ‘Day’, ‘Thursday’], [‘Inform’, ‘Train’, ‘Destination’, ‘Norwich’], [‘Inform’, ‘Train’, ‘Departure’, ‘Cambridge’]] |
| BERT Predicted DA: | [[‘Inform’, ‘Train’, ‘Day’, ‘Thursday’], [‘Inform’, ‘Train’, ‘Destination’, ‘Norwich’], [‘Inform’, ‘Train’, ‘Departure’, ‘Cambridge’]] |
| System (Teacher*): | What time do you need to arrive? Is there a certain time you are wanting to leave? |
| System (Teacher): | ‘ ‘ (Note: Policy was unable to generate any response.) |
| System (STORL): | What time do you need to arrive? Is there a certain time you are wanting to leave? |
| Goal ID: 623 | |
| User: | I need a hotel as well. I need one with Wifi. I’m looking for a place to stay in the centre. I would like it to have a 4 star rating |
| User DA: | [[‘Inform’, ‘Hotel’, ‘none’, ‘none’], [‘Inform’, ‘Hotel’, ‘Internet’, ‘yes’], [‘Inform’, ‘Hotel’, ‘Area’, ‘centre’], [‘Inform’, ‘Hotel’, ‘Stars’, ‘4’]] |
| BERT Predicted DA: | [[‘Inform’, ‘Hotel’, ‘Internet’, ‘yes’], [‘Inform’, ‘Hotel’, ‘Type’, ‘hotel’], [‘Inform’, ‘Hotel’, ‘Area’, ‘centre’], [‘Inform’, ‘Hotel’, ‘Stars’, ‘4’]] |
| System (Teacher*): | There are 2 of those. How about Alexander bed and breakfast? |
| System (Teacher): | I am sorry I have no listings for any with 4 stars. I’m sorry, there are no hotel that match your preferences. |
| System (STORL): | There are 1 of those. They have a 4 Star rating. University arms hotel looks like it would be a good choice. |
| User: | I would just like to find a train first, and get the info. I need to leave after 14:15. I would like to leave on Friday. I would like to depart from Cambridge. |
| User DA: | [[‘Inform’, ‘Train’, ‘none’, ‘none’], [‘Inform’, ‘Train’, ‘Leave’, ‘14:15’], [‘Inform’, ‘Train’, ‘Day’, ‘Friday’], [‘Inform’, ‘Train’, ‘Departure’, ‘Cambridge’]] |
| BERT Predicted DA: | [[‘Inform’, ‘Train’, ‘Leave’, ‘14:15’], [‘Inform’, ‘Train’, ‘Day’, ‘Friday’], [‘Inform’, ‘Train’, ‘Departure’, ‘Cambridge’]] |
| System (Teacher*): | What is your destination? |
| System (Teacher): | There is a train leaving at 15:00 would you like me to book this? What station would you like to arrive at? |
| System (STORL): | What is your destination? |
| User: | I would just like to find a train first, and get the info. I’m looking to travel on Thursday. Can you tell me when that train will be arriving in Norwich? I also need a train departing from Cambridge. |
| User DA: | [[‘Inform’, ‘Train’, ‘none’, ‘none’], [‘Inform’, ‘Train’, ‘Day’, ‘Thursday’], [‘Inform’, ‘Train’, ‘Destination’, ‘Norwich’], [‘Inform’, ‘Train’, ‘Departure’, ‘Cambridge’]] |
| BERT Predicted DA: | [[‘Inform’, ‘Train’, ‘Day’, ‘Thursday’], [‘Inform’, ‘Train’, ‘Destination’, ‘Norwich’], [‘Inform’, ‘Train’, ‘Departure’, ‘Cambridge’]] |
| System (Teacher*): | What time do you need to arrive? Is there a certain time you are wanting to leave? |
| System (Teacher): | ‘ ‘ (Note: Policy was unable to generate any response.) |
| System (STORL): | What time do you need to arrive? Is there a certain time you are wanting to leave? |
| User: | I need a hotel as well. I need one with Wifi. I’m looking for a place to stay in the centre. I would like it to have a 4 star rating |
| User DA: | [[‘Inform’, ‘Hotel’, ‘none’, ‘none’], [‘Inform’, ‘Hotel’, ‘Internet’, ‘yes’], [‘Inform’, ‘Hotel’, ‘Area’, ‘centre’], [‘Inform’, ‘Hotel’, ‘Stars’, ‘4’]] |
| BERT Predicted DA: | [[‘Inform’, ‘Hotel’, ‘Internet’, ‘yes’], [‘Inform’, ‘Hotel’, ‘Type’, ‘hotel’], [‘Inform’, ‘Hotel’, ‘Area’, ‘centre’], [‘Inform’, ‘Hotel’, ‘Stars’, ‘4’]] |
| System (Teacher*): | There are 2 of those. How about Alexander bed and breakfast? |
| System (Teacher): | I am sorry I have no listings for any with 4 stars. I’m sorry, there are no hotel that match your preferences. |
| System (STORL): | There are 1 of those. They have a 4 Star rating. University arms hotel looks like it would be a good choice. |
Sharing content requires targeting cookies to be enabled. Please update your cookie preferences to use this feature.