Tempura: Query Analysis with Structural Templates

Tempura: Query Analysis with Structural Templates
Tongshuang Wu;Kanit Wongsuphasawat;Donghao Ren;Kayur Patel;Chris DuBois

CHI'20: ACM CHI Conference on Human Factors in Computing Systems
Session: Speech & language

Abstract
Analyzing queries from search engines and intelligent assistants is difficult. A key challenge is organizing queries into interpretable, context-preserving, representative, and flexible groups. We present structural templates, abstract queries that replace tokens with their linguistic feature forms, as a query grouping method. The templates allow analysts to create query groups with structural similarity at different granularities. We introduce Tempura, an interactive tool that lets analysts explore a query dataset with structural templates. Tempura summarizes a query dataset by selecting a representative subset of templates to show the query distribution. The tool also helps analysts navigate the template space by suggesting related templates likely to yield further explorations. Our user study shows that Tempura helps analysts examine the distribution of a query dataset, find labeling errors, and discover model error patterns and outliers.

DOI::
WEB::

Video preview for the ACM CHI Conference on Human Factors in Computing Systems 2020

SIGCHI,Video Previews,CHI 2020,Natural Language Processing,Error Analysis,Query Analysis,