Abstract
We work with 1450 concordances of 29 English verbs (50 concordances per lemma) and their corresponding entries in the Pattern Dictionary of English Verbs (PDEV). Three human annotators working independently but in parallel judged how well each lexical unit of the corresponding PDEV entry illustrates the given concordance.
Thereafter they selected one best-fitting lexical unit for each concordance - while the former setup allowed for ties (equally good matches), the latter did not. We measure the interannotator agreement/correlation in both setups and show that our results are not worse (in fact, slightly better) than in an already published graded-decision annotation performed on a traditional dictionary.
We also manually examine the cases where several PDEV lexical units were classified as good matches and how this fact affected the interannotator agreement in the bestfit setup. The main causes of overlap between lexical units include semantic coercion and regular polysemy, as well as occasionally in