Projects per year
We present an in-depth comparison of three clinical information extraction (IE) systems designed to perform entity recognition and negation detection on brain imaging reports: EdIE-R, a bespoke rule-based system, and two neural network models, EdIE-BiLSTM and EdIE-BERT, both multi-task learning models with a BiLSTM and BERT encoder respectively. We compare our models both on an in-sample and an out-of-sample dataset containing mentions of stroke findings and draw on our error analysis to suggest improvements for effective annotation when building clinical NLP models for a new domain. Our analysis finds that our rule-based system outperforms the neural models on both datasets and seems to generalise to the out-of-sample dataset. On the other hand, the neural models do not generalise negation to the out-of-sample dataset, despite metrics on the in-sample dataset suggesting otherwise.
|Title of host publication||Proceedings of the 11th International Workshop on Health Text Mining and Information Analysis|
|Publisher||Association for Computational Linguistics|
|Number of pages||14|
|Publication status||Published - 20 Nov 2020|
|Event||The 11th International Workshop on Health Text Mining and Information Analysis at EMNLP 2020 - Online Workshop|
Duration: 20 Nov 2020 → 20 Nov 2020
|Workshop||The 11th International Workshop on Health Text Mining and Information Analysis at EMNLP 2020|
|Abbreviated title||LOUHI 2020|
|Period||20/11/20 → 20/11/20|
Whiteley, W. & Sandercock, P.
1/09/10 → 28/02/16