Loading
About
TeamTat is free and open to all users and there is no login requirement.
Introduction
TeamTat is a novel tool for managing multi-user, multi-label document annotation. The project interface reflects
a production life cycle. Projects can specify annotation and normalization options for both entities and relations. A project
consists of a user-selected set of documents which can be automatically retrieved from PubMed/PubMed Central. Input format
can be BioC, plain text or PDF, and output format is XML with inline annotations. Since images frequently contain crucial
information or experimental evidence, TeamTat is equiped to display images for annotators’ convenience. In addition to the
web-based system, TeamTat can be setup locally.
TeamTat project managers can select annotator(s) and conveniently distribute documents anonymously to prevent bias. Multiple users can work on the same document independently in their workspaces, and the team manager can track task completion. At the end of an annotation round, the project manager can merge all individual annotations, and evaluate corpus quality via inter-annotator agreement statistics. TeamTat annotators can review the annotations and resolve disagreements, until desired quality is achieved.
TeamTat has been actively used since March 2019 for several team annotation projects at the National Library of Medicine. Our projects have generally consisted of 100-150 PubMed/PMC documents, with teams of 4-10 annotators. Word-of-mouth has generated a current active base of ~50 document annotators.
TeamTat project managers can select annotator(s) and conveniently distribute documents anonymously to prevent bias. Multiple users can work on the same document independently in their workspaces, and the team manager can track task completion. At the end of an annotation round, the project manager can merge all individual annotations, and evaluate corpus quality via inter-annotator agreement statistics. TeamTat annotators can review the annotations and resolve disagreements, until desired quality is achieved.
TeamTat has been actively used since March 2019 for several team annotation projects at the National Library of Medicine. Our projects have generally consisted of 100-150 PubMed/PMC documents, with teams of 4-10 annotators. Word-of-mouth has generated a current active base of ~50 document annotators.
Team
- Rezarta Islamaj 1 (rezarta.islamaj@nih.gov)
- Dongseop Kwon 2 (dongseop@mju.ac.kr)
- Sun Kim 1 (sun.kim@nih.gov)
- Zhiyong Lu 1 (zhiyong.lu@nih.gov)
- National Library of Medicine, National Institutes of Health, Bethesda, MD 20894, USA
- School of Software Convergence, Myongji University, Seoul 03674, South Korea
Publication
Browser compatibility
| OS | Version | Chronme | Firefox | Microsoft Edge | Safari |
|---|---|---|---|---|---|
| Linux | Ubuntu 18.04.3 LTS | 79.0.3945.88 | 71.0 | n/a | n/a |
| macOS | Mojave 10.14.6 | 79.0.3945.88 | 71.0 | n/a | 13.0.4 |
| Windows | 10 Pro (Version 1903) | 79.0.3945.88 | 71.0 | 44.18362.449.0 | n/a |
License
The MIT License (MIT)
Copyright (c) 2019 TeamTat
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
Copyright (c) 2019 TeamTat
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.