Binary package “ucto” in ubuntu disco

Unicode Tokenizer

 Ucto can tokenize UTF-8 encoded text files (i.e. separate words from
 punctuation, split sentences, generate n-grams), and offers several other
 basic preprocessing steps that make your text suited for further processing
 such as indexing, part-of-speech tagging, or machine translation.
 .
 This package provides the command-line tool itself.
 .
 Ucto was written by Maarten van Gompel and Ko van der Sloot. Work on Ucto
 was funded by NWO, the Netherlands Organisation for Scientific Research,
 under the Implicit Linguistics project, the CLARIN-NL program, and the
 CLARIAH project.
 .
 Ucto is a product of the Centre of Language and Speech Technology (Radboud
 University Nijmegen), and previously the ILK Research Group
 (Tilburg University, The Netherlands).
 .
 If you are interested in machine parsing of UTF-8 encoded text files, e.g. to
 do scientific research in natural language processing, ucto will likely be of
 use to you.