Cleaned Polish Oscar corpus (128M above lines)
- Authors
- Sopyła, Krzysztof
- Project URL
- https://github.com/Ermlab/PoLitBert/
- Date issued
- 2021
- Type
- corpus
- Language(s)
- Polish
- Description
- Cleaned Polish Oscar corpus (part: 128M above lines, 1.93 GB). Data was prepared with a few cleaning heuristics: - remove sentences shorter than - remove non-polish sentences - remove ungrammatical sentences - perform sentence tokenization and save each sentence in a new line, after each document the new line was added
- Publisher
- Ermlab
- Subject(s)
- corpus
- Collection(s)
-