Skip to content

Commit

Permalink
Add command, turn list of features into section
Browse files Browse the repository at this point in the history
  • Loading branch information
tsproisl committed Oct 27, 2023
1 parent 1997602 commit 148709e
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ media texts), we recommend
somajo-tokenizer --split_sentences <file> | somewe-tagger --tag <model> -
```

Features:
## Features

- Rule-based tokenization and sentence-splitting:
- [EmpiriST 2015 tokenization
Expand Down Expand Up @@ -109,6 +109,7 @@ You can use the tokenizer as a standalone program from the command
line. General usage information is available via the `-h` option:

```
somajo-tokenizer -h
usage: somajo-tokenizer [-h] [-l {en_PTB,de_CMC}]
[-s {single_newlines,empty_lines}] [-x] [--tag TAG]
[--prune PRUNE] [--strip-tags] [-c]
Expand Down

0 comments on commit 148709e

Please sign in to comment.