Use Ray and the spacy-ray extension package for parallel and distributed training. To configure the number of workers, you can change the n_workers variable in the project.yml.
The project.yml defines the data assets required by the
project, as well as the available commands and workflows. For details, see the
Weasel documentation.
The following commands are defined by the project. They
can be executed using weasel run [name].
Commands are only re-run if their inputs have changed.
| Command | Description |
|---|---|
convert |
Convert the data to spaCy's format |
train |
Train UD_English-EWT |
The following workflows are defined by the project. They
can be executed using weasel run [name]
and will run the specified commands in order. Commands are only re-run if their
inputs have changed.
| Workflow | Steps |
|---|---|
all |
convert → train |
The following assets are defined by the project. They can
be fetched by running weasel assets
in the project directory.
| File | Source | Description |
|---|---|---|
assets/UD_English-EWT |
Git |