Skip to content

Latest commit

 

History

History
20 lines (17 loc) · 998 Bytes

README.md

File metadata and controls

20 lines (17 loc) · 998 Bytes
Raw

pymusas-conllu-parlamint

This repo contains the wrapper script and Dockerfile for running the PyMUSAS tagging of the CoNLL-U format of the ParlaMint project corpora translated to English

Format considerations

Previous discussions with Tomaž and Matyáš about the output format are at clarin-eric/ParlaMint#204

Set up

First, create the docker image from the Dockerfile and other files in the DockerBuild folder, naming it as follows:

docker build -t pymusas_conllu .

Tagging process per parliament zip file

Something like the following ...

  1. Unzip the file
  2. cd into directory showing all the year folders
  3. run pymusas_parlamint_wrapper.sh script
  4. monitor timestamps and output files until complete (speed is approx. 3 million words/hour on the UCREL VM)
  5. create a tar.gz of the output files
  6. copy the tarball to https://ucrel.lancs.ac.uk/paul/parlamint/PyMUSASTagged/ or some other wget-able location