Skip to content

Latest commit

 

History

History
37 lines (32 loc) · 1.75 KB

from-parquet-cl.md

File metadata and controls

37 lines (32 loc) · 1.75 KB
Raw

from-parquet-cl

  • domain(s): classification
  • generates: ldc.api.supervised.classification.ClassificationData

Reads classification data from Parquet database files.

usage: from-parquet-cl [-h] [-l {DEBUG,INFO,WARNING,ERROR,CRITICAL}]
                       [-N LOGGER_NAME] [-i [INPUT [INPUT ...]]]
                       [-I [INPUT_LIST [INPUT_LIST ...]]] [--col_text COL]
                       [--col_label COL] [--col_id COL]
                       [--col_meta [COL [COL ...]]]

Reads classification data from Parquet database files.

optional arguments:
  -h, --help            show this help message and exit
  -l {DEBUG,INFO,WARNING,ERROR,CRITICAL}, --logging_level {DEBUG,INFO,WARNING,ERROR,CRITICAL}
                        The logging level to use. (default: WARN)
  -N LOGGER_NAME, --logger_name LOGGER_NAME
                        The custom name to use for the logger, uses the plugin
                        name by default (default: None)
  -i [INPUT [INPUT ...]], --input [INPUT [INPUT ...]]
                        Path to the parquet file(s) to read; glob syntax is
                        supported (default: None)
  -I [INPUT_LIST [INPUT_LIST ...]], --input_list [INPUT_LIST [INPUT_LIST ...]]
                        Path to the text file(s) listing the parquet files to
                        use (default: None)
  --col_text COL        The name of the column with the text (default: None)
  --col_label COL       The name of the column with the label (default: None)
  --col_id COL          The name of the column with the row IDs (gets stored
                        under 'id' in meta-data) (default: None)
  --col_meta [COL [COL ...]]
                        The name of the columns to store in the meta-data
                        (default: None)