Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tabular module ignores ending quote #223

Open
blcham opened this issue Oct 16, 2023 · 0 comments
Open

Tabular module ignores ending quote #223

blcham opened this issue Oct 16, 2023 · 0 comments

Comments

@blcham
Copy link
Contributor

blcham commented Oct 16, 2023

  1. Download input.csv file into ~/Download directory

  2. Configure SPipes in config-core.properties:
    contexts.scriptPaths=$MY_PROJECTS/git/s-pipes-modules;$MY_PROJECTS/git/aircraft-maintenance-planning-system/aircraft-maintenance-planning-model/data;

  3. Run SPipes from bash:

cd $MY_PROJECTS/git/aircraft-maintenance-planning-system
cd aircraft-maintenance-planning-model/data/time-analysis
cp ~/Download/input.csv ./target/input.csv
./bin/retrieve-data.sh
  1. You should see the following error in SPipes log:
17-10-2023 01:42:36.704 [http-nio-8080-exec-3] ERROR c.c.s.modules.TabularModule - Reading input file failed when reading record #2 (may not reflect the line #).
 It was expected that the current record contains 28 values, but 17. element was not retrieved before whole record was processed.
The problematic record: 

Note, that the following pipeline fails only if acceptInvalidQuoting=true.


A/C:

  1. formulate when and why it happens
  2. propose a fix and validate with me
  3. in case we agree on the fix, implement it otherwise make appropriate comment to the module and the option acceptInvalidQuoting
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

No branches or pull requests

1 participant