Skip to content

Commit

Permalink
gcs failure tests fix
Browse files Browse the repository at this point in the history
  • Loading branch information
itsmekumari committed Oct 4, 2023
1 parent f75f09d commit d3cda7d
Show file tree
Hide file tree
Showing 3 changed files with 11 additions and 7 deletions.
8 changes: 4 additions & 4 deletions src/e2e-test/features/gcs/source/GCSourceSchema.feature
Original file line number Diff line number Diff line change
Expand Up @@ -38,14 +38,14 @@ Feature: GCS source - Validate GCS plugin output schema for different formats
Examples:
| GcsPath | FileFormat | ExpectedSchema |
| gcsTextFile | text | gcsTextFileSchema |
@GCS_PARQUET_TEST @CDAP-18494
@GCS_PARQUET_TEST
Examples:
| GcsPath | FileFormat | ExpectedSchema |
| gcsParquetFile | parquet | gcsParquetFileSchema |
@GCS_AVRO_TEST @CDAP-18494
@GCS_AVRO_FILE
Examples:
| GcsPath | FileFormat | ExpectedSchema |
| gcsAvroFile | avro | gcsAvroFileSchema |
| GcsPath | FileFormat | ExpectedSchema |
| gcsAvroAllDataFile | avro | gcsAvroAllTypeDataSchema |

@GCS_Source
Scenario Outline:GCS Source output schema validation for delimited files
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -28,10 +28,9 @@
features = {"src/e2e-test/features"},
glue = {"io.cdap.plugin.gcs.stepsdesign", "io.cdap.plugin.bigquery.stepsdesign",
"stepsdesign", "io.cdap.plugin.common.stepsdesign"},
tags = {"@GCS_Source and not @PLUGIN-823 and not @PLUGIN-1113 and not @CDAP-18494 and not @PLUGIN-825"},
tags = {"@GCS_Source and not @PLUGIN-823 and not @PLUGIN-1113 and not @PLUGIN-825"},
/* TODO :Enable tests once issues fixed https://cdap.atlassian.net/browse/PLUGIN-823,
https://cdap.atlassian.net/browse/PLUGIN-1113,
https://cdap.atlassian.net/browse/PLUGIN-825, https://cdap.atlassian.net/browse/CDAP-18494 */
https://cdap.atlassian.net/browse/PLUGIN-1113, https://cdap.atlassian.net/browse/PLUGIN-825 */
monochrome = true,
plugin = {"pretty", "html:target/cucumber-html-report/gcs-source",
"json:target/cucumber-reports/cucumber-gcs-source.json",
Expand Down
5 changes: 5 additions & 0 deletions src/e2e-test/resources/pluginParameters.properties
Original file line number Diff line number Diff line change
Expand Up @@ -154,6 +154,11 @@ gcsInvalidMinSplitSize=10000000000000000000000000
gcsInvalidRegexPathFilter=\\\is
gcsInvalidFileSysProperty=**
gcsInvalidRefName=invalidRef&^*&&*
gcsParquetFileSchema=[{"key":"workforce","value":"string"},{"key":"report_year","value":"long"},\
{"key":"gender_us","value":"string"},{"key":"race_asian","value":"long"},\
{"key":"race_black","value":"long"},{"key":"race_hispanic_latinx","value":"long"},\
{"key":"race_native_american","value":"long"},{"key":"race_white","value":"long"},\
{"key":"tablename","value":"string"}]
## GCS-PLUGIN-PROPERTIES-END

## BIGQUERY-PLUGIN-PROPERTIES-START
Expand Down

0 comments on commit d3cda7d

Please sign in to comment.