Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Macro runtime step change #1479

Merged
merged 1 commit into from
Dec 20, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ Feature: BigQuery sink - Verification of GCS to BigQuery successful data transfe
Then Close the pipeline logs
Then Close the preview
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "projectId" for key "gcsProjectId"
Then Enter runtime argument value "serviceAccountType" for key "serviceAccountType"
Then Enter runtime argument value "serviceAccount" for key "serviceAccount"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ Feature: BigQuery source - Verification of BigQuery to GCS successful data trans
Then Click on preview data for GCS sink
Then Close the preview data
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "projectId" for key "bqProjectId"
Then Enter runtime argument value "projectId" for key "bqDatasetProjectId"
Then Enter runtime argument value "serviceAccountType" for key "serviceAccountType"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ Feature: BigQueryExecute - Verify data transfer using BigQuery Execute plugin wi
Then Validate "BigQuery Execute" plugin properties
Then Close the Plugin Properties page
Then Save and Deploy Pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "projectId" for key "bqeProjectId"
Then Enter runtime argument value "bqExecuteQuery" for key "bqeSQl"
Then Enter runtime argument value "projectId" for key "bqeDatasetProjectId"
Expand Down
6 changes: 3 additions & 3 deletions src/e2e-test/features/bigtable/BigTableToBigTable.feature
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ Feature: BigTable source - Verification of BigTable to BigTable Successful Data
Then Close the Plugin Properties page
Then Save the pipeline
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "cbtSourceOutputSchema" for key "macroKeyString"
Then Run the Pipeline in Runtime with runtime arguments
Then Wait till pipeline is in running state
Expand Down Expand Up @@ -79,7 +79,7 @@ Feature: BigTable source - Verification of BigTable to BigTable Successful Data
Then Close the Plugin Properties page
Then Save the pipeline
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "cbtSourceOutputSchema" for key "macroKeyString"
Then Run the Pipeline in Runtime with runtime arguments
Then Wait till pipeline is in running state
Expand Down Expand Up @@ -115,7 +115,7 @@ Feature: BigTable source - Verification of BigTable to BigTable Successful Data
Then Close the Plugin Properties page
Then Save the pipeline
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "cbtSourceOutputSchema" for key "macroKeyString"
Then Run the Pipeline in Runtime with runtime arguments
Then Wait till pipeline is in running state
Expand Down
2 changes: 1 addition & 1 deletion src/e2e-test/features/gcscopy/GCSCopy_WithMacro.feature
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ Feature:GCSCopy - Verification of successful objects copy from one bucket to ano
Then Validate "GCS Copy" plugin properties
Then Close the Plugin Properties page
Then Save and Deploy Pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "projectId" for key "projectId"
Then Enter runtime argument value "gcsCsvFile" for GCSCopy property sourcePath key "SourcePath"
Then Enter runtime argument value for GCSCopy property destination path key "DestPath"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ Feature: GCSCreate - Verification of GCS Create plugin with macro arguments
Then Validate "GCS Create" plugin properties
Then Close the GCS Create properties
Then Save and Deploy Pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "projectId" for key "gcsCreateProjectId"
Then Enter runtime argument value "gcsCreateObject1" for GCSCreate property key "gcsCreateObjectsToCreate"
Then Enter runtime argument value "true" for GCSCreate property key "gcsCreateFailIfObjectExists"
Expand Down
4 changes: 2 additions & 2 deletions src/e2e-test/features/gcsdelete/GCSDelete_WithMacro.feature
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ Feature: GCS Delete - Verification of GCS Delete plugin with macro arguments
Then Validate "GCS Delete" plugin properties
Then Close the GCS Delete properties
Then Save and Deploy Pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "projectId" for key "gcsDeleteProjectId"
Then Enter runtime argument value source bucket name for key "gcsDeleteObjectsToDelete"
Then Enter runtime argument value "serviceAccountType" for key "serviceAccountType"
Expand All @@ -40,7 +40,7 @@ Feature: GCS Delete - Verification of GCS Delete plugin with macro arguments
Then Validate "GCS Delete" plugin properties
Then Close the GCS Delete properties
Then Save and Deploy Pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "projectId" for key "gcsDeleteProjectId"
Then Enter runtime argument value "gcsDeleteObjectsList" as comma separated objects for key "gcsDeleteObjectsToDelete"
Then Enter runtime argument value "serviceAccountType" for key "serviceAccountType"
Expand Down
2 changes: 1 addition & 1 deletion src/e2e-test/features/gcsmove/GCSMove_WithMacro.feature
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ Feature:GCSMove - Verification of successful objects move from one bucket to ano
Then Validate "GCSMove" plugin properties
Then Close GCSMove properties
Then Save and Deploy Pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "projectId" for key "gcsMoveProjectId"
Then Enter runtime argument value "gcsCsvFile" for GCSMove property sourcePath key "gcsMoveSourcePath"
Then Enter runtime argument value for GCSMove property destination path key "gcsMoveDestinationPath"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ Feature: PubSub-Sink - Verification of GCS to PubSub successful data transfer wi
Then Close the pipeline logs
Then Close the preview
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "projectId" for key "PubSubProjectId"
Then Enter runtime argument value "serviceAccountType" for key "serviceAccountType"
Then Enter runtime argument value "serviceAccount" for key "serviceAccount"
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ Feature: Spanner source - Verification of Spanner to Spanner Successful data tra
Then Close the pipeline logs
Then Close the preview
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Click on the Runtime Arguments Dropdown button
Then Enter runtime argument value "spannerInstance" for key "macroStringInstance"
Then Enter runtime argument value "spannerDatabase" for key "macroStringDatabase"
Then Enter runtime argument value "spannerSourceTable" for key "macroStringSourceTable"
Expand Down
Loading