Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

on_kill() operator added. #2461

Closed
wants to merge 36 commits into from

Conversation

sarthaksarthak9
Copy link
Contributor

@sarthaksarthak9 sarthaksarthak9 commented May 12, 2023

Fixes #2416

Special notes for your reviewer:

thank you for reviewing it , you all are doing an amazing work

┆Issue is synchronized with this Jira Task by Unito

@kannon92
Copy link
Contributor

Can you fix the merge conflict?

@sarthaksarthak9
Copy link
Contributor Author

sarthaksarthak9 commented May 15, 2023

Can you fix the merge conflict?

Yah, I fixed it.

@codecov
Copy link

codecov bot commented May 15, 2023

Codecov Report

All modified lines are covered by tests ✅

Comparison is base (98bcb76) 47.34% compared to head (3943a6c) 16.21%.
Report is 71 commits behind head on master.

❗ Current head 3943a6c differs from pull request most recent head 7c4cd03. Consider uploading reports for the commit 7c4cd03 to get more accurate results

Additional details and impacted files
@@             Coverage Diff             @@
##           master    #2461       +/-   ##
===========================================
- Coverage   47.34%   16.21%   -31.13%     
===========================================
  Files         395      160      -235     
  Lines       44045    12559    -31486     
  Branches      487      487               
===========================================
- Hits        20854     2037    -18817     
+ Misses      21600    10353    -11247     
+ Partials     1591      169     -1422     
Flag Coverage Δ
unittests 16.21% <ø> (-31.13%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

see 236 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@sarthaksarthak9
Copy link
Contributor Author

@kannon92 pls review the changes!!

@sarthaksarthak9
Copy link
Contributor Author

sarthaksarthak9 commented May 22, 2023

@kannon92 pls review the changes

@Sharpz7
Copy link
Contributor

Sharpz7 commented Aug 15, 2023

Can we get CI and the conflicts fixed please?

@sarthaksarthak9
Copy link
Contributor Author

Can we get CI and the conflicts fixed please?

Yes, i will try my best

@richscott
Copy link
Member

@sarthaksarthak9 If you follow the instructions in the Details link for the DCO sign-off check, and also re-merge from master, that should fix both check issues - let us know if you have any questions.

@sarthaksarthak9
Copy link
Contributor Author

@sarthaksarthak9 If you follow the instructions in the Details link for the DCO sign-off check, and also re-merge from master, that should fix both check issues - let us know if you have any questions.

okk!!

@sarthaksarthak9
Copy link
Contributor Author

sarthaksarthak9 commented Sep 13, 2023

@sarthaksarthak9 If you follow the instructions in the Details link for the DCO sign-off check, and also re-merge from master, that should fix both check issues - let us know if you have any questions.

@richscott this week , I'm involved in my university exams . I'll start working after that!!

Signed-off-by: sarthaksarthak9 <sarthaknegi908@gmail.com>
@sarthaksarthak9
Copy link
Contributor Author

@sarthaksarthak9 If you follow the instructions in the Details link for the DCO sign-off check, and also re-merge from master, that should fix both check issues - let us know if you have any questions.

is there any jobservice class exist?

@Sharpz7 Sharpz7 added the PR CI issues PR is waiting for CI fixes. label Sep 20, 2023
@richscott
Copy link
Member

is there any jobservice class exist

Well, there are several data-type definitions for Job-Service-related services:

  • the server (JobServiceServer) is defined in internal/jobservice/server/server.go
  • the SQLJobService database layer is a Go interface defined in internal/jobservice/repository/sql_job_service.go - it is basically a very thin shim over the JSRepostgres and JSRepoSQLite interface implementations. The Job Service server calls the methods on that interface to update the JS database as it receives messages from GRPC and the REST API.

Most of the code is in internal/jobservice. The GRPC definitions are in pkg/api/jobservice/. The server command (has the main() startpoint) is in cmd/jobservice/.

@kannon92
Copy link
Contributor

If you don't see a jobservice class in python, make sure to run the mage target to generate them. mage airflow-operator.

@sarthaksarthak9
Copy link
Contributor Author

is there any jobservice class exist

Well, there are several data-type definitions for Job-Service-related services:

  • the server (JobServiceServer) is defined in internal/jobservice/server/server.go
  • the SQLJobService database layer is a Go interface defined in internal/jobservice/repository/sql_job_service.go - it is basically a very thin shim over the JSRepostgres and JSRepoSQLite interface implementations. The Job Service server calls the methods on that interface to update the JS database as it receives messages from GRPC and the REST API.

Most of the code is in internal/jobservice. The GRPC definitions are in pkg/api/jobservice/. The server command (has the main() startpoint) is in cmd/jobservice/.

thank you

@sarthaksarthak9
Copy link
Contributor Author

If you don't see a jobservice class in python, make sure to run the mage target to generate them. mage airflow-operator.

thank you @kannon92

@sarthaksarthak9
Copy link
Contributor Author

sarthaksarthak9 commented Oct 3, 2023

@Sharpz7 I think unit test which I created causing CI - failure? Should I remove it !!

@Sharpz7
Copy link
Contributor

Sharpz7 commented Oct 3, 2023

@sarthaksarthak9 ideally no, if you are instead able to fix the error, it doesn't seem that hard.

@sarthaksarthak9
Copy link
Contributor Author

@sarthaksarthak9 ideally no, if you are instead able to fix the error, it doesn't seem that hard.

I'll try my best

@sarthaksarthak9
Copy link
Contributor Author

@Sharpz7 I'm getting this error. Installation of mage is done
(armada3) sarthak@hp-pavilion:~/armada$ mage airflow-operator
Unknown target specified: "airflow-operator"

also does armada remove the support of make ?

@richscott
Copy link
Member

@Sharpz7 I'm getting this error. Installation of mage is done (armada3) sarthak@hp-pavilion:~/armada$ mage airflow-operator Unknown target specified: "airflow-operator"

also does armada remove the support of make ?

Hi, Sarthak. Yes, we have removed support for using Make as a build tool for the Armada repository, and have migrated completely to Mage. The target names have been slightly altered in the Mage transition - in this case, you would run mage airflowOperator. You can get a list of all the Mage targets by running mage -l.

@sarthaksarthak9
Copy link
Contributor Author

@Sharpz7 I'm getting this error. Installation of mage is done (armada3) sarthak@hp-pavilion:~/armada$ mage airflow-operator Unknown target specified: "airflow-operator"
also does armada remove the support of make ?

Hi, Sarthak. Yes, we have removed support for using Make as a build tool for the Armada repository, and have migrated completely to Mage. The target names have been slightly altered in the Mage transition - in this case, you would run mage airflowOperator. You can get a list of all the Mage targets by running mage -l.

thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
PR CI issues PR is waiting for CI fixes.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Airflow - If you mark a dag as failed jobservice will still keep listening on the jobset.
5 participants