Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement minimal built-in checks for Ibis backend #1885

Draft
wants to merge 22 commits into
base: main
Choose a base branch
from

Conversation

deepyaman
Copy link
Collaborator

@deepyaman deepyaman commented Dec 25, 2024

Base should be the updated ibis-dev from #1884

deepyaman and others added 22 commits December 24, 2024 16:18
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
* Restore accidentally-deleted use of "breakpoint()"

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Swap `types-pkg_resources` with `types-setuptools` (unionai-oss#1779)

* Swap `types-pkg_resources` with `types-setuptools`

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Update the expected error message to name variable

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Fix expected outputs for pandas-stubs 2.2.2.240807

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Update CI configuration to filter right pandas ver

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

---------

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Do not test Ibis below py3.9, add DuckDB for tests

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

---------

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
* Test model schema equivalency with optional dtypes

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Support specifying and validating optional columns

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Add DuckDB for testing and regenerate requirements

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

---------

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
* Implement minimal `coerce` and corresponding tests

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Do not exclude 3.9 in Ibis CI, and regenerate reqs

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

---------

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
* [wip] add minimal ibis check backend implementation

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* support scalar, column, and table check output types

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* support scalar, column, and table check output types

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* Ibis check backend suggestions (unionai-oss#1855)

* Apply suggestions from code review

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* Fix row-order-dependent order by adding table cols

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

---------

Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>

* fix lint

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

* fix unit tests

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>

---------

Signed-off-by: cosmicBboy <niels.bantilan@gmail.com>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Co-authored-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
@deepyaman deepyaman changed the base branch from main to ibis-dev December 25, 2024 18:40
@deepyaman deepyaman changed the base branch from ibis-dev to main December 25, 2024 18:40
Copy link

codecov bot commented Dec 25, 2024

Codecov Report

Attention: Patch coverage is 2.41758% with 444 lines in your changes missing coverage. Please review.

Project coverage is 73.45%. Comparing base (812b2a8) to head (5bb28e8).
Report is 179 commits behind head on main.

Files with missing lines Patch % Lines
pandera/backends/ibis/container.py 0.00% 92 Missing ⚠️
pandera/backends/ibis/checks.py 0.00% 66 Missing ⚠️
pandera/backends/ibis/components.py 0.00% 56 Missing ⚠️
pandera/engines/ibis_engine.py 0.00% 53 Missing ⚠️
pandera/api/ibis/model.py 0.00% 45 Missing ⚠️
pandera/backends/ibis/base.py 0.00% 41 Missing ⚠️
pandera/api/ibis/components.py 0.00% 30 Missing ⚠️
pandera/api/ibis/container.py 0.00% 13 Missing ⚠️
pandera/api/ibis/types.py 0.00% 13 Missing ⚠️
pandera/backends/ibis/register.py 0.00% 11 Missing ⚠️
... and 6 more

❗ There is a different number of reports uploaded between BASE (812b2a8) and HEAD (5bb28e8). Click for more details.

HEAD has 2 uploads less than BASE
Flag BASE (812b2a8) HEAD (5bb28e8)
48 46
Additional details and impacted files
@@             Coverage Diff             @@
##             main    #1885       +/-   ##
===========================================
- Coverage   94.28%   73.45%   -20.83%     
===========================================
  Files          91      134       +43     
  Lines        7013     9721     +2708     
===========================================
+ Hits         6612     7141      +529     
- Misses        401     2580     +2179     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants