Skip to content

Commit

Permalink
Refine comment on distinguishing between number of rows scanned and r…
Browse files Browse the repository at this point in the history
…ows read
  • Loading branch information
brifitz committed Jan 1, 2025
1 parent a03da1a commit 92d59cc
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions crates/polars-io/src/parquet/read/read_impl.rs
Original file line number Diff line number Diff line change
Expand Up @@ -689,8 +689,8 @@ fn rg_to_dfs_par_over_rg(
.sum();
let slice_end = slice.0 + slice.1;

// we need to distinguish between the number of rows scanned and the number of rows actually read
// these values can differ when the slice_pushdown optimization and/or the async Parquet reader are being used
// we distinguish between the number of rows scanned and the number of rows actually
// read as these values can differ when the slice pushdown optimization is used
let mut rows_scanned: IdxSize = (0..row_group_start)
.map(|i| file_metadata.row_groups[i].num_rows() as IdxSize)
.sum();
Expand Down

0 comments on commit 92d59cc

Please sign in to comment.