Skip to content

Commit

Permalink
WIP: add logger for monitoring
Browse files Browse the repository at this point in the history
  • Loading branch information
machichima committed Jan 10, 2025
1 parent a1c99ec commit 9b432ea
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions flytekit/types/structured/basic_dfs.py
Original file line number Diff line number Diff line change
Expand Up @@ -134,6 +134,7 @@ def decode(
if current_task_metadata.structured_dataset_type and current_task_metadata.structured_dataset_type.columns:
columns = [c.name for c in current_task_metadata.structured_dataset_type.columns]
try:
logger.debug(f"structured data uri: {uri}")
return pd.read_parquet(uri, columns=columns, storage_options=kwargs)
except NoCredentialsError:
logger.debug("S3 source detected, attempting anonymous S3 access")
Expand Down

0 comments on commit 9b432ea

Please sign in to comment.