-
Notifications
You must be signed in to change notification settings - Fork 112
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
world_bank_datasets #1075
base: master
Are you sure you want to change the base?
world_bank_datasets #1075
Conversation
@@ -334,7 +348,7 @@ def load_stat_vars(stat_var_file): | |||
else: | |||
logging.error('SKIPPED stat var row: %s', csv_row) | |||
|
|||
logging.info(svs) | |||
#logging.info(svs) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please remove commented line.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code looks good, so approved the changes.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- Please add Readme.md file
- Update copyright year to 2024
logging.info('Writing response to file %s', response_file) | ||
json.dump(response, f, indent=2) | ||
return response | ||
try: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If the download fails for existing data, better to abort the processing as autorefresh with partial data will result in deletions in prod.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We have one tMCF file and multiple CSV files. So can we add wildcards in CSV Paths instead of referring to each individual CSV file?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please fix the comments
Auto refresh for https://github.com/datacommonsorg/data/tree/master/scripts/world_bank/datasets (PR#892).