Skip to content

Commit

Permalink
Casting issue with s3 files list
Browse files Browse the repository at this point in the history
  • Loading branch information
rohith1122 committed Feb 6, 2024
1 parent ecfe700 commit ae7813f
Showing 1 changed file with 3 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,9 @@ def read_csv_files():
# delete the previously processed files so we have a clean workspace
bucket.objects.filter(Prefix=PROCESSED_FOLDER).delete()
# run the process for the first 8 files and this is due to the lambda timeout
postcode_location_csv_files = bucket.objects.filter(Prefix=INPUT_FOLDER, Delimiter="/")[:8]
postcode_location_csv_files = list(bucket.objects.filter(Prefix=INPUT_FOLDER, Delimiter="/"))[:8]
print(postcode_location_csv_files)


for postcode_location_csv_file in postcode_location_csv_files:
name = postcode_location_csv_file.key
Expand Down

0 comments on commit ae7813f

Please sign in to comment.