-
-
Notifications
You must be signed in to change notification settings - Fork 578
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Refactor product/ingredient import #1666
Commits on Jan 1, 2024
-
Configuration menu - View commit details
-
Copy full SHA for feb4540 - Browse repository at this point
Copy the full SHA feb4540View commit details -
Configuration menu - View commit details
-
Copy full SHA for fff7c86 - Browse repository at this point
Copy the full SHA fff7c86View commit details
Commits on Jan 23, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f5fcae9 - Browse repository at this point
Copy the full SHA f5fcae9View commit details
Commits on May 18, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 193e6ca - Browse repository at this point
Copy the full SHA 193e6caView commit details -
Configuration menu - View commit details
-
Copy full SHA for 42d2add - Browse repository at this point
Copy the full SHA 42d2addView commit details -
This allows to properly update them during imports. Currently, we were using the code field for OFF products but e.g. USDA products have their own id
Configuration menu - View commit details
-
Copy full SHA for ebd9534 - Browse repository at this point
Copy the full SHA ebd9534View commit details -
Configuration menu - View commit details
-
Copy full SHA for 741a3c7 - Browse repository at this point
Copy the full SHA 741a3c7View commit details
Commits on May 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for d5a796e - Browse repository at this point
Copy the full SHA d5a796eView commit details
Commits on May 20, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 1a0ab64 - Browse repository at this point
Copy the full SHA 1a0ab64View commit details -
Configuration menu - View commit details
-
Copy full SHA for 248f28b - Browse repository at this point
Copy the full SHA 248f28bView commit details -
Download the dataset to a temporary folder by default
Also, add some error handling for missing folders, urls, etc.
Configuration menu - View commit details
-
Copy full SHA for 53230ac - Browse repository at this point
Copy the full SHA 53230acView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5aebcd2 - Browse repository at this point
Copy the full SHA 5aebcd2View commit details -
Configuration menu - View commit details
-
Copy full SHA for aa3f49b - Browse repository at this point
Copy the full SHA aa3f49bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8c3ab81 - Browse repository at this point
Copy the full SHA 8c3ab81View commit details
Commits on May 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 5eb3783 - Browse repository at this point
Copy the full SHA 5eb3783View commit details -
Configuration menu - View commit details
-
Copy full SHA for e4c75c4 - Browse repository at this point
Copy the full SHA e4c75c4View commit details -
Configuration menu - View commit details
-
Copy full SHA for bff088e - Browse repository at this point
Copy the full SHA bff088eView commit details -
Configuration menu - View commit details
-
Copy full SHA for b234b2e - Browse repository at this point
Copy the full SHA b234b2eView commit details -
Configuration menu - View commit details
-
Copy full SHA for dc1a4d1 - Browse repository at this point
Copy the full SHA dc1a4d1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9aa837f - Browse repository at this point
Copy the full SHA 9aa837fView commit details -
Configuration menu - View commit details
-
Copy full SHA for e4a6f7e - Browse repository at this point
Copy the full SHA e4a6f7eView commit details
Commits on May 22, 2024
-
Merge branch 'refs/heads/fork/import_off_jsonl' into feature/import-u…
…sda-products # Conflicts: # wger/nutrition/management/commands/import-off-products.py
Configuration menu - View commit details
-
Copy full SHA for a6733be - Browse repository at this point
Copy the full SHA a6733beView commit details -
Now it is possible to import the OFF dumps or delta files directly from the JSONL files, without needing to import them to mongoDB
Configuration menu - View commit details
-
Copy full SHA for 3dbeb62 - Browse repository at this point
Copy the full SHA 3dbeb62View commit details -
Make sync of OFF daily delta files a celery task
This can run automatically once per day if configured
Configuration menu - View commit details
-
Copy full SHA for fdca08d - Browse repository at this point
Copy the full SHA fdca08dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 69b53e5 - Browse repository at this point
Copy the full SHA 69b53e5View commit details -
Move some common data checks to the IngredientData class
This is specially important if we regularly import the delta files, since these can have bad quality. We will probably need to add a bit more before putting this live
Configuration menu - View commit details
-
Copy full SHA for e3aa521 - Browse repository at this point
Copy the full SHA e3aa521View commit details -
Merge remote-tracking branch 'refs/remotes/origin/term-consistency' i…
…nto feature/import-usda-products # Conflicts: # wger/nutrition/off.py
Configuration menu - View commit details
-
Copy full SHA for 352c19b - Browse repository at this point
Copy the full SHA 352c19bView commit details -
Merge the branch term-consistency
Also, make sure just rename the field and don't accidentally nuke the fibre field ;)
Configuration menu - View commit details
-
Copy full SHA for 234cef4 - Browse repository at this point
Copy the full SHA 234cef4View commit details
Commits on May 23, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 91ebb8c - Browse repository at this point
Copy the full SHA 91ebb8cView commit details -
Configuration menu - View commit details
-
Copy full SHA for e3214eb - Browse repository at this point
Copy the full SHA e3214ebView commit details -
Needed because the change of "fibres" to "fiber"
Configuration menu - View commit details
-
Copy full SHA for 15a5bc0 - Browse repository at this point
Copy the full SHA 15a5bc0View commit details -
Revert "Consolidate fiber related migrations into one"
This reverts commit e3214eb.
Configuration menu - View commit details
-
Copy full SHA for 88af124 - Browse repository at this point
Copy the full SHA 88af124View commit details
Commits on May 24, 2024
-
Remove the status for ingredients
Ingredients / products will only be imported through automatic processes. We should just point users in case of missing products to Open Food Facts, and not handle this on our side. Admins can still add entries if they want.
Configuration menu - View commit details
-
Copy full SHA for 5349446 - Browse repository at this point
Copy the full SHA 5349446View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6381dbb - Browse repository at this point
Copy the full SHA 6381dbbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5e79936 - Browse repository at this point
Copy the full SHA 5e79936View commit details
Commits on May 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 6ee150f - Browse repository at this point
Copy the full SHA 6ee150fView commit details
Commits on May 29, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0dfb912 - Browse repository at this point
Copy the full SHA 0dfb912View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b6b035 - Browse repository at this point
Copy the full SHA 5b6b035View commit details -
Configuration menu - View commit details
-
Copy full SHA for fde12ad - Browse repository at this point
Copy the full SHA fde12adView commit details