Code

Refactor product/ingredient import#1666

Code

Merged

rolandgeider merged 39 commits intomasterwger-project/wger:masterfrom feature/import-usda-productswger-project/wger:feature/import-usda-productsCopy head branch name to clipboardMay 29, 2024

+1,325-797

Commits

Commits on Jan 1, 2024

• Add option to download ingredients as JSONL from Open Food Facts (requires no mongo)

  strawpants

  committed
  feb4540

  Copy full SHA for feb4540

• update authors

  strawpants

  committed
  fff7c86

  Copy full SHA for fff7c86

Commits on Jan 23, 2024

• Merge branch 'master' into import_off_jsonl

  rolandgeider

  authored
  f5fcae9

  Copy full SHA for f5fcae9

Commits on May 18, 2024

• Start working on import script for USDA products

  rolandgeider

  committed
  193e6ca

  Copy full SHA for 193e6ca

• Fix path for OFF mongo dump

  rolandgeider

  committed
  42d2add

  Copy full SHA for 42d2add

• Add remote_id to ingredients.

  Show description for ebd9534
  rolandgeider

  committed
  ebd9534

  Copy full SHA for ebd9534

• If no ingredients were found the result is now None

  rolandgeider

  committed
  741a3c7

  Copy full SHA for 741a3c7

Commits on May 19, 2024

• Make USDA food import actually import the products

  rolandgeider

  committed
  d5a796e

  Copy full SHA for d5a796e

Commits on May 20, 2024

• Some polishing, add tests for the USDA extraction function

  rolandgeider

  committed
  1a0ab64

  Copy full SHA for 1a0ab64

• Better handling branded products

  rolandgeider

  committed
  248f28b

  Copy full SHA for 248f28b

• Download the dataset to a temporary folder by default

  Show description for 53230ac
  rolandgeider

  committed
  53230ac

  Copy full SHA for 53230ac

• Add method to try to fetch existing USDA entries

  rolandgeider

  committed
  5aebcd2

  Copy full SHA for 5aebcd2

• Rename command line options

  rolandgeider

  committed
  aa3f49b

  Copy full SHA for aa3f49b

• Commit missing migration to also increase author field length in other models

  rolandgeider

  committed
  8c3ab81

  Copy full SHA for 8c3ab81

Commits on May 21, 2024

• Merge branch 'refs/heads/master' into feature/import-usda-products

  rolandgeider

  committed
  5eb3783

  Copy full SHA for 5eb3783

• Fix migration order

  rolandgeider

  committed
  e4c75c4

  Copy full SHA for e4c75c4

• Don't try to rename the index twice

  rolandgeider

  committed
  bff088e

  Copy full SHA for bff088e

• fibre/fibres/fibers -> fiber

  Dieterbe

  committed
  b234b2e

  Copy full SHA for b234b2e

• Some products have empty names, skip them

  rolandgeider

  committed
  dc1a4d1

  Copy full SHA for dc1a4d1

• Further increase the author field length

  rolandgeider

  committed
  9aa837f

  Copy full SHA for 9aa837f

• Increase number of returned results in the API ingredient search

  rolandgeider

  committed
  e4a6f7e

  Copy full SHA for e4a6f7e

Commits on May 22, 2024

• Merge branch 'refs/heads/fork/import_off_jsonl' into feature/import-usda-products

  Show description for a6733be
  rolandgeider

  committed
  a6733be

  Copy full SHA for a6733be

• Refactor import scripts

  Show description for 3dbeb62
  rolandgeider

  committed
  3dbeb62

  Copy full SHA for 3dbeb62

• Make sync of OFF daily delta files a celery task

  Show description for fdca08d
  rolandgeider

  committed
  fdca08d

  Copy full SHA for fdca08d

• Refactor and remove hard coded paths

  rolandgeider

  committed
  69b53e5

  Copy full SHA for 69b53e5

• Move some common data checks to the IngredientData class

  Show description for e3aa521
  rolandgeider

  committed
  e3aa521

  Copy full SHA for e3aa521

• Merge remote-tracking branch 'refs/remotes/origin/term-consistency' into feature/import-usda-products

  Show description for 352c19b
  rolandgeider

  committed
  352c19b

  Copy full SHA for 352c19b

• Merge the branch term-consistency

  Show description for 234cef4
  rolandgeider

  committed
  234cef4

  Copy full SHA for 234cef4

Commits on May 23, 2024

• Merge branch 'master' into feature/import-usda-products

  rolandgeider

  authored
  91ebb8c

  Copy full SHA for 91ebb8c

• Consolidate fiber related migrations into one

  rolandgeider

  committed
  e3214eb

  Copy full SHA for e3214eb

• Bump minimum app version

  Show description for 15a5bc0
  rolandgeider

  committed
  15a5bc0

  Copy full SHA for 15a5bc0

• Revert "Consolidate fiber related migrations into one"

  Show description for 88af124
  rolandgeider

  committed
  88af124

  Copy full SHA for 88af124

Commits on May 24, 2024

• Remove the status for ingredients

  Show description for 5349446
  rolandgeider

  committed
  5349446

  Copy full SHA for 5349446

• Update all remote IDs at once

  rolandgeider

  committed
  6381dbb

  Copy full SHA for 6381dbb

• Fix test

  rolandgeider

  committed
  5e79936

  Copy full SHA for 5e79936

Commits on May 28, 2024

• Remove unused imports

  rolandgeider

  committed
  6ee150f

  Copy full SHA for 6ee150f

Commits on May 29, 2024

• Remove one-off method, this is not needed anymore

  rolandgeider

  committed
  0dfb912

  Copy full SHA for 0dfb912

• Seems it's possible for a product to not have "lang" key

  rolandgeider

  committed
  5b6b035

  Copy full SHA for 5b6b035

• Reformat and remove unused imports

  rolandgeider

  committed
  fde12ad

  Copy full SHA for fde12ad