Skip to content

1.4.0

Compare
Choose a tag to compare
@jpmckinney jpmckinney released this 10 Feb 07:11
· 310 commits to master since this release
faa49ab

Added

  • Add item_url and log_url to the response from the listjobs.json webservice. (@mxdev88)
  • Scrapy 2.8 support. Scrapyd sets LOG_FILE and FEEDS command-line arguments, instead of SCRAPY_LOG_FILE and SCRAPY_FEED_URI environment variables.
  • Python 3.11 support.
  • Python 3.12 support. Use packaging.version.Version instead of distutils.LooseVersion. (@pawelmhm)

Changed

  • Rename environment variables to avoid spurious Scrapy deprecation warnings.

    • SCRAPY_EGG_VERSION to SCRAPYD_EGG_VERSION
    • SCRAPY_FEED_URI to SCRAPYD_FEED_URI
    • SCRAPY_JOB to SCRAPYD_JOB
    • SCRAPY_LOG_FILE to SCRAPYD_LOG_FILE
    • SCRAPY_SLOT to SCRAPYD_SLOT
    • SCRAPY_SPIDER to SCRAPYD_SPIDER

    ::: attention
    ::: title
    Attention
    :::

    These are undocumented and unused, and may be removed in future versions. If you use these environment variables, please report your use in an issue.
    :::

Removed

  • Scrapy 1.x support.
  • Python 3.6 support.
  • Unmaintained files (Debian packaging) and unused code (scrapyd/script.py).

Fixed

  • Print Scrapyd's version instead of Twisted's version with --version (-v) flag. (@niuguy)
  • Override Scrapy's LOG_STDOUT setting to False to suppress logging output for listspiders.json webservice. (@Lucioric2000)