- Drop support for Python 3.8 and lower, add support for Python 3.9 and higher.
- Add support for Scrapy 2.12.
- Use the
REQUEST_FINGERPRINTER_CLASSsetting introduced in Scrapy 2.7. - Support new item types introduced in Scrapy 2.2.
- Support
Pathinstances in theDELTAFETCH_DIRsetting.
- drop Python 2 support
- replace bsddb3 with Python's dbm for storing request fingerprints
- minor README fix
- option to disable deltafetch for some requests with deltafetch_enabled=False request meta key
- dev workflow: changed from Travis to Github Actions
- Use python idiom to check key in dict
- Update minimum Scrapy version supported by this extension to v1.1.0
- Log through
loggingmodule instead of (deprecated) scrapy's spider.log(). - Fix README on passing
deltafetch_resetargument on the command line.
Adds support for callbacks returning dict items.
Fix package URL in setup.py
Initial release.
This version is functionally equivalent to scrapylib's v1.7.0
scrapylib.deltafetch.DeltaFetch.
The only (and major) difference is that support for bsddb is dropped
in favor of bsddb3, which is a new required dependency.
Note
bsddb has been deprecated since Python 2.6, and even removed in Python 3