Usage Use the following settings in your project: ITEM_PIPELINES = { 'scrapy_folder_tree.FilesHashTreePipeline': 300 }