KnowledgeHub
Questions
Tags
Users
Search
Alex Rivera
|
Logout
Edit Question
Title
Body
I have a scrapy project where the item that ultimately enters my pipeline is relatively large and stores lots of metadata and content. Everything is working properly in my spider and pipelines. The logs, however, are printing out the entire scrapy Item as it leaves the pipeline (I believe): 2013-01-17 18:42:17-0600 [tutorial] DEBUG: processing Pipeline pipeline module 2013-01-17 18:42:17-0600 [tutorial] DEBUG: Scraped from <200 http://www.example.com> {'attr1': 'value1', 'attr2': 'value2', 'attr3': 'value3', ... snip ... 'attrN': 'valueN'} 2013-01-17 18:42:18-0600 [tutorial] INFO: Closing spider (finished) I would rather not have all this data puked into log files if I can avoid it. Any suggestions about how to suppress this output?
Tags (comma-separated)
Save Edits
Cancel