INFO FINISHED. INFO Duration: 0:00:21. Speed: 58.4 KiB/s. INFO Downloaded: 1 file, 58.9 KiB. INFO Exiting with status 4. Finished WgetDownload for Item newsbuddy:warrior_450_1498848491.56 Starting DeduplicateWarc for Item newsbuddy:warrior_450_1498848491.56 Deduplicating digest sha1:MX3OGRSDKHEELLAHLWZ3MSXLYKD3DHEP, url http://www.washingtonpost.com/news/where-we-live Failed DeduplicateWarc for Item newsbuddy:warrior_450_1498848491.56 Traceback (most recent call last): File "/usr/local/lib/python3.4/dist-packages/seesaw/task.py", line 69, in enqueue self.process(item) File "<string>", line 210, in process File "<string>", line 164, in ia_available File "/usr/lib/python3/dist-packages/requests/api.py", line 60, in get return request('get', url, **kwargs) File "/usr/lib/python3/dist-packages/requests/api.py", line 49, in request return session.request(method=method, url=url, **kwargs) File "/usr/lib/python3/dist-packages/requests/sessions.py", line 457, in request resp = self.send(prep, **send_kwargs) File "/usr/lib/python3/dist-packages/requests/sessions.py", line 595, in send history = [resp for resp in gen] if allow_redirects else [] File "/usr/lib/python3/dist-packages/requests/sessions.py", line 595, in <listcomp> history = [resp for resp in gen] if allow_redirects else [] File "/usr/lib/python3/dist-packages/requests/sessions.py", line 111, in resolve_redirects raise TooManyRedirects('Exceeded %s redirects.' % self.max_redirects) requests.exceptions.TooManyRedirects: Exceeded 30 redirects. Waiting 10 seconds...