YaCy-Bugtracker - YaCy
View Issue Details
0000584YaCyWishlist - Wunschlistepublic2015-06-04 14:082015-06-09 11:14
Guims 
 
normalfeatureN/A
newopen 
none 
LinuxDebian8
YaCy 1.8 
 
0000584: Add function Re-load Load-Failure Button
Hello,

It's possible to add function for the button "Re-load laod-failure docs ( 414s etc) to Recrawl for all HOSTs.

I have 1200 différents HOST with, for each, many urls with error 5XX ( a crash of my proxy ...)

One clic and all urls in red are re-crawl
No tags attached.
Issue History
2015-06-04 14:08GuimsNew Issue
2015-06-09 00:09BuBuNote Added: 0001069
2015-06-09 11:14GuimsNote Added: 0001070

Notes
(0001069)
BuBu   
2015-06-09 00:09   
Alternative Hint:
You can archieve this with the new Re-Crawl Agent
1. goto /IndexReIndexMonitor_p.html
2. start "re-crawl Job now"
3. mark Checkbox "include failed URLs"
4. change "Edit Solr Query" field to
            -httpstatus_i:200

(make sure to Keep the minus sign at the begin of the query term,
this will recrawl all failed URLs in your index)
(0001070)
Guims   
2015-06-09 11:14   
Nice hint.
I have change Solr query for
failtype_s:fail

unfortunately the crawler must be idle
Thx BuBu