YaCy-Bugtracker

View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0000584YaCyWishlist - Wunschlistepublic2015-06-04 14:082015-06-09 11:14
ReporterGuims 
Assigned To 
PrioritynormalSeverityfeatureReproducibilityN/A
StatusnewResolutionopen 
ETAnone 
PlatformLinuxOSDebianOS Version8
Product VersionYaCy 1.8 
Target VersionFixed in Version 
Summary0000584: Add function Re-load Load-Failure Button
DescriptionHello,

It's possible to add function for the button "Re-load laod-failure docs ( 414s etc) to Recrawl for all HOSTs.

I have 1200 différents HOST with, for each, many urls with error 5XX ( a crash of my proxy ...)

One clic and all urls in red are re-crawl
TagsNo tags attached.
Attached Files

- Relationships

-  Notes
(0001069)
BuBu (developer)
2015-06-09 00:09

Alternative Hint:
You can archieve this with the new Re-Crawl Agent
1. goto /IndexReIndexMonitor_p.html
2. start "re-crawl Job now"
3. mark Checkbox "include failed URLs"
4. change "Edit Solr Query" field to
            -httpstatus_i:200

(make sure to Keep the minus sign at the begin of the query term,
this will recrawl all failed URLs in your index)
(0001070)
Guims (reporter)
2015-06-09 11:14

Nice hint.
I have change Solr query for
failtype_s:fail

unfortunately the crawler must be idle
Thx BuBu

- Issue History
Date Modified Username Field Change
2015-06-04 14:08 Guims New Issue
2015-06-09 00:09 BuBu Note Added: 0001069
2015-06-09 11:14 Guims Note Added: 0001070


Copyright © 2000 - 2021 MantisBT Team
Powered by Mantis Bugtracker