| View Issue Details [ Jump to Notes ] | [ Issue History ] [ Print ] |
| ID | Project | Category | View Status | Date Submitted | Last Update |
| 0000699 | YaCy | [All Projects] General | public | 2016-10-20 12:09 | 2016-10-22 00:16 |
|
| Reporter | luc | |
| Assigned To | administrator | |
| Priority | normal | Severity | minor | Reproducibility | always |
| Status | resolved | Resolution | fixed | |
| ETA | none | |
| Platform | | OS | | OS Version | |
| Product Version | | |
| Target Version | | Fixed in Version | | |
|
| Summary | 0000699: Crawl start from a redirected URL fails |
| Description | Starting a crawl from a redirected URL is failing : the Link-list is sucessfully loaded and displayed in the /CrawlStartSite.html or /CrawlStartExpert.html page, but once the crawl is started nothing is crawled.
The "Rejected URLs" page (/IndexCreateParserErrors_p.html) effectively display a message such as "TEMPORARY_NETWORK_FAILURE cannot load: load error - java.io.IOException: CRAWLER Redirect of URL=http://wikipedia.org/ [^] to https://wikipedia.org/ [^] placed on crawler queue for double-check", but indeed nothing happens. |
| Steps To Reproduce | - Go to the /CrawlStartSite.html or /CrawlStartExpert.html page
- Choose a redirected URL as starting point, such as "http://wikipedia.org/" [^] (redirected to https://wikipedia.org/ [^] and then to https://www.wikipedia.org/ [^])
- the Link-list is sucessfully loaded and displayed
- start the new crawl job with default or whatever options
- the job is started, but nothing is effectively crawled, even if the "Rejected URLs" page pretend the redirection will be sucessfully handled |
| Tags | No tags attached. |
|
| Attached Files | |
|
Relationships 
Relationships 