0000695: Crawl starts failing with link-List of URL

View Issue Details [ Jump to Notes ]

[ Issue History ] [ Print ]

Project

Category

View Status

Date Submitted

Last Update

0000695

YaCy

[All Projects] General

public

2016-10-10 01:06

2016-10-10 01:26

Reporter

luc

Assigned To

administrator

Priority

normal

Severity

minor

Reproducibility

always

Status

resolved

Resolution

fixed

ETA

none

Platform

Debian GNU Linux

OS Version

Jessie

Product Version

Target Version

Fixed in Version

Summary

0000695: Crawl starts failing with link-List of URL

Description

Starting a crawl using "Link-List of URL" on some websites fails immediately with this error : "Crawling of "(no url given)" failed. Reason: you must submit at least one crawl url"

Steps To Reproduce

- Go to the /CrawlStartSite.html or /CrawlStartExpert.html admin page
- In the 'Start URL' input field, type a site such as 'https://en.wikipedia.org' [^]
- Links contained in the page are successfully loaded and displayed
- Select the option "Link-List of URL"
- Start the crawl
- Crawler_p.html opens but display the following error message : "Crawling of "(no url given)" failed. Reason: you must submit at least one crawl url"

Additional Information

The error occurs with websites using cookies, such as :
- https://fr.wikipedia.org/ [^]
- http://www.dmoz.org/ [^]
- http://www.w3.org/TR/ [^]

The problem does not occur with websites such as :
- http://yacy.net [^]
- http://www.json.org [^]

Tags

No tags attached.

Attached Files

Relationships

Notes
(0001327) luc (reporter) 2016-10-10 01:14	Fix commited : https://github.com/yacy/yacy_search_server/commit/242707f9b4c24f8ee17aa8c554aa989172c848e1 [^]

(0001328) BuBu (developer) 2016-10-10 01:26	https://github.com/yacy/yacy_search_server/commit/242707f9b4c24f8ee17aa8c554aa989172c848e1 [^]

Issue History
Date Modified	Username	Field	Change
2016-10-10 01:06	luc	New Issue
2016-10-10 01:14	luc	Note Added: 0001327
2016-10-10 01:26	BuBu	Note Added: 0001328
2016-10-10 01:26	BuBu	Status	new => resolved
2016-10-10 01:26	BuBu	Resolution	open => fixed
2016-10-10 01:26	BuBu	Assigned To	=> administrator