YaCy-Bugtracker

View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0000730YaCyWishlist - Wunschlistepublic2017-03-28 19:342017-03-28 19:34
Reportersmokingwheels 
Assigned To 
PrioritynormalSeverityminorReproducibilityalways
StatusnewResolutionopen 
ETAnone 
PlatformX86OSLinux Debian +UbuntuOS Version
Product VersionYaCy 1.9 
Target VersionFixed in Version 
Summary0000730: Some web sites have URL's with ;amp;amp. hundreds of them.
DescriptionWhen crawling some sites, I have noticed a few sites having a URL's that suffice/fix with www.domain.com/somepage.html;amp;amp;amp so on for at least 3 to 4 lines in the crawler monitor.

If I find then now I terminate the crawl or blacklist the site because it just slows down my slow PC.

Maybe an option to bypass the sites if one wishes?


 
TagsNo tags attached.
Attached Files

- Relationships

-  Notes
There are no notes attached to this issue.

- Issue History
Date Modified Username Field Change
2017-03-28 19:34 smokingwheels New Issue


Copyright © 2000 - 2017 MantisBT Team
Powered by Mantis Bugtracker