YaCy-Bugtracker

View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0000730YaCyWishlist - Wunschlistepublic2017-03-28 19:342020-12-16 06:24
Reportersmokingwheels 
Assigned To 
PrioritynormalSeverityminorReproducibilityalways
StatusnewResolutionopen 
ETAnone 
PlatformX86OSLinux Debian +UbuntuOS Version
Product VersionYaCy 1.9 
Target VersionFixed in Version 
Summary0000730: Some web sites have URL's with ;amp;amp. hundreds of them.
DescriptionWhen crawling some sites, I have noticed a few sites having a URL's that suffice/fix with www.domain.com/somepage.html;amp;amp;amp so on for at least 3 to 4 lines in the crawler monitor.

If I find then now I terminate the crawl or blacklist the site because it just slows down my slow PC.

Maybe an option to bypass the sites if one wishes?


 
TagsNo tags attached.
Attached Files

- Relationships

-  Notes
(0001517)
hnnanan (reporter)
2020-12-16 06:23
edited on: 2020-12-16 06:24

Thank you all for your kindness and wish you happiness
Official website:https://www.assortlist.com [^]


- Issue History
Date Modified Username Field Change
2017-03-28 19:34 smokingwheels New Issue
2020-12-16 06:23 hnnanan Note Added: 0001517
2020-12-16 06:24 hnnanan Note Edited: 0001517 View Revisions


Copyright © 2000 - 2021 MantisBT Team
Powered by Mantis Bugtracker