YaCy-Bugtracker

View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0000778YaCy[All Projects] Generalpublic2018-02-25 03:512018-03-03 00:48
ReporterPigeon 
Assigned To 
PrioritynormalSeverityblockReproducibilityalways
StatusnewResolutionopen 
ETAnone 
PlatformDesktop?OSGNU/Linux Mint kernel 4.13OS Version18.3
Product VersionYaCy 1.9 
Target VersionFixed in Version 
Summary0000778: Can't crawl and connect to http interface after updating to newest version.
DescriptionAfter updating YaCy to newest version, http interface acts weird, everything is slow, crawler isn't working, and after some time you can't reach http interface, whereas java process is still working. Also YaCy is consuming a lot of processing power, while not crawling. Now I can't even access server inteface.
Steps To ReproduceDownload and run 1.92 version from website, do a lot of crawling (I had 5M indexes), change -Xmx to 3GB, and update to newest version from YaCy interface. This problem happend twice.
TagsNo tags attached.
Attached Files

- Relationships

-  Notes
(0001496)
luc (reporter)
2018-03-01 09:45

Between 1.92 and 1.921/9513 versions, the internal Solr index also upgrades between two major versions : from 5.5.2 to 6.6.2. Maybe the automated index upgrade is what consumes much of your CPU, furthermore considering that 5M documents is not negligible for an embedded Solr index.

Doesn't your CPU usage reduce a few hours after upgrade?

In the /IndexControlURLs_p.html page, there is also the "Optimize Solr" option. Maybe this could help you?
(0001497)
Pigeon (reporter)
2018-03-03 00:48

I have just compiled the newest version form github, and deleted all files from my old server, except for DATA folder with my indexes, and replaced these files with new one. For now YaCy seems to work stable.

- Issue History
Date Modified Username Field Change
2018-02-25 03:51 Pigeon New Issue
2018-03-01 09:45 luc Note Added: 0001496
2018-03-03 00:48 Pigeon Note Added: 0001497


Copyright © 2000 - 2018 MantisBT Team
Powered by Mantis Bugtracker