YaCy-Bugtracker - YaCy
View Issue Details
0000771YaCy[All Projects] Generalpublic2017-10-09 07:432019-07-28 08:38
smokingwheels 
 
normalminorhave not tried
newopen 
none 
YaCy 1.9 
 
0000771: Blocked threads when crawling.
I was profiling my Server with YourKit-JavaProfiler eval software.

I was crawling some random sites with my modified code and then reverted back to Github version 1.921/9410.

Both had blocked threads but the Github version had more and my server did a fatal exception dump for reason unknown to me.
I will attach it to a comment.


 


Possible Potential deadlock: frozen threads found in both versions when monitoring.

No tags attached.
txt yourkit.txt (72,778) 2017-10-09 07:43
http://mantis.tokeek.de/file_download.php?file_id=302&type=bug
log hs_err_pid3909.log (165,794) 2017-10-09 07:44
http://mantis.tokeek.de/file_download.php?file_id=303&type=bug
gz yacyyourkit9-sep-17.tar.gz (11,814) 2017-10-09 20:03
http://mantis.tokeek.de/file_download.php?file_id=304&type=bug
? report (33,377) 2017-10-22 08:38
http://mantis.tokeek.de/file_download.php?file_id=305&type=bug
Issue History
2017-10-09 07:43smokingwheelsNew Issue
2017-10-09 07:43smokingwheelsFile Added: yourkit.txt
2017-10-09 07:44smokingwheelsFile Added: hs_err_pid3909.log
2017-10-09 10:36smokingwheelsNote Added: 0001485
2017-10-09 20:03smokingwheelsFile Added: yacyyourkit9-sep-17.tar.gz
2017-10-09 20:04smokingwheelsNote Added: 0001486
2017-10-22 08:38smokingwheelsFile Added: report
2017-10-22 08:44smokingwheelsNote Added: 0001490
2017-10-22 08:45smokingwheelsNote Edited: 0001485bug_revision_view_page.php?bugnote_id=1485#r464

Notes
(0001485)
smokingwheels   
2017-10-09 10:36   
(edited on: 2017-10-22 08:45)
Maybe of sum use because of all the code is shifted a little on each file.
hprof5.tar.gz 283 mb site is down

(0001486)
smokingwheels   
2017-10-09 20:04   
yacyyourkit9-sep-17.tar.gz just some more blocked threads.
Yacy is still working ok.
(0001490)
smokingwheels   
2017-10-22 08:44   
I upgraded to version 1.921/9431 and there seems to be a lot less blocked threads.
See report att.
The Demo Java profiler license runs out very soon (YourKit).
If you need my source I can arrange that I know the line numbers wont match the copy on github.