YaCy-Bugtracker

View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0000250YaCy[All Projects] Generalpublic2013-06-16 09:392013-10-24 16:22
Reporterlucipher 
Assigned ToOrbiter 
PriorityurgentSeveritycrashReproducibilityalways
StatusresolvedResolutionfixed 
ETAnone 
PlatformOSOS Version
Product VersionYaCy 1.0 
Target VersionFixed in Version 
Summary0000250: out of memory
DescriptionMashine have 12GB RAM and for yacy I use 8GB
Openjdk 1.6, yacy 1.5 and 1.4
I'm trying to index http://zmudzmar.home.pl/pub [^] in expert mode
Im using second option link list of urls with restriction od 100 pages per domain and regex match .*\.pl/.*not match .*\.pl$
Mashine is allways crash with OOM. Is it not possible to even switch between tabs.
Only way to make it alive is kill process and restart
TagsNo tags attached.
Attached Files

- Relationships

-  Notes
(0000512)
lucipher (reporter)
2013-06-26 11:13

with heavy ulimit parameters tuning in linux OOM is fixed but there is problem with inserting crawled url int database. number of URLS for crawling still grow up, in logs exist info about crawling pages but there are no inserts into database (0 results). Looks like crawler is working but cannot isert results into solr
(0000549)
Orbiter (manager)
2013-07-22 17:30

I tried a crawl on this start point and discovered a very large list of urls. However, this did not cause a OOM on my machine. Please provide a log containing the OOM message inside to get a hint where this happens (a stack trace must be visible there)

Without a stack trace, this is not fixable; in that case please close the bug.
(0000626)
Orbiter (manager)
2013-10-23 19:23

I can reproduce this. But I guess the start URL is now
http://zmudzmar.home.pl/pub/1.html [^]
?
(0000632)
Orbiter (manager)
2013-10-24 16:22

tested with your start list, fixed in https://gitorious.org/yacy/rc1/commit/030d0776ff4dc6cbf23697188866ee5feb1107f8.html [^]

- Issue History
Date Modified Username Field Change
2013-06-16 09:39 lucipher New Issue
2013-06-26 11:13 lucipher Note Added: 0000512
2013-07-22 17:30 Orbiter Note Added: 0000549
2013-07-22 17:30 Orbiter Assigned To => Orbiter
2013-07-22 17:30 Orbiter Status new => feedback
2013-10-23 19:23 Orbiter Note Added: 0000626
2013-10-23 19:23 Orbiter Status feedback => confirmed
2013-10-24 16:22 Orbiter Note Added: 0000632
2013-10-24 16:22 Orbiter Status confirmed => resolved
2013-10-24 16:22 Orbiter Resolution open => fixed


Copyright © 2000 - 2020 MantisBT Team
Powered by Mantis Bugtracker