YaCy-Bugtracker

View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0000444YaCyWishlist - Wunschlistepublic2014-08-25 08:122014-12-07 23:57
ReporterLA_FORGE 
Assigned ToOrbiter 
PrioritynormalSeveritytweakReproducibilityalways
StatusresolvedResolutionfixed 
ETAnone 
PlatformOSOS Version
Product VersionYaCy 1.6 
Target VersionFixed in Version 
Summary0000444: Wishlist: Performance boost for 2 procedures
DescriptionI just copied the data directory from an external Solr instance (Used the YaCy Solr Schema for this) to the Solr data directory of YaCy. Starting YaCy worked very well. All procedures at the initial stage of the bootstrapping worked very well. No errors and/or exceptions are occuring. YaCy seems to be compiling now several data structures of the entire data set:

I 2014/08/22 12:34:47 CollectionConfiguration convergence step 1 for host inthesetimes.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 2 for host inthesetimes.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence for host inthesetimes.com after 2 steps
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 1 for host iphone.tmcnet.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 2 for host iphone.tmcnet.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence for host iphone.tmcnet.com after 2 steps
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 1 for host isg.inesc-id.pt ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 2 for host isg.inesc-id.pt ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence for host isg.inesc-id.pt after 2 steps
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 1 for host jinnidigital.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 2 for host jinnidigital.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence for host jinnidigital.com after 2 steps
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 1 for host jorel314.wordpress.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 2 for host jorel314.wordpress.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence for host jorel314.wordpress.com after 2 steps
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 1 for host kpoconsultants.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence step 2 for host kpoconsultants.com ...
I 2014/08/22 12:34:47 CollectionConfiguration convergence for host kpoconsultants.com after 2 steps
I 2014/08/22 12:34:48 CollectionConfiguration convergence step 1 for host marakana.com ...
I 2014/08/22 12:34:48 CollectionConfiguration convergence step 2 for host marakana.com ...
I 2014/08/22 12:34:48 CollectionConfiguration convergence for host marakana.com after 2 steps
I 2014/08/22 12:34:49 CollectionConfiguration convergence step 1 for host marginalrevolution.com ...
I 2014/08/22 12:34:49 CollectionConfiguration convergence step 2 for host marginalrevolution.com ...
I 2014/08/22 12:34:49 CollectionConfiguration convergence for host marginalrevolution.com after 2 steps
I 2014/08/22 12:34:49 CollectionConfiguration convergence step 1 for host markblevis.com ...
I 2014/08/22 12:34:49 CollectionConfiguration convergence step 2 for host markblevis.com ...
I 2014/08/22 12:34:49 CollectionConfiguration convergence for host markblevis.com after 2 steps
I 2014/08/22 12:34:50 CollectionConfiguration convergence step 1 for host markmaloney.bloginky.com ...
I 2014/08/22 12:34:50 CollectionConfiguration convergence step 2 for host markmaloney.bloginky.com ...
I 2014/08/22 12:34:50 CollectionConfiguration convergence for host markmaloney.bloginky.com after 2 steps
I 2014/08/22 12:34:50 CollectionConfiguration convergence step 1 for host moneymap.bnz.co.nz ...
I 2014/08/22 12:34:50 CollectionConfiguration convergence step 2 for host moneymap.bnz.co.nz ...
I 2014/08/22 12:34:50 CollectionConfiguration convergence for host moneymap.bnz.co.nz after 2 steps
I 2014/08/22 12:34:50 CollectionConfiguration convergence step 1 for host oukc.oracle.com ...
I 2014/08/22 12:34:50 CollectionConfiguration convergence step 2 for host oukc.oracle.com ...
I 2014/08/22 12:34:50 CollectionConfiguration convergence for host oukc.oracle.com after 2 steps
I 2014/08/22 12:34:51 CollectionConfiguration convergence step 1 for host pivotallabs.com ...
I 2014/08/22 12:34:51 CollectionConfiguration convergence step 2 for host pivotallabs.com ...
I 2014/08/22 12:34:51 CollectionConfiguration convergence for host pivotallabs.com after 2 steps
I 2014/08/22 12:34:52 CollectionConfiguration convergence step 1 for host pl.wikivoyage.org ...
I 2014/08/22 12:34:52 CollectionConfiguration convergence step 2 for host pl.wikivoyage.org ...
I 2014/08/22 12:34:52 CollectionConfiguration convergence for host pl.wikivoyage.org after 2 steps
I 2014/08/22 12:34:52 CollectionConfiguration convergence step 1 for host poynder.blogspot.ca ...
I 2014/08/22 12:34:52 CollectionConfiguration convergence step 2 for host poynder.blogspot.ca ...
I 2014/08/22 12:34:52 CollectionConfiguration convergence for host poynder.blogspot.ca after 2 steps
I 2014/08/22 12:34:53 CollectionConfiguration convergence step 1 for host quebec.huffingtonpost.ca ...
I 2014/08/22 12:34:53 CollectionConfiguration convergence step 2 for host quebec.huffingtonpost.ca ...
I 2014/08/22 12:34:53 CollectionConfiguration convergence for host quebec.huffingtonpost.ca after 2 steps
I 2014/08/22 12:34:53 CollectionConfiguration convergence step 1 for host ramblingfoo.blogspot.com ...
I 2014/08/22 12:34:53 CollectionConfiguration convergence step 2 for host ramblingfoo.blogspot.com ...
I 2014/08/22 12:34:53 CollectionConfiguration convergence for host ramblingfoo.blogspot.com after 2 steps
I 2014/08/22 12:34:54 CollectionConfiguration convergence step 1 for host ru.tardis.wikia.com ...
I 2014/08/22 12:34:54 CollectionConfiguration convergence step 2 for host ru.tardis.wikia.com ...
I 2014/08/22 12:34:54 CollectionConfiguration convergence for host ru.tardis.wikia.com after 2 steps
I 2014/08/22 12:34:55 CollectionConfiguration convergence step 1 for host searchservervirtualization.techtarget.com ...
I 2014/08/22 12:34:55 CollectionConfiguration convergence step 2 for host searchservervirtualization.techtarget.com ...
I 2014/08/22 12:34:55 CollectionConfiguration convergence for host searchservervirtualization.techtarget.com after 2 steps
I 2014/08/22 12:34:55 CollectionConfiguration convergence step 1 for host seeingredinchina.com ...
I 2014/08/22 12:34:55 CollectionConfiguration convergence step 2 for host seeingredinchina.com ...
I 2014/08/22 12:34:55 CollectionConfiguration convergence for host seeingredinchina.com after 2 steps
I 2014/08/22 12:34:55 CollectionConfiguration convergence step 1 for host skye-s-got-your-tongue.tumblr.com ...
I 2014/08/22 12:34:55 CollectionConfiguration convergence step 2 for host skye-s-got-your-tongue.tumblr.com ...
I 2014/08/22 12:34:55 CollectionConfiguration convergence for host skye-s-got-your-tongue.tumblr.com after 2 steps
I 2014/08/22 12:34:55 CollectionConfiguration convergence step 1 for host smithsonianeducation.org ...
I 2014/08/22 12:34:55 CollectionConfiguration convergence step 2 for host smithsonianeducation.org ...
I 2014/08/22 12:34:55 CollectionConfiguration convergence for host smithsonianeducation.org after 2 steps
I 2014/08/22 12:34:56 CollectionConfiguration convergence step 1 for host spacestationinfo.blogspot.co.uk ...
I 2014/08/22 12:34:56 CollectionConfiguration convergence step 2 for host spacestationinfo.blogspot.co.uk ...
I 2014/08/22 12:34:56 CollectionConfiguration convergence for host spacestationinfo.blogspot.co.uk after 2 steps
I 2014/08/22 12:34:56 CollectionConfiguration convergence step 1 for host theavamovement.tumblr.com ...
I 2014/08/22 12:34:56 CollectionConfiguration convergence step 2 for host theavamovement.tumblr.com ...
I 2014/08/22 12:34:56 CollectionConfiguration convergence for host theavamovement.tumblr.com after 2 steps
I 2014/08/22 12:34:57 CollectionConfiguration convergence step 1 for host tr.foursquare.com ...
I 2014/08/22 12:34:57 CollectionConfiguration convergence step 2 for host tr.foursquare.com ...
I 2014/08/22 12:34:57 CollectionConfiguration convergence for host tr.foursquare.com after 2 steps
I 2014/08/22 12:34:58 CollectionConfiguration convergence step 1 for host uknow.uky.edu ...
I 2014/08/22 12:34:58 CollectionConfiguration convergence step 2 for host uknow.uky.edu ...
I 2014/08/22 12:34:58 CollectionConfiguration convergence for host uknow.uky.edu after 2 steps
I 2014/08/22 12:34:58 CollectionConfiguration convergence step 1 for host video.foxbusiness.com ...
I 2014/08/22 12:34:58 CollectionConfiguration convergence step 2 for host video.foxbusiness.com ...
I 2014/08/22 12:34:58 CollectionConfiguration convergence for host video.foxbusiness.com after 2 steps
I 2014/08/22 12:34:59 CollectionConfiguration convergence step 1 for host wayback.kb.dk ...
I 2014/08/22 12:34:59 CollectionConfiguration convergence step 2 for host wayback.kb.dk ...
I 2014/08/22 12:34:59 CollectionConfiguration convergence for host wayback.kb.dk after 2 steps
I 2014/08/22 12:35:07 CollectionConfiguration convergence step 1 for host wiki.zum.de ...
I 2014/08/22 12:35:07 CollectionConfiguration convergence step 2 for host wiki.zum.de ...
I 2014/08/22 12:35:07 CollectionConfiguration convergence for host wiki.zum.de after 2 steps
I 2014/08/22 12:35:07 CollectionConfiguration convergence step 1 for host www.2ndswing.com ...
I 2014/08/22 12:35:07 CollectionConfiguration convergence step 2 for host www.2ndswing.com ...
I 2014/08/22 12:35:07 CollectionConfiguration convergence for host www.2ndswing.com after 2 steps
I 2014/08/22 12:35:08 CollectionConfiguration convergence step 1 for host www.3nzh.com ...
I 2014/08/22 12:35:08 CollectionConfiguration convergence step 2 for host www.3nzh.com ...
I 2014/08/22 12:35:08 CollectionConfiguration convergence for host www.3nzh.com after 2 steps
I 2014/08/22 12:35:08 CollectionConfiguration convergence step 1 for host www.8bitpeoples.com ...
I 2014/08/22 12:35:08 CollectionConfiguration convergence step 2 for host www.8bitpeoples.com ...
I 2014/08/22 12:35:08 CollectionConfiguration convergence for host www.8bitpeoples.com after 2 steps
I 2014/08/22 12:35:08 CollectionConfiguration convergence step 1 for host www.aaanet.org ...
I 2014/08/22 12:35:08 CollectionConfiguration convergence step 2 for host www.aaanet.org ...
I 2014/08/22 12:35:08 CollectionConfiguration convergence for host www.aaanet.org after 2 steps
I 2014/08/22 12:35:08 CollectionConfiguration convergence step 1 for host www.abandonia.com ...
I 2014/08/22 12:35:08 CollectionConfiguration convergence step 2 for host www.abandonia.com ...
I 2014/08/22 12:35:08 CollectionConfiguration convergence for host www.abandonia.com after 2 steps
I 2014/08/22 12:35:09 CollectionConfiguration convergence step 1 for host www.akilidada.org ...
I 2014/08/22 12:35:09 CollectionConfiguration convergence step 2 for host www.akilidada.org ...
I 2014/08/22 12:35:09 CollectionConfiguration convergence for host www.akilidada.org after 2 steps
I 2014/08/22 12:35:09 CollectionConfiguration convergence step 1 for host www.aluminiumwarehouse.co.uk ...
I 2014/08/22 12:35:09 CollectionConfiguration convergence step 2 for host www.aluminiumwarehouse.co.uk ...
I 2014/08/22 12:35:09 CollectionConfiguration convergence for host www.aluminiumwarehouse.co.uk after 2 steps


I 2014/08/24 19:17:21 CollectionConfiguration collection - postprocessed 8600 from 9948796 documents; 10 docs/second; 16440 minutes remaining
I 2014/08/24 19:17:21 CollectionConfiguration collection - postprocessed 8700 from 9948796 documents; 10 docs/second; 16284 minutes remaining
I 2014/08/24 19:17:22 CollectionConfiguration collection - postprocessed 8800 from 9948796 documents; 10 docs/second; 16124 minutes remaining
I 2014/08/24 19:17:22 CollectionConfiguration collection - postprocessed 8900 from 9948796 documents; 10 docs/second; 15957 minutes remaining
I 2014/08/24 19:17:23 CollectionConfiguration collection - postprocessed 9000 from 9948796 documents; 10 docs/second; 15787 minutes remaining
I 2014/08/24 19:17:24 CollectionConfiguration collection - postprocessed 9100 from 9948796 documents; 10 docs/second; 15627 minutes remaining
I 2014/08/24 19:17:25 CollectionConfiguration collection - postprocessed 9200 from 9948796 documents; 10 docs/second; 15491 minutes remaining
I 2014/08/24 19:17:26 CollectionConfiguration collection - postprocessed 9300 from 9948796 documents; 10 docs/second; 15340 minutes remaining
I 2014/08/24 19:17:28 CollectionConfiguration collection - postprocessed 9400 from 9948796 documents; 10 docs/second; 15202 minutes remaining
I 2014/08/24 19:17:29 CollectionConfiguration collection - postprocessed 9500 from 9948796 documents; 10 docs/second; 15064 minutes remaining
I 2014/08/24 19:17:29 CollectionConfiguration collection - postprocessed 9600 from 9948796 documents; 11 docs/second; 14909 minutes remaining
I 2014/08/24 19:17:30 CollectionConfiguration collection - postprocessed 9700 from 9948796 documents; 11 docs/second; 14770 minutes remaining
I 2014/08/24 19:17:30 CollectionConfiguration collection - postprocessed 9800 from 9948796 documents; 11 docs/second; 14627 minutes remaining
I 2014/08/24 19:17:31 CollectionConfiguration collection - postprocessed 9900 from 9948796 documents; 11 docs/second; 14482 minutes remaining
I 2014/08/24 19:17:31 CollectionConfiguration collection - postprocessed 10000 from 9948796 documents; 11 docs/second; 14344 minutes remaining
I 2014/08/24 19:20:00 CollectionConfiguration collection - postprocessed 10100 from 9948796 documents; 9 docs/second; 16641 minutes remaining
I 2014/08/24 19:20:01 CollectionConfiguration collection - postprocessed 10200 from 9948796 documents; 10 docs/second; 16494 minutes remaining
I 2014/08/24 19:20:02 CollectionConfiguration collection - postprocessed 10300 from 9948796 documents; 10 docs/second; 16350 minutes remaining
I 2014/08/24 19:20:02 CollectionConfiguration collection - postprocessed 10400 from 9948796 documents; 10 docs/second; 16199 minutes remaining
I 2014/08/24 19:20:02 CollectionConfiguration collection - postprocessed 10500 from 9948796 documents; 10 docs/second; 16045 minutes remaining
I 2014/08/24 19:20:03 CollectionConfiguration collection - postprocessed 10600 from 9948796 documents; 10 docs/second; 15906 minutes remaining
I 2014/08/24 19:20:05 CollectionConfiguration collection - postprocessed 10700 from 9948796 documents; 10 docs/second; 15784 minutes remaining
I 2014/08/24 19:20:05 CollectionConfiguration collection - postprocessed 10800 from 9948796 documents; 10 docs/second; 15648 minutes remaining
I 2014/08/24 19:20:07 CollectionConfiguration collection - postprocessed 10900 from 9948796 documents; 10 docs/second; 15521 minutes remaining
I 2014/08/24 19:20:07 CollectionConfiguration collection - postprocessed 11000 from 9948796 documents; 10 docs/second; 15393 minutes remaining
I 2014/08/24 19:20:08 CollectionConfiguration collection - postprocessed 11100 from 9948796 documents; 10 docs/second; 15259 minutes remaining
I 2014/08/24 19:20:08 CollectionConfiguration collection - postprocessed 11200 from 9948796 documents; 10 docs/second; 15128 minutes remaining
I 2014/08/24 19:20:09 CollectionConfiguration collection - postprocessed 11300 from 9948796 documents; 11 docs/second; 15003 minutes remaining
I 2014/08/24 19:20:09 CollectionConfiguration collection - postprocessed 11400 from 9948796 documents; 11 docs/second; 14878 minutes remaining
I 2014/08/24 19:20:10 CollectionConfiguration collection - postprocessed 11500 from 9948796 documents; 11 docs/second; 14757 minutes remaining
I 2014/08/24 19:20:10 CollectionConfiguration collection - postprocessed 11600 from 9948796 documents; 11 docs/second; 14638 minutes remaining
I 2014/08/24 19:20:11 CollectionConfiguration collection - postprocessed 11700 from 9948796 documents; 11 docs/second; 14519 minutes remaining
I 2014/08/24 19:20:11 CollectionConfiguration collection - postprocessed 11800 from 9948796 documents; 11 docs/second; 14406 minutes remaining
I 2014/08/24 19:20:12 CollectionConfiguration collection - postprocessed 11900 from 9948796 documents; 11 docs/second; 14294 minutes remaining
I 2014/08/24 19:20:13 CollectionConfiguration collection - postprocessed 12000 from 9948796 documents; 11 docs/second; 14181 minutes remaining
I 2014/08/24 19:22:41 CollectionConfiguration collection - postprocessed 12100 from 9948796 documents; 10 docs/second; 16090 minutes remaining
I 2014/08/24 19:22:43 CollectionConfiguration collection - postprocessed 12200 from 9948796 documents; 10 docs/second; 15988 minutes remaining
I 2014/08/24 19:22:44 CollectionConfiguration collection - postprocessed 12300 from 9948796 documents; 10 docs/second; 15871 minutes remaining
I 2014/08/24 19:22:45 CollectionConfiguration collection - postprocessed 12400 from 9948796 documents; 10 docs/second; 15754 minutes remaining
I 2014/08/24 19:22:46 CollectionConfiguration collection - postprocessed 12500 from 9948796 documents; 10 docs/second; 15641 minutes remaining
I 2014/08/24 19:22:47 CollectionConfiguration collection - postprocessed 12600 from 9948796 documents; 10 docs/second; 15529 minutes remaining
I 2014/08/24 19:22:47 CollectionConfiguration collection - postprocessed 12700 from 9948796 documents; 10 docs/second; 15416 minutes remaining
I 2014/08/24 19:22:48 CollectionConfiguration collection - postprocessed 12800 from 9948796 documents; 10 docs/second; 15300 minutes remaining
I 2014/08/24 19:22:48 CollectionConfiguration collection - postprocessed 12900 from 9948796 documents; 10 docs/second; 15187 minutes remaining
I 2014/08/24 19:22:49 CollectionConfiguration collection - postprocessed 13000 from 9948796 documents; 10 docs/second; 15076 minutes remaining
I 2014/08/24 19:22:49 CollectionConfiguration collection - postprocessed 13100 from 9948796 documents; 11 docs/second; 14971 minutes remaining
I 2014/08/24 19:25:18 CollectionConfiguration collection - postprocessed 13200 from 9948796 documents; 9 docs/second; 16727 minutes remaining
I 2014/08/24 19:25:20 CollectionConfiguration collection - postprocessed 13300 from 9948796 documents; 9 docs/second; 16621 minutes remaining
I 2014/08/24 19:25:21 CollectionConfiguration collection - postprocessed 13400 from 9948796 documents; 10 docs/second; 16514 minutes remaining
I 2014/08/24 19:25:22 CollectionConfiguration collection - postprocessed 13500 from 9948796 documents; 10 docs/second; 16403 minutes remaining
I 2014/08/24 19:25:23 CollectionConfiguration collection - postprocessed 13600 from 9948796 documents; 10 docs/second; 16292 minutes remaining
I 2014/08/24 19:25:23 CollectionConfiguration collection - postprocessed 13700 from 9948796 documents; 10 docs/second; 16176 minutes remaining
I 2014/08/24 19:25:25 CollectionConfiguration collection - postprocessed 13800 from 9948796 documents; 10 docs/second; 16081 minutes remaining
I 2014/08/24 19:25:26 CollectionConfiguration collection - postprocessed 13900 from 9948796 documents; 10 docs/second; 15972 minutes remaining
I 2014/08/24 19:25:26 CollectionConfiguration collection - postprocessed 14000 from 9948796 documents; 10 docs/second; 15865 minutes remaining
I 2014/08/24 19:25:27 CollectionConfiguration collection - postprocessed 14100 from 9948796 documents; 10 docs/second; 15758 minutes remaining
I 2014/08/24 19:25:28 CollectionConfiguration collection - postprocessed 14200 from 9948796 documents; 10 docs/second; 15662 minutes remaining
I 2014/08/24 19:25:29 CollectionConfiguration collection - postprocessed 14300 from 9948796 documents; 10 docs/second; 15564 minutes remaining
I 2014/08/24 19:25:30 CollectionConfiguration collection - postprocessed 14400 from 9948796 documents; 10 docs/second; 15461 minutes remaining
I 2014/08/24 19:25:30 CollectionConfiguration collection - postprocessed 14500 from 9948796 documents; 10 docs/second; 15359 minutes remaining
I 2014/08/24 19:28:16 CollectionConfiguration collection - postprocessed 14600 from 9948796 documents; 9 docs/second; 17139 minutes remaining
I 2014/08/24 19:28:17 CollectionConfiguration collection - postprocessed 14700 from 9948796 documents; 9 docs/second; 17030 minutes remaining
I 2014/08/24 19:28:18 CollectionConfiguration collection - postprocessed 14800 from 9948796 documents; 9 docs/second; 16923 minutes remaining
I 2014/08/24 19:28:19 CollectionConfiguration collection - postprocessed 14900 from 9948796 documents; 9 docs/second; 16816 minutes remaining
I 2014/08/24 19:28:19 CollectionConfiguration collection - postprocessed 15000 from 9948796 documents; 9 docs/second; 16712 minutes remaining
I 2014/08/24 19:28:20 CollectionConfiguration collection - postprocessed 15100 from 9948796 documents; 9 docs/second; 16610 minutes remaining
I 2014/08/24 19:28:21 CollectionConfiguration collection - postprocessed 15200 from 9948796 documents; 10 docs/second; 16507 minutes remaining
I 2014/08/24 19:28:21 CollectionConfiguration collection - postprocessed 15300 from 9948796 documents; 10 docs/second; 16405 minutes remaining
I 2014/08/24 19:28:22 CollectionConfiguration collection - postprocessed 15400 from 9948796 documents; 10 docs/second; 16305 minutes remaining
I 2014/08/24 19:28:22 CollectionConfiguration collection - postprocessed 15500 from 9948796 documents; 10 docs/second; 16206 minutes remaining
I 2014/08/24 19:28:23 CollectionConfiguration collection - postprocessed 15600 from 9948796 documents; 10 docs/second; 16110 minutes remaining
I 2014/08/24 19:28:24 CollectionConfiguration collection - postprocessed 15700 from 9948796 documents; 10 docs/second; 16013 minutes remaining
I 2014/08/24 19:28:26 CollectionConfiguration collection - postprocessed 15800 from 9948796 documents; 10 docs/second; 15931 minutes remaining
I 2014/08/24 19:28:26 CollectionConfiguration collection - postprocessed 15900 from 9948796 documents; 10 docs/second; 15837 minutes remaining
I 2014/08/24 19:28:27 CollectionConfiguration collection - postprocessed 16000 from 9948796 documents; 10 docs/second; 15745 minutes remaining
I 2014/08/24 19:28:27 CollectionConfiguration collection - postprocessed 16100 from 9948796 documents; 10 docs/second; 15647 minutes remaining
I 2014/08/24 19:28:28 CollectionConfiguration collection - postprocessed 16200 from 9948796 documents; 10 docs/second; 15557 minutes remaining
I 2014/08/24 19:28:28 CollectionConfiguration collection - postprocessed 16300 from 9948796 documents; 10 docs/second; 15469 minutes remaining
I 2014/08/24 19:28:29 CollectionConfiguration collection - postprocessed 16400 from 9948796 documents; 10 docs/second; 15380 minutes remaining
I 2014/08/24 19:28:31 CollectionConfiguration collection - postprocessed 16500 from 9948796 documents; 10 docs/second; 15306 minutes remaining
I 2014/08/24 19:28:31 CollectionConfiguration collection - postprocessed 16600 from 9948796 documents; 10 docs/second; 15215 minutes remaining
I 2014/08/24 19:28:33 CollectionConfiguration collection - postprocessed 16700 from 9948796 documents; 10 docs/second; 15141 minutes remaining
I 2014/08/24 19:28:33 CollectionConfiguration collection - postprocessed 16800 from 9948796 documents; 10 docs/second; 15057 minutes remaining
I 2014/08/24 19:31:01 CollectionConfiguration collection - postprocessed 16900 from 9948796 documents; 10 docs/second; 16414 minutes remaining
I 2014/08/24 19:31:01 CollectionConfiguration collection - postprocessed 17000 from 9948796 documents; 10 docs/second; 16323 minutes remaining
I 2014/08/24 19:31:02 CollectionConfiguration collection - postprocessed 17100 from 9948796 documents; 10 docs/second; 16233 minutes remaining
I 2014/08/24 19:31:03 CollectionConfiguration collection - postprocessed 17200 from 9948796 documents; 10 docs/second; 16144 minutes remaining
I 2014/08/24 19:31:03 CollectionConfiguration collection - postprocessed 17300 from 9948796 documents; 10 docs/second; 16056 minutes remaining
I 2014/08/24 19:31:04 CollectionConfiguration collection - postprocessed 17400 from 9948796 documents; 10 docs/second; 15970 minutes remaining
I 2014/08/24 19:31:05 CollectionConfiguration collection - postprocessed 17500 from 9948796 documents; 10 docs/second; 15885 minutes remaining
I 2014/08/24 19:31:05 CollectionConfiguration collection - postprocessed 17600 from 9948796 documents; 10 docs/second; 15801 minutes remaining
I 2014/08/24 19:31:06 CollectionConfiguration collection - postprocessed 17700 from 9948796 documents; 10 docs/second; 15717 minutes remaining
I 2014/08/24 19:31:06 CollectionConfiguration collection - postprocessed 17800 from 9948796 documents; 10 docs/second; 15634 minutes remaining
I 2014/08/24 19:31:07 CollectionConfiguration collection - postprocessed 17900 from 9948796 documents; 10 docs/second; 15552 minutes remaining
I 2014/08/24 19:31:08 CollectionConfiguration collection - postprocessed 18000 from 9948796 documents; 10 docs/second; 15470 minutes remaining
I 2014/08/24 19:31:08 CollectionConfiguration collection - postprocessed 18100 from 9948796 documents; 10 docs/second; 15389 minutes remaining
I 2014/08/24 19:31:09 CollectionConfiguration collection - postprocessed 18200 from 9948796 documents; 10 docs/second; 15309 minutes remaining
I 2014/08/24 19:31:09 CollectionConfiguration collection - postprocessed 18300 from 9948796 documents; 10 docs/second; 15231 minutes remaining
I 2014/08/24 19:31:10 CollectionConfiguration collection - postprocessed 18400 from 9948796 documents; 10 docs/second; 15153 minutes remaining
I 2014/08/24 19:33:34 CollectionConfiguration collection - postprocessed 18500 from 9948796 documents; 10 docs/second; 16361 minutes remaining
I 2014/08/24 19:33:35 CollectionConfiguration collection - postprocessed 18600 from 9948796 documents; 10 docs/second; 16281 minutes remaining
I 2014/08/24 19:33:35 CollectionConfiguration collection - postprocessed 18700 from 9948796 documents; 10 docs/second; 16199 minutes remaining
I 2014/08/24 19:33:36 CollectionConfiguration collection - postprocessed 18800 from 9948796 documents; 10 docs/second; 16121 minutes remaining
I 2014/08/24 19:33:37 CollectionConfiguration collection - postprocessed 18900 from 9948796 documents; 10 docs/second; 16040 minutes remaining
I 2014/08/24 19:33:38 CollectionConfiguration collection - postprocessed 19000 from 9948796 documents; 10 docs/second; 15963 minutes remaining
I 2014/08/24 19:33:38 CollectionConfiguration collection - postprocessed 19100 from 9948796 documents; 10 docs/second; 15884 minutes remaining
I 2014/08/24 19:33:39 CollectionConfiguration collection - postprocessed 19200 from 9948796 documents; 10 docs/second; 15807 minutes remaining

The timeframe between the 'convergence' and 'postprocessing' procedures averages at 2 days. Some code optimizations at these program routines would be very appreciated. I already added the java flag -XX:+UseNUMA in startYACY.sh. CPU Power and I/O throughput should't be the problem here. 80.000 MIPS and hard drives with 3,4 ms access time are available at my private data center :-)
Steps To ReproduceSetup an external Solr Instance utilising the YaCy schema as described in the Wiki. Connect this instance to YaCy. Start a widespread webcrawl, let it run at least 8 weeks. Pause the crawl, shutdown YaCy and the external Solr, copy the data directory from the external Solr into the data directory of YaCys internal Solr. Then start YaCy again.
TagsNo tags attached.
Attached Files

- Relationships

-  Notes
(0000876)
LA_FORGE (reporter)
2014-08-31 13:45

The main reason I created this issue isn't to achieve such a huge performance boost that's not possible from the view of the software architecture, the main reason is a better verbosity in the log. After the processes characterized above finished successfully, there is a timeframe of in the log of almost 2 days, where some kind of activity is happening in the background an no information about it is shown in the log:

I 2014/08/31 10:40:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 10:40:32 SWITCHBOARD Solr auto-optimization: idleSearch=224710219, idleAdmin=149760884, deltaOptimize=5100215, proccount=0
D 2014/08/31 10:45:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 10:45:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 10:45:32 RESOURCE OBSERVER resources ok
I 2014/08/31 10:45:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 10:45:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 10:45:32 SWITCHBOARD Solr auto-optimization: idleSearch=225010228, idleAdmin=150060893, deltaOptimize=5400224, proccount=0
D 2014/08/31 10:50:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 10:50:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 10:50:32 RESOURCE OBSERVER resources ok
I 2014/08/31 10:50:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 10:50:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 10:50:32 SWITCHBOARD Solr auto-optimization: idleSearch=225310231, idleAdmin=150360896, deltaOptimize=5700227, proccount=0
D 2014/08/31 10:55:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 10:55:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 10:55:32 RESOURCE OBSERVER resources ok
I 2014/08/31 10:55:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 10:55:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 10:55:32 SWITCHBOARD Solr auto-optimization: idleSearch=225610243, idleAdmin=150660908, deltaOptimize=6000239, proccount=0
D 2014/08/31 11:00:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:00:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:00:32 RESOURCE OBSERVER resources ok
I 2014/08/31 11:00:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:00:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:00:32 SWITCHBOARD Solr auto-optimization: idleSearch=225910245, idleAdmin=150960910, deltaOptimize=6300241, proccount=0
D 2014/08/31 11:05:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:05:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:05:32 RESOURCE OBSERVER resources ok
I 2014/08/31 11:05:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:05:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:05:32 SWITCHBOARD Solr auto-optimization: idleSearch=226210253, idleAdmin=151260918, deltaOptimize=6600249, proccount=0
D 2014/08/31 11:10:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:10:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:10:32 RESOURCE OBSERVER resources ok
I 2014/08/31 11:10:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:10:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:10:32 SWITCHBOARD Solr auto-optimization: idleSearch=226510257, idleAdmin=151560922, deltaOptimize=6900253, proccount=0
D 2014/08/31 11:15:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:15:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:15:32 RESOURCE OBSERVER resources ok
I 2014/08/31 11:15:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:15:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:15:32 SWITCHBOARD Solr auto-optimization: idleSearch=226810265, idleAdmin=151860930, deltaOptimize=7200261, proccount=0
I 2014/08/31 11:15:32 SWITCHBOARD Solr auto-optimization: running solr.optimize(10)
D 2014/08/31 11:20:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:20:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:20:32 RESOURCE OBSERVER resources ok
I 2014/08/31 11:20:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:20:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:20:32 SWITCHBOARD Solr auto-optimization: idleSearch=227110271, idleAdmin=152160936, deltaOptimize=300004, proccount=0
D 2014/08/31 11:25:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:25:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:25:32 RESOURCE OBSERVER resources ok
I 2014/08/31 11:25:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:25:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:25:32 SWITCHBOARD Solr auto-optimization: idleSearch=227410323, idleAdmin=152460988, deltaOptimize=600056, proccount=0
D 2014/08/31 11:30:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:30:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:30:32 RESOURCE OBSERVER resources ok
I 2014/08/31 11:30:32 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:30:32 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:30:32 SWITCHBOARD Solr auto-optimization: idleSearch=227710326, idleAdmin=152760991, deltaOptimize=900059, proccount=0
D 2014/08/31 11:35:32 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:35:32 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:35:33 RESOURCE OBSERVER resources ok
I 2014/08/31 11:35:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:35:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:35:33 SWITCHBOARD Solr auto-optimization: idleSearch=228010334, idleAdmin=153060999, deltaOptimize=1200067, proccount=0
D 2014/08/31 11:40:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:40:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:40:33 RESOURCE OBSERVER resources ok
I 2014/08/31 11:40:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:40:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:40:33 SWITCHBOARD Solr auto-optimization: idleSearch=228310337, idleAdmin=153361002, deltaOptimize=1500070, proccount=0
D 2014/08/31 11:45:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:45:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:45:33 RESOURCE OBSERVER resources ok
I 2014/08/31 11:45:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:45:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:45:33 SWITCHBOARD Solr auto-optimization: idleSearch=228610348, idleAdmin=153661013, deltaOptimize=1800081, proccount=0
D 2014/08/31 11:50:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:50:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:50:33 RESOURCE OBSERVER resources ok
I 2014/08/31 11:50:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:50:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:50:33 SWITCHBOARD Solr auto-optimization: idleSearch=228910351, idleAdmin=153961016, deltaOptimize=2100084, proccount=0
D 2014/08/31 11:55:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 11:55:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 11:55:33 RESOURCE OBSERVER resources ok
I 2014/08/31 11:55:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 11:55:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 11:55:33 SWITCHBOARD Solr auto-optimization: idleSearch=229210360, idleAdmin=154261025, deltaOptimize=2400093, proccount=0
D 2014/08/31 12:00:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:00:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:00:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:00:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:00:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:00:33 SWITCHBOARD Solr auto-optimization: idleSearch=229510363, idleAdmin=154561028, deltaOptimize=2700096, proccount=0
D 2014/08/31 12:05:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:05:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:05:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:05:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:05:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:05:33 SWITCHBOARD Solr auto-optimization: idleSearch=229810372, idleAdmin=154861037, deltaOptimize=3000105, proccount=0
D 2014/08/31 12:10:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:10:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:10:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:10:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:10:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:10:33 SWITCHBOARD Solr auto-optimization: idleSearch=230110375, idleAdmin=155161040, deltaOptimize=3300108, proccount=0
D 2014/08/31 12:15:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:15:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:15:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:15:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:15:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:15:33 SWITCHBOARD Solr auto-optimization: idleSearch=230410383, idleAdmin=155461048, deltaOptimize=3600116, proccount=0
D 2014/08/31 12:20:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:20:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:20:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:20:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:20:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:20:33 SWITCHBOARD Solr auto-optimization: idleSearch=230710400, idleAdmin=155761065, deltaOptimize=3900133, proccount=0
D 2014/08/31 12:25:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:25:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:25:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:25:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:25:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:25:33 SWITCHBOARD Solr auto-optimization: idleSearch=231010470, idleAdmin=156061135, deltaOptimize=4200203, proccount=0
D 2014/08/31 12:30:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:30:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:30:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:30:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:30:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:30:33 SWITCHBOARD Solr auto-optimization: idleSearch=231310474, idleAdmin=156361139, deltaOptimize=4500207, proccount=0
D 2014/08/31 12:35:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:35:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:35:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:35:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:35:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:35:33 SWITCHBOARD Solr auto-optimization: idleSearch=231610485, idleAdmin=156661150, deltaOptimize=4800218, proccount=0
D 2014/08/31 12:40:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:40:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:40:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:40:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:40:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:40:33 SWITCHBOARD Solr auto-optimization: idleSearch=231910488, idleAdmin=156961153, deltaOptimize=5100221, proccount=0
D 2014/08/31 12:45:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:45:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:45:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:45:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:45:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:45:33 SWITCHBOARD Solr auto-optimization: idleSearch=232210502, idleAdmin=157261167, deltaOptimize=5400235, proccount=0
D 2014/08/31 12:50:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:50:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:50:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:50:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:50:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:50:33 SWITCHBOARD Solr auto-optimization: idleSearch=232510504, idleAdmin=157561169, deltaOptimize=5700237, proccount=0
D 2014/08/31 12:55:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 12:55:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 12:55:33 RESOURCE OBSERVER resources ok
I 2014/08/31 12:55:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 12:55:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 12:55:33 SWITCHBOARD Solr auto-optimization: idleSearch=232810517, idleAdmin=157861182, deltaOptimize=6000250, proccount=0
D 2014/08/31 13:00:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 13:00:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 13:00:33 RESOURCE OBSERVER resources ok
I 2014/08/31 13:00:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 13:00:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 13:00:33 SWITCHBOARD Solr auto-optimization: idleSearch=233110519, idleAdmin=158161184, deltaOptimize=6300252, proccount=0
D 2014/08/31 13:05:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 13:05:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 13:05:33 RESOURCE OBSERVER resources ok
I 2014/08/31 13:05:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 13:05:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 13:05:33 SWITCHBOARD Solr auto-optimization: idleSearch=233410531, idleAdmin=158461196, deltaOptimize=6600264, proccount=0
D 2014/08/31 13:10:33 SWITCHBOARD Cleaning Incoming News, 0 entries on stack
I 2014/08/31 13:10:33 YACY rulebasedUpdateInfo: not an automatic update selected
I 2014/08/31 13:10:33 RESOURCE OBSERVER resources ok
I 2014/08/31 13:10:33 SWITCHBOARD cleanup post-processed 0 documents
I 2014/08/31 13:10:33 NoticedURL CLEARING ALL STACKS
I 2014/08/31 13:10:33 SWITCHBOARD Solr auto-optimization: idleSearch=233710534, idleAdmin=158761199, deltaOptimize=6900267, proccount=0
(0000880)
LA_FORGE (reporter)
2014-09-07 12:14

I would like to correct my insight above; the timeframe between 'CollectionConfiguration convergence step 2 for host iphone.tmcnet.com' and 'CollectionConfiguration collection - postprocessed 8600 from 9948796 documents' is up to 4 days. Nothing more than my paste from the first comment is shown during this time. More verbosity would be very appreciated.
(0000881)
LA_FORGE (reporter)
2014-09-07 12:18

My most recent calculation unearths that the whole process will run until december.
(0000963)
Orbiter (manager)
2014-12-07 23:57

the postprocessing method has recently enhanced, but because it is still not as performant as expected, the postprocessing has been disabled by default. You can disable the postprocessing as well by disabling the field process_sxt.

- Issue History
Date Modified Username Field Change
2014-08-25 08:12 LA_FORGE New Issue
2014-08-31 13:43 LA_FORGE Note Added: 0000875
2014-08-31 13:44 LA_FORGE Note Deleted: 0000875
2014-08-31 13:45 LA_FORGE Note Added: 0000876
2014-09-07 12:14 LA_FORGE Note Added: 0000880
2014-09-07 12:18 LA_FORGE Note Added: 0000881
2014-12-07 23:57 Orbiter Note Added: 0000963
2014-12-07 23:57 Orbiter Status new => resolved
2014-12-07 23:57 Orbiter Resolution open => fixed
2014-12-07 23:57 Orbiter Assigned To => Orbiter


Copyright © 2000 - 2019 MantisBT Team
Powered by Mantis Bugtracker