YaCy-Bugtracker

View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0000273YaCy[All Projects] Generalpublic2013-07-27 14:442013-07-28 19:37
ReporterQuix0r 
Assigned To 
PrioritynormalSeverityminorReproducibilityrandom
StatusnewResolutionopen 
ETAnone 
PlatformDebian Wheezy/JessieOSLinuxOS Version3.9.7
Product VersionYaCy 1.0 
Target VersionFixed in Version 
Summary0000273: More NPEs
DescriptionAs the NPEs (NullPointerException) doesn't want to stop here at my node, I track them now not separately. This ticket should also serve as a parent ticket for all other NPE-related tickets.

I then try to fix them in my repository:
https://gitorious.org/~quix0r/yacy/quix0rs-yacy-rc1/ [^]
Additional InformationHere is the next one:
W 2013/07/27 14:41:03 StackTrace null
java.lang.NullPointerException
        at net.yacy.search.schema.CollectionConfiguration$CRHost.convergenceStep(CollectionConfiguration.java:1119)
        
at net.yacy.search.schema.CollectionConfiguration.postprocessing(CollectionConfiguration.java:898)
        at net.yacy.search.Switchboard.cleanupJob(Switchboard.java:2296)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at net.yacy.kelondro.workflow.InstantBusyThread.job(InstantBusyThread.java:107)
        at net.yacy.kelondro.workflow.AbstractBusyThread.run(AbstractBusyThread.java:165)
TagsNo tags attached.
Attached Files

- Relationships
parent of 0000259new NPE in RobotsTxt Thread 
parent of 0000264resolvedOrbiter NPEs @ v1.52/9156 
parent of 0000257new NPE beim Herunterfahren/Neustarten der Node 
parent of 0000256closedOrbiter NPE beim Starten/Verteilen von RWIs 
parent of 0000255new Remote Crawler loest NPE aus 
parent of 0000187new NPE @ Crawler Queue 
parent of 0000130new "False positive" - indexing not allowed - indexText and indexMedia not set 
parent of 0000024resolvedOrbiter BLOCKINGTHREAD Runtime Error in serverInstantThread.job 
parent of 0000082resolvedOrbiter Yacy throws java.lang.reflect.InvocationTargetException 
parent of 0000194new Keine Ergebnisanzeige, Nullpointerexeption in Log 
parent of 0000080resolvedOrbiter Yacy process hangs 
parent of 0000132resolvedOrbiter SMB & File Crawler funktionieren nicht 
parent of 0000092resolvedOrbiter Exceptions after starting yacy 
Not all the children of this issue are yet resolved or closed.

-  Notes
(0000579)
Quix0r (updater)
2013-07-27 15:23

And one more (la_forge has similar bug):

W 2013/07/27 15:02:57 StackTrace null
java.lang.NullPointerException
    at java.io.File.<init>(File.java:334)
    at BlacklistCleaner_p.respond(BlacklistCleaner_p.java:76)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at net.yacy.server.http.HTTPDFileHandler.invokeServlet(HTTPDFileHandler.java:1419)
    at net.yacy.server.http.HTTPDFileHandler.doResponse(HTTPDFileHandler.java:953)
    at net.yacy.server.http.HTTPDFileHandler.doGet(HTTPDFileHandler.java:250)
    at net.yacy.server.http.HTTPDemon.GET(HTTPDemon.java:402)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at net.yacy.server.serverCore$Session.listen(serverCore.java:767)
    at net.yacy.server.serverCore$Session.run(serverCore.java:658)
(0000580)
Quix0r (updater)
2013-07-27 15:56
edited on: 2013-07-27 16:27

A fix for last NPE is to change your yacy.conf from:
listsPath=DATA/LISTS

to:
listManager.listsPath=DATA/LISTS

It also helped la_forge to fix his peer.

(0000581)
Quix0r (updater)
2013-07-27 16:00

Here is a fix for first NPE in CollectionConfiguration.java:
https://gitorious.org/~quix0r/yacy/quix0rs-yacy-rc1/commit/24a6691dfedcb6146f3a24eb276f311f41f03ba7 [^]
(0000586)
Quix0r (updater)
2013-07-28 18:02
edited on: 2013-07-28 19:37

And another one:
E 2013/07/28 18:01:36 BUSYTHREAD Runtime Error in serverInstantThread.job, thread 'HTTPClient-localhost': 
null; target exception: null
java.lang.NullPointerException
        at net.yacy.search.schema.CollectionConfiguration$CRHost.log(CollectionConfiguration.java:1062)
        
at net.yacy.search.schema.CollectionConfiguration.postprocessing(CollectionConfiguration.java:903)
        at net.yacy.search.Switchboard.cleanupJob(Switchboard.java:2297)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at net.yacy.kelondro.workflow.InstantBusyThread.job(InstantBusyThread.java:107)
        at net.yacy.kelondro.workflow.AbstractBusyThread.run(AbstractBusyThread.java:165)

Please remember that the line numbers only fit to my repository. Line 1062 says:
String url = (String) connector.getDocumentById(ASCII.String(entry.getKey()), CollectionSchema.sku.getSolrFieldName()).getFieldValue(CollectionSchema.sku.getSolrFieldName());

The instance "connector" was NULL here. This repeatable happens on shutdown:
- Let the remote crawler work for some time (so that there is work to do)
- Stop it, e.g.: /Crawler_p.html?pause=remotecrawler
- Wait until the crawler is fully stopped (does not crawl anymore)
- Shutdown the peer

For me it looks like that the connector has shutdown first and then the cleanup-job cannot find the instance.


- Issue History
Date Modified Username Field Change
2013-07-27 14:44 Quix0r New Issue
2013-07-27 14:44 Quix0r Relationship added parent of 0000259
2013-07-27 14:44 Quix0r Relationship added parent of 0000264
2013-07-27 14:44 Quix0r Relationship added parent of 0000257
2013-07-27 14:44 Quix0r Relationship added parent of 0000256
2013-07-27 14:45 Quix0r Relationship added parent of 0000255
2013-07-27 14:45 Quix0r Relationship added parent of 0000187
2013-07-27 14:45 Quix0r Relationship added parent of 0000130
2013-07-27 14:46 Quix0r Relationship added parent of 0000024
2013-07-27 14:46 Quix0r Relationship added parent of 0000082
2013-07-27 14:47 Quix0r Relationship added parent of 0000194
2013-07-27 14:47 Quix0r Relationship added parent of 0000080
2013-07-27 14:47 Quix0r Relationship added parent of 0000132
2013-07-27 14:48 Quix0r Relationship added parent of 0000092
2013-07-27 15:23 Quix0r Note Added: 0000579
2013-07-27 15:56 Quix0r Note Added: 0000580
2013-07-27 16:00 Quix0r Note Added: 0000581
2013-07-27 16:27 Quix0r Note Edited: 0000580 View Revisions
2013-07-28 18:02 Quix0r Note Added: 0000586
2013-07-28 18:04 Quix0r Note Edited: 0000586 View Revisions
2013-07-28 18:05 Quix0r Note Edited: 0000586 View Revisions
2013-07-28 18:39 Quix0r Note Edited: 0000586 View Revisions
2013-07-28 19:37 Quix0r Note Edited: 0000586 View Revisions


Copyright © 2000 - 2019 MantisBT Team
Powered by Mantis Bugtracker