0000727: Solr database problem: java.nio.file.NoSuchFileException: [..]/segments_* file

View Issue Details [ Jump to Notes ]

[ Issue History ] [ Print ]

Project

Category

View Status

Date Submitted

Last Update

0000727

YaCy

[All Projects] General

public

2017-02-26 18:31

2017-06-15 23:01

Reporter

webproject

Assigned To

administrator

Priority

normal

Severity

minor

Reproducibility

random

Status

resolved

Resolution

fixed

ETA

none

Platform

OS Version

Product Version

Target Version

Fixed in Version

Summary

0000727: Solr database problem: java.nio.file.NoSuchFileException: [..]/segments_* file

Description

java.nio.file.NoSuchFileException: /yacy/DATA/INDEX/freeworld/SEGMENTS/solr_5_5/webgraph/data/index/segments_n0g
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
        at sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144)
        at sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99)
        at java.nio.file.Files.readAttributes(Files.java:1737)
        at java.nio.file.Files.size(Files.java:2332)
        at org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:210)
        at org.apache.solr.handler.admin.LukeRequestHandler.getFileLength(LukeRequestHandler.java:604)
        at org.apache.solr.handler.admin.LukeRequestHandler.getIndexInfo(LukeRequestHandler.java:592)
        at org.apache.solr.handler.admin.LukeRequestHandler.handleRequestBody(LukeRequestHandler.java:137)
        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:155)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:2102)
        at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:178)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:166)
        at net.yacy.cora.federate.solr.connector.SolrServerConnector.getIndexBrowser(SolrServerConnector.java:422)
        at net.yacy.cora.federate.solr.connector.SolrServerConnector.getSegmentCount(SolrServerConnector.java:346)
        at net.yacy.cora.federate.solr.connector.MirrorSolrConnector.getSegmentCount(MirrorSolrConnector.java:133)
        at net.yacy.cora.federate.solr.connector.ConcurrentUpdateSolrConnector.getSegmentCount(ConcurrentUpdateSolrConnector.java:177)
        at status_p.respond(status_p.java:89)
        at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at net.yacy.http.servlets.YaCyDefaultServlet.invokeServlet(YaCyDefaultServlet.java:670)
        at net.yacy.http.servlets.YaCyDefaultServlet.handleTemplate(YaCyDefaultServlet.java:881)
        at net.yacy.http.servlets.YaCyDefaultServlet.doGet(YaCyDefaultServlet.java:312)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:687)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
        at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
        at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:587)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
        at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:542)
        at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
        at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
        at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
        at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
        at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
        at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at net.yacy.http.CrashProtectionHandler.handle(CrashProtectionHandler.java:33)
        at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:499)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
        at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:258)
        at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
        at java.lang.Thread.run(Thread.java:745)
I 2017/02/26 18:15:44 org.apache.solr.update.DirectUpdateHandler2 end_commit_flush

Steps To Reproduce

Aufter some time (1-2 hours) of indexing, the error

java.nio.file.NoSuchFileException: /yacy/DATA/INDEX/freeworld/SEGMENTS/solr_5_5/webgraph/data/index/segments_n0g

arises, where the filename is incrementing from erorr to error, segments_n0g, segments_n0h, segments_n0i and so on.

Filesysystem is OK and yacy can write the file and there is always a segments_* file in this folder.

Notes
(0001381) luc (reporter) 2017-03-07 12:59	It looks like this kind of non-critical error is known for a while by the Solr team, but still unresolved in 5.5.x and 6.x Solr releases (see https://issues.apache.org/jira/browse/SOLR-9120 [^])

(0001443) BuBu (developer) 2017-06-15 23:01	upd by @luc https://github.com/yacy/yacy_search_server/commit/73ab4a7b3adf6ff1e10086199fa4324ecbc47da1 [^]

Issue History
Date Modified	Username	Field	Change
2017-02-26 18:31	webproject	New Issue
2017-02-26 18:31	webproject	File Added: yacy00.log
2017-03-07 12:59	luc	Note Added: 0001381
2017-06-15 23:01	BuBu	Note Added: 0001443
2017-06-15 23:01	BuBu	Status	new => resolved
2017-06-15 23:01	BuBu	Resolution	open => fixed
2017-06-15 23:01	BuBu	Assigned To	=> administrator

Relationships