YaCy-Bugtracker - YaCy
View Issue Details
IDProjectCategoryView StatusDate SubmittedLast Update
0000682YaCy[All Projects] Generalpublic2016-08-29 10:412017-04-29 21:26
ReporterGuims 
Assigned Toadministrator 
PriorityhighSeveritymajorReproducibilityalways
StatusresolvedResolutionfixed 
ETAnone 
PlatformOSOS Version
Product Version 
Target VersionFixed in Version 
Summary0000682: Internal Index Export YAcy 1.9
DescriptionWith Yacy 1.90/9000

When i try to export my index i have always the same message:
Export to file -no export- failed: number of exported documents == 0
Steps To ReproduceGo to IndexExport_p.html
Use default filter

Export Path /usr/share/yacy/DATA/EXPORT/
URL Filter .*.*
query *.*
maximum age (seconds, -1 = unlimited) -1

Click Export

2016/08/21 00:45:06 org.apache.solr.handler.RequestHandlerBase java.lang.IllegalStateException: unexpected docvalues type NONE for field 'load_date_dt' (expected=NUMERIC). Use UninvertingReader or index with docvalues.
Additional Information2016/08/21 00:45:06 org.apache.solr.handler.RequestHandlerBase java.lang.IllegalStateException: unexpected docvalues type NONE for field 'load_date_dt' (expected=NUMERIC). Use UninvertingReader or index with docvalues.
TagsNo tags attached.
Relationships
related to 0000681new  This error should be handled/catched by the reindex/recrawl procedures 
Attached Files
Issue History
Date ModifiedUsernameFieldChange
2016-08-29 10:41GuimsNew Issue
2016-08-30 00:44BuBuNote Added: 0001290
2016-08-30 00:47BuBuRelationship addedrelated to 0000681
2016-08-30 00:50BuBuNote Edited: 0001290bug_revision_view_page.php?bugnote_id=1290#r372
2016-08-30 00:56BuBuNote Edited: 0001290bug_revision_view_page.php?bugnote_id=1290#r373
2016-09-09 19:28LA_FORGENote Added: 0001293
2016-09-15 14:41GuimsNote Added: 0001294
2016-11-30 04:56DNcrawlerNote Added: 0001348
2017-04-28 11:43lucNote Added: 0001399
2017-04-29 21:26BuBuNote Added: 0001402
2017-04-29 21:26BuBuStatusnew => resolved
2017-04-29 21:26BuBuResolutionopen => fixed
2017-04-29 21:26BuBuAssigned To => administrator

Notes
(0001290)
BuBu   
2016-08-30 00:44   
(edited on: 2016-08-30 00:56)
That's likely nothing that can be fixed in the code base and a Solr index issue.
Since introduction of docvalues in the YaCy Solr schema (some time ago) https://github.com/yacy/yacy_search_server/commit/87e4abe393d70165e3d7dfaec5be7365ff2ac965#diff-0aebdb8a8b7e1ed37f8db6f5388627cf, [^] documents indexed before the change may produce this error message.
Solr docvalue references are created at index time, so the docs need to be reindexed to comply with the current sturcture.
Alternatively the doc's creating the error could be deleted.
(0001293)
LA_FORGE   
2016-09-09 19:28   
Thx for the relation to my issue. So a re-crawl of all index documents utilizing the new implemented feature at the page 'IndexReIndexMonitor_p.html' will fix this issue?
(0001294)
Guims   
2016-09-15 14:41   
I have 23 millions urls in my index from 1200 websites, we can't reindex all urls. What is this solution ?" Alternatively the doc's creating the error could be deleted."
(0001348)
DNcrawler   
2016-11-30 04:56   
I also have the same error appearing in my logs on startup of yacy, not just during export. I have 19 million docs from 45000 sites indexed from prior versions, so if there is a way to re-index, I could do that, or just continue to ignore it hoping nothing bad is occurring within the indexes.
(0001399)
luc   
2017-04-28 11:43   
A fix is proposed here https://github.com/yacy/yacy_search_server/commit/9697209ef6f672543c01e4edf2173ed90b0412fe [^]
Tested with (small) DATA and index migrated from YaCy 1.82 to latest 1.92/9185.
(0001402)
BuBu   
2017-04-29 21:26   
https://github.com/yacy/yacy_search_server/commit/9697209ef6f672543c01e4edf2173ed90b0412fe [^]