YaCy-Bugtracker

View Issue Details Jump to Notes ] Issue History ] Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0000682YaCy[All Projects] Generalpublic2016-08-29 10:412016-11-30 04:56
ReporterGuims 
Assigned To 
PriorityhighSeveritymajorReproducibilityalways
StatusnewResolutionopen 
ETAnone 
PlatformOSOS Version
Product Version 
Target VersionFixed in Version 
Summary0000682: Internal Index Export YAcy 1.9
DescriptionWith Yacy 1.90/9000

When i try to export my index i have always the same message:
Export to file -no export- failed: number of exported documents == 0
Steps To ReproduceGo to IndexExport_p.html
Use default filter

Export Path /usr/share/yacy/DATA/EXPORT/
URL Filter .*.*
query *.*
maximum age (seconds, -1 = unlimited) -1

Click Export

2016/08/21 00:45:06 org.apache.solr.handler.RequestHandlerBase java.lang.IllegalStateException: unexpected docvalues type NONE for field 'load_date_dt' (expected=NUMERIC). Use UninvertingReader or index with docvalues.
Additional Information2016/08/21 00:45:06 org.apache.solr.handler.RequestHandlerBase java.lang.IllegalStateException: unexpected docvalues type NONE for field 'load_date_dt' (expected=NUMERIC). Use UninvertingReader or index with docvalues.
TagsNo tags attached.
Attached Files

- Relationships
related to 0000681new This error should be handled/catched by the reindex/recrawl procedures 

-  Notes
(0001290)
BuBu (developer)
2016-08-30 00:44
edited on: 2016-08-30 00:56

That's likely nothing that can be fixed in the code base and a Solr index issue.
Since introduction of docvalues in the YaCy Solr schema (some time ago) https://github.com/yacy/yacy_search_server/commit/87e4abe393d70165e3d7dfaec5be7365ff2ac965#diff-0aebdb8a8b7e1ed37f8db6f5388627cf, [^] documents indexed before the change may produce this error message.
Solr docvalue references are created at index time, so the docs need to be reindexed to comply with the current sturcture.
Alternatively the doc's creating the error could be deleted.

(0001293)
LA_FORGE (reporter)
2016-09-09 19:28

Thx for the relation to my issue. So a re-crawl of all index documents utilizing the new implemented feature at the page 'IndexReIndexMonitor_p.html' will fix this issue?
(0001294)
Guims (reporter)
2016-09-15 14:41

I have 23 millions urls in my index from 1200 websites, we can't reindex all urls. What is this solution ?" Alternatively the doc's creating the error could be deleted."
(0001348)
DNcrawler (reporter)
2016-11-30 04:56

I also have the same error appearing in my logs on startup of yacy, not just during export. I have 19 million docs from 45000 sites indexed from prior versions, so if there is a way to re-index, I could do that, or just continue to ignore it hoping nothing bad is occurring within the indexes.

- Issue History
Date Modified Username Field Change
2016-08-29 10:41 Guims New Issue
2016-08-30 00:44 BuBu Note Added: 0001290
2016-08-30 00:47 BuBu Relationship added related to 0000681
2016-08-30 00:50 BuBu Note Edited: 0001290 View Revisions
2016-08-30 00:56 BuBu Note Edited: 0001290 View Revisions
2016-09-09 19:28 LA_FORGE Note Added: 0001293
2016-09-15 14:41 Guims Note Added: 0001294
2016-11-30 04:56 DNcrawler Note Added: 0001348


Copyright © 2000 - 2017 MantisBT Team
Powered by Mantis Bugtracker