[JENA-217] tdbloader : Unsafe memory access operation

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Cannot Reproduce
• Affects Version/s: Fuseki 0.2.1
• Component/s: TDB

Environment

Ubuntu 10.04

• Assignee: Andy Seaborne
• Reporter: Sarven Capadisli
• Created: 04/Mar/12 19:16
• Updated: 13/Jul/12 12:44
• Resolved: 13/Jul/12 12:44

Description

First of all, I'm not sure if this is necessarily a bug or whether my system encountered some other issue. Here it is:

I'm trying to import world-development-indicators.nt which is 68 GB into a TDB store.

I've performed the following operation:

java tdb.tdbloader --loc /usr/lib/fuseki/DB/DB.worldbank2 world-development-indicators --graph=http://worldbank.270a.info/graph/world-bank-indicators /data/worldbank.270a.info/indicators/en/indicator/world-bank-indicators.nt

..
360,393,432 triples loaded in 15,956.80 seconds [Rate: 22,585.57 per second]
..

• • Index GSPO->GPOS: 360,202,756 slots indexed in 18,194.61 seconds [Rate: 19,797.23 per second]
    ..
  • Index GSPO->GOSP: 360,202,756 slots indexed in 4,410.64 seconds [Rate: 81,666.85 per second]
    ..
  • Index GSPO->POSG: 360,202,756 slots indexed in 4,354.58 seconds [Rate: 82,718.05 per second]
    ..
  • Index GSPO->OSPG: 360,202,756 slots indexed in 4,084.50 seconds [Rate: 88,187.73 per second]
    ..
    Index GSPO->SPOG: 113,900,000 slots (Batch: 213,675 slots/s / Avg: 113,695 slots/s)
    Exception in thread "main" java.lang.InternalError: a fault occurred in a recent unsafe memory access operation in compiled Java code
    at com.hp.hpl.jena.tdb.lib.TupleLib.tuple(TupleLib.java:208)
    at com.hp.hpl.jena.tdb.index.TupleIndexRecord$1.convert(TupleIndexRecord.java:195)
    at com.hp.hpl.jena.tdb.index.TupleIndexRecord$1.convert(TupleIndexRecord.java:191)
    at org.openjena.atlas.iterator.Iter$4.next(Iter.java:293)
    at com.hp.hpl.jena.tdb.store.bulkloader.LoaderNodeTupleTable.copyIndex(LoaderNodeTupleTable.java:209)
    at com.hp.hpl.jena.tdb.store.bulkloader.BuilderSecondaryIndexesSequential.createSecondaryIndexes(BuilderSecondaryIndexesSequential.java:43)
    at com.hp.hpl.jena.tdb.store.bulkloader.LoaderNodeTupleTable.createSecondaryIndexes(LoaderNodeTupleTable.java:192)
    at com.hp.hpl.jena.tdb.store.bulkloader.LoaderNodeTupleTable.loadSecondaryIndexes(LoaderNodeTupleTable.java:91)
    at com.hp.hpl.jena.tdb.store.bulkloader.LoaderNodeTupleTable.loadIndexStart(LoaderNodeTupleTable.java:144)
    at com.hp.hpl.jena.tdb.store.bulkloader.BulkLoader$1.finish(BulkLoader.java:232)
    at com.hp.hpl.jena.tdb.store.bulkloader.BulkLoader.loadTriples$(BulkLoader.java:141)
    at com.hp.hpl.jena.tdb.store.bulkloader.BulkLoader.loadNamedGraph(BulkLoader.java:107)
    at com.hp.hpl.jena.tdb.TDBLoader.loadNamedGraph$(TDBLoader.java:271)
    at com.hp.hpl.jena.tdb.TDBLoader.loadGraph$(TDBLoader.java:246)
    at com.hp.hpl.jena.tdb.TDBLoader.loadGraph(TDBLoader.java:177)
    at com.hp.hpl.jena.tdb.TDBLoader.load(TDBLoader.java:112)
    at tdb.tdbloader.loadNamedGraph(tdbloader.java:157)
    at tdb.tdbloader.exec(tdbloader.java:142)
    at arq.cmdline.CmdMain.mainMethod(CmdMain.java:97)
    at arq.cmdline.CmdMain.mainRun(CmdMain.java:59)
    at arq.cmdline.CmdMain.mainRun(CmdMain.java:46)
    at tdb.tdbloader.main(tdbloader.java:53)