[JENA-1909] TDB1: tdbloader2 crashes

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Done
• Affects Version/s: Jena 3.15.0
• Fix Version/s: Jena 3.16.0
• Component/s: TDB
• Assignee: Unassigned
• Reporter: Jonas Sourlier
• Created: 04/Jun/20 07:33
• Updated: 01/Sep/20 08:29
• Resolved: 24/Jun/20 12:58

Description

This might be related to JENA-1908, but since the stack trace is different, I opened a second ticket.

Tried to import the latest Wikidata dump into Apache Jena, using the following setup:

• Ubuntu 20.04 on Windows 10 Subsystem for Linux
• Apache Jena 3.15.0
• Intel i7 4770K, 32GB RAM

• openjdk 11.0.7 2020-04-14
  OpenJDK Runtime Environment (build 11.0.7+10-post-Ubuntu-3ubuntu1)
  OpenJDK 64-Bit Server VM (build 11.0.7+10-post-Ubuntu-3ubuntu1, mixed mode, sharing)

These are the commands I have run:

wget -c http://mirror.easyname.ch/apache/jena/binaries/apache-jena-3.15.0.tar.gz
tar -xvzf apache-jena-3.15.0.tar.gz
mkdir data
apache-jena-3.15.0/bin/tdbloader2 --phase data --loc data/ ../latest-all.ttl > tdb1.log 2> tdb2.log &
apache-jena-3.15.0/bin/tdbloader2 --phase index --loc data/  > tdb1.log 2> tdb2.log &

The data phase ran fine, but the index phase crashed after about 10 hours. The stack trace is attached to this ticket (tdb2.log).

Here's the standard output:

 08:47:57 INFO -- TDB Bulk Loader Start
 08:47:57 INFO Index Building Phase
 08:47:57 INFO Creating Index SPO
 08:47:58 INFO Sort SPO
 18:26:19 INFO Sort SPO Completed
 18:26:19 INFO Build SPO

 

Issue Links

• is related to: JENA-1908 TDB2: tdb2.tdbloader crashes