Uploaded image for project: 'Apache Jena'
  1. Apache Jena
  2. JENA-1296

Fuseki SPARQL endpoints become permanently unresponsive after read/write load

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • Fuseki 2.4.1, Fuseki 2.5.0
    • Jena 3.3.0
    • Fuseki, TDB
    • None
    • CentOS 7.3 inside VM, 2 cores, OpenJDK 1.8.0_121 (64-bit), 1GB JVM heap, Fuseki running as service

    Description

      Steps:

      1. Start with plain Fuseki + given configuration (simple TDB store)
      2. Import 1k.ttl
      3. Run lockup.py (same host, mix of multiple parallel updates & single select)

      Result:
      After some time Fuseki stops accepting any additional SPARQL queries until it is restarted. (They time out at client end and are left in CLOSE_WAIT state on server). During my testing this happened within ~30s of running the script.

      Notes:

      • Locks up more quickly if JVM has had cold start (e.g. restart after step 2) but it definitely is not only a startup issue.
      • During testing the VM was very rarely I/O limited.
      • The "static" web UI elements are accessible, but any SPARQL-querying features (e.g. triple count) do not
      • Reproducible as detailed above in v2.4.1 & v2.5.0
      • In v2.4.0 and v2.3.1 no lockup seems to occur, but once the script has been running for a while, the SELECT query times out sometimes.

      So for now we're limited to using the (now somewhat old) v2.3.1 - it would be nice to be able to upgrade.

      Attachments

        1. prepareCommit_error.tgz
          4 kB
          Vilnis Termanis (Iotic Labs)
        2. lockup_update.sparql
          0.4 kB
          Vilnis Termanis (Iotic Labs)
        3. lockup_select.sparql
          0.4 kB
          Vilnis Termanis (Iotic Labs)
        4. threaddump-1487963000778.tdump
          42 kB
          Vilnis Termanis (Iotic Labs)
        5. fuseki_lockup.tgz
          574 kB
          Vilnis Termanis (Iotic Labs)

        Activity

          People

            andy Andy Seaborne
            vtiotic Vilnis Termanis (Iotic Labs)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: