Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-4751

Some WALs don't replicate due to lacking a createdTime entry

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.7.3, 1.8.1
    • 1.9.0
    • None

    Description

      From what I can tell, the below error is thrown when no data for a particular table is written to a WAL, but the file is closed. This would be because the Status entry from the StatusUtil for fileClosed is pre-built and therefore does not have a createdTime. This prevents a WAL from being replicated until a createdTime entry is added manually.

      From the Accumulo master:

      Status record ([begin: 0 end: 0 infiniteEnd: true closed: true]) for hdfs://namenode:9000/accumulo/wal/tserver.example.com+31732/f922df9c-3ffc-49ee-8d0c-261c7a05fea2 in table 7l was written to metadata table which lacked createdTime
      

      There are two solutions I have in mind:
      1. Update the StatusUtil such that every returned Status object sets the createdTime to System.currentTimeMillis if not explicitly given.
      2. Update the Accumulo Master to set the createdTime to the WAL's modification time in HDFS if the WAL is closed but there is no createdTime.

      Attachments

        1. repl_logs.txt
          14 kB
          Adam J. Shook

        Issue Links

          Activity

            People

              adamjshook Adam J. Shook
              adamjshook Adam J. Shook
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 50m
                  1h 50m