Uploaded image for project: 'Accumulo'
  1. Accumulo
  2. ACCUMULO-335

Can't batchscan over the !METADATA table

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.0
    • Fix Version/s: 1.6.0
    • Component/s: client, tserver
    • Labels:
      None

      Description

      If you batch scan over the !METADATA table and have a tserver hosting both the root tablet and a metadata tablet, then you you will get an error. The quick fix is to specify a range. We should fix this in the long term. Perhaps this is a good reason to finally split the root tablet into it's own table?

        Issue Links

          Activity

          Hide
          kturner Keith Turner added a comment -

          An exception like the following will show up in 1.4 when you run into this issue.

          root@test14> grep -t !METADATA -nt 1 time
          28 16:25:45,753 [impl.TabletServerBatchReaderIterator] WARN : multiple extent types not allowed METADATA ROOT
          java.lang.IllegalArgumentException: multiple extent types not allowed METADATA ROOT
          	at org.apache.accumulo.core.client.impl.TabletType.type(TabletType.java:45)
          	at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderIterator.java:537)
          	at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator$QueryTask.run(TabletServerBatchReaderIterator.java:338)
          	at org.apache.accumulo.cloudtrace.instrument.TraceRunnable.run(TraceRunnable.java:47)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
          	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
          	at java.lang.Thread.run(Thread.java:662)
          

          A workaround is to scan the root tablet and metadata tablets separately as follows :

          root@test14> grep -t !METADATA -e !0< time
          !0;~ srv:time []    L3
          !0< srv:time []    L0
          root@test14> grep -t !METADATA -b 0 time
          1< srv:time []    M0
          
          Show
          kturner Keith Turner added a comment - An exception like the following will show up in 1.4 when you run into this issue. root@test14> grep -t !METADATA -nt 1 time 28 16:25:45,753 [impl.TabletServerBatchReaderIterator] WARN : multiple extent types not allowed METADATA ROOT java.lang.IllegalArgumentException: multiple extent types not allowed METADATA ROOT at org.apache.accumulo.core.client.impl.TabletType.type(TabletType.java:45) at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator.doLookup(TabletServerBatchReaderIterator.java:537) at org.apache.accumulo.core.client.impl.TabletServerBatchReaderIterator$QueryTask.run(TabletServerBatchReaderIterator.java:338) at org.apache.accumulo.cloudtrace.instrument.TraceRunnable.run(TraceRunnable.java:47) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) A workaround is to scan the root tablet and metadata tablets separately as follows : root@test14> grep -t !METADATA -e !0< time !0;~ srv:time [] L3 !0< srv:time [] L0 root@test14> grep -t !METADATA -b 0 time 1< srv:time [] M0
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit 2a968563500f2fbbfcef75be4112694e24a5eda6 in branch refs/heads/master from Christopher Tubbs
          [ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=2a96856 ]

          ACCUMULO-335 Create test to ensure batch scanning over metadata works

          Show
          jira-bot ASF subversion and git services added a comment - Commit 2a968563500f2fbbfcef75be4112694e24a5eda6 in branch refs/heads/master from Christopher Tubbs [ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=2a96856 ] ACCUMULO-335 Create test to ensure batch scanning over metadata works
          Hide
          ctubbsii Christopher Tubbs added a comment -

          This was fixed by ACCUMULO-1481, but I added a test to be sure.

          Show
          ctubbsii Christopher Tubbs added a comment - This was fixed by ACCUMULO-1481 , but I added a test to be sure.

            People

            • Assignee:
              ctubbsii Christopher Tubbs
              Reporter:
              vines John Vines
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development