Accumulo
  1. Accumulo
  2. ACCUMULO-2719

Shell fails to find instance_id when using viewfs

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.6.1, 1.7.0
    • Component/s: shell
    • Labels:
      None

      Description

      Shell fails to find instance id at /accumulo/instance_id when just the name service roots are configured in viewfs. Fails at ZooUtil.getInstanceIDFromHDFS(line 63). I'm thinking the code should prepend one of the instance.volumes.

      Workaround is to explicitly map /accumulo/instance_id in viewfs to one of the locations.

        Activity

        Dave Marion created issue -
        Hide
        Josh Elser added a comment -

        Dave Marion, can you elaborate on your configuration here (notably the instance.* values in accumulo-site.xml and your viewfs mount table)? You're trying to run Accumulo over ViewFS, but as I understand it, viewfs presents a single Hadoop FileSystem over multiple DFS instances using mount-points, so I'm confused as to the environment.

        You mention instance.volumes, but I would have thought that you'd use viewfs to try to alleviate the need to specify multiple volumes when you only want to pin a certain table to a given filesystem (and not spread files across many filesystems).

        Also, how/where did accumulo init write the instance_id?

        Show
        Josh Elser added a comment - Dave Marion , can you elaborate on your configuration here (notably the instance.* values in accumulo-site.xml and your viewfs mount table)? You're trying to run Accumulo over ViewFS, but as I understand it, viewfs presents a single Hadoop FileSystem over multiple DFS instances using mount-points, so I'm confused as to the environment. You mention instance.volumes , but I would have thought that you'd use viewfs to try to alleviate the need to specify multiple volumes when you only want to pin a certain table to a given filesystem (and not spread files across many filesystems). Also, how/where did accumulo init write the instance_id?
        Hide
        Dave Marion added a comment -

        viewfs:
        /clustera -> hdfs://clustera
        /clusterb -> hdfs://clusterb

        instance.volumes: hdfs://clustera/accumulo,hdfs://clusterb/accumulo

        To get things to work, I have to add the following entry to viewfs:

        /accumulo/instance_id -> hdfs://clustera/accumulo/instance_id

        Show
        Dave Marion added a comment - viewfs: /clustera -> hdfs://clustera /clusterb -> hdfs://clusterb instance.volumes: hdfs://clustera/accumulo,hdfs://clusterb/accumulo To get things to work, I have to add the following entry to viewfs: /accumulo/instance_id -> hdfs://clustera/accumulo/instance_id
        Hugh Mann made changes -
        Field Original Value New Value
        Priority Minor [ 4 ] Blocker [ 1 ]
        Josh Elser made changes -
        Priority Blocker [ 1 ] Minor [ 4 ]
        Hide
        Josh Elser added a comment -

        Without a fixVersion, this isn't a blocker bug.

        Show
        Josh Elser added a comment - Without a fixVersion, this isn't a blocker bug.
        Ed Coleman made changes -
        Fix Version/s 1.6.1 [ 12325441 ]
        Ed Coleman made changes -
        Priority Minor [ 4 ] Blocker [ 1 ]
        Ed Coleman made changes -
        Assignee Eric Newton [ ecn ]
        Hide
        Ed Coleman added a comment -

        Set fix version and assigned to @Eric Newton

        Show
        Ed Coleman added a comment - Set fix version and assigned to @Eric Newton
        Christopher Tubbs made changes -
        Fix Version/s 1.7.0 [ 12324607 ]
        ASF subversion and git services logged work - 17/Jul/14 20:48
        ASF subversion and git services made changes -
        Remaining Estimate 0h [ 0 ]
        Time Spent 10m [ 600 ]
        Worklog Id 16667 [ 16667 ]
        ASF subversion and git services logged work - 17/Jul/14 20:48
        ASF subversion and git services made changes -
        Time Spent 10m [ 600 ] 20m [ 1200 ]
        Worklog Id 16668 [ 16668 ]
        Eric Newton made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Eric Newton
            Reporter:
            Dave Marion
          • Votes:
            1 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 20m
              20m

                Development