Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-2325

Fuse-DFS fails to build on Hadoop 20.203.0

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.20.203.0, 0.20.205.0
    • Fix Version/s: 0.20.205.0
    • Component/s: fuse-dfs, libhdfs
    • Labels:
    • Environment:

      Ubuntu 11.04, Linux 2.6.38-11-generic x86_64

      Description

      In building fuse-dfs, the compile fails due to an argument mismatch between call to hdfsConnectAsUser on line 40 of src/contrib/fuse-dfs/src/fuse_connect.c and an earlier definition of hdfsConnectAsUser given in src/c++/libhdfs/hdfs.h.
      I suggest changing hdfs.h. I made the following change in hdfs.h in my local copy:

      106c106,107
      < hdfsFS hdfsConnectAsUser(const char* host, tPort port, const char *user);

      > // hdfsFS hdfsConnectAsUser(const char* host, tPort port, const char *user);
      > hdfsFS hdfsConnectAsUser(const char* host, tPort port, const char user, const char* groups, int numgroups);

      This new version successfully compiles.

        Activity

        Hide
        Matt Foley added a comment -

        Closed upon release of 0.20.205.0

        Show
        Matt Foley added a comment - Closed upon release of 0.20.205.0
        Hide
        Matt Foley added a comment -

        Kihwal, thanks for tackling this!
        +1 for code review.
        Committed to 0.20-security and 0.20.205.

        Show
        Matt Foley added a comment - Kihwal, thanks for tackling this! +1 for code review. Committed to 0.20-security and 0.20.205.
        Hide
        Kihwal Lee added a comment -

        The API issue is already fixed in trunk, but the build is not working. I think it can still be manually configured and built. This issue will be addressed in HDFS-2097.

        Show
        Kihwal Lee added a comment - The API issue is already fixed in trunk, but the build is not working. I think it can still be manually configured and built. This issue will be addressed in HDFS-2097 .
        Hide
        Kihwal Lee added a comment -

        The localtion of library can be different if the core build used different build directory. Since fuse-dfs build is kind of disconnected right now, it is hardcoded as "build" and no attempt is made to obtain it automatically. If a custom directory is used, it can be specified by "-Dlibhdfs.lib=/path/to/libhdfs.so".

        Show
        Kihwal Lee added a comment - The localtion of library can be different if the core build used different build directory. Since fuse-dfs build is kind of disconnected right now, it is hardcoded as "build" and no attempt is made to obtain it automatically. If a custom directory is used, it can be specified by "-Dlibhdfs.lib=/path/to/libhdfs.so".
        Hide
        Kihwal Lee added a comment -

        Attaching patch for brach-0.20-security and 0.20.205. The API was changed in HDFS-1000. This patch changes fuse_connect.c to follow the new API. It also includes the suggested build.xml change.

        Show
        Kihwal Lee added a comment - Attaching patch for brach-0.20-security and 0.20.205. The API was changed in HDFS-1000 . This patch changes fuse_connect.c to follow the new API. It also includes the suggested build.xml change.
        Hide
        Roman Shaposhnik added a comment -

        I would also like to point out that build.xml for fuse-dfs needs to be modifies in order to pick up libdhfs.so from its new location (build/c++/<arch>/lib).

        Show
        Roman Shaposhnik added a comment - I would also like to point out that build.xml for fuse-dfs needs to be modifies in order to pick up libdhfs.so from its new location (build/c++/<arch>/lib).
        Hide
        Suresh Srinivas added a comment -

        Marking this as blocker for 205.

        Show
        Suresh Srinivas added a comment - Marking this as blocker for 205.

          People

          • Assignee:
            Kihwal Lee
            Reporter:
            Charles Earl
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 10m
              10m
              Remaining:
              Remaining Estimate - 10m
              10m
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development