Details

    • Type: Sub-task Sub-task
    • Status: Reopened
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.6.0
    • Fix Version/s: 0.6.0
    • Component/s: Debian, General, RPM
    • Labels:
      None

      Description

      I would like us to consider bumping version of Sqoop in Bigtop trunk (and Bigtop 0.6) from 1.99.1 to 1.99.2. Here's why:

      As a part of BIGTOP-949, I started playing around with Sqoop in Bigtop trunk. During this process, I found out that even simple commands like show connector --all fail with an error like:

      Exception has occurred during processing command 
      Exception: com.sun.jersey.api.client.UniformInterfaceException Message: GET http://localhost:8080/sqoop/v1/connector/all returned a response status of 400 Bad Request
      

      It turns out that Sqoop's tomcat is trying to bind to port 8080 but MR2 uses the same port 8080 for its shuffle manager (via a property called mapreduce.shuffle.port), hence the error.

      This makes Sqoop unusable on Bigtop trunk and there not much point in writing integration tests for it. The upstream Sqoop JIRA (SQOOP-881) resolves this issue and changes the default Tomcat port to 12000. However, the first release of Sqoop that contains this fix is 1.99.2. Morever, 1.99.2 contains other many other improvements related to Sqoop2.

      Given the usability of current Sqoop version in trunk, I would suggest we bump up the sqoop version from 1.99.1 to 1.99.2 for Bigtop 0.6. Sorry for the late timing of this request. I would love to hear your thoughts or concerns here, so please share!

        Activity

        Mark Grover created issue -
        Roman Shaposhnik made changes -
        Field Original Value New Value
        Parent BIGTOP-816 [ 12625123 ]
        Issue Type Bug [ 1 ] Sub-task [ 7 ]
        Sean Mackrory made changes -
        Assignee Sean Mackrory [ mackrorysd ]
        Sean Mackrory made changes -
        Sean Mackrory made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Roman Shaposhnik made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Roman Shaposhnik made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        made changes -
        Status Closed [ 6 ] Reopened [ 4 ]

          People

          • Assignee:
            Sean Mackrory
            Reporter:
            Mark Grover
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development