Sqoop
  1. Sqoop
  2. SQOOP-971

Sqoop2: Component reconfigurability

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.99.2
    • Fix Version/s: 1.99.3
    • Component/s: None
    • Labels:
      None

      Description

      Our configuration manager supports reloading configuration file without restarting the server, however most of the components do not support on-the-fly reconfiguration. We might consider implementing this feature.

      1. SQOOP-971.4.patch
        19 kB
        Mengwei Ding
      2. SQOOP-971.3.patch
        20 kB
        Mengwei Ding
      3. SQOOP-971.2.patch
        19 kB
        Mengwei Ding
      4. SQOOP-971.1.patch
        18 kB
        Mengwei Ding
      5. SQOOP-971.1.pdf
        80 kB
        Mengwei Ding

        Issue Links

          Activity

          Hide
          Jarek Jarcec Cecho added a comment -

          Hi Mengwei Ding, the initial proposal looks good, please go ahead with the implementation!

          Show
          Jarek Jarcec Cecho added a comment - Hi Mengwei Ding , the initial proposal looks good, please go ahead with the implementation!
          Hide
          ASF subversion and git services added a comment -

          Commit d62567ddf3b553956a3cb2a999ef47abdbc8eeb3 in branch refs/heads/sqoop2 from Jarek Jarcec Cecho
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=d62567d ]

          SQOOP-971: Sqoop2: Component reconfigurability

          (Mengwei Ding via Jarek Jarcec Cecho)

          Show
          ASF subversion and git services added a comment - Commit d62567ddf3b553956a3cb2a999ef47abdbc8eeb3 in branch refs/heads/sqoop2 from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=d62567d ] SQOOP-971 : Sqoop2: Component reconfigurability (Mengwei Ding via Jarek Jarcec Cecho)
          Hide
          Jarek Jarcec Cecho added a comment -

          Thank you Mengwei Ding for your contribution!

          Show
          Jarek Jarcec Cecho added a comment - Thank you Mengwei Ding for your contribution!
          Hide
          Hudson added a comment -

          Integrated in Sqoop2-hadoop100 #423 (See https://builds.apache.org/job/Sqoop2-hadoop100/423/)
          SQOOP-971: Sqoop2: Component reconfigurability (Revision d62567ddf3b553956a3cb2a999ef47abdbc8eeb3)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d62567ddf3b553956a3cb2a999ef47abdbc8eeb3
          Files :

          • core/src/main/java/org/apache/sqoop/repository/RepositoryProvider.java
          • core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryProvider.java
          • core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java
          • core/src/main/java/org/apache/sqoop/core/Reconfigurable.java
          • core/src/main/java/org/apache/sqoop/core/CoreError.java
          • core/src/main/java/org/apache/sqoop/connector/ConnectorManager.java
          • core/src/main/java/org/apache/sqoop/core/SqoopConfiguration.java
          • core/src/main/java/org/apache/sqoop/repository/RepositoryManager.java
          • core/src/main/java/org/apache/sqoop/framework/JobManager.java
          Show
          Hudson added a comment - Integrated in Sqoop2-hadoop100 #423 (See https://builds.apache.org/job/Sqoop2-hadoop100/423/ ) SQOOP-971 : Sqoop2: Component reconfigurability (Revision d62567ddf3b553956a3cb2a999ef47abdbc8eeb3) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d62567ddf3b553956a3cb2a999ef47abdbc8eeb3 Files : core/src/main/java/org/apache/sqoop/repository/RepositoryProvider.java core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryProvider.java core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java core/src/main/java/org/apache/sqoop/core/Reconfigurable.java core/src/main/java/org/apache/sqoop/core/CoreError.java core/src/main/java/org/apache/sqoop/connector/ConnectorManager.java core/src/main/java/org/apache/sqoop/core/SqoopConfiguration.java core/src/main/java/org/apache/sqoop/repository/RepositoryManager.java core/src/main/java/org/apache/sqoop/framework/JobManager.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop2-hadoop200 #421 (See https://builds.apache.org/job/Sqoop2-hadoop200/421/)
          SQOOP-971: Sqoop2: Component reconfigurability (Revision d62567ddf3b553956a3cb2a999ef47abdbc8eeb3)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d62567ddf3b553956a3cb2a999ef47abdbc8eeb3
          Files :

          • core/src/main/java/org/apache/sqoop/repository/RepositoryManager.java
          • core/src/main/java/org/apache/sqoop/framework/JobManager.java
          • core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java
          • core/src/main/java/org/apache/sqoop/core/SqoopConfiguration.java
          • core/src/main/java/org/apache/sqoop/core/CoreError.java
          • core/src/main/java/org/apache/sqoop/core/Reconfigurable.java
          • core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryProvider.java
          • core/src/main/java/org/apache/sqoop/connector/ConnectorManager.java
          • core/src/main/java/org/apache/sqoop/repository/RepositoryProvider.java
          Show
          Hudson added a comment - Integrated in Sqoop2-hadoop200 #421 (See https://builds.apache.org/job/Sqoop2-hadoop200/421/ ) SQOOP-971 : Sqoop2: Component reconfigurability (Revision d62567ddf3b553956a3cb2a999ef47abdbc8eeb3) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d62567ddf3b553956a3cb2a999ef47abdbc8eeb3 Files : core/src/main/java/org/apache/sqoop/repository/RepositoryManager.java core/src/main/java/org/apache/sqoop/framework/JobManager.java core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java core/src/main/java/org/apache/sqoop/core/SqoopConfiguration.java core/src/main/java/org/apache/sqoop/core/CoreError.java core/src/main/java/org/apache/sqoop/core/Reconfigurable.java core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryProvider.java core/src/main/java/org/apache/sqoop/connector/ConnectorManager.java core/src/main/java/org/apache/sqoop/repository/RepositoryProvider.java

            People

            • Assignee:
              Mengwei Ding
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development