Sqoop
  1. Sqoop
  2. SQOOP-971

Sqoop2: Component reconfigurability

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.99.2
    • Fix Version/s: 1.99.3
    • Component/s: None
    • Labels:
      None

      Description

      Our configuration manager supports reloading configuration file without restarting the server, however most of the components do not support on-the-fly reconfiguration. We might consider implementing this feature.

      1. SQOOP-971.4.patch
        19 kB
        Mengwei Ding
      2. SQOOP-971.3.patch
        20 kB
        Mengwei Ding
      3. SQOOP-971.2.patch
        19 kB
        Mengwei Ding
      4. SQOOP-971.1.patch
        18 kB
        Mengwei Ding
      5. SQOOP-971.1.pdf
        80 kB
        Mengwei Ding

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          80d 54m 1 Mengwei Ding 17/Jun/13 23:39
          Patch Available Patch Available Resolved Resolved
          6d 17h 52m 1 Jarek Jarcec Cecho 24/Jun/13 17:32
          Mengwei Ding made changes -
          Affects Version/s 1.99.2 [ 12323640 ]
          Affects Version/s 1.99.1 [ 12323641 ]
          Hide
          Hudson added a comment -

          Integrated in Sqoop2-hadoop200 #421 (See https://builds.apache.org/job/Sqoop2-hadoop200/421/)
          SQOOP-971: Sqoop2: Component reconfigurability (Revision d62567ddf3b553956a3cb2a999ef47abdbc8eeb3)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d62567ddf3b553956a3cb2a999ef47abdbc8eeb3
          Files :

          • core/src/main/java/org/apache/sqoop/repository/RepositoryManager.java
          • core/src/main/java/org/apache/sqoop/framework/JobManager.java
          • core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java
          • core/src/main/java/org/apache/sqoop/core/SqoopConfiguration.java
          • core/src/main/java/org/apache/sqoop/core/CoreError.java
          • core/src/main/java/org/apache/sqoop/core/Reconfigurable.java
          • core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryProvider.java
          • core/src/main/java/org/apache/sqoop/connector/ConnectorManager.java
          • core/src/main/java/org/apache/sqoop/repository/RepositoryProvider.java
          Show
          Hudson added a comment - Integrated in Sqoop2-hadoop200 #421 (See https://builds.apache.org/job/Sqoop2-hadoop200/421/ ) SQOOP-971 : Sqoop2: Component reconfigurability (Revision d62567ddf3b553956a3cb2a999ef47abdbc8eeb3) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d62567ddf3b553956a3cb2a999ef47abdbc8eeb3 Files : core/src/main/java/org/apache/sqoop/repository/RepositoryManager.java core/src/main/java/org/apache/sqoop/framework/JobManager.java core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java core/src/main/java/org/apache/sqoop/core/SqoopConfiguration.java core/src/main/java/org/apache/sqoop/core/CoreError.java core/src/main/java/org/apache/sqoop/core/Reconfigurable.java core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryProvider.java core/src/main/java/org/apache/sqoop/connector/ConnectorManager.java core/src/main/java/org/apache/sqoop/repository/RepositoryProvider.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop2-hadoop100 #423 (See https://builds.apache.org/job/Sqoop2-hadoop100/423/)
          SQOOP-971: Sqoop2: Component reconfigurability (Revision d62567ddf3b553956a3cb2a999ef47abdbc8eeb3)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d62567ddf3b553956a3cb2a999ef47abdbc8eeb3
          Files :

          • core/src/main/java/org/apache/sqoop/repository/RepositoryProvider.java
          • core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryProvider.java
          • core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java
          • core/src/main/java/org/apache/sqoop/core/Reconfigurable.java
          • core/src/main/java/org/apache/sqoop/core/CoreError.java
          • core/src/main/java/org/apache/sqoop/connector/ConnectorManager.java
          • core/src/main/java/org/apache/sqoop/core/SqoopConfiguration.java
          • core/src/main/java/org/apache/sqoop/repository/RepositoryManager.java
          • core/src/main/java/org/apache/sqoop/framework/JobManager.java
          Show
          Hudson added a comment - Integrated in Sqoop2-hadoop100 #423 (See https://builds.apache.org/job/Sqoop2-hadoop100/423/ ) SQOOP-971 : Sqoop2: Component reconfigurability (Revision d62567ddf3b553956a3cb2a999ef47abdbc8eeb3) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d62567ddf3b553956a3cb2a999ef47abdbc8eeb3 Files : core/src/main/java/org/apache/sqoop/repository/RepositoryProvider.java core/src/main/java/org/apache/sqoop/repository/JdbcRepositoryProvider.java core/src/main/java/org/apache/sqoop/framework/FrameworkManager.java core/src/main/java/org/apache/sqoop/core/Reconfigurable.java core/src/main/java/org/apache/sqoop/core/CoreError.java core/src/main/java/org/apache/sqoop/connector/ConnectorManager.java core/src/main/java/org/apache/sqoop/core/SqoopConfiguration.java core/src/main/java/org/apache/sqoop/repository/RepositoryManager.java core/src/main/java/org/apache/sqoop/framework/JobManager.java
          Jarek Jarcec Cecho made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 1.99.3 [ 12324298 ]
          Fix Version/s 2.0.0 [ 12319272 ]
          Resolution Fixed [ 1 ]
          Hide
          Jarek Jarcec Cecho added a comment -

          Thank you Mengwei Ding for your contribution!

          Show
          Jarek Jarcec Cecho added a comment - Thank you Mengwei Ding for your contribution!
          Hide
          ASF subversion and git services added a comment -

          Commit d62567ddf3b553956a3cb2a999ef47abdbc8eeb3 in branch refs/heads/sqoop2 from Jarek Jarcec Cecho
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=d62567d ]

          SQOOP-971: Sqoop2: Component reconfigurability

          (Mengwei Ding via Jarek Jarcec Cecho)

          Show
          ASF subversion and git services added a comment - Commit d62567ddf3b553956a3cb2a999ef47abdbc8eeb3 in branch refs/heads/sqoop2 from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=d62567d ] SQOOP-971 : Sqoop2: Component reconfigurability (Mengwei Ding via Jarek Jarcec Cecho)
          Mengwei Ding made changes -
          Attachment SQOOP-971.4.patch [ 12589434 ]
          Mengwei Ding made changes -
          Attachment SQOOP-971.3.patch [ 12589164 ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 12360 ]
          Mengwei Ding made changes -
          Attachment SQOOP-971.2.patch [ 12588508 ]
          Mengwei Ding made changes -
          Attachment SQOOP-971.2.patch [ 12588507 ]
          Mengwei Ding made changes -
          Attachment SQOOP-971.2.patch [ 12588507 ]
          Mengwei Ding made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Mengwei Ding made changes -
          Attachment SQOOP-971.1.patch [ 12588240 ]
          Hide
          Jarek Jarcec Cecho added a comment -

          Hi Mengwei Ding, the initial proposal looks good, please go ahead with the implementation!

          Show
          Jarek Jarcec Cecho added a comment - Hi Mengwei Ding , the initial proposal looks good, please go ahead with the implementation!
          Mengwei Ding made changes -
          Attachment SQOOP-971.1.pdf [ 12587921 ]
          Mengwei Ding made changes -
          Field Original Value New Value
          Assignee Mengwei Ding [ mengweid ]
          Jarek Jarcec Cecho created issue -

            People

            • Assignee:
              Mengwei Ding
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development