Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1367 Sqoop2: From/To
  3. SQOOP-1377

Sqoop2: From/To: Improve client/server communication

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.99.4
    • Component/s: None
    • Labels:
      None

      Description

      The JSON response currently takes the form:

      {
        "connection-id": 1,
        "id": 1,
        "updated": 1371246055277,
        "created": 1371246055277,
        "name": "import1",
        "connector": [
          {
            "id": 3,
            "inputs": [
              {
                "id": 10,
                "name": "table.schemaName",
                "type": "STRING",
                "size": 50,
                "sensitive": false
              },
              ...
            ],
            "name": "table",
            "type": "CONNECTION"
          }
        ],
        "connector-id": 1,
        "type": "IMPORT",
        "framework": [
          {
            "id": 7,
            "inputs": [
              {
                "id": 20,
                "values": "HDFS",
                "name": "output.storageType",
                "value": "HDFS",
                "type": "ENUM",
                "sensitive": false
              },
              ...
            ],
            "name": "output",
            "type": "CONNECTION"
          },
          {
            "id": 8,
            "inputs": [
              {
                "id": 23,
                "name": "throttling.extractors",
                "type": "INTEGER",
                "sensitive": false
              },
              ...
            ],
            "name": "throttling",
            "type": "CONNECTION"
          }
        ]
      }
      

      There will be multiple connectors and connections per job. The response should reflect this. Example:

      {
        "connection-id": 1,
        "id": 1,
        "updated": 1371246055277,
        "created": 1371246055277,
        "name": "import1",
        "connectors": {
          'from': [
            {
              "id": 3,
              "inputs": [
                {
                  "id": 10,
                  "name": "table.schemaName",
                  "type": "STRING",
                  "size": 50,
                  "sensitive": false
                },
                ...
              ],
              "name": "table",
              "type": "CONNECTION"
            }
          ],
          'to': [
            {
              "id": 3,
              "inputs": [
                {
                  "id": 10,
                  "name": "table.schemaName",
                  "type": "STRING",
                  "size": 50,
                  "sensitive": false
                },
                ...
              ],
              "name": "table",
              "type": "CONNECTION"
            }
          ],
        }
        "connector-id": 1,
        "type": "IMPORT",
        "framework": [
          {
            "id": 8,
            "inputs": [
              {
                "id": 23,
                "name": "throttling.extractors",
                "type": "INTEGER",
                "sensitive": false
              },
              ...
            ],
            "name": "throttling",
            "type": "CONNECTION"
          }
        ]
      }
      

        Attachments

          Activity

            People

            • Assignee:
              abec Abraham Elmahrek
              Reporter:
              abec Abraham Elmahrek
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: