Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-1986 Sqoop2: Schema matching improvements
  3. SQOOP-1976

Sqoop2: Avoid massive in-memory copy of schema column

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      SQOOP-1836 introduced a new method getColumnsArray. As the class Schema is used very often, the idea is to provide a constant (better) lookup time for particular column. But I think the implementation will create array from a list for every call, it will be even slower than accessing the original getColumnsList in some cases. I think we can change the type of columns from LinkedList to ArrayList, which is included in SQOOP-1969. The jira proposes to remove getColumnsArray.

        Attachments

          Activity

            People

            • Assignee:
              stanleyxu2005 Qian Xu
              Reporter:
              stanleyxu2005 Qian Xu
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: