Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1986 Sqoop2: Schema matching improvements
  3. SQOOP-1976

Sqoop2: Avoid massive in-memory copy of schema column

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      SQOOP-1836 introduced a new method getColumnsArray. As the class Schema is used very often, the idea is to provide a constant (better) lookup time for particular column. But I think the implementation will create array from a list for every call, it will be even slower than accessing the original getColumnsList in some cases. I think we can change the type of columns from LinkedList to ArrayList, which is included in SQOOP-1969. The jira proposes to remove getColumnsArray.

      Attachments

        Activity

          People

            stanleyxu2005 Qian Xu
            stanleyxu2005 Qian Xu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: