Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-1925

Improve hive compatibility with TIMESTAMP partition column.

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.11.0, 0.12.0
    • Fix Version/s: 0.12.0
    • Component/s: Catalog, Physical Operator
    • Labels:
      None

      Description

      Currently, Tajo allow to use TIMESTAMP column as a partition key. But if users use TIMESTAMP partition column, Tajo doesn't keep the original TIMESTAMP values. Actually, Tajo automatically converts TIMESTAMP values to STRING literals which are accepted in the format YYYY-MM-DD HH:MM:SS. As a result, Tajo can't keep mills of second and can't provide right hive compatibility

      We need to support hive compatibility for all partition column types. But when using TIMESTAMP partition column, users might not get correct partitions occasionally because tajo partition name is different from hive partition name. Actually, Tajo automatically converts TIMESTAMP values to STRING literals which are accepted in the format YYYY-MM-DD HH:MM:SS. But Hive automatically converts it to STRING literals which are accepted in the format YYYY-MM-DD HH:MM:SS.MS.

        Attachments

        1. TAJO-1925.patch
          25 kB
          Jaehwa Jung
        2. TAJO-1925_2.patch
          42 kB
          Jaehwa Jung
        3. TAJO-1925_3.patch
          43 kB
          Jaehwa Jung

          Issue Links

            Activity

              People

              • Assignee:
                hyunsik Hyunsik Choi
                Reporter:
                blrunner Jaehwa Jung
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: