Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3833

object inspectors should be initialized based on partition metadata

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.11.0
    • Component/s: Query Processor
    • Labels:
      None
    • Release Note:
      Rows in partitions are now read using partition schema and than made to comply with table schema, instead of being read directly using table schema.

      Description

      Currently, different partitions can be picked up for the same input split based on the
      serdes' etc. And, we dont allow to change the schema for LazyColumnarBinarySerDe.
      Instead of that, different partitions should be part of the same split, only if the
      partition schemas exactly match. The operator tree object inspectors should be based
      on the partition schema. That would give greater flexibility and also help using binary serde with rcfile

        Attachments

        1. hive.3833.23.patch
          301 kB
          Namit Jain
        2. hive.3833.22.patch
          275 kB
          Namit Jain
        3. hive.3833.21.patch
          274 kB
          Namit Jain
        4. hive.3833.20.patch
          273 kB
          Namit Jain
        5. hive.3833.19.patch
          273 kB
          Namit Jain
        6. hive.3833.18.patch
          273 kB
          Namit Jain
        7. hive.3833.17.patch
          265 kB
          Namit Jain
        8. hive.3833.16.path
          164 kB
          Namit Jain
        9. hive.3833.14.patch
          265 kB
          Namit Jain
        10. hive.3833.13.patch
          278 kB
          Namit Jain
        11. hive.3833.12.patch
          281 kB
          Namit Jain
        12. hive.3833.11.patch
          280 kB
          Namit Jain
        13. hive.3833.10.patch
          207 kB
          Namit Jain
        14. hive.3833.9.patch
          103 kB
          Namit Jain
        15. hive.3833.8.patch
          108 kB
          Namit Jain
        16. hive.3833.7.patch
          583 kB
          Namit Jain
        17. hive.3833.6.patch
          583 kB
          Namit Jain
        18. hive.3833.5.patch
          573 kB
          Namit Jain
        19. hive.3833.4.patch
          97 kB
          Namit Jain
        20. hive.3833.3.patch
          74 kB
          Namit Jain
        21. hive.3833.2.patch
          74 kB
          Namit Jain
        22. hive.3833.1.patch
          26 kB
          Namit Jain

          Issue Links

            Activity

              People

              • Assignee:
                namit Namit Jain
                Reporter:
                namit Namit Jain
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: