Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-9933

HDFS Blockplacement policy for ORC ACID delta files

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.2.0
    • None
    • File Formats
    • None

    Description

      The ACID implementation triggers locality misses due to the fact that the splits only have locality of the base file at best and offers no idea on the data locality of the delta blocks.

      HDFS-2576 offers a preferred location placement policy for HDFS which can be taken advantage of by the ORC Delta writer as hint.

      Attachments

        Activity

          People

            Unassigned Unassigned
            gopalv Gopal Vijayaraghavan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: