Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12661 StatsSetupConst.COLUMN_STATS_ACCURATE is not used correctly
  3. HIVE-12882

Automatically choose to use noscan for stats collection

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      noscan is leveraging the file system to derive the #rows and rawDataSize. According to ashutoshc, it now only works with RC and ORC file type. We would like Hive to automatically choose to use noscan or scan based on the file system when stats task starts or when user issues the same query "Analyze ...."

      Attachments

        Activity

          People

            Unassigned Unassigned
            pxiong Pengcheng Xiong
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: