Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17745

FileSinkOperator: do not invoke updateProgress for every record

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Depending on the query and the number of records, updateProgress shows up in profiler as hotspot. It would be good to consider updating the progress on completing "x" number of records instead of invoking it for every record.

      Attachments

        1. fileSinkOperator.png
          1.15 MB
          Rajesh Balamohan

        Activity

          People

            Unassigned Unassigned
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: