Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4059 Pig on Spark
  3. PIG-4788

the value BytesRead metric info always returns 0 even the length of input file is not 0 in spark engine

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • spark-branch
    • spark
    • None

    Description

      In JobMetricsLinstener#onTaskEnd, taskMetrics.inputMetrics().get().bytesRead() always returns 0 even the length of input file is not zero.

      Attachments

        1. PIG-4788.patch
          8 kB
          liyunzhang

        Issue Links

          Activity

            People

              kellyzly liyunzhang
              kellyzly liyunzhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: