Uploaded image for project: 'Apache Gobblin'
  1. Apache Gobblin
  2. GOBBLIN-1417

Make row batch size in ORC Mapreduce writer configurable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.15.0
    • 0.17.0
    • gobblin-compaction
    • None

    Description

      Current behavior enforces the default row batch size of 1024. To prevent OOMs during writes, this config may need to be overridden.

      Attachments

        Activity

          People

            ibuenros Issac Buenrostro
            sv2000 Sudarshan Vasudevan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1.5h
                1.5h