Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-3062

[Python] Extend fast libtensorflow_framework.so compatibility workaround to Python 2.7

    Details

      Description

      The workaround ARROW-2657 should be optimized a little bit and use the loading of libtensorflow_framework.so (instead of doing a full "import tensorflow") also for Python 2.7.

      We are running into this, since doing "import tensorflow" spawns a number of threads, so without this optimization, using many python processes with pyarrow will hit OS limits for threads.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                pcmoritz Philipp Moritz
                Reporter:
                pcmoritz Philipp Moritz
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 40m
                  40m