Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12665

Add option to return filename from ReadAll transforms

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.33.0
    • io-py-common
    • None

    Description

      When using ReadAll transforms (as `ReadAllFromText` and similar), it would be great to add the option to also return the filename.

      This would help with an use case of reading multiple files that are not known at launch time and perform aggregations by file

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-12741 Read multiple files keeping track of file names (Python)

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved
          links to

          Web Link GitHub Pull Request #15126

          Activity

            People

              Unassigned Unassigned
              Inigosj Inigo San Jose Visiers
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 5h 50m
                  5h 50m