Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-159

Support fixed number of shards in sinks

    XMLWordPrintableJSON

Details

    Description

      TextIO supports .withNumShards, however custom sinks, in particular FileBasedSinks, provide no support for controlling sharding. Some users want this, e.g. http://stackoverflow.com/questions/36316304/set-num-of-output-shard-in-write-tosink-in-dataflow

      Attachments

        Issue Links

          duplicates

          New Feature - A new feature of the product, which has yet to be developed. BEAM-68 Support for limiting parallelism of a step

          • P3 - Non-urgent bugs, features, and improvements
          • Open

          New Feature - A new feature of the product, which has yet to be developed. BEAM-92 Data-dependent sinks

          • P3 - Non-urgent bugs, features, and improvements
          • Open
          links to

          Web Link GitHub Pull Request #436

          Web Link GitHub Pull Request #534

          Activity

            People

              dhalperi Dan Halperin
              jkff Eugene Kirpichov
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: