Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-629

Add support for null values to the java api

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • pre-apache
    • None

    Description

      Currently, many runtime operations fail when encountering a null value. Tuple serialization should allow null fields.

      I suggest to add a method to the tuples called `getFieldNotNull()` which throws a meaningful exception when the accessed field is null. That way, we simplify the logic of operators that should not dead with null fields, like key grouping or aggregations.

      Even though SQL allows grouping and aggregating of null values, I suggest to exclude this from the java api, because the SQL semantics of aggregating null fields are messy.

      ---------------- Imported from GitHub ----------------
      Url: https://github.com/stratosphere/stratosphere/issues/629
      Created by: StephanEwen
      Labels: enhancement, java api,
      Milestone: Release 0.5.1
      Created at: Wed Mar 26 00:27:49 CET 2014
      State: open

      Attachments

        1. model.tar.gz
          6 kB
          mustafa elbehery
        2. Selection_006.png
          143 kB
          mustafa elbehery
        3. SimpleTweetInputFormat.java
          2 kB
          mustafa elbehery
        4. Tweet.java
          7 kB
          mustafa elbehery

        Issue Links

          Activity

            People

              gyfora Gyula Fora
              sewen Stephan Ewen
              Votes:
              2 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: