Version 1.9.0

RELEASED

Start: 25/Feb/19

Released: 22/Aug/19

Release Notes

PTKeySummaryAssigneeStatus
BlockerBugFLINK-8801S3's eventual consistent read-after-write may fail yarn deployment of resources to S3Nico KruberClosed
BlockerBugFLINK-10368'Kerberized YARN on Docker test' unstableAljoscha KrettekClosed
BlockerBugFLINK-11107Avoid memory stateBackend to create arbitrary folders under HA path when no checkpoint path configuredYun TangResolved
BlockerBugFLINK-11727JSON row format is not serializableTimo WaltherClosed
BlockerImprovementFLINK-11756Update migration tests for Flink 1.8vinoyangResolved
BlockerSub-taskFLINK-11757Add 1.8 MigrationVersionvinoyangClosed
BlockerSub-taskFLINK-11758Update ContinuousFileProcessingMigrationTest for 1.8vinoyangResolved
BlockerSub-taskFLINK-11759Update AbstractNonKeyedOperatorRestoreTestBase for 1.8vinoyangResolved
BlockerSub-taskFLINK-11760Update CEPMigrationTest for 1.8vinoyangResolved
BlockerSub-taskFLINK-11761Update FlinkKafkaConsumerBaseMigrationTest for 1.8vinoyangResolved
BlockerSub-taskFLINK-11762Update WindowOperatorMigrationTest for 1.8vinoyangResolved
BlockerSub-taskFLINK-11763Update AbstractKeyedOperatorRestoreTestBase for 1.8vinoyangResolved
BlockerSub-taskFLINK-11764Update BucketingSinkMigrationTest for Flink 1.8vinoyangResolved
BlockerSub-taskFLINK-11765Update Java / Scala StatefulJobWBroadcastStateMigrationITCase for 1.8vinoyangResolved
BlockerSub-taskFLINK-11766Update Java / Scala StatefulJobSavepointMigrationITCase for 1.8vinoyangResolved
BlockerSub-taskFLINK-11768Update TypeSerializerSnapshotMigrationITCase for Flink 1.8Tzu-Li (Gordon) TaiResolved
BlockerSub-taskFLINK-11770Update FlinkKinesisConsumerMigrationTest for 1.8vinoyangResolved
BlockerBugFLINK-11987Kafka producer occasionally throws NullpointerExceptionYu LiResolved
BlockerImprovementFLINK-12070Make blocking result partitions consumable multiple timesStephan EwenClosed
BlockerBugFLINK-12296Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task Congxian QiuResolved
BlockerBugFLINK-12297Make ClosureCleaner recursiveWenJun MinClosed
BlockerBugFLINK-12347flink-table-runtime-blink is missing scala suffixLiya FanClosed
BlockerBugFLINK-12392FlinkRelMetadataQuery does not compile with Scala 2.12godfrey heClosed
BlockerBugFLINK-12510Deadlock when reading from InputGatesPiotr NowojskiClosed
BlockerBugFLINK-12512TableSourceTest#testNestedProject test failedDawid WysakowiczResolved
BlockerImprovementFLINK-12578Use secure URLs for Maven repositoriesJungtaek LimClosed
BlockerBugFLINK-12688Make serializer lazy initialization thread safe in StateDescriptorYu LiClosed
BlockerBugFLINK-12689flink-dist is missing flink-azure-fs-hadoop dependencyGary YaoResolved
BlockerSub-taskFLINK-12704Enable the configuration of using blink plannerWei ZhongClosed
BlockerImprovementFLINK-12776Ambiguous content in flink-dist NOTICE fileUnassignedClosed
BlockerBugFLINK-12852[hotfix timeout] Deadlock occurs when requiring exclusive buffer for RemoteInputChannelYun GaoClosed
BlockerBugFLINK-12858Potential distributed deadlock in case of synchronous savepoint failureAlexClosed
BlockerBugFLINK-12868Yarn and Mesos clusters can not be deployed if plugins dir does not existPiotr NowojskiClosed
BlockerImprovementFLINK-12901Update build instructions for building Flink with a custom hadoop versionChesnay ScheplerClosed
BlockerBugFLINK-12907flink-table-planner-blink fails to compile with scala 2.12Jark WuClosed
BlockerBugFLINK-12908flink-table-planner-blink does not compile on mastergodfrey heClosed
BlockerBugFLINK-12916KeyedComplexChainTest.testMigrationAndRestore failed on TravisYun TangClosed
BlockerSub-taskFLINK-12998Document Plugins mechanismAlexClosed
BlockerSub-taskFLINK-13012Handle default partition name of Hive tableRui LiResolved
BlockerBugFLINK-13016StreamTaskNetworkInput can linger records for longer period of timesPiotr NowojskiClosed
BlockerBugFLINK-13044Shading of AWS SDK in flink-s3-fs-hadoop results in ClassNotFoundExceptionsChesnay ScheplerClosed
BlockerBugFLINK-13063AsyncWaitOperator shouldn't be releasing checkpointingLockStefan RichterClosed
BlockerBugFLINK-13075Project pushdown rule shouldn't require the TableSource return a modified schema in blink plannerCaizhi WengResolved
BlockerBugFLINK-13077CatalogPartitionAPICompletenessTests in pyflink failed because of lacking "getComment" methodWei ZhongClosed
BlockerBugFLINK-13116Catalog statistic is not bridged to blink planner godfrey heResolved
BlockerBugFLINK-13124Stop fails with Universal Kafka ConsumerAljoscha KrettekClosed
BlockerSub-taskFLINK-13145Run HA dataset E2E test with new RestartPipelinedRegionStrategyGary YaoResolved
BlockerBugFLINK-13153SplitAggregateITCase.testMinMaxWithRetraction failed on TravisJark WuResolved
BlockerBugFLINK-13154Broken links in documentationYun TangClosed
BlockerBugFLINK-13159java.lang.ClassNotFoundException when restore jobYun TangClosed
BlockerImprovementFLINK-13168clarify isBatch/isStreaming/isBounded flag in flink planner and blink plannergodfrey heClosed
BlockerBugFLINK-13214Hive connector is missing jdk.tools exclusion for Java 9Chesnay ScheplerClosed
BlockerBugFLINK-13215Hive connector does not compile on Java 9Chesnay ScheplerClosed
BlockerBugFLINK-13217Blink planner does not compile with Scala 2.12Jark WuResolved
BlockerBugFLINK-13221Blink planner should set ScheduleMode to LAZY_FROM_SOURCES_WITH_BATCH_SLOT_REQUEST for batch jobsLiya FanClosed
BlockerSub-taskFLINK-13222Add documentation for AdaptedRestartPipelinedRegionStrategyNGZhu ZhuResolved
BlockerSub-taskFLINK-13223Set jobmanager.execution.failover-strategy to region in default flink-conf.yamlChesnay ScheplerClosed
BlockerBugFLINK-13241YarnResourceManager does not handle slot allocations in certain casesXintong SongResolved
BlockerBugFLINK-13245Network stack is leaking filesZhijiangClosed
BlockerBugFLINK-13249Distributed Jepsen test fails with blocked TaskExecutorStefan RichterClosed
BlockerBugFLINK-13256Periodical checkpointing is stopped after failoversYun TangClosed
BlockerSub-taskFLINK-13262Add documentation for the new Table & SQL API type systemTimo WaltherClosed
BlockerSub-taskFLINK-13264Remove planner class clashes for planner type inference lookupsTimo WaltherClosed
BlockerSub-taskFLINK-13266Relocate blink planner classes to avoid class clashesgodfrey heResolved
BlockerSub-taskFLINK-13268Revert SqlSplittableAggFunction to support making two planners available in one jargodfrey heResolved
BlockerSub-taskFLINK-13269copy RelDecorrelator & FlinkFilterJoinRule to flink planner to fix CALCITE-3169 & CALCITE-3170godfrey heResolved
BlockerNew FeatureFLINK-13273Allow switching planners in SQL ClientTimo WaltherClosed
BlockerBugFLINK-13279not able to query table registered in catalogs in SQL CLIDawid WysakowiczClosed
BlockerBugFLINK-13282LocalExecutorITCase#testUseCatalogAndUseDatabase failed on TravisBowen LiClosed
BlockerSub-taskFLINK-13286Port SchemaValidator and others validators to table-commonJingsong LeeResolved
BlockerSub-taskFLINK-13289Blink-planner should setKeyFields to upsert table sinkJingsong LeeResolved
BlockerSub-taskFLINK-13290HBaseITCase bug using blink-runner: SinkCodeGenerator should not compare row type field namesJark WuResolved
BlockerBugFLINK-13308flink-python releases 2 jarsDian FuClosed
BlockerBugFLINK-13314Correct resultType of some PlannerExpression when operands contains DecimalTypeInfo or BigDecimalTypeInfo in Blink plannerJing ZhangClosed
BlockerImprovementFLINK-13316Update binary licensingChesnay ScheplerClosed
BlockerBugFLINK-13318Blink planner tests failing on Scala 2.12Jing ZhangResolved
BlockerBugFLINK-13319Catalog documentation is missing chinese pageChesnay ScheplerClosed
BlockerSub-taskFLINK-13325Add test case for FLINK-13249Stefan RichterClosed
BlockerBugFLINK-13327Blink planner not compiling with Scala 2.12Dawid WysakowiczClosed
BlockerSub-taskFLINK-13335Bring the SQL CREATE TABLE DDL closer to FLIP-37Danny ChenClosed
BlockerSub-taskFLINK-13341Connector Sinks should implement consumeDataStream instead of emitDataStreamchenqiClosed
BlockerImprovementFLINK-13345Dump jstack output for Flink JVMs after Jepsen TestsGary YaoResolved
BlockerSub-taskFLINK-13348ProjectableTableSource is not supported by blink-planner correctlyCaizhi WengClosed
BlockerSub-taskFLINK-13349Flink sinks should implement consumeDataStream instead of emitDataStreamUnassignedClosed
BlockerSub-taskFLINK-13350Mark useCatalog & useDatabase as Experimental for 1.9 releaseDawid WysakowiczClosed
BlockerBugFLINK-13352Using hive connector with hive-1.2.1 needs libfb303 jarRui LiClosed
BlockerBugFLINK-13371Release partitions in JM if producer restartsChesnay ScheplerClosed
BlockerBugFLINK-13374Scala compiler causes StackOverflowErrorChesnay ScheplerClosed
BlockerSub-taskFLINK-13376FileInputFormat can not be used in batch mode of blink-plannerBiao LiuClosed
BlockerBugFLINK-13377Streaming SQL e2e test failed on travisZhenghua GaoClosed
BlockerBugFLINK-13378Fix SINGLE_VALUE is not correctly supported in blink plannerJingsong LeeResolved
BlockerBugFLINK-13384The back pressure monitoring does not work for StreamSourcesGary YaoClosed
BlockerImprovementFLINK-13396Deprecate BucketingSinkKostas KloudasClosed
BlockerImprovementFLINK-13397Remove RollingSinkAljoscha KrettekClosed
BlockerBugFLINK-13398Hive connector doesn't compile on Java 9Chesnay ScheplerClosed
BlockerImprovementFLINK-13399Create two separate uber jars for each plannerDawid WysakowiczClosed
BlockerSub-taskFLINK-13402RelOptCluster's constructor can not be accessed when connector dependent both flink-planner and blink-plannergodfrey heResolved
BlockerSub-taskFLINK-13403Correct package name after relocationgodfrey heResolved
BlockerSub-taskFLINK-13407Fix thread visibility of checked SlotManager.failUnfulfillableRequest in StandaloneResourceManagerTestAndrey ZagrebinResolved
BlockerSub-taskFLINK-13408Schedule StandaloneResourceManager.setFailUnfulfillableRequest whenever the leadership is acquiredXintong SongResolved
BlockerBugFLINK-13421Unexpected ConcurrentModificationException when RM notifies JM about allocation failureTill RohrmannResolved
BlockerBugFLINK-13429SQL Client end-to-end test failsTimo WaltherResolved
BlockerSub-taskFLINK-13434Add E2E test for stop-with-savepointKostas KloudasClosed
BlockerSub-taskFLINK-13435Remove ShuffleDescriptor.ReleaseType and make release semantics fixed per partition typeAndrey ZagrebinClosed
BlockerImprovementFLINK-13436Add TPC-H queries as E2E testsCaizhi WengResolved
BlockerImprovementFLINK-13439Run existing SQL/Table API E2E tests with blink runnerZhenghua GaoClosed
BlockerSub-taskFLINK-13440Add test that fails job when sync savepoint is discarded.Kostas KloudasClosed
BlockerImprovementFLINK-13441Add batch sql E2E test which runs with fewer slots than parallelismAlexClosed
BlockerImprovementFLINK-13447Change default planner to legacy planner instead of any oneJark WuResolved
BlockerBugFLINK-13452Pipelined region failover strategy does not recover Job if checkpoint cannot be readYun TangClosed
BlockerSub-taskFLINK-13458ThreadLocalCache clashes for Blink plannerTimo WaltherClosed
BlockerBugFLINK-13476Release partitions for FINISHED tasks if they are cancelled/suspendedChesnay ScheplerClosed
BlockerBugFLINK-13486AsyncDataStreamITCase.testOrderedWaitUsingAnonymousFunction instable on TravisBiao LiuClosed
BlockerBugFLINK-13487TaskExecutorPartitionLifecycleTest.testPartitionReleaseAfterReleaseCall failed on TravisYun GaoClosed
BlockerBugFLINK-13488flink-python fails to build on Travis due to PackagesNotFoundErrorsunjinchengClosed
BlockerBugFLINK-13491AsyncWaitOperator doesn't handle endInput call properlyBiao LiuClosed
BlockerBugFLINK-13494Blink planner changes source parallelism which causes stream SQL e2e test failsXuPingyongResolved
BlockerBugFLINK-13499Remove dependency on MapR artifact repositoryStephan EwenClosed
BlockerBugFLINK-13504NoSuchFieldError when executing DDL via tEnv.sqlUpdate in application projectDawid WysakowiczClosed
BlockerBugFLINK-13532Broken links in documentationBiao LiuResolved
BlockerBugFLINK-13540DDL do not support key of properties contains number or "-"Danny ChenResolved
BlockerBugFLINK-13541State Processor Api sets the wrong key selector when writing savepointsSeth WiesmanClosed
BlockerImprovementFLINK-13546Run TPC-H E2E test on travis cron job Caizhi WengResolved
BlockerImprovementFLINK-13555Failures of slot requests requiring unfulfillable managed memory should not be ignored.Xintong SongResolved
BlockerBugFLINK-13579Failed launching standalone cluster due to improper configured irrelevant config options for active mode.Till RohrmannResolved
BlockerBugFLINK-13592test_tpch.sh should not hardcode flink versionKurt YoungClosed
BlockerBugFLINK-13593Prevent failing the wrong execution attempt in CheckpointFailureManagerYu LiResolved
BlockerImprovementFLINK-13597Test Flink 1.9.0 on clusterAljoscha KrettekClosed
BlockerBugFLINK-13605AsyncDataStreamITCase.testUnorderedWait failed on TravisBiao LiuClosed
BlockerBugFLINK-13607TPC-H end-to-end test (Blink planner) failed on TravisKurt YoungClosed
BlockerImprovementFLINK-13608Update upgrade compatibility table (docs/ops/upgrading.md) for 1.9.0Tzu-Li (Gordon) TaiClosed
BlockerBugFLINK-13645Error in code-gen when using blink planner in scala shellJeff ZhangResolved
BlockerImprovementFLINK-13712Add 1.9.0 release notes to documentationTzu-Li (Gordon) TaiClosed
CriticalBugFLINK-9526BucketingSink end-to-end test failed on TravisBiao LiuClosed
CriticalBugFLINK-9782BucketingSink E2E test fails on travisKostas KloudasClosed
CriticalBugFLINK-10455Potential Kafka producer leak in case of failuresJiangjie QinResolved
CriticalBugFLINK-10712RestartPipelinedRegionStrategy does not restore stateYun TangClosed
CriticalBugFLINK-10941Slots prematurely released which still contain unconsumed data Andrey ZagrebinClosed
CriticalBugFLINK-11059JobMaster may continue using an invalid slot if releasing idle slot meet a timeoutshuai.xuResolved
CriticalBugFLINK-11662Discarded checkpoint can cause Tasks to failYun TangClosed
CriticalBugFLINK-11897ExecutionGraphSuspendTest does not wait for all tasks to be submittedchunpingheClosed
CriticalImprovementFLINK-11947Support MapState value schema evolution for RocksDBCongxian QiuResolved
CriticalBugFLINK-12038YARNITCase stalls on travisshuai.xuResolved
CriticalBugFLINK-12042RocksDBStateBackend mistakenly uses default filesystemPaul LinResolved
CriticalBugFLINK-12051TaskExecutorTest.testFilterOutDuplicateJobMasterRegistrations() does not wait for TaskExecutor to be startedChesnay ScheplerClosed
CriticalImprovementFLINK-12069Add proper lifecycle management for intermediate result partitionsChesnay ScheplerClosed
CriticalBugFLINK-12111TaskManagerProcessFailureBatchRecoveryITCase fails due to removed SlotChesnay ScheplerClosed
CriticalBugFLINK-12163Use correct ClassLoader for Hadoop Writable TypeInfoarganzhengClosed
CriticalBugFLINK-12249Type equivalence check fails for Window AggregatesHequn ChengClosed
CriticalBugFLINK-12260Slot allocation failure by taskmanager registration timeout and raceHwanju KimResolved
CriticalBugFLINK-12285Memory leak in SavepointITCase and SavepointMigrationTestBaseBiao LiuClosed
CriticalBugFLINK-12313SynchronousCheckpointITCase.taskCachedThreadPoolAllowsForSynchronousCheckpoints is unstableAlexClosed
CriticalBugFLINK-12329Netty thread deadlock bug of the SpilledSubpartitionViewUnassignedClosed
CriticalBugFLINK-12359SystemResourcesMetricsITCase unstableChesnay ScheplerClosed
CriticalBugFLINK-12444Large number of broken linksJark WuClosed
CriticalBugFLINK-12592StreamTableEnvironment object has no attribute connectsunjinchengClosed
CriticalBugFLINK-12595KinesisDataFetcherTest.testOriginalExceptionIsPreservedWhenInterruptedDuringShutdown deadlocksShannon CareyResolved
CriticalBugFLINK-12642OutputBufferPoolUsageGauge can fail with NPEAndrey ZagrebinClosed
CriticalBugFLINK-12736ResourceManager may release TM with allocated slotsAndrey ZagrebinResolved
CriticalBugFLINK-12768FlinkKinesisConsumerTest.testSourceSynchronization unstable on TravisThomas WeiseClosed
CriticalBugFLINK-12863Race condition between slot offerings and AllocatedSlotReportTill RohrmannClosed
CriticalSub-taskFLINK-12883Add elaborate partition release logicGary YaoClosed
CriticalBugFLINK-12889Job keeps in FAILING stateTill RohrmannResolved
CriticalBugFLINK-12895TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure failed on travis Till RohrmannResolved
CriticalBugFLINK-12915AbstractOperatorRestoreTestBase can deadlock if one test failsYun TangClosed
CriticalBugFLINK-12929scala.StreamExecutionEnvironment.addSource does not propagate TypeInformationUnassignedClosed
CriticalSub-taskFLINK-13013Make sure that SingleInputGate can always request partitionsPiotr NowojskiClosed
CriticalBugFLINK-13017Broken and irreproducible dockerized docs buildNico KruberResolved
CriticalSub-taskFLINK-13119Add blink table config to documentationXuPingyongClosed
CriticalBugFLINK-13139Various Hive tests fail on TravisBowen LiClosed
CriticalBugFLINK-13155SQL Client end-to-end test fails on TravisZhenghua GaoClosed
CriticalBugFLINK-13156Elasticsearch (v1.7.1) sink end-to-end test failed on TravisChesnay ScheplerResolved
CriticalSub-taskFLINK-13169IT test for fine-grained recovery (task executor failures)Andrey ZagrebinClosed
CriticalSub-taskFLINK-13173Only run openSSL tests if desiredNico KruberClosed
CriticalBugFLINK-13175FLINK-12951 breaks SQL CLI's ExecutionContextTestDanny ChenClosed
CriticalSub-taskFLINK-13192Add tests for different Hive table formatsRui LiClosed
CriticalBugFLINK-13216AggregateITCase.testNestedGroupByAgg fails on TravisJark WuResolved
CriticalBugFLINK-13226KafkaProducerExactlyOnceITCase.testMultipleSinkOperators fails on TravisJiangjie QinResolved
CriticalBugFLINK-13228HadoopRecoverableWriterTest.testCommitAfterNormalClose fails on TravisYu LiClosed
CriticalBugFLINK-13232TemporalTypesTest>ExpressionTestBase.evaluateExprs in blink planner fails on PST TimezoneJingsong LeeClosed
CriticalBugFLINK-13234TemporalTypesTest randomly failed on travisJingsong LeeClosed
CriticalImprovementFLINK-13237Add expression table api test to blinkJingsong LeeResolved
CriticalBugFLINK-13257blink runner should avoid stream operator implementing BoundedOneInputJingsong LeeResolved
CriticalImprovementFLINK-13267Making it possible to have both flink planner and blink planner in classpathJark WuResolved
CriticalSub-taskFLINK-13280Revert blink changes in DateTimeUtils, and keep it same as flink version.Zhenghua GaoResolved
CriticalBugFLINK-13304Fix implementation of getString and getBinary method in NestedRowCaizhi WengResolved
CriticalBugFLINK-13338Sql conformance is hard to config in TableConfigDanny ChenClosed
CriticalImprovementFLINK-13375Improve config names in ExecutionConfigOptions and OptimizerConfigOptionsJark WuResolved
CriticalBugFLINK-13385Align Hive data type mapping with FLIP-37Terry WangClosed
CriticalBugFLINK-13387Can not download taskmanger & jobmanager's logs in the old UIChesnay ScheplerClosed
CriticalSub-taskFLINK-13391Blink-planner should not invoke deprecated getReturnType of TableSourceJingsong LeeResolved
CriticalSub-taskFLINK-13404Port csv factories & descriptors from flink-table-planner to flink-csvgodfrey heResolved
CriticalSub-taskFLINK-13409Supported java UDFs in python APIDian FuClosed
CriticalBugFLINK-13423Unable to find function in hive 1Rui LiResolved
CriticalBugFLINK-13424HiveCatalog should add hive version in confRui LiClosed
CriticalBugFLINK-13427HiveCatalog's createFunction fails when function name has upper-case charactersRui LiResolved
CriticalBugFLINK-13431NameNode HA configuration was not loaded when running HiveConnector on YarnHongtao ZhangClosed
CriticalBugFLINK-13446Row count sliding window outputs incorrectly in blink plannerHequn ChengClosed
CriticalBugFLINK-13463SQL VALUES might fail for Blink plannerTimo WaltherClosed
CriticalImprovementFLINK-13475Reduce dependency on third-party maven repositoriesTerry WangClosed
1200 of 999