Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-4371

NullPointerException when HoodieTableFileSystemView.getReplaceInstant

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.11.0
    • None
    • flink, flink-sql
    • hadoop3.x flink 1.14 hudi 0.11.0

    Description

      2022-07-07 16:18:40,369 ERROR org.apache.hudi.timeline.service.RequestHandler [] - Got runtime exception servicing request partition=2022-07-04&maxinstant=20220707161605152&includependingcompaction=false&basepath=XXXXXXXXXXXX&lastinstantts=20220707161605152&timelinehash=39ca9988a873b481b6d9f476ff2578de6b8c975e9c438cc6ad688ffe0a4ec8d5
      java.lang.NullPointerException: null
      at org.apache.hudi.common.table.view.HoodieTableFileSystemView.getReplaceInstant(HoodieTableFileSystemView.java:360) ~[hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.common.table.view.AbstractTableFileSystemView.isFileGroupReplacedBeforeOrOn(AbstractTableFileSystemView.java:1112) ~[hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.common.table.view.AbstractTableFileSystemView.lambda$getLatestFileSlicesBeforeOrOn$42(AbstractTableFileSystemView.java:653) ~[hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) ~[?:1.8.0_221]
      at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_221]
      at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_221]
      at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_221]
      at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) ~[?:1.8.0_221]
      at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_221]
      at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_221]
      at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_221]
      at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_221]
      at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) ~[?:1.8.0_221]
      at org.apache.hudi.timeline.service.handlers.FileSliceHandler.getLatestFileSlicesBeforeOrOn(FileSliceHandler.java:67) ~[hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.timeline.service.RequestHandler.lambda$registerFileSlicesAPI$16(RequestHandler.java:362) ~[hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.timeline.service.RequestHandler$ViewHandler.handle(RequestHandler.java:501) ~[hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at io.javalin.security.SecurityUtil.noopAccessManager(SecurityUtil.kt:22) ~[hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at io.javalin.Javalin.lambda$addHandler$0(Javalin.java:606) ~[hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at io.javalin.core.JavalinServlet$service$2$1.invoke(JavalinServlet.kt:46) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at io.javalin.core.JavalinServlet$service$2$1.invoke(JavalinServlet.kt:17) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at io.javalin.core.JavalinServlet$service$1.invoke(JavalinServlet.kt:143) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at io.javalin.core.JavalinServlet$service$2.invoke(JavalinServlet.kt:41) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at io.javalin.core.JavalinServlet.service(JavalinServlet.kt:107) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at io.javalin.core.util.JettyServerUtil$initialize$httpHandler$1.doHandle(JettyServerUtil.kt:72) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1668) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.handler.HandlerList.handle(HandlerList.java:61) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.handler.StatisticsHandler.handle(StatisticsHandler.java:174) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.Server.handle(Server.java:502) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.HttpChannel.handle(HttpChannel.java:370) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.io.FillInterest.fillable(FillInterest.java:103) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at org.apache.hudi.org.apache.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683) [hudi-flink1.14-bundle-yichesql_2.11-0.11.0.jar:0.11.0]
      at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221] 

      there is always happen this bug when i use hudi 0.11.0 but not in 0.10.0

      i notice that there is a bug fix in https://issues.apache.org/jira/browse/HUDI-3263

      but this bug still happen

       

       

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            liockency liockency
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: