Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8835

Artifact retrieval fails with FlinkUberJarJobServer

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.18.0
    • Component/s: runner-flink
    • Labels:
      None

      Description

      We seem to be able to stage artifacts and retrieve the manifest fine, but retrieving the artifacts doesn't work. This happens on both my k8s Flink cluster and on my local Flink cluster. At a quick glance the artifact is in the jar where it should be. cc Robert Bradshaw

      2019-11-21 18:43:39,336 INFO org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService - GetArtifact name: "pickled_main_session"
      retrieval_token: "BEAM-PIPELINE/pipeline/artifact-manifest.json"
      failed
      java.io.IOException: Unable to load e1d24d848414cecf805a7b5c2b950c6430c20eb32875dac00b40f80f3c73a141/ea0d10d07f4601782ed647e8f6ba4a055be13674ab79fa0c6e2fa44917c5264c with org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$ChildFirstClassLoader@785297ac

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ibzib Kyle Weaver
                Reporter:
                ibzib Kyle Weaver
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 6h
                  6h