Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-7603

Erasure coding and encryption are not flagged on FileStatus for ofs

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      HDDS-7208 purported to solve this. But when I use BasicRootedOzoneFileSystem.listLocatedStatus (via a FileSystemUtil::listLocatedStatusIterator) to search for a file recursively in Impala, I get back a FileStatus without the EC flag set.

      The FileStatus path is ofs://localhost:9862/impala/test-warehouse/alltypes/year=2009/month=1/090101.txt, and

      $ ozone sh key info impala/test-warehouse/alltypes/year=2009/month=1/090101.txt
      {
        "volumeName" : "impala",
        "bucketName" : "test-warehouse",
        "name" : "alltypes/year=2009/month=1/090101.txt",
        "dataSize" : 20433,
        "creationTime" : "2022-12-07T18:13:34.358Z",
        "modificationTime" : "2022-12-07T18:13:34.400Z",
        "replicationConfig" : {
          "data" : 3,
          "parity" : 2,
          "ecChunkSize" : 1048576,
          "codec" : "RS",
          "replicationType" : "EC",
          "requiredNodes" : 5
        },
        "ozoneKeyLocations" : [ {
          "containerID" : 3,
          "localID" : 109611004723200015,
          "length" : 20433,
          "offset" : 0,
          "keyOffset" : 0
        } ],
        "metadata" : { },
        "fileEncryptionInfo" : {...}
      }
      

      It looks like https://github.com/apache/ozone/blob/master/hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java#L1334-L1346 is missing the updates applied in HDDS-7208.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            swamirishi Swaminathan Balachandran
            MikaelSmith Michael Smith
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment