Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21339

LLAP: Cache hit also initializes an FS object

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0-alpha-1
    • llap
    • None

    Description

      https://github.com/apache/hive/blob/master/llap-server/src/java/org/apache/hadoop/hive/llap/io/encoded/OrcEncodedDataReader.java#L214

          // 1. Get file metadata from cache, or create the reader and read it.
          // Don't cache the filesystem object for now; Tez closes it and FS cache will fix all that
          fs = split.getPath().getFileSystem(jobConf);
          fileKey = determineFileId(fs, split,
              HiveConf.getBoolVar(daemonConf, ConfVars.LLAP_CACHE_ALLOW_SYNTHETIC_FILEID),
              HiveConf.getBoolVar(daemonConf, ConfVars.LLAP_CACHE_DEFAULT_FS_FILE_ID),
              !HiveConf.getBoolVar(daemonConf, ConfVars.LLAP_IO_USE_FILEID_PATH)
              );
      

      Attachments

        1. HIVE-21339.1.patch
          11 kB
          Prasanth Jayachandran
        2. HIVE-21339.2.patch
          5 kB
          Prasanth Jayachandran
        3. HIVE-21339.3.patch
          5 kB
          Prasanth Jayachandran
        4. HIVE-21339.4.patch
          5 kB
          Prasanth Jayachandran
        5. HIVE-21339.5.patch
          5 kB
          Prasanth Jayachandran
        6. llap-cache-fs-get.png
          83 kB
          Gopal Vijayaraghavan
        7. llap-query7-cached.svg
          75 kB
          Gopal Vijayaraghavan

        Activity

          People

            prasanth_j Prasanth Jayachandran
            gopalv Gopal Vijayaraghavan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: