Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-26584 Further improvements on StoreFileTracker
  3. HBASE-27265

Tool to read the contents of the storefile tracker file

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.6.0, 3.0.0-alpha-4
    • 2.6.0, 3.0.0-alpha-4
    • None
    • None

    Description

      It will be useful to have a tool that provides an ability to read the contents of the tracker file (.filelist/f1 or f2)
      Using the hdfs -cat or -text displays the contents of the tracker file in binary and there is no option to show the contents in plain text.

      x[cloudbreak@cod--z4t08rqbuyms-master0 ~]$ sudo hdfs dfs -text s3a://odx-qe-bucket/odx-d7v40h/audit/cod--z4t08rqbuyms/hbase/data/default/one/6126beb5b349a1eee4b92987b78f1058/cf/.filelist/f1
      22/04/05 19:51:14 WARN impl.MetricsConfig: Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties
      22/04/05 19:51:14 INFO impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s).
      22/04/05 19:51:14 INFO impl.MetricsSystemImpl: s3a-file-system metrics system started
      22/04/05 19:51:14 INFO s3a.IDBDelegationTokenBinding: There is no Knox Token available, fetching one from IDBroker...
      22/04/05 19:51:14 INFO idbroker.AbstractIDBClient: Authenticating with IDBroker requires Kerberos
      22/04/05 19:51:14 INFO idbroker.AbstractIDBClient: Kerberos credentials are available, using Kerberos to establish a session. UGI=hbase/cod--z4t08rqbuyms-master0.odx-d7v4.svbr-nqvp.int.cldr.work@ODX-D7V4.SVBR-NQVP.INT.CLDR.WORK (auth:KERBEROS)
      Apr 05, 2022 7:51:14 PM org.apache.knox.gateway.shell.KnoxSession createClient
      INFO: Using default JAAS configuration
      22/04/05 19:51:15 INFO s3a.IDBDelegationTokenBinding: Bonded to Knox token eyJqa3...OGdQmQ
      22/04/05 19:51:15 INFO Configuration.deprecation: No unit for fs.s3a.connection.request.timeout(0) assuming SECONDS
      22/04/05 19:51:15 INFO idbroker.AbstractIDBClient: Creating Knox CAB session using Knox DT eyJqa3...OGdQmQ ...
      22/04/05 19:51:16 INFO s3a.S3AInputStream: Switching to Random IO seek policy
      ⑙��/%
       98ef4cf597be48598c8376bc1cac200d�&����22/04/05 19:51:16 INFO impl.MetricsSystemImpl: Stopping s3a-file-system metrics system...
      22/04/05 19:51:16 INFO impl.MetricsSystemImpl: s3a-file-system metrics system stopped.
      22/04/05 19:51:16 INFO impl.MetricsSystemImpl: s3a-file-system metrics system shutdown complete.

      Attachments

        Issue Links

          Activity

            People

              abhradeep.kundu Abhradeep Kundu
              abhradeep.kundu Abhradeep Kundu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: