HBase
  1. HBase
  2. HBASE-8015 Support for Namespaces
  3. HBASE-9149

javadoc cleanup of to reflect .META. rename to hbase:meta

    Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0
    • Component/s: documentation
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    1. HBASE-9149.patch
      12 kB
      Misty Stanley-Jones
    2. HBASE-9149v2.patch
      12 kB
      stack

      Activity

      Hide
      stack added a comment -

      Making critical documentation issue. Needs fixing in javadoc and in refguide.

      Show
      stack added a comment - Making critical documentation issue. Needs fixing in javadoc and in refguide.
      Hide
      Misty Stanley-Jones added a comment -

      Can I get a little more info on what exactly this means? I can find all instances of .META in Javadoc and change them to hbase:meta, but is that what this means?

      Show
      Misty Stanley-Jones added a comment - Can I get a little more info on what exactly this means? I can find all instances of .META in Javadoc and change them to hbase:meta, but is that what this means?
      Hide
      Misty Stanley-Jones added a comment -

      For instance, does Javadoc like https://hbase.apache.org/devapidocs/org/apache/hadoop/hbase/catalog/MetaEditor.html need to be changed such that every time META is mentioned it is changed to hbase:meta, or is that too ham-fisted?

      Show
      Misty Stanley-Jones added a comment - For instance, does Javadoc like https://hbase.apache.org/devapidocs/org/apache/hadoop/hbase/catalog/MetaEditor.html need to be changed such that every time META is mentioned it is changed to hbase:meta, or is that too ham-fisted?
      Hide
      stack added a comment -

      That'd work. I tried a blanket search and replace but there are legit areas where we need to retain .META. – i.e. where we have to migrate old data to the new, stuff we could probably let go now we are on 0.99... but they are there at the moment still.

      ./bin/region_mover.rb:# Returns true if passed region is still on 'original' when we look at .META.
      ./bin/region_mover.rb:# Get servername that is up in .META.; this is hostname + port + startcode comma-delimited.
      ./bin/region_mover.rb:  # No prefetching on .META. This is for versions pre 0.99. Newer versions do not prefetch.
      ./bin/region_status.rb:# .META. table, that is not included in our scan
      ./conf/log4j.properties:# and scan of .META. messages
      ./hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java:  public static final String OLD_META_STR = ".META.";
      ./hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java:   * TableName for old .META. table. Used in testing.
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java:      // 2. Remove table from .META. and HDFS
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java:   * Removes the table from .META. and archives the HDFS files.
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java:    // NOTE: At this point we still have data on disk, but nothing in .META.
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/TruncateTableHandler.java:    // 2. Remove table from .META. and HDFS
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java: * - creates system namespace directory and move .META. table there
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java: * renaming .META. table to hbase:meta,
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java:    List<String> sysTables = Lists.newArrayList("-ROOT-",".META.", ".META");
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java:    Path oldMetaDir = new Path(rootDir, ".META.");
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java:    // Remove .tableinfo files as they refer to ".META.".
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java:    // rename .META. to hbase:meta
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java:      // create a put for new .META. entry with rowkey as hbase:meta
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java:    // This is the point of no return.  Adding subsequent edits to .META. as we
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java:    // do below when we do the daughter opens adding each to .META. can fail in
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java:    // still and the server shutdown fixup of .META. will point to these
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogKey.java:        LOG.info("Got an old .META. edit, continuing with new format ");
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/util/HFileV1Detector.java:        .getCurrentTableInfoStatus(fs, path, false) != null) || path.toString().endsWith(".META.");
      ./hbase-server/src/main/java/org/apache/hadoop/hbase/util/ZKDataMigrator.java:      if (table.equals("-ROOT-") || table.equals(".META.")) {
      ./hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestMetaMigrationConvertingToPB.java:      new Path(hbaseRootDir, ".META.").toString()});
      ./hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlock.java:    BlockType.META.write(dos); // Let's make this a meta block.
      ./hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockCompatibility.java:    BlockType.META.write(dos); // Let's make this a meta block.
      ./hbase-server/src/test/java/org/apache/hadoop/hbase/migration/TestNamespaceUpgrade.java:      p = new Put(Bytes.toBytes(".META."));
      ./hbase-server/src/test/java/org/apache/hadoop/hbase/migration/TestNamespaceUpgrade.java:      // verify rows .META. is renamed to hbase:meta
      ./src/main/docbkx/book.xml:       <para>The catalog tables -ROOT- and .META. exist as HBase tables.  They are filtered out
      ./src/main/docbkx/book.xml:        <para>-ROOT- keeps track of where the .META. table is.  The -ROOT- table structure is as follows:
      ./src/main/docbkx/book.xml:              <listitem><para>.META. region key (<code>.META.,,1</code>)</para></listitem>
      ./src/main/docbkx/book.xml:               instance of .META.)</para></listitem>
      ./src/main/docbkx/book.xml:              <listitem><para><code>info:server</code> (server:port of the RegionServer holding .META.)</para></listitem>
      ./src/main/docbkx/book.xml:              <listitem><para><code>info:serverstartcode</code> (start-time of the RegionServer process holding .META.)</para></listitem>
      ./src/main/docbkx/book.xml:        <para>The .META. table keeps a list of all regions in the system. The .META. table structure is as follows:
      ./src/main/docbkx/book.xml:         the <code>.META.</code> and <code>-ROOT-</code> catalog tables
      ./src/main/docbkx/book.xml:           <para>Periodically checks and cleans up the .META. table.  See <xref linkend="arch.catalog.meta" /> for more information on META.</para>
      ./src/main/docbkx/book.xml:            <listitem><para>Catalog tables: The -ROOT- and .META. tables are forced into the block cache and have the in-memory priority which means that they are harder to evict. The former never uses
      ./src/main/docbkx/book.xml:(.regioninfo files), the region’s row in the .META. table., and region’s deployment/assignments on
      ./src/main/docbkx/ops_mgt.xml:      table directory and then do an edit of the .META. table replacing all mentions of the old
      ./src/main/docbkx/troubleshooting.xml:           and then the client goes back to .META. to find the new location of the moved region.</para>
      ./src/main/docbkx/upgrading.xml:             hdfs://localhost:41020/myHBase/.META.
      ./src/main/docbkx/upgrading.xml:On startup, the <varname>.META.</varname> table content is rewritten removing the table schema from the <varname>info:regioninfo</varname> column.
      ./src/main/docbkx/upgrading.xml:            <varname>.META.</varname> schema in the shell.  In the past we would
      ./src/main/docbkx/upgrading.xml:            the current <varname>.META.</varname> schema.  Check
      ./src/main/docbkx/upgrading.xml:            This will make the necessary edit to your <varname>.META.</varname> schema.
      ./src/main/docbkx/upgrading.xml:            See <link xlink:href="https://issues.apache.org/jira/browse/HBASE-3499">HBASE-3499 Users upgrading to 0.90.0 need to have their .META. table updated with the right MEMSTORE_SIZE</link>
      ./src/main/site/xdoc/replication.xml:          .META. or -ROOT-, and did not originate in the target slave cluster - in
      

      Those in ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java should probably be retained as is.

      Ditto on this one: ./hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java: * TableName for old .META. table. Used in testing.

      ...

      Show
      stack added a comment - That'd work. I tried a blanket search and replace but there are legit areas where we need to retain .META. – i.e. where we have to migrate old data to the new, stuff we could probably let go now we are on 0.99... but they are there at the moment still. ./bin/region_mover.rb:# Returns true if passed region is still on 'original' when we look at .META. ./bin/region_mover.rb:# Get servername that is up in .META.; this is hostname + port + startcode comma-delimited. ./bin/region_mover.rb: # No prefetching on .META. This is for versions pre 0.99. Newer versions do not prefetch. ./bin/region_status.rb:# .META. table, that is not included in our scan ./conf/log4j.properties:# and scan of .META. messages ./hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java: public static final String OLD_META_STR = ".META." ; ./hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java: * TableName for old .META. table. Used in testing. ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java: // 2. Remove table from .META. and HDFS ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java: * Removes the table from .META. and archives the HDFS files. ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java: // NOTE: At this point we still have data on disk, but nothing in .META. ./hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/TruncateTableHandler.java: // 2. Remove table from .META. and HDFS ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java: * - creates system namespace directory and move .META. table there ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java: * renaming .META. table to hbase:meta, ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java: List< String > sysTables = Lists.newArrayList( "-ROOT-" , ".META." , ".META" ); ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java: Path oldMetaDir = new Path(rootDir, ".META." ); ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java: // Remove .tableinfo files as they refer to ".META." . ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java: // rename .META. to hbase:meta ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java: // create a put for new .META. entry with rowkey as hbase:meta ./hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java: // This is the point of no return . Adding subsequent edits to .META. as we ./hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java: // do below when we do the daughter opens adding each to .META. can fail in ./hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java: // still and the server shutdown fixup of .META. will point to these ./hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogKey.java: LOG.info( "Got an old .META. edit, continuing with new format " ); ./hbase-server/src/main/java/org/apache/hadoop/hbase/util/HFileV1Detector.java: .getCurrentTableInfoStatus(fs, path, false ) != null ) || path.toString().endsWith( ".META." ); ./hbase-server/src/main/java/org/apache/hadoop/hbase/util/ZKDataMigrator.java: if (table.equals( "-ROOT-" ) || table.equals( ".META." )) { ./hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestMetaMigrationConvertingToPB.java: new Path(hbaseRootDir, ".META." ).toString()}); ./hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlock.java: BlockType.META.write(dos); // Let's make this a meta block. ./hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFileBlockCompatibility.java: BlockType.META.write(dos); // Let's make this a meta block. ./hbase-server/src/test/java/org/apache/hadoop/hbase/migration/TestNamespaceUpgrade.java: p = new Put(Bytes.toBytes( ".META." )); ./hbase-server/src/test/java/org/apache/hadoop/hbase/migration/TestNamespaceUpgrade.java: // verify rows .META. is renamed to hbase:meta ./src/main/docbkx/book.xml: <para>The catalog tables -ROOT- and .META. exist as HBase tables. They are filtered out ./src/main/docbkx/book.xml: <para>-ROOT- keeps track of where the .META. table is. The -ROOT- table structure is as follows: ./src/main/docbkx/book.xml: <listitem><para>.META. region key (<code>.META.,,1</code>)</para></listitem> ./src/main/docbkx/book.xml: instance of .META.)</para></listitem> ./src/main/docbkx/book.xml: <listitem><para><code>info:server</code> (server:port of the RegionServer holding .META.)</para></listitem> ./src/main/docbkx/book.xml: <listitem><para><code>info:serverstartcode</code> (start-time of the RegionServer process holding .META.)</para></listitem> ./src/main/docbkx/book.xml: <para>The .META. table keeps a list of all regions in the system. The .META. table structure is as follows: ./src/main/docbkx/book.xml: the <code>.META.</code> and <code>-ROOT-</code> catalog tables ./src/main/docbkx/book.xml: <para>Periodically checks and cleans up the .META. table. See <xref linkend= "arch.catalog.meta" /> for more information on META.</para> ./src/main/docbkx/book.xml: <listitem><para>Catalog tables: The -ROOT- and .META. tables are forced into the block cache and have the in-memory priority which means that they are harder to evict. The former never uses ./src/main/docbkx/book.xml:(.regioninfo files), the region’s row in the .META. table., and region’s deployment/assignments on ./src/main/docbkx/ops_mgt.xml: table directory and then do an edit of the .META. table replacing all mentions of the old ./src/main/docbkx/troubleshooting.xml: and then the client goes back to .META. to find the new location of the moved region.</para> ./src/main/docbkx/upgrading.xml: hdfs: //localhost:41020/myHBase/.META. ./src/main/docbkx/upgrading.xml:On startup, the <varname>.META.</varname> table content is rewritten removing the table schema from the <varname>info:regioninfo</varname> column. ./src/main/docbkx/upgrading.xml: <varname>.META.</varname> schema in the shell. In the past we would ./src/main/docbkx/upgrading.xml: the current <varname>.META.</varname> schema. Check ./src/main/docbkx/upgrading.xml: This will make the necessary edit to your <varname>.META.</varname> schema. ./src/main/docbkx/upgrading.xml: See <link xlink:href= "https: //issues.apache.org/jira/browse/HBASE-3499" >HBASE-3499 Users upgrading to 0.90.0 need to have their .META. table updated with the right MEMSTORE_SIZE</link> ./src/main/site/xdoc/replication.xml: .META. or -ROOT-, and did not originate in the target slave cluster - in Those in ./hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java should probably be retained as is. Ditto on this one: ./hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java: * TableName for old .META. table. Used in testing. ...
      Hide
      Misty Stanley-Jones added a comment -

      Mistys-MacBook-Pro:apidocs misty$ grep -r '\.META' *
      constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.META_ROW_DELIMITER"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.META_VERSION"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.METADATA"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<TD ALIGN="right"><CODE>".META."</CODE></TD>
      deprecated-list.html:<TD><A HREF="org/apache/hadoop/hbase/HConstants.html#META_TABLE_NAME">org.apache.hadoop.hbase.HConstants.META_TABLE_NAME</A>
      index-all.html:<DD>TableName for old .META.
      org/apache/hadoop/hbase/class-use/TableName.html:          TableName for old .META.</TD>
      org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.META_ROW_DELIMITER">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.META_VERSION">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.METADATA">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/TableName.html:          TableName for old .META.</TD>
      org/apache/hadoop/hbase/TableName.html:<DD>TableName for old .META. table. Used in testing.

      Show
      Misty Stanley-Jones added a comment - Mistys-MacBook-Pro:apidocs misty$ grep -r '\.META' * constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.META_ROW_DELIMITER"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.META_VERSION"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.METADATA"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<TD ALIGN="right"><CODE>".META."</CODE></TD> deprecated-list.html:<TD><A HREF="org/apache/hadoop/hbase/HConstants.html#META_TABLE_NAME">org.apache.hadoop.hbase.HConstants.META_TABLE_NAME</A> index-all.html:<DD>TableName for old .META. org/apache/hadoop/hbase/class-use/TableName.html:          TableName for old .META.</TD> org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.META_ROW_DELIMITER">Constant Field Values</A></DL> org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.META_VERSION">Constant Field Values</A></DL> org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.METADATA">Constant Field Values</A></DL> org/apache/hadoop/hbase/TableName.html:          TableName for old .META.</TD> org/apache/hadoop/hbase/TableName.html:<DD>TableName for old .META. table. Used in testing.
      Hide
      Misty Stanley-Jones added a comment -

      Mistys-MacBook-Pro:devapidocs misty$ grep -r '\.META' *
      constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.META_ROW_DELIMITER"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.META_VERSION"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.METADATA"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<TD ALIGN="right"><CODE>".META."</CODE></TD>
      constant-values.html:<A NAME="org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_SIZE_DESC"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<A NAME="org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_SIZE_NAME"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<A NAME="org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_TIME_DESC"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<A NAME="org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_TIME_NAME"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<A NAME="org.apache.hadoop.hbase.protobuf.generated.HFileProtos.FileTrailerProto.META_INDEX_COUNT_FIELD_NUMBER"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      constant-values.html:<A NAME="org.apache.hadoop.hbase.regionserver.wal.HLog.META_HLOG_FILE_EXTN"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1">
      deprecated-list.html:<TD><A HREF="org/apache/hadoop/hbase/HConstants.html#META_TABLE_NAME">org.apache.hadoop.hbase.HConstants.META_TABLE_NAME</A>
      index-all.html: - creates system namespace directory and move .META.<DT><A HREF="./org/apache/hadoop/hbase/migration/NamespaceUpgrade.html#NamespaceUpgrade()"><B>NamespaceUpgrade()</B></A> -
      index-all.html:<DD>TableName for old .META.
      index-all.html:<DD>Removes the table from .META.
      org/apache/hadoop/hbase/class-use/HRegionInfo.html:          Removes the table from .META.</TD>
      org/apache/hadoop/hbase/class-use/TableName.html:          TableName for old .META.</TD>
      org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.META_ROW_DELIMITER">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.META_VERSION">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.METADATA">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/master/handler/DeleteTableHandler.html:          Removes the table from .META.</TD>
      org/apache/hadoop/hbase/master/handler/DeleteTableHandler.html:<DD>Removes the table from .META. and archives the HDFS files.
      org/apache/hadoop/hbase/master/MetricsMasterFileSystemSource.html:<DT><B>See Also:</B><DD><A HREF="../../../../../constant-values.html#org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_TIME_NAME">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/master/MetricsMasterFileSystemSource.html:<DT><B>See Also:</B><DD><A HREF="../../../../../constant-values.html#org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_SIZE_NAME">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/master/MetricsMasterFileSystemSource.html:<DT><B>See Also:</B><DD><A HREF="../../../../../constant-values.html#org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_TIME_DESC">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/master/MetricsMasterFileSystemSource.html:<DT><B>See Also:</B><DD><A HREF="../../../../../constant-values.html#org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_SIZE_DESC">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/migration/NamespaceUpgrade.html: - creates system namespace directory and move .META. table there
      org/apache/hadoop/hbase/migration/NamespaceUpgrade.html: renaming .META. table to hbase:meta,
      org/apache/hadoop/hbase/migration/package-summary.html: - creates system namespace directory and move .META.</TD>
      org/apache/hadoop/hbase/protobuf/generated/HFileProtos.FileTrailerProto.html:<DT><B>See Also:</B><DD><A HREF="../../../../../../constant-values.html#org.apache.hadoop.hbase.protobuf.generated.HFileProtos.FileTrailerProto.META_INDEX_COUNT_FIELD_NUMBER">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/regionserver/wal/HLog.html:<DT><B>See Also:</B><DD><A HREF="../../../../../../constant-values.html#org.apache.hadoop.hbase.regionserver.wal.HLog.META_HLOG_FILE_EXTN">Constant Field Values</A></DL>
      org/apache/hadoop/hbase/TableName.html:          TableName for old .META.</TD>
      org/apache/hadoop/hbase/TableName.html:<DD>TableName for old .META. table. Used in testing.

      Show
      Misty Stanley-Jones added a comment - Mistys-MacBook-Pro:devapidocs misty$ grep -r '\.META' * constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.META_ROW_DELIMITER"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.META_VERSION"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<A NAME="org.apache.hadoop.hbase.HConstants.METADATA"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<TD ALIGN="right"><CODE>".META."</CODE></TD> constant-values.html:<A NAME="org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_SIZE_DESC"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<A NAME="org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_SIZE_NAME"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<A NAME="org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_TIME_DESC"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<A NAME="org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_TIME_NAME"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<A NAME="org.apache.hadoop.hbase.protobuf.generated.HFileProtos.FileTrailerProto.META_INDEX_COUNT_FIELD_NUMBER"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> constant-values.html:<A NAME="org.apache.hadoop.hbase.regionserver.wal.HLog.META_HLOG_FILE_EXTN"><!-- --></A><TD ALIGN="right"><FONT SIZE="-1"> deprecated-list.html:<TD><A HREF="org/apache/hadoop/hbase/HConstants.html#META_TABLE_NAME">org.apache.hadoop.hbase.HConstants.META_TABLE_NAME</A> index-all.html: - creates system namespace directory and move .META.<DT><A HREF="./org/apache/hadoop/hbase/migration/NamespaceUpgrade.html#NamespaceUpgrade()"><B>NamespaceUpgrade()</B></A> - index-all.html:<DD>TableName for old .META. index-all.html:<DD>Removes the table from .META. org/apache/hadoop/hbase/class-use/HRegionInfo.html:          Removes the table from .META.</TD> org/apache/hadoop/hbase/class-use/TableName.html:          TableName for old .META.</TD> org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.META_ROW_DELIMITER">Constant Field Values</A></DL> org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.META_VERSION">Constant Field Values</A></DL> org/apache/hadoop/hbase/HConstants.html:<DT><B>See Also:</B><DD><A HREF="../../../../constant-values.html#org.apache.hadoop.hbase.HConstants.METADATA">Constant Field Values</A></DL> org/apache/hadoop/hbase/master/handler/DeleteTableHandler.html:          Removes the table from .META.</TD> org/apache/hadoop/hbase/master/handler/DeleteTableHandler.html:<DD>Removes the table from .META. and archives the HDFS files. org/apache/hadoop/hbase/master/MetricsMasterFileSystemSource.html:<DT><B>See Also:</B><DD><A HREF="../../../../../constant-values.html#org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_TIME_NAME">Constant Field Values</A></DL> org/apache/hadoop/hbase/master/MetricsMasterFileSystemSource.html:<DT><B>See Also:</B><DD><A HREF="../../../../../constant-values.html#org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_SIZE_NAME">Constant Field Values</A></DL> org/apache/hadoop/hbase/master/MetricsMasterFileSystemSource.html:<DT><B>See Also:</B><DD><A HREF="../../../../../constant-values.html#org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_TIME_DESC">Constant Field Values</A></DL> org/apache/hadoop/hbase/master/MetricsMasterFileSystemSource.html:<DT><B>See Also:</B><DD><A HREF="../../../../../constant-values.html#org.apache.hadoop.hbase.master.MetricsMasterFileSystemSource.META_SPLIT_SIZE_DESC">Constant Field Values</A></DL> org/apache/hadoop/hbase/migration/NamespaceUpgrade.html: - creates system namespace directory and move .META. table there org/apache/hadoop/hbase/migration/NamespaceUpgrade.html: renaming .META. table to hbase:meta, org/apache/hadoop/hbase/migration/package-summary.html: - creates system namespace directory and move .META.</TD> org/apache/hadoop/hbase/protobuf/generated/HFileProtos.FileTrailerProto.html:<DT><B>See Also:</B><DD><A HREF="../../../../../../constant-values.html#org.apache.hadoop.hbase.protobuf.generated.HFileProtos.FileTrailerProto.META_INDEX_COUNT_FIELD_NUMBER">Constant Field Values</A></DL> org/apache/hadoop/hbase/regionserver/wal/HLog.html:<DT><B>See Also:</B><DD><A HREF="../../../../../../constant-values.html#org.apache.hadoop.hbase.regionserver.wal.HLog.META_HLOG_FILE_EXTN">Constant Field Values</A></DL> org/apache/hadoop/hbase/TableName.html:          TableName for old .META.</TD> org/apache/hadoop/hbase/TableName.html:<DD>TableName for old .META. table. Used in testing.
      Hide
      Misty Stanley-Jones added a comment -

      Mistys-MacBook-Pro:hbase misty$ grep -nrc ' .META. ' *|grep -v target|grep -v ':0'
      CHANGES.txt:24
      bin/region_mover.rb:1
      bin/region_status.rb:1
      conf/log4j.properties:1
      hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java:1
      hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java:2
      hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/TruncateTableHandler.java:1
      hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java:4
      hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java:3
      hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogKey.java:1
      hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java:1
      hbase-server/src/test/data/TestMetaMigrationConvertToPB.README:1
      hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestMetaMigrationConvertingToPB.java:1
      hbase-server/src/test/java/org/apache/hadoop/hbase/migration/TestNamespaceUpgrade.java:1
      src/main/docbkx/book.xml:6
      src/main/docbkx/ops_mgt.xml:1
      src/main/docbkx/troubleshooting.xml:1
      src/main/docbkx/upgrading.xml:1
      src/main/site/xdoc/replication.xml:1

      Show
      Misty Stanley-Jones added a comment - Mistys-MacBook-Pro:hbase misty$ grep -nrc ' .META. ' *|grep -v target|grep -v ':0' CHANGES.txt:24 bin/region_mover.rb:1 bin/region_status.rb:1 conf/log4j.properties:1 hbase-common/src/main/java/org/apache/hadoop/hbase/TableName.java:1 hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java:2 hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/TruncateTableHandler.java:1 hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java:4 hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java:3 hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogKey.java:1 hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java:1 hbase-server/src/test/data/TestMetaMigrationConvertToPB.README:1 hbase-server/src/test/java/org/apache/hadoop/hbase/catalog/TestMetaMigrationConvertingToPB.java:1 hbase-server/src/test/java/org/apache/hadoop/hbase/migration/TestNamespaceUpgrade.java:1 src/main/docbkx/book.xml:6 src/main/docbkx/ops_mgt.xml:1 src/main/docbkx/troubleshooting.xml:1 src/main/docbkx/upgrading.xml:1 src/main/site/xdoc/replication.xml:1
      Hide
      Misty Stanley-Jones added a comment -

      hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java:262 and following

      Do I need to change the .META. in the comments to hbase:meta or is it referring to during the upgrade? stack

      Show
      Misty Stanley-Jones added a comment - hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java:262 and following Do I need to change the .META. in the comments to hbase:meta or is it referring to during the upgrade? stack
      Hide
      Misty Stanley-Jones added a comment -

      Patch 1 of possibly 2 – awaiting answer to a question in the comments.

      Show
      Misty Stanley-Jones added a comment - Patch 1 of possibly 2 – awaiting answer to a question in the comments.
      Hide
      Hadoop QA added a comment -

      -1 overall. Here are the results of testing the latest attachment
      http://issues.apache.org/jira/secure/attachment/12646177/HBASE-9149.patch
      against trunk revision .
      ATTACHMENT ID: 12646177

      +1 @author. The patch does not contain any @author tags.

      +0 tests included. The patch appears to be a documentation patch that doesn't require tests.

      +1 javac. The applied patch does not increase the total number of javac compiler warnings.

      -1 javadoc. The javadoc tool appears to have generated 3 warning messages.

      +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

      -1 release audit. The applied patch generated 32 release audit warnings (more than the trunk's current 0 warnings).

      -1 lineLengths. The patch introduces the following lines longer than 100:
      + <para>ROOT keeps track of where the hbase:meta table is. The ROOT table structure is as follows:
      + <listitem><para><code>info:server</code> (server:port of the RegionServer holding hbase:meta)</para></listitem>
      + <listitem><para><code>info:serverstartcode</code> (start-time of the RegionServer process holding hbase:meta)</para></listitem>
      + <para>The hbase:meta table keeps a list of all regions in the system. The hbase:meta table structure is as follows:
      + <para>Periodically checks and cleans up the hbase:meta table. See <xref linkend="arch.catalog.meta" /> for more information on META.</para>
      + <listitem><para>Catalog tables: The ROOT and hbase:meta tables are forced into the block cache and have the in-memory priority which means that they are harder to evict. The former never uses
      +(.regioninfo files), the region’s row in the hbase:meta table., and region’s deployment/assignments on
      + and then the client goes back to hbase:meta to find the new location of the moved region.</para>

      +1 site. The mvn site goal succeeds with this patch.

      +1 core tests. The patch passed unit tests in .

      Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//testReport/
      Release audit warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt
      Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html
      Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
      Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html
      Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html
      Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
      Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html
      Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
      Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
      Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html
      Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//console

      This message is automatically generated.

      Show
      Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12646177/HBASE-9149.patch against trunk revision . ATTACHMENT ID: 12646177 +1 @author . The patch does not contain any @author tags. +0 tests included . The patch appears to be a documentation patch that doesn't require tests. +1 javac . The applied patch does not increase the total number of javac compiler warnings. -1 javadoc . The javadoc tool appears to have generated 3 warning messages. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. -1 release audit . The applied patch generated 32 release audit warnings (more than the trunk's current 0 warnings). -1 lineLengths . The patch introduces the following lines longer than 100: + <para> ROOT keeps track of where the hbase:meta table is. The ROOT table structure is as follows: + <listitem><para><code>info:server</code> (server:port of the RegionServer holding hbase:meta)</para></listitem> + <listitem><para><code>info:serverstartcode</code> (start-time of the RegionServer process holding hbase:meta)</para></listitem> + <para>The hbase:meta table keeps a list of all regions in the system. The hbase:meta table structure is as follows: + <para>Periodically checks and cleans up the hbase:meta table. See <xref linkend="arch.catalog.meta" /> for more information on META.</para> + <listitem><para>Catalog tables: The ROOT and hbase:meta tables are forced into the block cache and have the in-memory priority which means that they are harder to evict. The former never uses +(.regioninfo files), the region’s row in the hbase:meta table., and region’s deployment/assignments on + and then the client goes back to hbase:meta to find the new location of the moved region.</para> +1 site . The mvn site goal succeeds with this patch. +1 core tests . The patch passed unit tests in . Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//testReport/ Release audit warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/patchReleaseAuditProblems.txt Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-examples.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-prefix-tree.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-thrift.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-client.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-protocol.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/9593//console This message is automatically generated.
      Hide
      stack added a comment -

      Minor changes. What I committed.

      Show
      stack added a comment - Minor changes. What I committed.
      Hide
      stack added a comment -

      Committed to trunk. Thanks Misty Stanley-Jones

      Show
      stack added a comment - Committed to trunk. Thanks Misty Stanley-Jones
      Hide
      Hudson added a comment -

      FAILURE: Integrated in HBase-TRUNK #5144 (See https://builds.apache.org/job/HBase-TRUNK/5144/)
      HBASE-9149 javadoc cleanup of to reflect .META. rename to hbase:meta (Misty Stanley-Jones) (stack: rev aa101ca97e8394e4ba293ae637cd0ca193040576)

      • hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/TruncateTableHandler.java
      • src/main/site/xdoc/replication.xml
      • src/main/docbkx/ops_mgt.xml
      • conf/log4j.properties
      • bin/region_status.rb
      • bin/region_mover.rb
      • hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
      • src/main/docbkx/troubleshooting.xml
      • src/main/docbkx/book.xml
      Show
      Hudson added a comment - FAILURE: Integrated in HBase-TRUNK #5144 (See https://builds.apache.org/job/HBase-TRUNK/5144/ ) HBASE-9149 javadoc cleanup of to reflect .META. rename to hbase:meta (Misty Stanley-Jones) (stack: rev aa101ca97e8394e4ba293ae637cd0ca193040576) hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/TruncateTableHandler.java src/main/site/xdoc/replication.xml src/main/docbkx/ops_mgt.xml conf/log4j.properties bin/region_status.rb bin/region_mover.rb hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java src/main/docbkx/troubleshooting.xml src/main/docbkx/book.xml
      Hide
      Enis Soztutar added a comment -

      Closing this issue after 0.99.0 release.

      Show
      Enis Soztutar added a comment - Closing this issue after 0.99.0 release.

        People

        • Assignee:
          Misty Stanley-Jones
          Reporter:
          Francis Liu
        • Votes:
          0 Vote for this issue
          Watchers:
          6 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development