Hive
  1. Hive
  2. HIVE-2840

INPUT__FILE__NAME virtual column returns unqualified paths on Hadoop 0.23

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.9.0
    • Component/s: Query Processor
    • Labels:
      None

      Activity

      Hide
      Carl Steinbach added a comment -

      On 0.20.1 the values generated by the INPUT_FILE_NAME virtual column are fully qualified:

      hive> SELECT INPUT__FILE__NAME FROM src LIMIT 1;
      file:/user/hive/warehouse/src/kv1.txt
      

      However, the same query on 0.23.1 produces unqualified results:

      hive> SELECT INPUT__FILE__NAME FROM src LIMIT 1;
      /user/hive/warehouse/src/kv1.txt
      
      Show
      Carl Steinbach added a comment - On 0.20.1 the values generated by the INPUT_ FILE _NAME virtual column are fully qualified: hive> SELECT INPUT__FILE__NAME FROM src LIMIT 1; file:/user/hive/warehouse/src/kv1.txt However, the same query on 0.23.1 produces unqualified results: hive> SELECT INPUT__FILE__NAME FROM src LIMIT 1; /user/hive/warehouse/src/kv1.txt
      Hide
      Phabricator added a comment -

      cwsteinbach requested code review of "HIVE-2840 [jira] INPUT_FILE_NAME virtual column returns unqualified paths on Hadoop 0.23".
      Reviewers: JIRA, ashutoshc

      HIVE-2840. INPUT_FILE_NAME virtual column returns unqualified paths on Hadoop 0.23

      TEST PLAN
      EMPTY

      REVISION DETAIL
      https://reviews.facebook.net/D2127

      AFFECTED FILES
      ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java

      MANAGE HERALD DIFFERENTIAL RULES
      https://reviews.facebook.net/herald/view/differential/

      WHY DID I GET THIS EMAIL?
      https://reviews.facebook.net/herald/transcript/4605/

      Tip: use the X-Herald-Rules header to filter Herald messages in your client.

      Show
      Phabricator added a comment - cwsteinbach requested code review of " HIVE-2840 [jira] INPUT_ FILE _NAME virtual column returns unqualified paths on Hadoop 0.23". Reviewers: JIRA, ashutoshc HIVE-2840 . INPUT_ FILE _NAME virtual column returns unqualified paths on Hadoop 0.23 TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D2127 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/4605/ Tip: use the X-Herald-Rules header to filter Herald messages in your client.
      Hide
      Phabricator added a comment -

      ashutoshc has accepted the revision "HIVE-2840 [jira] INPUT_FILE_NAME virtual column returns unqualified paths on Hadoop 0.23".

      +1. Will commit if tests pass.

      REVISION DETAIL
      https://reviews.facebook.net/D2127

      BRANCH
      HIVE-2840-input-file-name

      Show
      Phabricator added a comment - ashutoshc has accepted the revision " HIVE-2840 [jira] INPUT_ FILE _NAME virtual column returns unqualified paths on Hadoop 0.23". +1. Will commit if tests pass. REVISION DETAIL https://reviews.facebook.net/D2127 BRANCH HIVE-2840 -input-file-name
      Hide
      Ashutosh Chauhan added a comment -

      Committed to trunk.

      Show
      Ashutosh Chauhan added a comment - Committed to trunk.
      Hide
      Hudson added a comment -

      Integrated in Hive-trunk-h0.21 #1297 (See https://builds.apache.org/job/Hive-trunk-h0.21/1297/)
      HIVE-2840: INPUT_FILE_NAME virtual column returns unqualified paths on Hadoop 0.23 (Carl Steinbach via hashutosh) (Revision 1298042)

      Result = SUCCESS
      hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298042
      Files :

      • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java
      Show
      Hudson added a comment - Integrated in Hive-trunk-h0.21 #1297 (See https://builds.apache.org/job/Hive-trunk-h0.21/1297/ ) HIVE-2840 : INPUT_ FILE _NAME virtual column returns unqualified paths on Hadoop 0.23 (Carl Steinbach via hashutosh) (Revision 1298042) Result = SUCCESS hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298042 Files : /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java
      Hide
      Ashutosh Chauhan added a comment -

      This issue is closed now. It was released with the fix in 0.9.0. If there is a problem, please open a new jira and link this one with that.

      Show
      Ashutosh Chauhan added a comment - This issue is closed now. It was released with the fix in 0.9.0. If there is a problem, please open a new jira and link this one with that.
      Hide
      Hudson added a comment -

      Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/)
      HIVE-2840: INPUT_FILE_NAME virtual column returns unqualified paths on Hadoop 0.23 (Carl Steinbach via hashutosh) (Revision 1298042)

      Result = ABORTED
      hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298042
      Files :

      • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java
      Show
      Hudson added a comment - Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/ ) HIVE-2840 : INPUT_ FILE _NAME virtual column returns unqualified paths on Hadoop 0.23 (Carl Steinbach via hashutosh) (Revision 1298042) Result = ABORTED hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1298042 Files : /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java

        People

        • Assignee:
          Carl Steinbach
          Reporter:
          Carl Steinbach
        • Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development