Avro
  1. Avro
  2. AVRO-652

Expose sync points in DataFileReader

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.0
    • Component/s: java
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      DataFileReader.blockStart is hidden from the caller, but exposing it (as readonly) would allow callers to discover sync points in a file by watching it for changes.

      seek(long) only takes an exact block boundary, while sync(long) moves to the next block boundary. There does not appear to be a way to rediscover points that you can seek() to, which would be very useful for building or recovering an index for a file.

        Activity

        Stu Hood created issue -
        Stu Hood made changes -
        Field Original Value New Value
        Component/s java [ 12312780 ]
        Stu Hood made changes -
        Stu Hood made changes -
        Issue Type New Feature [ 2 ] Bug [ 1 ]
        Stu Hood made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 1.4.0 [ 12314789 ]
        Doug Cutting made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Assignee Stu Hood [ stuhood ]
        Resolution Fixed [ 1 ]
        Doug Cutting made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Stu Hood
            Reporter:
            Stu Hood
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development