Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-7438

Look into using new HDFS truncate feature in HdfsTransactionLog.

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Hadoop Integration, hdfs
    • Labels:
      None

      Description

      Looks like truncate is added in 2.7.

      See HdfsTransactionLog:

        // HACK
        // while waiting for HDFS-3107, instead of quickly
        // dropping, we slowly apply
        // This is somewhat brittle, but current usage
        // allows for it
        @Override
        public boolean dropBufferedUpdates() {
          Future<RecoveryInfo> future = applyBufferedUpdates();
          if (future != null) {
            try {
              future.get();
            } catch (InterruptedException | ExecutionException e) {
              throw new RuntimeException(e);
            }
          }
          return true;
        }
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                markrmiller@gmail.com Mark Miller
                Reporter:
                markrmiller@gmail.com Mark Miller
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: