Uploaded image for project: 'Giraph (Retired)'
  1. Giraph (Retired)
  2. GIRAPH-1009

Spammy 'lost reservation' messages from ZooKeeper in workers' log at the end of the computation.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.2.0
    • 1.2.0
    • bsp, zookeeper
    • All environment, while running with more than one worker.

    • Patch

    Description

      When running Giraph with more than one worker, ZooKeeper usually throws a bunch of 'lost reservation' info log messages for input splits at the end of the computation in workers' log. This clutters log file of workers, specially in cases where the job is running on a large graph with fairly large number of input splits.

      Here are examples of these log messages:
      ...
      INFO 2015-05-19 14:44:58,894 [main-EventThread] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1126 lost reservation
      INFO 2015-05-19 14:44:58,894 [main-EventThread] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2585 lost reservation
      INFO 2015-05-19 14:44:58,895 [main-EventThread] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1166 lost reservation
      INFO 2015-05-19 14:44:58,895 [main-EventThread] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1212 lost reservation
      INFO 2015-05-19 14:44:58,895 [main-EventThread] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1666 lost reservation
      INFO 2015-05-19 14:44:58,896 [main-EventThread] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2282 lost reservation
      INFO 2015-05-19 14:44:58,896 [main-EventThread] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/1302 lost reservation
      INFO 2015-05-19 14:44:58,896 [main-EventThread] org.apache.giraph.worker.InputSplitsHandler - process: Input split /_hadoopBsp/job_201411061513.184523_0001/_edgeInputSplitDir/2364 lost reservation
      ...

      Attachments

        Activity

          People

            heslami Hassan Eslami
            heslami Hassan Eslami
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 72h
                72h
                Remaining:
                Remaining Estimate - 72h
                72h
                Logged:
                Time Spent - Not Specified
                Not Specified