Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-1692

Deleting large tablets causes a lot of tcmalloc contention

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0
    • Fix Version/s: 1.1.0
    • Component/s: tablet, util
    • Labels:
      None

      Description

      I deleted a large table which contained about 1TB of data per tablet server. The tablet servers then started spending a large amount of time in this stack:

                        855e94 tcmalloc::ThreadCache::GetThreadStats(unsigned long*, unsigned long*) (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
                        84e9ba ExtractStats(TCMallocStats*, unsigned long*, tcmalloc::PageHeap::SmallSpanStats*, tcmalloc::PageHeap::LargeSpanStats*) (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-releas
                        850f8f TCMallocImplementation::GetNumericProperty(char const*, unsigned long*) (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
                       1a18c50 kudu::GetTCMallocCurrentAllocatedBytes() (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
                       1a19a50 kudu::MemTracker::UpdateConsumption() (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
                        980f01 std::_Sp_counted_ptr<kudu::cfile::CFileReader*, (__gnu_cxx::_Lock_policy)2>::_M_dispose() (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
                        99a937 kudu::tablet::CFileSet::~CFileSet() (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
                        99ad61 kudu::tablet::CFileSet::~CFileSet() (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
                        948b42 kudu::tablet::DiskRowSet::~DiskRowSet() (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
                        965f35 kudu::tablet::RowSetTree::~RowSetTree() (/opt/cloudera/parcels/KUDU-1.0.0-1.kudu1.0.0.p0.6/lib/kudu/sbin-release/kudu-tserver)
      

        Attachments

          Activity

            People

            • Assignee:
              adar Adar Dembo
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: