Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6970

Issue with LogRegex format plugin where drillbuf was overflowing

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.15.0
    • 1.16.0
    • None

    Description

      The log format plugin does re-allocate the drillbuf when it fills up. You can query small log files but larger ones will fail with this error:

      0: jdbc:drill:zk=local> select * from dfs.root.`/prog/test.log`;
      Error: INTERNAL_ERROR ERROR: index: 32724, length: 108 (expected: range(0, 32768))

      Fragment 0:0

      Please, refer to logs for more information.

       

      I'm running drill-embeded. The log storage plugin is configured like so

      "log": {
      "type": "logRegex",
      "regex": "(.+)",
      "extension": "log",
      "maxErrors": 10,
      "schema": [
      {
      "fieldName": "line"
      }
      ]
      },
      

      The log files is very simple

      jdsaljfldaksjfldsajfldasjflkjdsfldsjfljsdalfk
      jdsaljfldaksjfldsajfldasjflkjdsfldsjfljsdalfk
      jdsaljfldaksjfldsajfldasjflkjdsfldsjfljsdalfk
      jdsaljfldaksjfldsajfldasjflkjdsfldsjfljsdalfk
      jdsaljfldaksjfldsajfldasjflkjdsfldsjfljsdalfk
      jdsaljfldaksjfldsajfldasjflkjdsfldsjfljsdalfk
      ...

       

       

      Attachments

        Activity

          People

            jccote jean-claude
            jccote jean-claude
            Charles Givre Charles Givre
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: