01-14-2016 17:00:20.836 INFO dispatchRunner - initing LicenseMgr in search process: nonPro=0 01-14-2016 17:00:20.836 INFO dispatchRunner - registering build time modules, count=1 01-14-2016 17:00:20.836 INFO dispatchRunner - registering search time components of build time module name=vix 01-14-2016 17:00:20.837 INFO dispatchRunner - Splunkd starting (build 271114). 01-14-2016 17:00:20.837 INFO dispatchRunner - System info: Linux, vruatsph001.iggroup.local, 2.6.32-431.20.3.el6.x86_64, #1 SMP Fri Jun 6 18:30:54 EDT 2014, x86_64. 01-14-2016 17:00:20.837 INFO dispatchRunner - Detected 8 (virtual) CPUs, 8 CPU cores, and 7871MB RAM 01-14-2016 17:00:20.837 INFO dispatchRunner - Maximum number of threads (approximate): 3935 01-14-2016 17:00:20.837 INFO dispatchRunner - Arguments are: "search" "--id=1452790820.13" "--maxbuckets=0" "--ttl=86400" "--maxout=500000" "--maxtime=8640000" "--lookups=1" "--reduce_freq=10" "--user=pearcem" "--pro" "--roles=dealing:power:user" 01-14-2016 17:00:20.837 INFO dispatchRunner - Getting search configuration data from: /opt/hunk/etc/modules/parsing/config.xml 01-14-2016 17:00:20.842 INFO BundlesSetup - Setup stats for /opt/hunk/etc: wallclock_elapsed_msec=19, cpu_time_used=0.017997, shared_services_generation=2, shared_services_population=1 01-14-2016 17:00:20.846 INFO UserManagerPro - Load authentication: forcing roles="dealing, power, user" 01-14-2016 17:00:20.848 INFO SessionManager - auth tokens will be generated with shpooling shared secret 01-14-2016 17:00:20.848 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:20.848 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:20.849 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:20.849 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:20.849 INFO UserManager - Done setting user context: NULL -> pearcem 01-14-2016 17:00:20.854 INFO dispatchRunner - search context: user="pearcem", app="search", bs-pathname="/opt/hunk/etc" 01-14-2016 17:00:20.856 INFO IndexProcessor - Initializing: readonly=true reloading=false 01-14-2016 17:00:20.866 INFO HotDBManager - idx=_audit Setting hot mgr params: maxHotSpanSecs=7776000 snapBucketTimespans=false maxHotBuckets=3 maxDataSizeBytes=786432000 quarantinePastSecs=77760000 quarantineFutureSecs=2592000 01-14-2016 17:00:20.867 INFO AuditTrailManager - audit stanza does not exist in audit.conf - no signing will take place 01-14-2016 17:00:20.867 INFO HotDBManager - idx=_blocksignature Setting hot mgr params: maxHotSpanSecs=7776000 snapBucketTimespans=false maxHotBuckets=3 maxDataSizeBytes=1048576000 quarantinePastSecs=77760000 quarantineFutureSecs=2592000 01-14-2016 17:00:20.867 INFO AuditTrailManager - audit stanza does not exist in audit.conf - no signing will take place 01-14-2016 17:00:20.867 INFO HotDBManager - idx=_internal Setting hot mgr params: maxHotSpanSecs=432000 snapBucketTimespans=false maxHotBuckets=3 maxDataSizeBytes=1048576000 quarantinePastSecs=77760000 quarantineFutureSecs=2592000 01-14-2016 17:00:20.867 INFO AuditTrailManager - audit stanza does not exist in audit.conf - no signing will take place 01-14-2016 17:00:20.867 INFO HotDBManager - idx=_introspection Setting hot mgr params: maxHotSpanSecs=7776000 snapBucketTimespans=false maxHotBuckets=3 maxDataSizeBytes=1073741824 quarantinePastSecs=77760000 quarantineFutureSecs=2592000 01-14-2016 17:00:20.867 INFO AuditTrailManager - audit stanza does not exist in audit.conf - no signing will take place 01-14-2016 17:00:20.867 INFO HotDBManager - idx=_thefishbucket Setting hot mgr params: maxHotSpanSecs=7776000 snapBucketTimespans=false maxHotBuckets=3 maxDataSizeBytes=524288000 quarantinePastSecs=77760000 quarantineFutureSecs=2592000 01-14-2016 17:00:20.867 INFO AuditTrailManager - audit stanza does not exist in audit.conf - no signing will take place 01-14-2016 17:00:20.867 INFO HotDBManager - idx=history Setting hot mgr params: maxHotSpanSecs=7776000 snapBucketTimespans=false maxHotBuckets=3 maxDataSizeBytes=10485760 quarantinePastSecs=77760000 quarantineFutureSecs=2592000 01-14-2016 17:00:20.867 INFO AuditTrailManager - audit stanza does not exist in audit.conf - no signing will take place 01-14-2016 17:00:20.867 INFO HotDBManager - idx=main Setting hot mgr params: maxHotSpanSecs=7776000 snapBucketTimespans=false maxHotBuckets=10 maxDataSizeBytes=10737418240 quarantinePastSecs=77760000 quarantineFutureSecs=2592000 01-14-2016 17:00:20.867 INFO AuditTrailManager - audit stanza does not exist in audit.conf - no signing will take place 01-14-2016 17:00:20.867 INFO HotDBManager - idx=summary Setting hot mgr params: maxHotSpanSecs=7776000 snapBucketTimespans=false maxHotBuckets=3 maxDataSizeBytes=786432000 quarantinePastSecs=77760000 quarantineFutureSecs=2592000 01-14-2016 17:00:20.867 INFO AuditTrailManager - audit stanza does not exist in audit.conf - no signing will take place 01-14-2016 17:00:20.867 INFO IndexProcessor - Initializing indexes took usec=566 reloading=false indexes_initialized=8 01-14-2016 17:00:20.867 INFO SearchParser - PARSING: search index=miker | stats count by topic 01-14-2016 17:00:20.868 INFO ISplunkDispatch - Not running in splunkd. Bundle replication not triggered. 01-14-2016 17:00:20.878 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:20.878 INFO UserManager - Done setting user context: NULL -> pearcem 01-14-2016 17:00:20.899 INFO SearchProcessor - Final search filter= 01-14-2016 17:00:20.905 INFO SearchOperator:kv - name=EXTRACT-GUID, can_use_re2=0, regex: (?i)(?!=\w)(?:objectguid|guid)\s*=\s*(?[\w\-]+) 01-14-2016 17:00:20.905 INFO SearchOperator:kv - name=EXTRACT-SID, can_use_re2=0, regex: objectSid\s*=\s*(?\S+) 01-14-2016 17:00:20.907 INFO SearchOperator:kv - name=ad-kv, can_use_re2=0, regex: (?<_KEY_1>[\w-]+)=(?<_VAL_1>[^\r\n]*) 01-14-2016 17:00:20.908 INFO SearchOperator:kv - name=access-extractions, can_use_re2=0, regex: ^(?P\S+)\s++(?P\S+)\s++(?P\S+)\s++\[(?[^\]]*+)\]\s++"\s*+(?P[^\s"]++)?(?:\s++(?(?:(?\w++://[^/\s"]++))?+(?(?:/++(?(?:\\"|[^\s\?/"])++)/++)?(?:(?:\\"|[^\s\?/"])*+/++)*(?[^\s\?/]+)?)(?:\?(?[^\s]*))?)(?:\s++(?P[^\s"]++))*)?\s*+"\s++(?P\S+)\s++(?P\S+)(?:\s++"(?(?:(?\w++://[^/\s"]++))?+[^"]*+)"(?:\s++"(?[^"]*+)"(?:\s++"(?[^"]*+)")?+)?+)?(?P.*) 01-14-2016 17:00:20.908 INFO SearchOperator:kv - name=syslog-extractions, can_use_re2=0, regex: \s([^\s\[]+)(?:\[(\d+)\])?:\s 01-14-2016 17:00:20.909 INFO SearchOperator:kv - name=db2, can_use_re2=0, regex: ([A-Z]+) *: (.*?)(?=\n|$| +[A-Z]+ *:) 01-14-2016 17:00:20.909 INFO SearchOperator:kv - name=EXTRACT-extract_spent, can_use_re2=0, regex: (?\d+)ms$ 01-14-2016 17:00:20.909 INFO SearchOperator:kv - name=EXTRACT-1, can_use_re2=0, regex: (?<_KEY_1>\S+)::(?<_VAL_1>\S+) 01-14-2016 17:00:20.910 INFO SearchOperator:kv - name=bracket-space, can_use_re2=0, regex: \[(\S+) (.*?)\] 01-14-2016 17:00:20.911 INFO SearchOperator:kv - name=sendmail-extractions, can_use_re2=0, regex: sendmail\[(\d+)\]: (\w+): 01-14-2016 17:00:20.911 INFO SearchOperator:kv - name=tcpdump-endpoints, can_use_re2=0, regex: (\d+\.\d+\.\d+\.\d+):(\d+) -> (\d+\.\d+\.\d+\.\d+):(\d+) 01-14-2016 17:00:20.912 INFO SearchOperator:kv - name=colon-kv, can_use_re2=0, regex: (?<= )([A-Za-z]+): ?((0x[A-F\d]+)|\d+)(?= |\n|$) 01-14-2016 17:00:20.919 INFO SearchOperator:kv - name=EXTRACT-severity,logger, can_use_re2=0, regex: .*?(?[A-Z]+) ((?[^\s]+) \-)* 01-14-2016 17:00:20.920 INFO SearchOperator:kv - name=EXTRACT-collection,category,object, can_use_re2=0, regex: collection=\"?(?P[^\"\n]+)\"?\ncategory=\"?(?P[^\"\n]+)\"?\nobject=\"?(?P[^\"\n]+)\"?\n 01-14-2016 17:00:20.920 INFO SearchOperator:kv - name=wel-message, can_use_re2=0, regex: (?sm)^(?<_pre_msg>.+)\nMessage=(?.+)$ 01-14-2016 17:00:20.921 INFO SearchOperator:kv - name=wel-col-kv, can_use_re2=0, regex: \n([^:\n\r]+):[ \t]++([^\n]*) 01-14-2016 17:00:20.921 INFO SearchOperator:kv - name=EXTRACT-useragent, can_use_re2=0, regex: userAgent=(?P[^ (]+) 01-14-2016 17:00:20.921 INFO SearchOperator:kv - name=splunk-service-extractions, can_use_re2=0, regex: (?i)^(?:[^ ]* ){2}(?P[^\s]*)\s+\[(?P\w+)]\s+(?P[^ ]+):(?P\d+) - (?P.+) 01-14-2016 17:00:20.921 INFO SearchOperator:kv - name=EXTRACT-fields, can_use_re2=0, regex: (?i)^(?:[^ ]* ){2}(?:[+\-]\d+ )?(?P[^ ]*)\s+(?P[^ ]+) - (?P.+) 01-14-2016 17:00:20.921 INFO SearchOperator:kv - name=extract_spent, can_use_re2=0, regex: (?P\d+)ms$ 01-14-2016 17:00:20.922 INFO SearchOperator:kv - name=EXTRACT-path_part_1, can_use_re2=0, regex: ^(?:[^/\n]*/){1}(?P[^/\"]+) 01-14-2016 17:00:20.922 INFO SearchOperator:kv - name=EXTRACT-path_part_2, can_use_re2=0, regex: ^(?:[^/\n]*/){2}(?P[^/\"]+) 01-14-2016 17:00:20.922 INFO SearchOperator:kv - name=EXTRACT-path_part_3, can_use_re2=0, regex: ^(?:[^/\n]*/){3}(?P[^/\"]+) 01-14-2016 17:00:20.922 INFO SearchOperator:kv - name=EXTRACT-path_part_4, can_use_re2=0, regex: ^(?:[^/\n]*/){4}(?P[^/\"]+) 01-14-2016 17:00:20.922 INFO SearchOperator:kv - name=EXTRACT-path_part_5, can_use_re2=0, regex: ^(?:[^/\n]*/){5}(?P[^/\"]+) 01-14-2016 17:00:20.922 INFO SearchOperator:kv - name=EXTRACT-path_part_6, can_use_re2=0, regex: ^(?:[^/\n]*/){6}(?P[^/\"]+) 01-14-2016 17:00:20.922 INFO SearchOperator:kv - name=EXTRACT-path_part_7, can_use_re2=0, regex: ^(?:[^/\n]*/){7}(?P[^/\"]+) 01-14-2016 17:00:20.922 INFO SearchOperator:kv - name=EXTRACT-path_part_8, can_use_re2=0, regex: ^(?:[^/\n]*/){8}(?P[^/\"]+) 01-14-2016 17:00:20.922 INFO SearchOperator:kv - name=weblogic-code, can_use_re2=0, regex: 01-14-2016 17:00:20.923 INFO SearchOperator:kv - name=colon-line, can_use_re2=0, regex: ^(\w+)\s*:[ \t]*(.*?)$ 01-14-2016 17:00:20.923 INFO SearchOperator:kv - name=was-trlog-code, can_use_re2=0, regex: ] ([a-fA-F0-9]{8}) 01-14-2016 17:00:20.923 INFO UnifiedSearch - base lispy: [ AND index::miker ] 01-14-2016 17:00:20.926 INFO DispatchThread - Disabling remote timeline computation due to processor name=search, not allowing it 01-14-2016 17:00:20.926 INFO SortOperator - maxmem = 209715200 01-14-2016 17:00:20.926 INFO SearchParser - PARSING: prestats count by topic 01-14-2016 17:00:20.926 INFO SearchParser - PARSING: addinfo type=count label=prereport_events 01-14-2016 17:00:20.927 INFO DispatchThread - BatchMode: allowBatchMode: 1, conf(1): 1, timeline/Status buckets(0):0, realtime(0):0, report pipe empty(0):0, reqTimeOrder(0):0, summarize(0):0, statefulStreaming(0):0 01-14-2016 17:00:20.927 INFO DispatchThread - required fields list = prestats_reserved_*,psrsvd_*,topic 01-14-2016 17:00:20.927 INFO SearchParser - PARSING: fields keepcolorder=t "prestats_reserved_*" "psrsvd_*" "topic" 01-14-2016 17:00:20.952 INFO DispatchThread - Did not find a usable summary_id, setting info._summary_mode=none, not modifying input summary_id=44C898A2-6F9C-42B4-B380-270E069BBF48_search_pearcem_f28bebd759e9a2ff 01-14-2016 17:00:20.978 INFO DispatchThread - Did not find a usable summary_id, setting info._summary_mode=none, not modifying input summary_id=44C898A2-6F9C-42B4-B380-270E069BBF48_search_pearcem_NS47ede18ae1b63f54 01-14-2016 17:00:20.978 INFO DistributedSearchResultCollectionManager - Stream search: litsearch index=miker | addinfo type=count label=prereport_events | fields keepcolorder=t "prestats_reserved_*" "psrsvd_*" "topic" | prestats count by topic 01-14-2016 17:00:20.978 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:20.978 INFO UserManager - Done setting user context: pearcem -> pearcem 01-14-2016 17:00:20.979 INFO ExternalResultProvider - Search after asserting splunk_server=local: (index=miker) 01-14-2016 17:00:20.983 INFO ExternalResultProvider - Found bundlePath=/opt/hunk/var/run/vruatsph001.iggroup.local-1452790201.bundle 01-14-2016 17:00:20.984 INFO ExternalResultProvider - Creating external result provider=myuatmrigniteprovider, with index.count=1, search="search (index=miker) | addinfo type=count label=prereport_events | fields keepcolorder=t "prestats_reserved_*" "psrsvd_*" "topic" | prestats count by topic" 01-14-2016 17:00:20.985 INFO SearchParser - PARSING: stdin | search (index=miker) | addinfo type=count label=prereport_events | fields keepcolorder=t "prestats_reserved_*" "psrsvd_*" "topic" | prestats count by topic 01-14-2016 17:00:21.000 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:21.002 INFO FastTyper - found nodes count: comparisons=8, unique_comparisons=7, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=24 01-14-2016 17:00:21.011 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:21.011 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:21.012 INFO ExternalResultProvider - provider=myuatmrigniteprovider, mode.config=report, mode.search=mixed 01-14-2016 17:00:21.013 INFO SearchParser - PARSING: search (index=miker) | addinfo type=count label=prereport_events | fields keepcolorder=t "prestats_reserved_*" "psrsvd_*" "topic" | prestats count by topic 01-14-2016 17:00:21.027 INFO SearchProcessor - Final search filter= 01-14-2016 17:00:21.034 INFO SearchOperator:kv - name=EXTRACT-GUID, can_use_re2=0, regex: (?i)(?!=\w)(?:objectguid|guid)\s*=\s*(?[\w\-]+) 01-14-2016 17:00:21.034 INFO SearchOperator:kv - name=EXTRACT-SID, can_use_re2=0, regex: objectSid\s*=\s*(?\S+) 01-14-2016 17:00:21.034 INFO SearchOperator:kv - name=ad-kv, can_use_re2=0, regex: (?<_KEY_1>[\w-]+)=(?<_VAL_1>[^\r\n]*) 01-14-2016 17:00:21.035 INFO SearchOperator:kv - name=access-extractions, can_use_re2=0, regex: ^(?P\S+)\s++(?P\S+)\s++(?P\S+)\s++\[(?[^\]]*+)\]\s++"\s*+(?P[^\s"]++)?(?:\s++(?(?:(?\w++://[^/\s"]++))?+(?(?:/++(?(?:\\"|[^\s\?/"])++)/++)?(?:(?:\\"|[^\s\?/"])*+/++)*(?[^\s\?/]+)?)(?:\?(?[^\s]*))?)(?:\s++(?P[^\s"]++))*)?\s*+"\s++(?P\S+)\s++(?P\S+)(?:\s++"(?(?:(?\w++://[^/\s"]++))?+[^"]*+)"(?:\s++"(?[^"]*+)"(?:\s++"(?[^"]*+)")?+)?+)?(?P.*) 01-14-2016 17:00:21.035 INFO SearchOperator:kv - name=syslog-extractions, can_use_re2=0, regex: \s([^\s\[]+)(?:\[(\d+)\])?:\s 01-14-2016 17:00:21.035 INFO SearchOperator:kv - name=EXTRACT-apiEndTime, can_use_re2=0, regex: apiEndTime=\'(?[^\']*?)\' 01-14-2016 17:00:21.035 INFO SearchOperator:kv - name=EXTRACT-apiStartTime, can_use_re2=0, regex: apiStartTime=\'(?[^\']*?)\' 01-14-2016 17:00:21.035 INFO SearchOperator:kv - name=EXTRACT-search_id, can_use_re2=0, regex: search_id=\'(?[^\']*?)\' 01-14-2016 17:00:21.035 INFO SearchOperator:kv - name=EXTRACT-search_string, can_use_re2=0, regex: search=\'(?.*?)\',\sautojoin 01-14-2016 17:00:21.035 INFO SearchOperator:kv - name=db2, can_use_re2=0, regex: ([A-Z]+) *: (.*?)(?=\n|$| +[A-Z]+ *:) 01-14-2016 17:00:21.036 INFO SearchOperator:kv - name=EXTRACT-extract_spent, can_use_re2=0, regex: (?\d+)ms$ 01-14-2016 17:00:21.036 INFO SearchOperator:kv - name=EXTRACT-1, can_use_re2=0, regex: (?<_KEY_1>\S+)::(?<_VAL_1>\S+) 01-14-2016 17:00:21.037 INFO SearchOperator:kv - name=bracket-space, can_use_re2=0, regex: \[(\S+) (.*?)\] 01-14-2016 17:00:21.038 INFO SearchOperator:kv - name=sendmail-extractions, can_use_re2=0, regex: sendmail\[(\d+)\]: (\w+): 01-14-2016 17:00:21.038 INFO SearchOperator:kv - name=tcpdump-endpoints, can_use_re2=0, regex: (\d+\.\d+\.\d+\.\d+):(\d+) -> (\d+\.\d+\.\d+\.\d+):(\d+) 01-14-2016 17:00:21.038 INFO SearchOperator:kv - name=colon-kv, can_use_re2=0, regex: (?<= )([A-Za-z]+): ?((0x[A-F\d]+)|\d+)(?= |\n|$) 01-14-2016 17:00:21.046 INFO SearchOperator:kv - name=EXTRACT-severity,logger, can_use_re2=0, regex: .*?(?[A-Z]+) ((?[^\s]+) \-)* 01-14-2016 17:00:21.047 INFO SearchOperator:kv - name=EXTRACT-collection,category,object, can_use_re2=0, regex: collection=\"?(?P[^\"\n]+)\"?\ncategory=\"?(?P[^\"\n]+)\"?\nobject=\"?(?P[^\"\n]+)\"?\n 01-14-2016 17:00:21.047 INFO SearchOperator:kv - name=wel-message, can_use_re2=0, regex: (?sm)^(?<_pre_msg>.+)\nMessage=(?.+)$ 01-14-2016 17:00:21.047 INFO SearchOperator:kv - name=wel-col-kv, can_use_re2=0, regex: \n([^:\n\r]+):[ \t]++([^\n]*) 01-14-2016 17:00:21.047 INFO SearchOperator:kv - name=EXTRACT-useragent, can_use_re2=0, regex: userAgent=(?P[^ (]+) 01-14-2016 17:00:21.047 INFO SearchOperator:kv - name=splunk-service-extractions, can_use_re2=0, regex: (?i)^(?:[^ ]* ){2}(?P[^\s]*)\s+\[(?P\w+)]\s+(?P[^ ]+):(?P\d+) - (?P.+) 01-14-2016 17:00:21.048 INFO SearchOperator:kv - name=EXTRACT-fields, can_use_re2=0, regex: (?i)^(?:[^ ]* ){2}(?:[+\-]\d+ )?(?P[^ ]*)\s+(?P[^ ]+) - (?P.+) 01-14-2016 17:00:21.048 INFO SearchOperator:kv - name=extract_spent, can_use_re2=0, regex: (?P\d+)ms$ 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=EXTRACT-path_part_1, can_use_re2=0, regex: ^(?:[^/\n]*/){1}(?P[^/\"]+) 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=EXTRACT-path_part_2, can_use_re2=0, regex: ^(?:[^/\n]*/){2}(?P[^/\"]+) 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=EXTRACT-path_part_3, can_use_re2=0, regex: ^(?:[^/\n]*/){3}(?P[^/\"]+) 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=EXTRACT-path_part_4, can_use_re2=0, regex: ^(?:[^/\n]*/){4}(?P[^/\"]+) 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=EXTRACT-path_part_5, can_use_re2=0, regex: ^(?:[^/\n]*/){5}(?P[^/\"]+) 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=EXTRACT-path_part_6, can_use_re2=0, regex: ^(?:[^/\n]*/){6}(?P[^/\"]+) 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=EXTRACT-path_part_7, can_use_re2=0, regex: ^(?:[^/\n]*/){7}(?P[^/\"]+) 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=EXTRACT-path_part_8, can_use_re2=0, regex: ^(?:[^/\n]*/){8}(?P[^/\"]+) 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=weblogic-code, can_use_re2=0, regex: 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=colon-line, can_use_re2=0, regex: ^(\w+)\s*:[ \t]*(.*?)$ 01-14-2016 17:00:21.049 INFO SearchOperator:kv - name=was-trlog-code, can_use_re2=0, regex: ] ([a-fA-F0-9]{8}) 01-14-2016 17:00:21.050 INFO UnifiedSearch - base lispy: [ AND index::miker ] 01-14-2016 17:00:21.051 INFO ERP.myuatmrigniteprovider - Starting: /opt/hunk/bin/jars/sudobash /opt/splunkforwarder/ignite-hadoop.sh jar "/opt/hunk/bin/jars/SplunkMR-s6.0-h2.0.jar" "com.splunk.mr.SplunkMR" 01-14-2016 17:00:21.051 INFO DistributedSearchResultCollectionManager - Default search group:* 01-14-2016 17:00:21.051 INFO DistributedSearchResultCollectionManager - Connecting to peer vruatsph001.iggroup.local connectAll 0 connectToSpecificPeer 1 01-14-2016 17:00:21.051 INFO SearchParser - PARSING: litsearch index=miker | addinfo type=count label=prereport_events | fields keepcolorder=t "prestats_reserved_*" "psrsvd_*" "topic" | prestats count by topic 01-14-2016 17:00:21.055 DEBUG ERP.myuatmrigniteprovider - MAPREDUCE_USER=, SPLUNK_HOME=/opt/hunk, HADOOP_CLASSPATH= 01-14-2016 17:00:21.058 DEBUG ERP.myuatmrigniteprovider - HADOOP_USER_CLASSPATH_FIRST= 01-14-2016 17:00:21.059 DEBUG ERP.myuatmrigniteprovider - HADOOP_CLASSPATH=:/opt/hunk/bin/jars/thirdparty/common/avro-1.7.4.jar:/opt/hunk/bin/jars/thirdparty/common/avro-mapred-1.7.4.jar:/opt/hunk/bin/jars/thirdparty/common/commons-compress-1.5.jar:/opt/hunk/bin/jars/thirdparty/common/commons-io-2.1.jar:/opt/hunk/bin/jars/thirdparty/common/libfb303-0.9.0.jar:/opt/hunk/bin/jars/thirdparty/common/parquet-hive-bundle-1.5.0.jar:/opt/hunk/bin/jars/thirdparty/common/snappy-java-1.0.5.jar:/opt/hunk/bin/jars/thirdparty/hive/hive-exec-0.12.0.jar:/opt/hunk/bin/jars/thirdparty/hive/hive-metastore-0.12.0.jar:/opt/hunk/bin/jars/thirdparty/hive/hive-serde-0.12.0.jar 01-14-2016 17:00:21.059 DEBUG ERP.myuatmrigniteprovider - Invoking command: /bin/bash /opt/splunkforwarder/ignite-hadoop.sh jar /opt/hunk/bin/jars/SplunkMR-s6.0-h2.0.jar com.splunk.mr.SplunkMR 01-14-2016 17:00:21.073 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:21.074 INFO FastTyper - found nodes count: comparisons=8, unique_comparisons=7, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=24 01-14-2016 17:00:21.081 INFO UserManager - Unwound user context: pearcem -> pearcem 01-14-2016 17:00:21.082 INFO DispatchThread - Disk quota = 524288000 01-14-2016 17:00:21.082 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:21.082 INFO UserManager - Done setting user context: NULL -> pearcem 01-14-2016 17:00:21.082 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:21.082 INFO UserManager - Done setting user context: NULL -> pearcem 01-14-2016 17:00:21.082 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:21.082 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:21.082 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:21.082 INFO UserManager - Done setting user context: NULL -> pearcem 01-14-2016 17:00:21.082 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:21.082 INFO UserManager - Setting user context: pearcem 01-14-2016 17:00:21.082 INFO UserManager - Done setting user context: NULL -> pearcem 01-14-2016 17:00:21.082 INFO UserManager - Done setting user context: NULL -> pearcem 01-14-2016 17:00:21.082 INFO UserManager - Done setting user context: NULL -> pearcem 01-14-2016 17:00:21.082 INFO UserManager - Unwound user context: pearcem -> NULL 01-14-2016 17:00:21.082 INFO UserManager - Done setting user context: NULL -> pearcem 01-14-2016 17:00:21.082 INFO ERPSearchResultCollector - ERP peer=myuatmrigniteprovider starts reading search results. 01-14-2016 17:00:21.084 DEBUG ERP.myuatmrigniteprovider - WARNING: Use "yarn jar" to launch YARN applications. 01-14-2016 17:00:21.662 INFO ERP.myuatmrigniteprovider - SplunkMR - starting, version=6.2 ... 01-14-2016 17:00:22.411 INFO ERP.myuatmrigniteprovider - Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 01-14-2016 17:00:22.417 INFO ERP.myuatmrigniteprovider - SplunkMR - Setting custom jars=file:/opt/hunk/bin/jars/thirdparty/common/avro-1.7.4.jar,file:/opt/hunk/bin/jars/thirdparty/common/avro-mapred-1.7.4.jar,file:/opt/hunk/bin/jars/thirdparty/common/commons-compress-1.5.jar,file:/opt/hunk/bin/jars/thirdparty/common/commons-io-2.1.jar,file:/opt/hunk/bin/jars/thirdparty/common/libfb303-0.9.0.jar,file:/opt/hunk/bin/jars/thirdparty/common/parquet-hive-bundle-1.5.0.jar,file:/opt/hunk/bin/jars/thirdparty/common/snappy-java-1.0.5.jar,file:/opt/hunk/bin/jars/thirdparty/hive/hive-exec-0.12.0.jar,file:/opt/hunk/bin/jars/thirdparty/hive/hive-metastore-0.12.0.jar,file:/opt/hunk/bin/jars/thirdparty/hive/hive-serde-0.12.0.jar 01-14-2016 17:00:23.015 INFO ERP.myuatmrigniteprovider - UserGroupInformation - Login successful for user splunk@IGI.IG.LOCAL using keytab file /etc/security/keytabs/splunk.service.keytab 01-14-2016 17:00:23.016 INFO ERP.myuatmrigniteprovider - SplunkMR - Configured to use installed splunk package. Ensuring package exists 01-14-2016 17:00:23.028 INFO ERP.myuatmrigniteprovider - GetsSplunkManifest - Discovered more than one manifest file. Using the last modified one: /opt/hunk/hunk-6.2.4-271114-linux-2.6-x86_64-manifest 01-14-2016 17:00:23.028 INFO ERP.myuatmrigniteprovider - SplunkMR - Setting configuration to use local Splunk package: /opt/hunk/hunk-6.2.4-271114-linux-2.6-x86_64.tgz 01-14-2016 17:00:23.088 INFO ERP.myuatmrigniteprovider - VixTimeSpecifier - using timezone=null, _tz.id="GB-Eire", name="Greenwich Mean Time" for regex=/(\d{4})/(\d{2})/(\d{2}), format=yyyyMMdd 01-14-2016 17:00:23.089 INFO ERP.myuatmrigniteprovider - VixTimeSpecifier - using timezone=null, _tz.id="GB-Eire", name="Greenwich Mean Time" for regex=/(\d{4})/(\d{2})/(\d{2}), format=yyyyMMdd 01-14-2016 17:00:23.093 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - VIXPathSpecifier globpath=/data/kafka/camus/ig/internal/attribution/event/*, accept=null, ignore=null 01-14-2016 17:00:23.104 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=null, inputId=null, list=SplunkLineRecordReader 01-14-2016 17:00:23.114 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Reduce search: sistats count by topic 01-14-2016 17:00:23.114 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Search mode: mixed 01-14-2016 17:00:23.115 DEBUG ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - parsed _keySet=[index::miker] 01-14-2016 17:00:23.115 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - setting requiredFields=Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:23.350 DEBUG ERP.myuatmrigniteprovider - NativeAzureFileSystem - finalize() called. 01-14-2016 17:00:23.351 DEBUG ERP.myuatmrigniteprovider - NativeAzureFileSystem - finalize() called. 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsWrapper - Failed to connect to IGFS using shared memory [port=10500] 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - java.io.IOException: Failed to connect shared memory endpoint to port (is shared memory server endpoint up and running?): 10500 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo.get(HadoopIgfsIpcIo.java:162) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.(HadoopIgfsOutProc.java:173) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.(HadoopIgfsOutProc.java:147) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.delegate(HadoopIgfsWrapper.java:389) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:304) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:282) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.handshake(HadoopIgfsWrapper.java:102) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.initialize(IgniteHadoopFileSystem.java:295) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR$SearchHandler.executeImpl(SplunkMR.java:900) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR$SearchHandler.execute(SplunkMR.java:771) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.PrivilegedCommandHandlerAction.run(PrivilegedCommandHandlerAction.java:51) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.PrivilegedCommandHandlerAction.run(PrivilegedCommandHandlerAction.java:17) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at java.security.AccessController.doPrivileged(Native Method) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at javax.security.auth.Subject.doAs(Subject.java:415) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR.runImpl(SplunkMR.java:1516) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR.run(SplunkMR.java:1300) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR.main(SplunkMR.java:1546) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at java.lang.reflect.Method.invoke(Method.java:606) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - Caused by: class org.apache.ignite.IgniteCheckedException: Failed to connect shared memory endpoint to port (is shared memory server endpoint up and running?): 10500 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryClientEndpoint.(IpcSharedMemoryClientEndpoint.java:167) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryClientEndpoint.(IpcSharedMemoryClientEndpoint.java:95) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.IpcEndpointFactory.connectSharedMemoryEndpoint(IpcEndpointFactory.java:85) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.IpcEndpointFactory.connectEndpoint(IpcEndpointFactory.java:59) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo.start(HadoopIgfsIpcIo.java:256) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo.get(HadoopIgfsIpcIo.java:159) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - ... 31 more 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - Caused by: java.net.SocketException: Connection reset 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at java.net.SocketInputStream.read(SocketInputStream.java:196) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at java.net.SocketInputStream.read(SocketInputStream.java:122) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream.(ObjectInputStream.java:299) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryClientEndpoint.(IpcSharedMemoryClientEndpoint.java:134) 01-14-2016 17:00:23.573 DEBUG ERP.myuatmrigniteprovider - ... 36 more 01-14-2016 17:00:23.590 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=0, msg=IgfsHandshakeRequest [gridName=null, igfsName=igfs, logDir=null]] 01-14-2016 17:00:23.592 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=0, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.617 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Created filesystem object, elapsed_ms=502 01-14-2016 17:00:23.618 DEBUG ERP.myuatmrigniteprovider - SplunkMR - Using file system with currentUser's realUser as cache fs 01-14-2016 17:00:23.619 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:splunk@IGI.IG.LOCAL (auth:KERBEROS) from:com.splunk.mr.SplunkMR.getProxyUserFileSystem(SplunkMR.java:438) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsWrapper - Failed to connect to IGFS using shared memory [port=10500] 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - java.io.IOException: Failed to connect shared memory endpoint to port (is shared memory server endpoint up and running?): 10500 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo.get(HadoopIgfsIpcIo.java:162) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.(HadoopIgfsOutProc.java:173) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc.(HadoopIgfsOutProc.java:147) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.delegate(HadoopIgfsWrapper.java:389) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:304) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.withReconnectHandling(HadoopIgfsWrapper.java:282) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsWrapper.handshake(HadoopIgfsWrapper.java:102) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem.initialize(IgniteHadoopFileSystem.java:295) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2653) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:170) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:355) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR$1.run(SplunkMR.java:443) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR$1.run(SplunkMR.java:439) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.security.AccessController.doPrivileged(Native Method) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at javax.security.auth.Subject.doAs(Subject.java:415) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR.getProxyUserFileSystem(SplunkMR.java:438) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR.getCacheFs(SplunkMR.java:429) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR$SearchHandler.executeImpl(SplunkMR.java:910) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR$SearchHandler.execute(SplunkMR.java:771) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.PrivilegedCommandHandlerAction.run(PrivilegedCommandHandlerAction.java:51) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.PrivilegedCommandHandlerAction.run(PrivilegedCommandHandlerAction.java:17) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.security.AccessController.doPrivileged(Native Method) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at javax.security.auth.Subject.doAs(Subject.java:415) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR.runImpl(SplunkMR.java:1516) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR.run(SplunkMR.java:1300) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at com.splunk.mr.SplunkMR.main(SplunkMR.java:1546) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.lang.reflect.Method.invoke(Method.java:606) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.util.RunJar.run(RunJar.java:221) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.hadoop.util.RunJar.main(RunJar.java:136) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - Caused by: class org.apache.ignite.IgniteCheckedException: Failed to connect shared memory endpoint to port (is shared memory server endpoint up and running?): 10500 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryClientEndpoint.(IpcSharedMemoryClientEndpoint.java:167) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryClientEndpoint.(IpcSharedMemoryClientEndpoint.java:95) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.IpcEndpointFactory.connectSharedMemoryEndpoint(IpcEndpointFactory.java:85) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.IpcEndpointFactory.connectEndpoint(IpcEndpointFactory.java:59) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo.start(HadoopIgfsIpcIo.java:256) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsIpcIo.get(HadoopIgfsIpcIo.java:159) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - ... 39 more 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - Caused by: java.net.SocketException: Connection reset 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.net.SocketInputStream.read(SocketInputStream.java:196) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.net.SocketInputStream.read(SocketInputStream.java:122) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2310) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2323) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at java.io.ObjectInputStream.(ObjectInputStream.java:299) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - at org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryClientEndpoint.(IpcSharedMemoryClientEndpoint.java:134) 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - ... 44 more 01-14-2016 17:00:23.624 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - IPC IO acquired: HadoopIgfsIpcIo [endpointAddr=127.0.0.1:10500, activeCnt=2, stopping=false] 01-14-2016 17:00:23.625 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1, msg=IgfsHandshakeRequest [gridName=null, igfsName=igfs, logDir=null]] 01-14-2016 17:00:23.626 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.651 INFO ERP.myuatmrigniteprovider - Configuration - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 01-14-2016 17:00:23.657 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:splunk@IGI.IG.LOCAL (auth:KERBEROS) from:com.splunk.mr.SplunkMR$SearchHandler.executeMapReduce(SplunkMR.java:1116) 01-14-2016 17:00:23.658 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:00:23.659 INFO ERP.myuatmrigniteprovider - DispatchReaper - Starting. Settings: hdfs.path=/user/splunk/dispatch, local.path=/opt/hunk/var/run/splunk/dispatch 01-14-2016 17:00:23.663 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=2, msg=IgfsPathControlRequest [path=/user/splunk/dispatch, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=INFO]] 01-14-2016 17:00:23.685 DEBUG ERP.myuatmrigniteprovider - Cluster - Trying ClientProtocolProvider : org.apache.hadoop.mapred.YarnClientProtocolProvider 01-14-2016 17:00:23.685 DEBUG ERP.myuatmrigniteprovider - Cluster - Cannot pick org.apache.hadoop.mapred.YarnClientProtocolProvider as the ClientProtocolProvider - returned null protocol 01-14-2016 17:00:23.687 DEBUG ERP.myuatmrigniteprovider - Cluster - Trying ClientProtocolProvider : org.apache.hadoop.mapred.LocalClientProtocolProvider 01-14-2016 17:00:23.687 DEBUG ERP.myuatmrigniteprovider - Cluster - Cannot pick org.apache.hadoop.mapred.LocalClientProtocolProvider as the ClientProtocolProvider - returned null protocol 01-14-2016 17:00:23.690 DEBUG ERP.myuatmrigniteprovider - Cluster - Trying ClientProtocolProvider : org.apache.ignite.hadoop.mapreduce.IgniteHadoopClientProtocolProvider 01-14-2016 17:00:23.697 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=2, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.705 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=3, msg=IgfsPathControlRequest [path=/user/splunk/dispatch, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=LIST_FILES]] 01-14-2016 17:00:23.729 DEBUG ERP.myuatmrigniteprovider - VixSplitGenerator - Generating splits for index=miker 01-14-2016 17:00:23.739 INFO ERP.myuatmrigniteprovider - VirtualIndex$Splitter - generateSplits started, vix.name=miker ... 01-14-2016 17:00:23.739 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$Splitter - using SplitGenerator class=com.splunk.mr.input.FileSplitGenerator, to split files in index=miker inputId=1 01-14-2016 17:00:23.739 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=4, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:23.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=3, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.752 INFO ERP.myuatmrigniteprovider - DispatchReaper - Finished, scanned=45, deleted=0, errors=0 01-14-2016 17:00:23.766 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=4, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.775 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=5, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:23.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=5, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.805 INFO ERP.myuatmrigniteprovider - Configuration - fs.default.name is deprecated. Instead, use fs.defaultFS 01-14-2016 17:00:23.805 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/ 01-14-2016 17:00:23.806 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL 01-14-2016 17:00:23.806 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790823 01-14-2016 17:00:23.807 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=6, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:23.830 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=6, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.831 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/ 01-14-2016 17:00:23.831 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily 01-14-2016 17:00:23.832 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790823 01-14-2016 17:00:23.832 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=7, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:23.854 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=7, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.856 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013/ 01-14-2016 17:00:23.856 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013 01-14-2016 17:00:23.856 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790823 01-14-2016 17:00:23.857 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=8, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:23.879 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=8, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.880 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013/03/ 01-14-2016 17:00:23.880 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013/03 01-14-2016 17:00:23.881 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013/03, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790823 01-14-2016 17:00:23.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=9, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013/03, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:23.881 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:00:23 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection 01-14-2016 17:00:23.881 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection established: localhost/127.0.0.1:11211 01-14-2016 17:00:23.903 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=9, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.904 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013/03/28/ 01-14-2016 17:00:23.904 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013/03/28 01-14-2016 17:00:23.905 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013/03/28, search.et=1452787200, search.lt=1452790820, file.et=1364428800, file.lt=1364515200, file.mtime=1452790823 01-14-2016 17:00:23.905 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2013/03/28, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:23.905 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/ 01-14-2016 17:00:23.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016 01-14-2016 17:00:23.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790823 01-14-2016 17:00:23.906 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=10, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:23.928 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:00:23 PM org.apache.ignite.internal.client.impl.GridClientImpl 01-14-2016 17:00:23.928 DEBUG ERP.myuatmrigniteprovider - INFO: Client started [id=66e7adde-a9ef-43e0-92ff-4df8de19b958, protocol=TCP] 01-14-2016 17:00:23.929 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=10, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.929 DEBUG ERP.myuatmrigniteprovider - Cluster - Picked org.apache.ignite.hadoop.mapreduce.IgniteHadoopClientProtocolProvider as the ClientProtocolProvider 01-14-2016 17:00:23.930 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/ 01-14-2016 17:00:23.930 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01 01-14-2016 17:00:23.930 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:794) 01-14-2016 17:00:23.930 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790823 01-14-2016 17:00:23.931 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=11, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:23.933 INFO ERP.myuatmrigniteprovider - ClusterInfoLogger - Hadoop cluster spec: provider=myuatmrigniteprovider, tasktrackers=0, map_inuse=0, map_slots=1000, reduce_inuse=0, reduce_slots=1000 01-14-2016 17:00:23.954 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=11, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:23.957 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/ 01-14-2016 17:00:23.957 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14 01-14-2016 17:00:23.958 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790823 01-14-2016 17:00:23.958 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=12, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:24.020 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=12, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.059 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.060 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.060 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy 01-14-2016 17:00:24.060 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.075 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=13, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2728, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.363 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=13, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.366 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy, fetchTime=292, locations=[BlockLocation [offset=0, length=2728, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.368 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy:0+2728 01-14-2016 17:00:24.371 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.371 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.372 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy 01-14-2016 17:00:24.372 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.373 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=14, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3108, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.384 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy:0+2728 01-14-2016 17:00:24.388 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:24.394 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=15, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:24.407 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=15, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.419 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:24.421 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=1] 01-14-2016 17:00:24.422 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2728]] 01-14-2016 17:00:24.427 INFO ERP.myuatmrigniteprovider - CodecPool - Got brand-new decompressor [.snappy] 01-14-2016 17:00:24.433 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy:0+2728 01-14-2016 17:00:24.433 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy:0+2728 01-14-2016 17:00:24.436 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=16, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:24.439 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=14, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.439 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy, fetchTime=65, locations=[BlockLocation [offset=0, length=3108, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.439 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy:0+3108 01-14-2016 17:00:24.439 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.439 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.439 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy 01-14-2016 17:00:24.439 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.439 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=17, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2873, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.439 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=16, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.447 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=18, msg=IgfsStreamControlRequest [streamId=1, pos=0, len=2728, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:24.477 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=17, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.477 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy, fetchTime=39, locations=[BlockLocation [offset=0, length=2873, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.478 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy:0+2873 01-14-2016 17:00:24.478 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.478 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.479 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy 01-14-2016 17:00:24.479 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=19, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2252, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.515 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=19, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.515 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy, fetchTime=36, locations=[BlockLocation [offset=0, length=2252, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.516 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy:0+2252 01-14-2016 17:00:24.516 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.516 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.517 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy 01-14-2016 17:00:24.517 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.518 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=20, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2999, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.554 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=18, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.574 INFO SearchOperator:stdin - Initializing from configuration 01-14-2016 17:00:24.575 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2728] 01-14-2016 17:00:24.575 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=21, msg=IgfsStreamControlRequest [streamId=1, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:24.575 INFO LineBreakingProcessor - Initializing 01-14-2016 17:00:24.575 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=20, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.577 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy, fetchTime=58, locations=[BlockLocation [offset=0, length=2999, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.577 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy:0+2999 01-14-2016 17:00:24.577 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.577 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.577 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy 01-14-2016 17:00:24.577 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.577 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=22, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2437, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.579 INFO regexExtractionProcessor - Initializing 01-14-2016 17:00:24.581 INFO PipelineComponent - Launching the pipelines. 01-14-2016 17:00:24.581 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:24.582 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy = 01-14-2016 17:00:24.583 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:24.585 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=21, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.585 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=1] 01-14-2016 17:00:24.585 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2728], readTime=114645107, userTime=42335361] 01-14-2016 17:00:24.585 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy:0+3108 01-14-2016 17:00:24.585 INFO pipeline - Registering metrics callback for: Pipeline:vix 01-14-2016 17:00:24.591 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:24.593 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=23, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:24.599 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=23, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.600 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:24.600 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=2] 01-14-2016 17:00:24.600 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3108]] 01-14-2016 17:00:24.600 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:24.601 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy:0+3108 01-14-2016 17:00:24.601 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy:0+3108 01-14-2016 17:00:24.604 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=24, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:24.606 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:24.607 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:24.607 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=24, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.608 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=25, msg=IgfsStreamControlRequest [streamId=2, pos=0, len=3108, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:24.612 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:24.612 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:24.612 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:24.612 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:24.612 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:24.612 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:24.612 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:24.612 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:24.612 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:24.617 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:24.617 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:24.617 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.617 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.617 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=22, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.618 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=2437, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.618 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy:0+2437 01-14-2016 17:00:24.618 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.618 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:24.618 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.618 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.618 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.619 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.619 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.619 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:24.619 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|1" 01-14-2016 17:00:24.619 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|1" 01-14-2016 17:00:24.619 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|1" 01-14-2016 17:00:24.619 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy 01-14-2016 17:00:24.619 INFO DateParserVerbose - Setting maxDaysAgo=1825 and maxDaysHence=7 01-14-2016 17:00:24.619 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|1 01-14-2016 17:00:24.619 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.620 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=26, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3658, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.621 INFO DateParserVerbose - Setting maxDaysAgo=2000 and maxDaysHence=2 01-14-2016 17:00:24.621 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:24.654 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=25, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.655 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:24.655 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914056.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|1 01-14-2016 17:00:24.655 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3108] 01-14-2016 17:00:24.655 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=27, msg=IgfsStreamControlRequest [streamId=2, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:24.656 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.656 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.656 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.656 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.656 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:24.656 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:24.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=26, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.656 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy, fetchTime=37, locations=[BlockLocation [offset=0, length=3658, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.656 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy:0+3658 01-14-2016 17:00:24.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.657 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy = 01-14-2016 17:00:24.657 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:24.658 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:24.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy 01-14-2016 17:00:24.658 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.658 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=28, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2866, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=27, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=2] 01-14-2016 17:00:24.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3108], readTime=50507408, userTime=8733850] 01-14-2016 17:00:24.664 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy:0+2873 01-14-2016 17:00:24.666 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:24.671 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=29, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:24.679 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=29, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.679 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:24.679 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=3] 01-14-2016 17:00:24.679 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2873]] 01-14-2016 17:00:24.680 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:24.680 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy:0+2873 01-14-2016 17:00:24.681 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy:0+2873 01-14-2016 17:00:24.682 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:24.684 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:24.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=30, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:24.688 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=30, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=31, msg=IgfsStreamControlRequest [streamId=3, pos=0, len=2873, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:24.690 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:24.690 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:24.690 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:24.690 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:24.690 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:24.690 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:24.690 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:24.690 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:24.690 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:24.697 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:24.697 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:24.697 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.697 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.698 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=28, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.698 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.698 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:24.698 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.698 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.698 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=2866, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.698 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy:0+2866 01-14-2016 17:00:24.698 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.699 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.699 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:24.699 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|2" 01-14-2016 17:00:24.699 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|2" 01-14-2016 17:00:24.699 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|2" 01-14-2016 17:00:24.699 INFO DateParserVerbose - Setting maxDaysAgo=1825 and maxDaysHence=7 01-14-2016 17:00:24.699 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|2 01-14-2016 17:00:24.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.699 INFO DateParserVerbose - Setting maxDaysAgo=2000 and maxDaysHence=2 01-14-2016 17:00:24.699 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:24.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy 01-14-2016 17:00:24.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.700 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=32, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2328, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.715 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=31, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.716 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:24.717 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913950.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|2 01-14-2016 17:00:24.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2873] 01-14-2016 17:00:24.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=33, msg=IgfsStreamControlRequest [streamId=3, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:24.718 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.718 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.718 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.718 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.718 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:24.718 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:24.718 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=33, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=3] 01-14-2016 17:00:24.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2873], readTime=28841203, userTime=10582994] 01-14-2016 17:00:24.719 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy = 01-14-2016 17:00:24.720 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:24.720 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy:0+2252 01-14-2016 17:00:24.724 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:24.729 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=34, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:24.736 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=34, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.736 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:24.736 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=4] 01-14-2016 17:00:24.736 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2252]] 01-14-2016 17:00:24.736 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:24.737 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy:0+2252 01-14-2016 17:00:24.737 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy:0+2252 01-14-2016 17:00:24.740 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=35, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:24.747 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=32, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.748 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy, fetchTime=47, locations=[BlockLocation [offset=0, length=2328, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.748 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy:0+2328 01-14-2016 17:00:24.748 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.748 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.749 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy 01-14-2016 17:00:24.749 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.750 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=36, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2896, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.751 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=35, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.751 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=37, msg=IgfsStreamControlRequest [streamId=4, pos=0, len=2252, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:24.752 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:24.753 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:24.760 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:24.760 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:24.760 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:24.760 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:24.760 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:24.760 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:24.760 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:24.760 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:24.760 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:24.767 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:24.767 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:24.768 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.768 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.768 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.768 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:24.768 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.768 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.769 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.769 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:24.769 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|3" 01-14-2016 17:00:24.769 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|3" 01-14-2016 17:00:24.769 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|3" 01-14-2016 17:00:24.769 INFO DateParserVerbose - Setting maxDaysAgo=1825 and maxDaysHence=7 01-14-2016 17:00:24.769 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|3 01-14-2016 17:00:24.769 INFO DateParserVerbose - Setting maxDaysAgo=2000 and maxDaysHence=2 01-14-2016 17:00:24.769 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:24.776 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=37, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.777 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:24.777 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914178.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|3 01-14-2016 17:00:24.778 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2252] 01-14-2016 17:00:24.778 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.778 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=38, msg=IgfsStreamControlRequest [streamId=4, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:24.778 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.778 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.778 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.778 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:24.778 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:24.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=38, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=4] 01-14-2016 17:00:24.779 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy = 01-14-2016 17:00:24.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2252], readTime=27695919, userTime=15643951] 01-14-2016 17:00:24.780 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:24.781 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy:0+2999 01-14-2016 17:00:24.785 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:24.789 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=39, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:24.789 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=36, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.790 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy, fetchTime=41, locations=[BlockLocation [offset=0, length=2896, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.790 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy:0+2896 01-14-2016 17:00:24.790 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.791 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.791 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy 01-14-2016 17:00:24.792 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.792 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=40, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2433, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=39, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.798 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:24.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=5] 01-14-2016 17:00:24.798 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2999]] 01-14-2016 17:00:24.799 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:24.799 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy:0+2999 01-14-2016 17:00:24.799 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy:0+2999 01-14-2016 17:00:24.802 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=41, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:24.804 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:24.804 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:24.805 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=41, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.806 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=42, msg=IgfsStreamControlRequest [streamId=5, pos=0, len=2999, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:24.809 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:24.809 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:24.810 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:24.810 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:24.810 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:24.810 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:24.810 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:24.810 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:24.810 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:24.814 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:24.814 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:24.814 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.814 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.815 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.815 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:24.815 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.815 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.816 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.816 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:24.816 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|4" 01-14-2016 17:00:24.816 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|4" 01-14-2016 17:00:24.816 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|4" 01-14-2016 17:00:24.816 INFO DateParserVerbose - Setting maxDaysAgo=1825 and maxDaysHence=7 01-14-2016 17:00:24.816 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|4 01-14-2016 17:00:24.816 INFO DateParserVerbose - Setting maxDaysAgo=2000 and maxDaysHence=2 01-14-2016 17:00:24.816 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:24.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=40, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.833 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy, fetchTime=41, locations=[BlockLocation [offset=0, length=2433, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.834 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy:0+2433 01-14-2016 17:00:24.834 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.834 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.835 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy 01-14-2016 17:00:24.835 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.835 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=43, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2897, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=42, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2999] 01-14-2016 17:00:24.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=44, msg=IgfsStreamControlRequest [streamId=5, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:24.843 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:24.843 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914062.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|4 01-14-2016 17:00:24.844 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.844 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.844 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.844 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.844 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:24.844 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:24.845 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=44, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.845 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=5] 01-14-2016 17:00:24.845 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2999], readTime=38195660, userTime=8513667] 01-14-2016 17:00:24.845 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy = 01-14-2016 17:00:24.846 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:24.846 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy:0+2437 01-14-2016 17:00:24.850 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:24.855 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=45, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:24.860 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=45, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.860 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:24.860 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=6] 01-14-2016 17:00:24.860 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2437]] 01-14-2016 17:00:24.861 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:24.861 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy:0+2437 01-14-2016 17:00:24.861 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy:0+2437 01-14-2016 17:00:24.863 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=46, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:24.868 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=46, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.869 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=47, msg=IgfsStreamControlRequest [streamId=6, pos=0, len=2437, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:24.869 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:24.870 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:24.876 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:24.876 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:24.876 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:24.876 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:24.876 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:24.876 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:24.876 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:24.876 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:24.876 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:24.877 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=43, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.877 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=2897, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.877 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy:0+2897 01-14-2016 17:00:24.877 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.877 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.877 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy 01-14-2016 17:00:24.877 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.878 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=48, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2847, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.882 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:24.882 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:24.882 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.882 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.883 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.883 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:24.883 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.883 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.883 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.883 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:24.883 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|5" 01-14-2016 17:00:24.883 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|5" 01-14-2016 17:00:24.883 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|5" 01-14-2016 17:00:24.884 INFO DateParserVerbose - Setting maxDaysAgo=1825 and maxDaysHence=7 01-14-2016 17:00:24.884 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|5 01-14-2016 17:00:24.884 INFO DateParserVerbose - Setting maxDaysAgo=2000 and maxDaysHence=2 01-14-2016 17:00:24.884 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:24.913 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=47, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.914 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:24.914 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914582.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|5 01-14-2016 17:00:24.914 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2437] 01-14-2016 17:00:24.914 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=49, msg=IgfsStreamControlRequest [streamId=6, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:24.915 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.915 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.915 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.915 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=48, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.915 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.915 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:24.915 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:24.915 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy, fetchTime=37, locations=[BlockLocation [offset=0, length=2847, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.915 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy:0+2847 01-14-2016 17:00:24.916 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.916 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.916 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy = 01-14-2016 17:00:24.916 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy 01-14-2016 17:00:24.916 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:24.916 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.917 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=50, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2940, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.917 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=49, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.918 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=6] 01-14-2016 17:00:24.918 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2437], readTime=47528433, userTime=9807547] 01-14-2016 17:00:24.920 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy:0+3658 01-14-2016 17:00:24.923 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:24.928 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=51, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:24.933 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=51, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.934 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:24.934 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=7] 01-14-2016 17:00:24.934 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3658]] 01-14-2016 17:00:24.935 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:24.935 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy:0+3658 01-14-2016 17:00:24.935 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy:0+3658 01-14-2016 17:00:24.937 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:24.938 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=52, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:24.938 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:24.941 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=52, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=53, msg=IgfsStreamControlRequest [streamId=7, pos=0, len=3658, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:24.943 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:24.943 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:24.943 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:24.943 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:24.943 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:24.943 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:24.943 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:24.943 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:24.943 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:24.949 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:24.949 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:24.949 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.949 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.949 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.949 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:24.950 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:24.950 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:24.950 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:24.950 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:24.950 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|6" 01-14-2016 17:00:24.950 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|6" 01-14-2016 17:00:24.950 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|6" 01-14-2016 17:00:24.950 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|6 01-14-2016 17:00:24.950 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:24.952 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=50, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.953 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy, fetchTime=35, locations=[BlockLocation [offset=0, length=2940, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:24.953 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy:0+2940 01-14-2016 17:00:24.953 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.954 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:24.954 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy 01-14-2016 17:00:24.954 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:24.955 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=54, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2743, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:24.971 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=53, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.972 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:24.972 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3658] 01-14-2016 17:00:24.972 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=55, msg=IgfsStreamControlRequest [streamId=7, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:24.973 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913996.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|6 01-14-2016 17:00:24.973 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.973 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.973 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.974 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:24.974 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:24.974 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:24.975 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=55, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.975 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy = 01-14-2016 17:00:24.975 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:24.980 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=7] 01-14-2016 17:00:24.980 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3658], readTime=32397845, userTime=8541293] 01-14-2016 17:00:24.980 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy:0+2866 01-14-2016 17:00:24.980 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:24.980 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=56, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:24.987 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=56, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.987 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:24.987 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=8] 01-14-2016 17:00:24.989 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2866]] 01-14-2016 17:00:24.989 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:24.989 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy:0+2866 01-14-2016 17:00:24.989 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy:0+2866 01-14-2016 17:00:24.991 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=57, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:24.995 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=57, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:24.995 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=58, msg=IgfsStreamControlRequest [streamId=8, pos=0, len=2866, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.000 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.001 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.004 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=54, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.005 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy, fetchTime=49, locations=[BlockLocation [offset=0, length=2743, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.005 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy:0+2743 01-14-2016 17:00:25.007 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.007 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.007 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy 01-14-2016 17:00:25.007 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.007 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=59, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2932, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.009 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.009 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.009 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.009 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.009 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.009 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.009 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.009 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.009 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.014 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.015 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.015 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.015 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.015 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.015 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.015 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.015 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.016 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.016 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.016 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|7" 01-14-2016 17:00:25.016 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|7" 01-14-2016 17:00:25.016 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|7" 01-14-2016 17:00:25.016 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|7 01-14-2016 17:00:25.016 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.046 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=59, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.046 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy, fetchTime=39, locations=[BlockLocation [offset=0, length=2932, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.047 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy:0+2932 01-14-2016 17:00:25.047 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.047 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.047 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy 01-14-2016 17:00:25.048 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.048 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=60, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3317, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.050 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=58, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.051 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.051 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.7.914875.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|7 01-14-2016 17:00:25.051 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2866] 01-14-2016 17:00:25.051 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=61, msg=IgfsStreamControlRequest [streamId=8, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.052 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.052 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.052 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.052 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.052 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.052 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.052 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=61, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.053 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=8] 01-14-2016 17:00:25.053 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2866], readTime=56488360, userTime=8925704] 01-14-2016 17:00:25.053 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy = 01-14-2016 17:00:25.053 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy:0+2328 01-14-2016 17:00:25.054 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.054 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=62, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.061 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=62, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.061 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.061 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=9] 01-14-2016 17:00:25.061 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2328]] 01-14-2016 17:00:25.062 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.062 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy:0+2328 01-14-2016 17:00:25.062 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy:0+2328 01-14-2016 17:00:25.064 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=63, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.067 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=63, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.068 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=64, msg=IgfsStreamControlRequest [streamId=9, pos=0, len=2328, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.075 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.076 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.080 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.080 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.080 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.080 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.080 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.080 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.080 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.080 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.080 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.082 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=60, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.082 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=3317, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.082 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy:0+3317 01-14-2016 17:00:25.083 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.083 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.083 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy 01-14-2016 17:00:25.084 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=65, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2317, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.085 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.085 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.085 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.085 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.085 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.085 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.086 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.086 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.086 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.086 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.086 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|8" 01-14-2016 17:00:25.086 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|8" 01-14-2016 17:00:25.086 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|8" 01-14-2016 17:00:25.086 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|8 01-14-2016 17:00:25.086 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.091 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=64, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.092 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.092 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913990.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|8 01-14-2016 17:00:25.092 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2328] 01-14-2016 17:00:25.092 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=66, msg=IgfsStreamControlRequest [streamId=9, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.092 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.092 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.092 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.092 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.093 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.093 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.093 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=66, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.093 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=9] 01-14-2016 17:00:25.093 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2328], readTime=24500145, userTime=7517349] 01-14-2016 17:00:25.094 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy = 01-14-2016 17:00:25.094 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy:0+2896 01-14-2016 17:00:25.094 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.095 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.096 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=67, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.101 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=67, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.102 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.102 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=10] 01-14-2016 17:00:25.102 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2896]] 01-14-2016 17:00:25.103 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.103 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy:0+2896 01-14-2016 17:00:25.103 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy:0+2896 01-14-2016 17:00:25.105 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=68, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.109 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=68, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.109 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=69, msg=IgfsStreamControlRequest [streamId=10, pos=0, len=2896, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.114 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.115 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.120 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.120 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.120 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.120 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.120 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.120 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.120 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.120 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.120 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.121 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=65, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.122 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy, fetchTime=37, locations=[BlockLocation [offset=0, length=2317, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.122 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy:0+2317 01-14-2016 17:00:25.122 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.123 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.123 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy 01-14-2016 17:00:25.123 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.124 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=70, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2885, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.124 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.124 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.125 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.125 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.125 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.125 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.125 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.126 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.126 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.126 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.126 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|9" 01-14-2016 17:00:25.126 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|9" 01-14-2016 17:00:25.126 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|9" 01-14-2016 17:00:25.126 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|9 01-14-2016 17:00:25.126 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.133 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=69, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.133 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.133 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913878.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|9 01-14-2016 17:00:25.134 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2896] 01-14-2016 17:00:25.134 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=71, msg=IgfsStreamControlRequest [streamId=10, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.134 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.134 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.134 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.134 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.135 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.135 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.135 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=71, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.136 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy = 01-14-2016 17:00:25.136 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=10] 01-14-2016 17:00:25.136 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2896], readTime=25432857, userTime=8199207] 01-14-2016 17:00:25.136 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.136 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy:0+2433 01-14-2016 17:00:25.138 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.140 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=72, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.144 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=72, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.144 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.144 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=11] 01-14-2016 17:00:25.144 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2433]] 01-14-2016 17:00:25.145 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.145 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy:0+2433 01-14-2016 17:00:25.146 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy:0+2433 01-14-2016 17:00:25.148 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=73, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.151 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=73, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.152 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=74, msg=IgfsStreamControlRequest [streamId=11, pos=0, len=2433, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.158 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.158 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=70, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.158 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=2885, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.159 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.159 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy:0+2885 01-14-2016 17:00:25.159 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.159 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.160 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy 01-14-2016 17:00:25.160 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.161 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=75, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1803, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.164 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.164 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.164 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.164 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.164 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.164 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.164 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.164 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.164 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.169 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.169 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.170 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.170 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.170 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.170 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.170 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.170 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.171 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.171 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.171 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|10" 01-14-2016 17:00:25.171 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|10" 01-14-2016 17:00:25.171 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|10" 01-14-2016 17:00:25.171 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|10 01-14-2016 17:00:25.171 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.177 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=74, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.178 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.178 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914022.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|10 01-14-2016 17:00:25.179 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.179 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.179 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.179 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.179 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.179 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.179 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2433] 01-14-2016 17:00:25.179 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=76, msg=IgfsStreamControlRequest [streamId=11, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.180 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=76, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.180 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=11] 01-14-2016 17:00:25.180 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2433], readTime=27109021, userTime=8464345] 01-14-2016 17:00:25.180 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy = 01-14-2016 17:00:25.180 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.181 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy:0+2897 01-14-2016 17:00:25.182 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.184 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=77, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.189 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=77, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.190 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.190 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=12] 01-14-2016 17:00:25.190 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2897]] 01-14-2016 17:00:25.190 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.191 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy:0+2897 01-14-2016 17:00:25.191 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy:0+2897 01-14-2016 17:00:25.193 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=78, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.194 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=75, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.195 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=1803, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.195 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy:0+1803 01-14-2016 17:00:25.195 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.196 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.196 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy 01-14-2016 17:00:25.196 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.197 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=79, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2717, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.197 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=78, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.198 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=80, msg=IgfsStreamControlRequest [streamId=12, pos=0, len=2897, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.204 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.205 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.210 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.210 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.210 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.210 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.210 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.210 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.210 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.210 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.210 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.215 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.215 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.215 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.215 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.216 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.216 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.216 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.216 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.217 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.217 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.217 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|11" 01-14-2016 17:00:25.217 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|11" 01-14-2016 17:00:25.217 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|11" 01-14-2016 17:00:25.217 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|11 01-14-2016 17:00:25.217 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=80, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.221 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.221 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913924.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|11 01-14-2016 17:00:25.222 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2897] 01-14-2016 17:00:25.222 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.222 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.222 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.222 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=81, msg=IgfsStreamControlRequest [streamId=12, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.222 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.222 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.222 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.223 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=81, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.223 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy = 01-14-2016 17:00:25.224 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=12] 01-14-2016 17:00:25.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2897], readTime=25722831, userTime=9469211] 01-14-2016 17:00:25.226 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy:0+2847 01-14-2016 17:00:25.227 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.228 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=82, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.229 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=79, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.229 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy, fetchTime=32, locations=[BlockLocation [offset=0, length=2717, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.229 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy:0+2717 01-14-2016 17:00:25.229 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.230 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.230 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy 01-14-2016 17:00:25.230 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.231 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=83, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2212, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.235 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=82, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.236 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.236 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=13] 01-14-2016 17:00:25.236 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2847]] 01-14-2016 17:00:25.236 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.237 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy:0+2847 01-14-2016 17:00:25.237 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy:0+2847 01-14-2016 17:00:25.238 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=84, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.241 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=84, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.242 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=85, msg=IgfsStreamControlRequest [streamId=13, pos=0, len=2847, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.248 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.249 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.259 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.259 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.259 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.259 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.260 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.260 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.260 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.260 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.260 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.260 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.260 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|12" 01-14-2016 17:00:25.260 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|12" 01-14-2016 17:00:25.260 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|12" 01-14-2016 17:00:25.260 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|12 01-14-2016 17:00:25.261 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.266 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=85, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.267 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.267 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913888.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|12 01-14-2016 17:00:25.268 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.268 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.268 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.268 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.268 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2847] 01-14-2016 17:00:25.268 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=86, msg=IgfsStreamControlRequest [streamId=13, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.268 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=83, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.268 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.268 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.269 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy, fetchTime=37, locations=[BlockLocation [offset=0, length=2212, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.269 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy:0+2212 01-14-2016 17:00:25.269 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.269 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.269 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy = 01-14-2016 17:00:25.269 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy 01-14-2016 17:00:25.270 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.270 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=87, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2757, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=86, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.271 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=13] 01-14-2016 17:00:25.271 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2847], readTime=28381322, userTime=6599266] 01-14-2016 17:00:25.272 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy:0+2940 01-14-2016 17:00:25.273 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.274 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=88, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.282 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=88, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.283 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.283 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=14] 01-14-2016 17:00:25.283 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2940]] 01-14-2016 17:00:25.286 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.286 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy:0+2940 01-14-2016 17:00:25.286 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy:0+2940 01-14-2016 17:00:25.287 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=89, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.290 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=89, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.291 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=90, msg=IgfsStreamControlRequest [streamId=14, pos=0, len=2940, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.296 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.296 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.302 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.302 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.302 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.302 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.302 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.302 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.302 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.302 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.302 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.307 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=87, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.307 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.307 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.307 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.307 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.307 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy, fetchTime=37, locations=[BlockLocation [offset=0, length=2757, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.308 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy:0+2757 01-14-2016 17:00:25.308 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.308 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.308 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.308 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.308 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.308 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.308 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.308 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.309 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|13" 01-14-2016 17:00:25.309 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|13" 01-14-2016 17:00:25.309 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|13" 01-14-2016 17:00:25.309 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|13 01-14-2016 17:00:25.309 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy 01-14-2016 17:00:25.309 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.309 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.310 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=91, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3315, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.326 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=90, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.327 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.328 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913842.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|13 01-14-2016 17:00:25.328 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2940] 01-14-2016 17:00:25.328 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=92, msg=IgfsStreamControlRequest [streamId=14, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.328 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.328 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.328 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.328 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.329 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.329 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.330 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy = 01-14-2016 17:00:25.330 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=92, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.330 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.330 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=14] 01-14-2016 17:00:25.330 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2940], readTime=38658333, userTime=8947162] 01-14-2016 17:00:25.331 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy:0+2743 01-14-2016 17:00:25.332 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.335 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=93, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.340 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=93, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.341 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=15] 01-14-2016 17:00:25.341 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2743]] 01-14-2016 17:00:25.342 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.342 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy:0+2743 01-14-2016 17:00:25.342 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy:0+2743 01-14-2016 17:00:25.343 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=94, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.346 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=94, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.347 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=95, msg=IgfsStreamControlRequest [streamId=15, pos=0, len=2743, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.349 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=91, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.349 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=3315, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.349 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy:0+3315 01-14-2016 17:00:25.350 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.350 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.350 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy 01-14-2016 17:00:25.351 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.351 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=96, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2839, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.357 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.358 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.364 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.364 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.364 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.364 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.364 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.364 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.364 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.364 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.364 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.370 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.370 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.370 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.370 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.371 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.371 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.371 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.371 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.372 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.372 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.372 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|14" 01-14-2016 17:00:25.372 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|14" 01-14-2016 17:00:25.372 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|14" 01-14-2016 17:00:25.372 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|14 01-14-2016 17:00:25.372 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.383 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=96, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.384 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=2839, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.384 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy:0+2839 01-14-2016 17:00:25.384 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.385 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.385 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy 01-14-2016 17:00:25.385 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.386 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=97, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2467, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.386 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=95, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.387 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.387 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914050.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|14 01-14-2016 17:00:25.387 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2743] 01-14-2016 17:00:25.388 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=98, msg=IgfsStreamControlRequest [streamId=15, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.388 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.388 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.388 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.388 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.389 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.389 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.389 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=98, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.389 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=15] 01-14-2016 17:00:25.389 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2743], readTime=41560906, userTime=6669603] 01-14-2016 17:00:25.390 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy = 01-14-2016 17:00:25.390 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy:0+2932 01-14-2016 17:00:25.390 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.392 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.393 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=99, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.400 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=99, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.401 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.401 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=16] 01-14-2016 17:00:25.401 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2932]] 01-14-2016 17:00:25.401 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.402 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy:0+2932 01-14-2016 17:00:25.402 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy:0+2932 01-14-2016 17:00:25.403 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=100, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.405 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=100, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.406 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=101, msg=IgfsStreamControlRequest [streamId=16, pos=0, len=2932, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.416 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.416 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.420 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=97, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.420 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=2467, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.421 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy:0+2467 01-14-2016 17:00:25.421 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.421 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.422 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy 01-14-2016 17:00:25.422 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.423 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=102, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1779, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.426 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.426 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.427 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.427 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.427 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.427 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.427 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.427 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.428 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.428 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.428 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|15" 01-14-2016 17:00:25.428 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|15" 01-14-2016 17:00:25.428 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|15" 01-14-2016 17:00:25.428 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|15 01-14-2016 17:00:25.428 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.428 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=101, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.429 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.429 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914002.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|15 01-14-2016 17:00:25.429 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2932] 01-14-2016 17:00:25.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=103, msg=IgfsStreamControlRequest [streamId=16, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.430 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.430 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.430 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.430 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.430 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.430 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.431 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=103, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.431 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=16] 01-14-2016 17:00:25.431 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2932], readTime=24355537, userTime=5967884] 01-14-2016 17:00:25.432 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy = 01-14-2016 17:00:25.432 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy:0+3317 01-14-2016 17:00:25.432 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.433 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.435 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=104, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.441 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=104, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.441 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.441 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=17] 01-14-2016 17:00:25.441 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3317]] 01-14-2016 17:00:25.442 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.442 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy:0+3317 01-14-2016 17:00:25.442 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy:0+3317 01-14-2016 17:00:25.443 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=105, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.445 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=105, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.446 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=106, msg=IgfsStreamControlRequest [streamId=17, pos=0, len=3317, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.456 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=102, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.457 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy, fetchTime=35, locations=[BlockLocation [offset=0, length=1779, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.457 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy:0+1779 01-14-2016 17:00:25.457 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.458 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.458 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.458 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy 01-14-2016 17:00:25.458 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.458 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.459 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=107, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2659, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.463 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.463 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.463 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.463 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.463 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.463 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.463 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.463 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.463 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.467 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.467 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.468 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.468 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.468 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.468 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.468 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.468 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.469 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.469 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.469 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|16" 01-14-2016 17:00:25.469 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|16" 01-14-2016 17:00:25.469 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|16" 01-14-2016 17:00:25.469 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|16 01-14-2016 17:00:25.469 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.488 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=107, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.489 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy, fetchTime=30, locations=[BlockLocation [offset=0, length=2659, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.489 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy:0+2659 01-14-2016 17:00:25.489 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.489 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.490 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy 01-14-2016 17:00:25.490 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.490 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=108, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1880, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.492 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=106, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.493 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.493 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914030.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|16 01-14-2016 17:00:25.494 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3317] 01-14-2016 17:00:25.494 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=109, msg=IgfsStreamControlRequest [streamId=17, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.494 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.494 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.494 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.494 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.494 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.494 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.495 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=109, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.495 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy = 01-14-2016 17:00:25.495 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=17] 01-14-2016 17:00:25.496 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.496 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3317], readTime=48713313, userTime=5655583] 01-14-2016 17:00:25.496 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy:0+2317 01-14-2016 17:00:25.497 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.499 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=110, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.505 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=110, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.506 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.506 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=18] 01-14-2016 17:00:25.506 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2317]] 01-14-2016 17:00:25.507 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.507 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy:0+2317 01-14-2016 17:00:25.507 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy:0+2317 01-14-2016 17:00:25.509 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=111, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.511 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=111, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.512 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=112, msg=IgfsStreamControlRequest [streamId=18, pos=0, len=2317, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.520 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.521 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.526 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.526 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.526 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.526 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.526 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.526 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.526 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.526 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.526 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.529 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=108, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.530 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=1880, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.530 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy:0+1880 01-14-2016 17:00:25.531 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.531 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.532 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.532 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.532 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy 01-14-2016 17:00:25.532 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.532 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.532 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.532 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.532 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.532 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.532 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.533 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=113, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3285, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.533 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.533 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.533 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|17" 01-14-2016 17:00:25.533 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|17" 01-14-2016 17:00:25.533 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|17" 01-14-2016 17:00:25.533 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|17 01-14-2016 17:00:25.533 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.550 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=112, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.551 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.551 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|17 01-14-2016 17:00:25.551 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2317] 01-14-2016 17:00:25.551 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=114, msg=IgfsStreamControlRequest [streamId=18, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.551 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.552 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.552 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.552 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.552 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.552 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.553 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=114, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.553 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy = 01-14-2016 17:00:25.553 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=18] 01-14-2016 17:00:25.553 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2317], readTime=39862567, userTime=7119308] 01-14-2016 17:00:25.553 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.554 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy:0+2885 01-14-2016 17:00:25.555 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.557 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=115, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.563 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=115, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.563 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.563 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=19] 01-14-2016 17:00:25.563 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2885]] 01-14-2016 17:00:25.564 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.564 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy:0+2885 01-14-2016 17:00:25.564 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy:0+2885 01-14-2016 17:00:25.565 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=116, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.568 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=116, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.569 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=117, msg=IgfsStreamControlRequest [streamId=19, pos=0, len=2885, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=113, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.572 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=3285, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.573 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy:0+3285 01-14-2016 17:00:25.573 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.573 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.574 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy 01-14-2016 17:00:25.574 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.574 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=118, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2846, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.578 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.579 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.590 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.590 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.590 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.590 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.591 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.591 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.591 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.591 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.592 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.592 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.592 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|18" 01-14-2016 17:00:25.592 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|18" 01-14-2016 17:00:25.592 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|18" 01-14-2016 17:00:25.592 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|18 01-14-2016 17:00:25.592 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.593 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=117, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.594 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.594 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.5.914123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|18 01-14-2016 17:00:25.595 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2885] 01-14-2016 17:00:25.595 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.595 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=119, msg=IgfsStreamControlRequest [streamId=19, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.595 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.595 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.595 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.595 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.595 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=119, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.596 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy = 01-14-2016 17:00:25.597 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=19] 01-14-2016 17:00:25.597 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.597 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2885], readTime=27211088, userTime=6308997] 01-14-2016 17:00:25.598 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy:0+1803 01-14-2016 17:00:25.599 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.601 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=120, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.607 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=118, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.608 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=2846, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.608 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy:0+2846 01-14-2016 17:00:25.608 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.609 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.609 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy 01-14-2016 17:00:25.609 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.610 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=121, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2894, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.610 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=120, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.613 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.613 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=20] 01-14-2016 17:00:25.614 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1803]] 01-14-2016 17:00:25.614 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.614 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy:0+1803 01-14-2016 17:00:25.614 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy:0+1803 01-14-2016 17:00:25.615 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=122, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.618 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=122, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.619 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=123, msg=IgfsStreamControlRequest [streamId=20, pos=0, len=1803, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.624 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.625 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.637 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.637 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.638 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.638 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.638 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.638 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.638 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.638 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.639 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.639 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.639 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|19" 01-14-2016 17:00:25.639 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|19" 01-14-2016 17:00:25.639 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|19" 01-14-2016 17:00:25.639 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|19 01-14-2016 17:00:25.639 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=123, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.642 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.643 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914272.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|19 01-14-2016 17:00:25.643 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1803] 01-14-2016 17:00:25.643 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=124, msg=IgfsStreamControlRequest [streamId=20, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.643 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=121, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.644 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.644 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.644 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.644 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.644 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy, fetchTime=35, locations=[BlockLocation [offset=0, length=2894, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.644 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.644 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.644 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy:0+2894 01-14-2016 17:00:25.644 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.645 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.645 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy 01-14-2016 17:00:25.645 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.646 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy = 01-14-2016 17:00:25.646 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.646 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=125, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2243, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.649 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=124, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.649 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=20] 01-14-2016 17:00:25.649 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1803], readTime=27422672, userTime=5771983] 01-14-2016 17:00:25.649 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy:0+2717 01-14-2016 17:00:25.649 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.650 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=126, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=126, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.657 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=21] 01-14-2016 17:00:25.657 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2717]] 01-14-2016 17:00:25.658 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.658 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy:0+2717 01-14-2016 17:00:25.658 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy:0+2717 01-14-2016 17:00:25.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=127, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.661 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=127, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.662 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=128, msg=IgfsStreamControlRequest [streamId=21, pos=0, len=2717, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.672 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.673 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.679 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.679 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.679 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.679 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.679 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.679 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.679 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.679 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.679 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.684 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.684 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.684 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.684 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.685 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.685 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.685 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.685 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.686 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.686 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.686 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|20" 01-14-2016 17:00:25.686 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|20" 01-14-2016 17:00:25.686 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|20" 01-14-2016 17:00:25.686 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|20 01-14-2016 17:00:25.686 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=125, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.687 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy, fetchTime=41, locations=[BlockLocation [offset=0, length=2243, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.688 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy:0+2243 01-14-2016 17:00:25.688 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.688 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.688 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy 01-14-2016 17:00:25.689 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=129, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3794, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.703 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=128, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.703 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.704 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914276.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|20 01-14-2016 17:00:25.704 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2717] 01-14-2016 17:00:25.704 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=130, msg=IgfsStreamControlRequest [streamId=21, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.704 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.705 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.705 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.705 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.705 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.705 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.705 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=130, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.706 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=21] 01-14-2016 17:00:25.706 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2717], readTime=43257065, userTime=5306976] 01-14-2016 17:00:25.706 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy = 01-14-2016 17:00:25.706 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:25.706 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.707 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy:0+2212 01-14-2016 17:00:25.708 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.709 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=131, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.714 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=131, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.714 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.715 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=22] 01-14-2016 17:00:25.715 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2212]] 01-14-2016 17:00:25.715 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.716 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy:0+2212 01-14-2016 17:00:25.716 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy:0+2212 01-14-2016 17:00:25.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=132, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=132, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.720 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=133, msg=IgfsStreamControlRequest [streamId=22, pos=0, len=2212, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.726 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=129, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.727 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy, fetchTime=37, locations=[BlockLocation [offset=0, length=3794, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.727 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy:0+3794 01-14-2016 17:00:25.727 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.727 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.728 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy 01-14-2016 17:00:25.728 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.728 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=134, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1738, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.739 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.740 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.741 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=133, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.742 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2212] 01-14-2016 17:00:25.743 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=135, msg=IgfsStreamControlRequest [streamId=22, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.744 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=135, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.744 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=22] 01-14-2016 17:00:25.744 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2212], readTime=22768151, userTime=6438048] 01-14-2016 17:00:25.745 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy:0+2757 01-14-2016 17:00:25.746 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.747 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.747 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.747 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.747 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.747 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.747 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.747 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.747 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.747 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.748 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=136, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.753 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=136, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.753 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.753 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=23] 01-14-2016 17:00:25.753 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2757]] 01-14-2016 17:00:25.754 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.754 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy:0+2757 01-14-2016 17:00:25.754 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy:0+2757 01-14-2016 17:00:25.755 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.755 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.755 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.755 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.755 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=137, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.756 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.756 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.756 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.756 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.756 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.756 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.756 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|21" 01-14-2016 17:00:25.756 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|21" 01-14-2016 17:00:25.756 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|21" 01-14-2016 17:00:25.756 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|21 01-14-2016 17:00:25.757 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.757 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.757 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914264.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|21 01-14-2016 17:00:25.757 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=137, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.758 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=138, msg=IgfsStreamControlRequest [streamId=23, pos=0, len=2757, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.759 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.759 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.759 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.759 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.759 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.759 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.759 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=134, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.760 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy, fetchTime=32, locations=[BlockLocation [offset=0, length=1738, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.760 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy:0+1738 01-14-2016 17:00:25.760 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.760 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy = 01-14-2016 17:00:25.761 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.761 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.761 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy 01-14-2016 17:00:25.761 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.763 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=139, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3328, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.780 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=138, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2757] 01-14-2016 17:00:25.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=140, msg=IgfsStreamControlRequest [streamId=23, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.784 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=140, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.784 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=23] 01-14-2016 17:00:25.784 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2757], readTime=24885163, userTime=5722520] 01-14-2016 17:00:25.785 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy:0+3315 01-14-2016 17:00:25.786 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.787 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=141, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.789 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.790 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.793 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=139, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.794 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=3328, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.794 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy:0+3328 01-14-2016 17:00:25.794 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.795 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.795 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy 01-14-2016 17:00:25.795 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.796 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=142, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3368, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.796 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=141, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.796 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.796 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.796 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.796 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.796 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.796 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.796 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.796 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.796 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.796 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.797 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=24] 01-14-2016 17:00:25.797 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3315]] 01-14-2016 17:00:25.797 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.798 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy:0+3315 01-14-2016 17:00:25.798 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy:0+3315 01-14-2016 17:00:25.799 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=143, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.801 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=143, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.802 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=144, msg=IgfsStreamControlRequest [streamId=24, pos=0, len=3315, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.802 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.802 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.804 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.804 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.804 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.804 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.804 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.804 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.805 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.805 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.805 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|22" 01-14-2016 17:00:25.805 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|22" 01-14-2016 17:00:25.805 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|22" 01-14-2016 17:00:25.805 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.805 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|22 01-14-2016 17:00:25.805 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.806 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914286.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|22 01-14-2016 17:00:25.807 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.807 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.807 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.807 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.807 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.808 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.808 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy = 01-14-2016 17:00:25.809 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.824 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=144, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.825 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3315] 01-14-2016 17:00:25.825 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=145, msg=IgfsStreamControlRequest [streamId=24, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.827 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=145, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.827 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=24] 01-14-2016 17:00:25.827 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3315], readTime=24260048, userTime=6113004] 01-14-2016 17:00:25.828 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy:0+2839 01-14-2016 17:00:25.829 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.830 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=146, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.831 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=142, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.831 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy, fetchTime=36, locations=[BlockLocation [offset=0, length=3368, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.831 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy:0+3368 01-14-2016 17:00:25.832 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.832 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.832 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy 01-14-2016 17:00:25.833 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=147, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=18352, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.834 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.835 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.835 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=146, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.836 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=25] 01-14-2016 17:00:25.836 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2839]] 01-14-2016 17:00:25.836 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.836 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy:0+2839 01-14-2016 17:00:25.837 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy:0+2839 01-14-2016 17:00:25.837 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=148, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.841 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.841 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.841 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.841 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.841 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.841 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.841 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.841 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.841 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=148, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=149, msg=IgfsStreamControlRequest [streamId=25, pos=0, len=2839, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.847 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.847 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.847 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.847 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.848 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.848 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.848 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.848 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.849 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.849 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.849 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|23" 01-14-2016 17:00:25.849 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|23" 01-14-2016 17:00:25.849 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|23" 01-14-2016 17:00:25.849 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|23 01-14-2016 17:00:25.849 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.849 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.850 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914154.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|23 01-14-2016 17:00:25.850 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.850 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.850 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.850 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.851 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.851 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.852 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy = 01-14-2016 17:00:25.852 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.870 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=149, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.871 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2839] 01-14-2016 17:00:25.871 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=150, msg=IgfsStreamControlRequest [streamId=25, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.871 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=147, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.872 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy, fetchTime=38, locations=[BlockLocation [offset=0, length=18352, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.872 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy:0+18352 01-14-2016 17:00:25.872 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.872 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.873 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy 01-14-2016 17:00:25.873 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.873 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=151, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2444, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=150, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=25] 01-14-2016 17:00:25.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2839], readTime=30749685, userTime=7339985] 01-14-2016 17:00:25.875 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy:0+2467 01-14-2016 17:00:25.876 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.878 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=152, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.880 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.881 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.884 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=152, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.884 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.884 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=26] 01-14-2016 17:00:25.884 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2467]] 01-14-2016 17:00:25.885 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.885 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy:0+2467 01-14-2016 17:00:25.885 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy:0+2467 01-14-2016 17:00:25.886 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=153, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.888 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=153, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.888 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.888 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.889 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.889 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.889 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.889 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.889 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.889 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.889 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.889 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=154, msg=IgfsStreamControlRequest [streamId=26, pos=0, len=2467, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.895 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.895 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.895 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.895 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.896 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.896 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.896 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.896 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.897 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.897 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.897 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|24" 01-14-2016 17:00:25.897 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|24" 01-14-2016 17:00:25.897 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|24" 01-14-2016 17:00:25.897 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|24 01-14-2016 17:00:25.897 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.897 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.897 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914342.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|24 01-14-2016 17:00:25.899 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.899 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.899 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.899 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.899 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.899 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.901 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy = 01-14-2016 17:00:25.901 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.906 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=151, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.906 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=2444, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.906 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy:0+2444 01-14-2016 17:00:25.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.907 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.907 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy 01-14-2016 17:00:25.907 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.908 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=155, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=10235, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.912 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=154, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.913 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2467] 01-14-2016 17:00:25.913 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=156, msg=IgfsStreamControlRequest [streamId=26, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:25.914 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=156, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.915 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=26] 01-14-2016 17:00:25.915 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2467], readTime=25169777, userTime=5253340] 01-14-2016 17:00:25.915 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy:0+1779 01-14-2016 17:00:25.917 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:25.918 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=157, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:25.924 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=157, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.924 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:25.924 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=27] 01-14-2016 17:00:25.924 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1779]] 01-14-2016 17:00:25.925 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:25.925 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy:0+1779 01-14-2016 17:00:25.925 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy:0+1779 01-14-2016 17:00:25.926 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.926 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=158, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:25.927 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.932 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=158, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.932 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=159, msg=IgfsStreamControlRequest [streamId=27, pos=0, len=1779, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:25.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.941 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.941 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.941 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.941 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.941 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=155, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:25.942 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.942 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.942 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.942 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy, fetchTime=35, locations=[BlockLocation [offset=0, length=10235, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:25.942 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.942 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy:0+10235 01-14-2016 17:00:25.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.942 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.942 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.942 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|25" 01-14-2016 17:00:25.942 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|25" 01-14-2016 17:00:25.942 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|25" 01-14-2016 17:00:25.942 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:25.942 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|25 01-14-2016 17:00:25.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:25.942 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:25.943 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy 01-14-2016 17:00:25.943 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|25 01-14-2016 17:00:25.943 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:25.944 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=160, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1773, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:25.945 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.945 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.945 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.945 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:25.945 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:25.945 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:25.946 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy = 01-14-2016 17:00:25.946 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:25.973 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:25.974 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:25.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:25.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:25.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:25.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:25.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:25.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:25.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:25.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:25.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:25.986 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:25.986 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:25.986 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.986 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.987 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.987 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:25.987 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:25.987 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:25.987 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:25.987 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:25.987 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|26" 01-14-2016 17:00:25.987 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|26" 01-14-2016 17:00:25.987 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|26" 01-14-2016 17:00:25.987 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|26 01-14-2016 17:00:25.987 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.007 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=159, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.008 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.008 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914162.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|26 01-14-2016 17:00:26.008 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1779] 01-14-2016 17:00:26.009 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=161, msg=IgfsStreamControlRequest [streamId=27, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.009 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.009 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.009 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.009 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.009 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.009 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.010 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=161, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.010 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=27] 01-14-2016 17:00:26.010 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1779], readTime=76867691, userTime=9177914] 01-14-2016 17:00:26.011 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy = 01-14-2016 17:00:26.011 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy:0+2659 01-14-2016 17:00:26.011 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.012 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.014 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=162, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.020 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=162, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.020 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.020 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=28] 01-14-2016 17:00:26.020 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2659]] 01-14-2016 17:00:26.021 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.021 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy:0+2659 01-14-2016 17:00:26.022 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy:0+2659 01-14-2016 17:00:26.023 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=163, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.025 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=163, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=164, msg=IgfsStreamControlRequest [streamId=28, pos=0, len=2659, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.030 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=160, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.030 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy, fetchTime=87, locations=[BlockLocation [offset=0, length=1773, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.030 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy:0+1773 01-14-2016 17:00:26.030 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.031 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.031 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy 01-14-2016 17:00:26.031 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.032 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=165, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=2212, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.036 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.037 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.042 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.042 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.042 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.042 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.042 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.042 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.042 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.042 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.042 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.048 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=164, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.048 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.048 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.049 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.049 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2659] 01-14-2016 17:00:26.049 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.049 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=166, msg=IgfsStreamControlRequest [streamId=28, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.050 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.050 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.050 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.050 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.050 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=166, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.050 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.051 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.051 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=28] 01-14-2016 17:00:26.051 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|27" 01-14-2016 17:00:26.051 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|27" 01-14-2016 17:00:26.051 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|27" 01-14-2016 17:00:26.051 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|27 01-14-2016 17:00:26.051 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.051 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.051 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2659], readTime=23907683, userTime=6557474] 01-14-2016 17:00:26.051 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914290.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|27 01-14-2016 17:00:26.052 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy:0+1880 01-14-2016 17:00:26.053 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.054 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.054 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.054 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.054 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.054 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.054 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.055 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=167, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.055 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy = 01-14-2016 17:00:26.056 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.059 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=167, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.060 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.060 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=29] 01-14-2016 17:00:26.060 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1880]] 01-14-2016 17:00:26.060 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.061 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy:0+1880 01-14-2016 17:00:26.061 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy:0+1880 01-14-2016 17:00:26.062 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=168, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.063 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=165, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.064 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy, fetchTime=31, locations=[BlockLocation [offset=0, length=2212, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.064 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy:0+2212 01-14-2016 17:00:26.064 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.064 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.065 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy 01-14-2016 17:00:26.065 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.065 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=169, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7669, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.066 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=168, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.066 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=170, msg=IgfsStreamControlRequest [streamId=29, pos=0, len=1880, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.087 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=170, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.088 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1880] 01-14-2016 17:00:26.088 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=171, msg=IgfsStreamControlRequest [streamId=29, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.090 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=171, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.090 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=29] 01-14-2016 17:00:26.090 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1880], readTime=22769971, userTime=7269417] 01-14-2016 17:00:26.091 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.091 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy:0+3285 01-14-2016 17:00:26.092 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.092 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.094 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=172, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.099 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=172, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.099 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.099 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=30] 01-14-2016 17:00:26.099 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3285]] 01-14-2016 17:00:26.099 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.099 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.099 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.099 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.099 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.100 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.100 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy:0+3285 01-14-2016 17:00:26.100 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy:0+3285 01-14-2016 17:00:26.101 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=173, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.102 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=169, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.103 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy, fetchTime=38, locations=[BlockLocation [offset=0, length=7669, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.103 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy:0+7669 01-14-2016 17:00:26.103 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.104 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.104 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy 01-14-2016 17:00:26.104 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.107 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.107 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.107 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=174, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6710, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.107 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=173, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.107 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.107 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.108 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=175, msg=IgfsStreamControlRequest [streamId=30, pos=0, len=3285, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.108 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.108 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.108 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.108 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.109 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.109 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.109 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|28" 01-14-2016 17:00:26.109 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|28" 01-14-2016 17:00:26.109 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|28" 01-14-2016 17:00:26.109 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.109 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|28 01-14-2016 17:00:26.109 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.110 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.913918.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|28 01-14-2016 17:00:26.112 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.112 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.112 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.112 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.112 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.112 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.113 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy = 01-14-2016 17:00:26.114 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.138 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=174, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.139 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=6710, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.139 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy:0+6710 01-14-2016 17:00:26.139 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.139 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.140 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy 01-14-2016 17:00:26.140 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.140 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=176, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=10153, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.143 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=175, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.145 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3285] 01-14-2016 17:00:26.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=177, msg=IgfsStreamControlRequest [streamId=30, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.145 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.147 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=177, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.148 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=30] 01-14-2016 17:00:26.148 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3285], readTime=38499159, userTime=9921806] 01-14-2016 17:00:26.149 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy:0+2846 01-14-2016 17:00:26.150 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.152 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.152 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.152 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.152 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.152 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.152 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.152 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.152 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.152 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.152 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=178, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.156 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=178, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.157 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.157 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=31] 01-14-2016 17:00:26.157 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2846]] 01-14-2016 17:00:26.157 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.157 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy:0+2846 01-14-2016 17:00:26.158 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy:0+2846 01-14-2016 17:00:26.158 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.158 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.158 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=179, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.158 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.158 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.159 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.159 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.159 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.159 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.160 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.160 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.160 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|29" 01-14-2016 17:00:26.160 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|29" 01-14-2016 17:00:26.160 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|29" 01-14-2016 17:00:26.160 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|29 01-14-2016 17:00:26.160 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.160 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.160 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=179, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.160 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914280.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|29 01-14-2016 17:00:26.161 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=180, msg=IgfsStreamControlRequest [streamId=31, pos=0, len=2846, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.162 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.162 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.162 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.162 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.162 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.162 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.163 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy = 01-14-2016 17:00:26.164 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.178 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=176, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.178 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy, fetchTime=38, locations=[BlockLocation [offset=0, length=10153, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.179 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy:0+10153 01-14-2016 17:00:26.179 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.179 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.180 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy 01-14-2016 17:00:26.180 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.181 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=181, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=8216, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.183 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=180, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.185 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2846] 01-14-2016 17:00:26.185 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=182, msg=IgfsStreamControlRequest [streamId=31, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.186 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=182, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.186 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=31] 01-14-2016 17:00:26.186 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2846], readTime=24302278, userTime=5207979] 01-14-2016 17:00:26.187 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy:0+2894 01-14-2016 17:00:26.188 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.188 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.189 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.190 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=183, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.195 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.195 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.195 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.195 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.195 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.195 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.195 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.195 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.195 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.195 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=183, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.196 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.196 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=32] 01-14-2016 17:00:26.196 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2894]] 01-14-2016 17:00:26.196 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.197 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy:0+2894 01-14-2016 17:00:26.197 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy:0+2894 01-14-2016 17:00:26.198 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=184, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.200 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=184, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.200 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.200 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.201 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.201 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.201 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=185, msg=IgfsStreamControlRequest [streamId=32, pos=0, len=2894, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.201 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.201 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.201 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.201 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.202 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.202 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.202 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.203 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|30" 01-14-2016 17:00:26.203 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|30" 01-14-2016 17:00:26.203 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|30" 01-14-2016 17:00:26.203 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|30 01-14-2016 17:00:26.203 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.203 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914102.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|30 01-14-2016 17:00:26.205 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.205 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.205 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.205 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.205 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.205 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.206 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy = 01-14-2016 17:00:26.207 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.219 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=181, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.219 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy, fetchTime=39, locations=[BlockLocation [offset=0, length=8216, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.220 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy:0+8216 01-14-2016 17:00:26.220 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.220 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.221 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy 01-14-2016 17:00:26.221 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.222 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=186, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6848, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.229 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=185, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.230 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2894] 01-14-2016 17:00:26.231 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=187, msg=IgfsStreamControlRequest [streamId=32, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.232 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=187, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.232 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.232 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=32] 01-14-2016 17:00:26.232 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2894], readTime=29867205, userTime=6298035] 01-14-2016 17:00:26.233 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.233 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy:0+2243 01-14-2016 17:00:26.234 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.236 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=188, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.238 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.238 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.238 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.238 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.238 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.238 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.238 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.238 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.238 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.241 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=188, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.241 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.241 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=33] 01-14-2016 17:00:26.242 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2243]] 01-14-2016 17:00:26.242 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.243 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy:0+2243 01-14-2016 17:00:26.243 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy:0+2243 01-14-2016 17:00:26.243 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.243 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.244 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.244 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.244 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=189, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.244 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.244 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.244 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.244 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.245 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.245 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.245 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|31" 01-14-2016 17:00:26.245 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|31" 01-14-2016 17:00:26.245 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|31" 01-14-2016 17:00:26.245 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|31 01-14-2016 17:00:26.245 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.245 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.245 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.914114.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|31 01-14-2016 17:00:26.247 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=189, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.247 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.247 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.247 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.247 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.247 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=190, msg=IgfsStreamControlRequest [streamId=33, pos=0, len=2243, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.247 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.247 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.249 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy = 01-14-2016 17:00:26.249 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.262 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=186, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.262 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy, fetchTime=41, locations=[BlockLocation [offset=0, length=6848, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.263 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy:0+6848 01-14-2016 17:00:26.263 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.263 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.264 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy 01-14-2016 17:00:26.264 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.265 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=191, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5986, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.271 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=190, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2243] 01-14-2016 17:00:26.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=192, msg=IgfsStreamControlRequest [streamId=33, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.274 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=192, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.274 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=33] 01-14-2016 17:00:26.274 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2243], readTime=26127850, userTime=6462958] 01-14-2016 17:00:26.275 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy:0+3794 01-14-2016 17:00:26.276 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.278 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=193, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.282 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.282 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=193, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.283 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.283 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=34] 01-14-2016 17:00:26.283 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3794]] 01-14-2016 17:00:26.283 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.283 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.284 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy:0+3794 01-14-2016 17:00:26.284 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy:0+3794 01-14-2016 17:00:26.285 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=194, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.286 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=194, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.287 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=195, msg=IgfsStreamControlRequest [streamId=34, pos=0, len=3794, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.291 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.291 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.291 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.291 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.291 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.291 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.291 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.291 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.291 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.297 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.297 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.297 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.297 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.298 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.298 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.298 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.298 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.299 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.299 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.299 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|32" 01-14-2016 17:00:26.299 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|32" 01-14-2016 17:00:26.299 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|32" 01-14-2016 17:00:26.299 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|32 01-14-2016 17:00:26.299 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.299 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.300 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914318.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|32 01-14-2016 17:00:26.301 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.301 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.301 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.301 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.302 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.302 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.303 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy = 01-14-2016 17:00:26.303 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.306 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=191, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.306 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy, fetchTime=42, locations=[BlockLocation [offset=0, length=5986, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.306 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy:0+5986 01-14-2016 17:00:26.307 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.307 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.308 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy 01-14-2016 17:00:26.308 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.308 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=196, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=8231, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.310 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=195, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.312 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3794] 01-14-2016 17:00:26.312 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=197, msg=IgfsStreamControlRequest [streamId=34, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.313 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=197, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.313 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=34] 01-14-2016 17:00:26.314 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3794], readTime=25501952, userTime=5325582] 01-14-2016 17:00:26.314 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy:0+1738 01-14-2016 17:00:26.315 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.317 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=198, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.321 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=198, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.321 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.321 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=35] 01-14-2016 17:00:26.321 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1738]] 01-14-2016 17:00:26.322 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.322 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy:0+1738 01-14-2016 17:00:26.322 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy:0+1738 01-14-2016 17:00:26.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=199, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=199, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.326 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=200, msg=IgfsStreamControlRequest [streamId=35, pos=0, len=1738, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.328 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.329 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.335 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.335 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.335 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.335 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.335 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.335 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.335 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.335 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.335 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.340 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.340 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.341 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.341 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.341 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.341 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.341 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.342 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.342 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.342 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.342 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|33" 01-14-2016 17:00:26.342 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|33" 01-14-2016 17:00:26.342 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|33" 01-14-2016 17:00:26.342 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|33 01-14-2016 17:00:26.342 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.343 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|33 01-14-2016 17:00:26.342 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.344 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.344 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.344 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.344 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.344 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.344 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.345 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy = 01-14-2016 17:00:26.346 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=196, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.346 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.346 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy, fetchTime=38, locations=[BlockLocation [offset=0, length=8231, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.346 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy:0+8231 01-14-2016 17:00:26.346 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.347 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.347 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy 01-14-2016 17:00:26.347 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.348 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=201, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7327, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.349 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=200, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.350 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1738] 01-14-2016 17:00:26.350 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=202, msg=IgfsStreamControlRequest [streamId=35, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.351 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=202, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.351 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=35] 01-14-2016 17:00:26.352 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1738], readTime=24607028, userTime=5252733] 01-14-2016 17:00:26.352 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy:0+3328 01-14-2016 17:00:26.354 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.355 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=203, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.359 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=203, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.363 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.363 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=36] 01-14-2016 17:00:26.363 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3328]] 01-14-2016 17:00:26.364 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.364 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy:0+3328 01-14-2016 17:00:26.364 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy:0+3328 01-14-2016 17:00:26.365 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=204, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.367 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=204, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.368 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=205, msg=IgfsStreamControlRequest [streamId=36, pos=0, len=3328, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.371 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.372 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.377 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.377 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.377 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.377 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.377 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.377 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.377 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.377 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.377 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.383 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.383 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.383 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.383 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=201, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.384 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.384 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.384 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.384 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.384 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy, fetchTime=36, locations=[BlockLocation [offset=0, length=7327, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.384 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy:0+7327 01-14-2016 17:00:26.384 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.385 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.385 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|34" 01-14-2016 17:00:26.385 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|34" 01-14-2016 17:00:26.385 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.385 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|34" 01-14-2016 17:00:26.385 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|34 01-14-2016 17:00:26.385 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.385 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.385 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.385 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.9.914884.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|34 01-14-2016 17:00:26.386 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy 01-14-2016 17:00:26.386 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.387 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=206, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7794, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.387 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.394 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.394 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.394 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.394 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.394 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.395 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy = 01-14-2016 17:00:26.396 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.390 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=205, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.396 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3328] 01-14-2016 17:00:26.396 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=207, msg=IgfsStreamControlRequest [streamId=36, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.396 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=207, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.396 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=36] 01-14-2016 17:00:26.396 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3328], readTime=24519133, userTime=5886974] 01-14-2016 17:00:26.396 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy:0+3368 01-14-2016 17:00:26.396 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.397 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=208, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.402 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=208, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.402 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.402 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=37] 01-14-2016 17:00:26.402 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3368]] 01-14-2016 17:00:26.402 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.403 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy:0+3368 01-14-2016 17:00:26.403 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy:0+3368 01-14-2016 17:00:26.404 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=209, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.406 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=209, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.406 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=210, msg=IgfsStreamControlRequest [streamId=37, pos=0, len=3368, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.422 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=206, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.422 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy, fetchTime=36, locations=[BlockLocation [offset=0, length=7794, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.422 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy:0+7794 01-14-2016 17:00:26.422 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.423 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.423 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy 01-14-2016 17:00:26.423 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.424 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=211, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1793, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.428 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.429 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.437 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.437 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.437 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.437 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.437 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.437 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.437 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.437 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.437 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.444 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.444 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.444 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.444 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.444 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.445 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.445 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.445 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.445 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.445 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.445 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|35" 01-14-2016 17:00:26.445 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|35" 01-14-2016 17:00:26.445 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|35" 01-14-2016 17:00:26.445 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|35 01-14-2016 17:00:26.445 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.445 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.446 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|35 01-14-2016 17:00:26.446 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=210, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.447 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.447 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.447 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.447 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.448 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.448 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.448 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3368] 01-14-2016 17:00:26.448 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=212, msg=IgfsStreamControlRequest [streamId=37, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.449 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy = 01-14-2016 17:00:26.449 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.450 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=212, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.453 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=37] 01-14-2016 17:00:26.453 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3368], readTime=42742161, userTime=5624157] 01-14-2016 17:00:26.453 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy:0+18352 01-14-2016 17:00:26.453 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.454 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=213, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.454 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=211, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.456 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=1793, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.456 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy:0+1793 01-14-2016 17:00:26.456 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.457 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.457 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy 01-14-2016 17:00:26.457 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.458 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=214, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=8044, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.460 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=213, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.460 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy, bufSize=4096] 01-14-2016 17:00:26.461 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=38] 01-14-2016 17:00:26.461 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=18352]] 01-14-2016 17:00:26.461 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.462 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy:0+18352 01-14-2016 17:00:26.462 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy:0+18352 01-14-2016 17:00:26.463 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=215, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.465 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=215, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.466 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=216, msg=IgfsStreamControlRequest [streamId=38, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.466 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=217, msg=IgfsStreamControlRequest [streamId=38, pos=4096, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.478 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.479 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.486 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.486 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.486 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.486 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.486 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.486 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.486 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.486 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.486 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.486 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=216, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=217, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.488 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=218, msg=IgfsStreamControlRequest [streamId=38, pos=8192, len=10160, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.488 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=218, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.492 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.492 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.492 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.492 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.493 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.493 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.493 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.493 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.493 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.493 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.494 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|36" 01-14-2016 17:00:26.494 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|36" 01-14-2016 17:00:26.494 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|36" 01-14-2016 17:00:26.494 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|36 01-14-2016 17:00:26.494 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.494 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.494 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.914070.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|36 01-14-2016 17:00:26.496 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.496 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.496 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.496 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.496 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.496 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.497 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy = 01-14-2016 17:00:26.498 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.523 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.524 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.528 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=214, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.529 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy, fetchTime=71, locations=[BlockLocation [offset=0, length=8044, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.529 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy:0+8044 01-14-2016 17:00:26.529 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.530 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.535 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.535 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.535 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.535 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.535 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.535 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.536 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.536 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.536 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.536 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.536 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|37" 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy 01-14-2016 17:00:26.536 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|37" 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.536 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|37" 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=18352] 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=219, msg=IgfsStreamControlRequest [streamId=38, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=220, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6434, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=219, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=38] 01-14-2016 17:00:26.536 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|37 01-14-2016 17:00:26.536 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=18352], readTime=64334915, userTime=6494519] 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy:0+2444 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=221, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.536 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.537 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.8.913806.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|37 01-14-2016 17:00:26.539 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.539 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.539 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.539 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.539 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.539 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.541 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy = 01-14-2016 17:00:26.541 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.575 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.576 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.584 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.591 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.591 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.591 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.591 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.592 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.592 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.592 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.592 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.592 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.592 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.592 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy|host::vruatsph001.iggroup.local|kafka_json|38" 01-14-2016 17:00:26.592 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy|host::vruatsph001.iggroup.local|kafka_json|38" 01-14-2016 17:00:26.592 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=220, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.592 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy|host::vruatsph001.iggroup.local|kafka_json|38" 01-14-2016 17:00:26.592 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=6434, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.592 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy:0+6434 01-14-2016 17:00:26.592 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.592 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.592 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy 01-14-2016 17:00:26.592 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy|host::vruatsph001.iggroup.local|kafka_json|38 01-14-2016 17:00:26.592 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.593 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=222, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7196, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.593 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=221, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.593 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.593 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=39] 01-14-2016 17:00:26.593 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.593 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2444]] 01-14-2016 17:00:26.593 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.593 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy:0+2444 01-14-2016 17:00:26.593 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy:0+2444 01-14-2016 17:00:26.593 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=223, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.599 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=222, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.599 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy, fetchTime=32, locations=[BlockLocation [offset=0, length=7196, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.599 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy:0+7196 01-14-2016 17:00:26.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy 01-14-2016 17:00:26.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.601 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=223, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.601 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=224, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7920, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.602 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=225, msg=IgfsStreamControlRequest [streamId=39, pos=0, len=2444, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.630 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=224, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.630 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy, fetchTime=29, locations=[BlockLocation [offset=0, length=7920, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.630 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy:0+7920 01-14-2016 17:00:26.630 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.631 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.631 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy 01-14-2016 17:00:26.631 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.632 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=226, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6649, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=225, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.657 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.657 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/cleaned-1452731449626-r-00000.snappy|host::vruatsph001.iggroup.local|kafka_json|38 01-14-2016 17:00:26.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2444] 01-14-2016 17:00:26.658 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=227, msg=IgfsStreamControlRequest [streamId=39, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.659 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.659 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.659 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.659 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.659 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.659 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.660 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy = 01-14-2016 17:00:26.661 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.688 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.688 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=226, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.688 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy, fetchTime=56, locations=[BlockLocation [offset=0, length=6649, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.689 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy:0+6649 01-14-2016 17:00:26.689 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=227, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.689 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.689 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=39] 01-14-2016 17:00:26.689 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy 01-14-2016 17:00:26.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2444], readTime=87123185, userTime=32737953] 01-14-2016 17:00:26.690 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.690 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy:0+10235 01-14-2016 17:00:26.690 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=228, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6594, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.694 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.694 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=229, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.695 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.695 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.695 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.695 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.695 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.695 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.695 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.695 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.695 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.701 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.701 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.701 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.701 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.702 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.702 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.702 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.702 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.703 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.703 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.703 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|39" 01-14-2016 17:00:26.703 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|39" 01-14-2016 17:00:26.703 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|39" 01-14-2016 17:00:26.703 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|39 01-14-2016 17:00:26.703 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=228, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.720 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy, fetchTime=29, locations=[BlockLocation [offset=0, length=6594, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.720 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy:0+6594 01-14-2016 17:00:26.720 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.720 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.721 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy 01-14-2016 17:00:26.721 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.721 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=230, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6184, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.724 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=229, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.724 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.725 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=40] 01-14-2016 17:00:26.725 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=10235]] 01-14-2016 17:00:26.725 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.725 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy:0+10235 01-14-2016 17:00:26.726 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy:0+10235 01-14-2016 17:00:26.726 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=231, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.753 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=230, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.754 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy, fetchTime=32, locations=[BlockLocation [offset=0, length=6184, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.754 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy:0+6184 01-14-2016 17:00:26.754 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.754 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.754 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=231, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.755 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy 01-14-2016 17:00:26.755 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.755 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=232, msg=IgfsStreamControlRequest [streamId=40, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.755 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=233, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7455, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.757 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=234, msg=IgfsStreamControlRequest [streamId=40, pos=4096, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.774 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=232, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.776 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=234, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.777 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=235, msg=IgfsStreamControlRequest [streamId=40, pos=8192, len=2043, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.777 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=235, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.778 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.778 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.6.915902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|39 01-14-2016 17:00:26.779 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.779 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.779 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.779 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.779 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.779 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.780 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy = 01-14-2016 17:00:26.780 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.781 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:26.781 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=10235] 01-14-2016 17:00:26.781 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=236, msg=IgfsStreamControlRequest [streamId=40, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.781 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=236, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.781 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=40] 01-14-2016 17:00:26.781 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=10235], readTime=23171826, userTime=32020226] 01-14-2016 17:00:26.781 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy:0+1773 01-14-2016 17:00:26.782 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.784 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=237, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.789 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=237, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.789 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.789 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=41] 01-14-2016 17:00:26.790 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1773]] 01-14-2016 17:00:26.790 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.791 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy:0+1773 01-14-2016 17:00:26.791 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy:0+1773 01-14-2016 17:00:26.792 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=238, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.794 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=238, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.795 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=239, msg=IgfsStreamControlRequest [streamId=41, pos=0, len=1773, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.806 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.807 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.818 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.818 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.818 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.819 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.819 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.819 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.819 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.819 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.820 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.820 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.820 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|40" 01-14-2016 17:00:26.820 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|40" 01-14-2016 17:00:26.820 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|40" 01-14-2016 17:00:26.820 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|40 01-14-2016 17:00:26.820 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.822 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=233, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.822 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy, fetchTime=67, locations=[BlockLocation [offset=0, length=7455, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.822 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy:0+7455 01-14-2016 17:00:26.823 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.823 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.823 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy 01-14-2016 17:00:26.823 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.824 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=240, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6972, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.824 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=239, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.825 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.825 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.38.915964.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|40 01-14-2016 17:00:26.825 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1773] 01-14-2016 17:00:26.826 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=241, msg=IgfsStreamControlRequest [streamId=41, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.826 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=241, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.826 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=41] 01-14-2016 17:00:26.827 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.827 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1773], readTime=31077404, userTime=5821427] 01-14-2016 17:00:26.827 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.827 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.827 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.827 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.827 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.827 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy:0+2212 01-14-2016 17:00:26.828 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy = 01-14-2016 17:00:26.828 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.828 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.830 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=242, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.834 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=242, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.835 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.835 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=42] 01-14-2016 17:00:26.835 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2212]] 01-14-2016 17:00:26.835 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.836 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy:0+2212 01-14-2016 17:00:26.836 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy:0+2212 01-14-2016 17:00:26.837 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=243, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.839 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=243, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.840 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=244, msg=IgfsStreamControlRequest [streamId=42, pos=0, len=2212, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.855 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.856 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.861 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=240, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.861 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy, fetchTime=37, locations=[BlockLocation [offset=0, length=6972, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.861 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy:0+6972 01-14-2016 17:00:26.861 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.862 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.862 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy 01-14-2016 17:00:26.863 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.863 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.863 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.863 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.863 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.863 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.863 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.863 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.863 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.863 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.864 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=245, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5653, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.868 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.868 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.869 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.869 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.869 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.869 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.869 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.869 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.870 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.870 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.870 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|41" 01-14-2016 17:00:26.870 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|41" 01-14-2016 17:00:26.870 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|41" 01-14-2016 17:00:26.870 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|41 01-14-2016 17:00:26.870 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.879 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=244, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.879 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.879 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.3.914126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|41 01-14-2016 17:00:26.880 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2212] 01-14-2016 17:00:26.880 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=246, msg=IgfsStreamControlRequest [streamId=42, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.880 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.880 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.880 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.880 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.880 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=246, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.880 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.881 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=42] 01-14-2016 17:00:26.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=2212], readTime=40122065, userTime=5676281] 01-14-2016 17:00:26.881 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy:0+7669 01-14-2016 17:00:26.882 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy = 01-14-2016 17:00:26.882 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.882 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.885 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=247, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.889 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=247, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.889 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.889 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=43] 01-14-2016 17:00:26.889 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7669]] 01-14-2016 17:00:26.890 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.890 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy:0+7669 01-14-2016 17:00:26.890 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy:0+7669 01-14-2016 17:00:26.891 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=248, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.894 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=248, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.895 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=249, msg=IgfsStreamControlRequest [streamId=43, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.895 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=250, msg=IgfsStreamControlRequest [streamId=43, pos=4096, len=3573, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.896 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=245, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.896 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=5653, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.896 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy:0+5653 01-14-2016 17:00:26.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.898 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy 01-14-2016 17:00:26.898 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.899 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=251, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6577, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.911 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.911 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.918 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.918 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.918 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.918 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.918 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.918 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.918 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.918 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.918 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.923 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.923 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.923 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.923 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.924 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.924 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.924 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.924 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.925 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.925 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.925 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|42" 01-14-2016 17:00:26.925 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|42" 01-14-2016 17:00:26.925 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|42" 01-14-2016 17:00:26.925 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|42 01-14-2016 17:00:26.925 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.930 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=249, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.930 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=250, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.931 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.931 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|42 01-14-2016 17:00:26.931 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7669] 01-14-2016 17:00:26.931 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=252, msg=IgfsStreamControlRequest [streamId=43, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.932 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.932 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.932 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=252, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.932 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=43] 01-14-2016 17:00:26.932 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7669], readTime=36808259, userTime=6244869] 01-14-2016 17:00:26.933 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy:0+6710 01-14-2016 17:00:26.932 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.934 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.934 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.934 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.934 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.935 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy = 01-14-2016 17:00:26.936 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.936 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=253, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.941 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=253, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.941 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.941 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=44] 01-14-2016 17:00:26.941 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6710]] 01-14-2016 17:00:26.941 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.942 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy:0+6710 01-14-2016 17:00:26.942 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy:0+6710 01-14-2016 17:00:26.943 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=254, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.944 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=254, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.945 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=255, msg=IgfsStreamControlRequest [streamId=44, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.945 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=256, msg=IgfsStreamControlRequest [streamId=44, pos=4096, len=2614, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.959 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=251, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.959 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy, fetchTime=61, locations=[BlockLocation [offset=0, length=6577, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.960 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy:0+6577 01-14-2016 17:00:26.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy 01-14-2016 17:00:26.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=257, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7900, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:26.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=255, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=256, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.965 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6710] 01-14-2016 17:00:26.966 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=258, msg=IgfsStreamControlRequest [streamId=44, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:26.966 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=258, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.966 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=44] 01-14-2016 17:00:26.967 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6710], readTime=20030645, userTime=5392659] 01-14-2016 17:00:26.967 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy:0+10153 01-14-2016 17:00:26.968 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:26.970 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=259, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:26.970 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:26.971 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:26.975 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=259, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.975 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:26.975 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=45] 01-14-2016 17:00:26.975 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=10153]] 01-14-2016 17:00:26.975 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:26.976 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy:0+10153 01-14-2016 17:00:26.976 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy:0+10153 01-14-2016 17:00:26.977 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=260, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:26.979 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=260, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.980 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=261, msg=IgfsStreamControlRequest [streamId=45, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:26.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:26.980 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=262, msg=IgfsStreamControlRequest [streamId=45, pos=4096, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:26.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:26.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:26.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:26.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:26.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:26.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:26.980 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:26.988 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:26.988 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:26.988 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.988 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.989 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.989 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:26.989 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:26.989 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:26.990 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:26.990 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:26.990 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|43" 01-14-2016 17:00:26.990 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|43" 01-14-2016 17:00:26.990 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|43" 01-14-2016 17:00:26.990 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|43 01-14-2016 17:00:26.990 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:26.990 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:26.991 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915031.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|43 01-14-2016 17:00:26.992 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.992 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.992 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.992 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:26.992 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:26.992 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:26.993 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy = 01-14-2016 17:00:26.994 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:26.994 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=257, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:26.994 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=7900, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:26.995 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy:0+7900 01-14-2016 17:00:26.995 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.995 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:26.996 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy 01-14-2016 17:00:26.996 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:26.997 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=263, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7891, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.001 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=261, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.001 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=262, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.001 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=264, msg=IgfsStreamControlRequest [streamId=45, pos=8192, len=1961, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.001 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=264, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.004 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=10153] 01-14-2016 17:00:27.004 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=265, msg=IgfsStreamControlRequest [streamId=45, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.005 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=265, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.005 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=45] 01-14-2016 17:00:27.005 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=10153], readTime=23315026, userTime=6708580] 01-14-2016 17:00:27.006 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy:0+8216 01-14-2016 17:00:27.007 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.009 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=266, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.016 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=266, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.017 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=46] 01-14-2016 17:00:27.017 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8216]] 01-14-2016 17:00:27.017 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.018 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy:0+8216 01-14-2016 17:00:27.018 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy:0+8216 01-14-2016 17:00:27.019 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=267, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.021 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=267, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.022 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=268, msg=IgfsStreamControlRequest [streamId=46, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.022 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.022 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=269, msg=IgfsStreamControlRequest [streamId=46, pos=4096, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.023 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.033 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=263, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.033 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy, fetchTime=37, locations=[BlockLocation [offset=0, length=7891, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.033 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy:0+7891 01-14-2016 17:00:27.034 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.034 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.034 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy 01-14-2016 17:00:27.034 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.035 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=270, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7954, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.037 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.037 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.037 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.037 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.038 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.038 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.038 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.038 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.039 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.039 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.039 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|44" 01-14-2016 17:00:27.039 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|44" 01-14-2016 17:00:27.039 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|44" 01-14-2016 17:00:27.039 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|44 01-14-2016 17:00:27.039 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.039 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.040 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.914943.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|44 01-14-2016 17:00:27.041 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.041 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.041 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.042 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.042 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.042 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=268, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=269, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=271, msg=IgfsStreamControlRequest [streamId=46, pos=8192, len=24, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=271, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.043 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy = 01-14-2016 17:00:27.043 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.047 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8216] 01-14-2016 17:00:27.047 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=272, msg=IgfsStreamControlRequest [streamId=46, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.047 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=272, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.047 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=46] 01-14-2016 17:00:27.047 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8216], readTime=22020618, userTime=6744121] 01-14-2016 17:00:27.047 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy:0+6848 01-14-2016 17:00:27.070 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.071 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.077 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.077 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.077 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.077 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.077 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.077 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.077 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.077 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.077 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.082 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.082 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.083 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.083 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.083 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.083 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.084 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.084 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.084 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.084 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.084 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|45" 01-14-2016 17:00:27.084 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|45" 01-14-2016 17:00:27.084 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|45" 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.084 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|45 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=273, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=273, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.084 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=47] 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6848]] 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.084 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy:0+6848 01-14-2016 17:00:27.084 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy:0+6848 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=274, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=274, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=275, msg=IgfsStreamControlRequest [streamId=47, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=276, msg=IgfsStreamControlRequest [streamId=47, pos=4096, len=2752, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.084 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=270, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy, fetchTime=36, locations=[BlockLocation [offset=0, length=7954, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy:0+7954 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.084 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=277, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7031, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=275, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=276, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6848] 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=278, msg=IgfsStreamControlRequest [streamId=47, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=278, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=47] 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6848], readTime=19193234, userTime=6435522] 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy:0+5986 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=279, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.085 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.36.915281.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|45 01-14-2016 17:00:27.087 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.087 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.087 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.087 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.087 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.087 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.087 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=279, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.088 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.088 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=48] 01-14-2016 17:00:27.088 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5986]] 01-14-2016 17:00:27.088 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy = 01-14-2016 17:00:27.088 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.088 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy:0+5986 01-14-2016 17:00:27.088 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.089 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy:0+5986 01-14-2016 17:00:27.089 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=280, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.091 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=280, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.092 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=281, msg=IgfsStreamControlRequest [streamId=48, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.092 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=282, msg=IgfsStreamControlRequest [streamId=48, pos=4096, len=1890, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.112 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=277, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.113 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=7031, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.113 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy:0+7031 01-14-2016 17:00:27.113 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.114 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.114 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy 01-14-2016 17:00:27.114 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.114 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=283, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6948, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.116 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.117 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.124 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.124 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.124 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.124 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.124 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.124 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.124 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.124 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.124 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.127 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=281, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.127 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=282, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.131 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.131 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.131 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.131 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.132 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.132 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.132 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.132 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.132 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.132 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.133 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|46" 01-14-2016 17:00:27.133 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|46" 01-14-2016 17:00:27.133 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|46" 01-14-2016 17:00:27.133 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5986] 01-14-2016 17:00:27.133 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=284, msg=IgfsStreamControlRequest [streamId=48, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.133 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=284, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.133 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|46 01-14-2016 17:00:27.133 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=48] 01-14-2016 17:00:27.133 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5986], readTime=36920127, userTime=5226035] 01-14-2016 17:00:27.133 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy:0+8231 01-14-2016 17:00:27.133 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.133 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.133 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.134 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=285, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.134 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915511.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|46 01-14-2016 17:00:27.135 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.135 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.135 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.135 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.136 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.136 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.137 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy = 01-14-2016 17:00:27.137 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.138 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=285, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.138 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.139 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=49] 01-14-2016 17:00:27.139 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8231]] 01-14-2016 17:00:27.139 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.140 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy:0+8231 01-14-2016 17:00:27.140 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy:0+8231 01-14-2016 17:00:27.141 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=286, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.143 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=286, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.143 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=287, msg=IgfsStreamControlRequest [streamId=49, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.144 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=288, msg=IgfsStreamControlRequest [streamId=49, pos=4096, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.156 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=283, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.156 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy, fetchTime=42, locations=[BlockLocation [offset=0, length=6948, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.156 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy:0+6948 01-14-2016 17:00:27.156 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.157 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.157 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy 01-14-2016 17:00:27.157 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.158 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=289, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6107, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.165 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=287, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.166 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=288, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.166 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=290, msg=IgfsStreamControlRequest [streamId=49, pos=8192, len=39, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.166 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=290, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.173 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.175 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.183 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.183 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.183 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.183 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.183 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.183 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.183 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.183 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.183 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.191 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.191 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.191 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.191 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.192 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.192 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.192 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.192 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.192 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.192 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.192 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|47" 01-14-2016 17:00:27.192 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|47" 01-14-2016 17:00:27.192 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8231] 01-14-2016 17:00:27.192 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=291, msg=IgfsStreamControlRequest [streamId=49, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.192 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|47" 01-14-2016 17:00:27.192 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=291, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.192 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=49] 01-14-2016 17:00:27.192 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8231], readTime=24310771, userTime=5963212] 01-14-2016 17:00:27.192 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|47 01-14-2016 17:00:27.192 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy:0+7327 01-14-2016 17:00:27.192 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.192 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.192 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=292, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.192 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.193 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=292, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.193 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.193 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=50] 01-14-2016 17:00:27.193 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7327]] 01-14-2016 17:00:27.193 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.193 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy:0+7327 01-14-2016 17:00:27.193 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy:0+7327 01-14-2016 17:00:27.193 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=293, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.193 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=293, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.193 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=294, msg=IgfsStreamControlRequest [streamId=50, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.193 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=295, msg=IgfsStreamControlRequest [streamId=50, pos=4096, len=3231, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.193 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916475.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|47 01-14-2016 17:00:27.195 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.195 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.195 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.195 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.195 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.195 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.196 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy = 01-14-2016 17:00:27.196 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.198 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=289, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.199 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy, fetchTime=41, locations=[BlockLocation [offset=0, length=6107, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.199 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy:0+6107 01-14-2016 17:00:27.199 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.200 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.200 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy 01-14-2016 17:00:27.200 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.201 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=296, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6702, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.218 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=294, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=295, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7327] 01-14-2016 17:00:27.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=297, msg=IgfsStreamControlRequest [streamId=50, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.221 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.222 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.229 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.229 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.229 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.229 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.229 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.229 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.229 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.229 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.229 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.235 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.235 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.236 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.236 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.236 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.236 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.236 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.236 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.237 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.237 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.237 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|48" 01-14-2016 17:00:27.237 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|48" 01-14-2016 17:00:27.237 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|48" 01-14-2016 17:00:27.237 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|48 01-14-2016 17:00:27.237 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.237 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=297, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=50] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7327], readTime=34079811, userTime=5818318] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy:0+7794 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=298, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=298, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=51] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7794]] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.237 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy:0+7794 01-14-2016 17:00:27.237 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy:0+7794 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=299, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=299, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=300, msg=IgfsStreamControlRequest [streamId=51, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.237 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=301, msg=IgfsStreamControlRequest [streamId=51, pos=4096, len=3698, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.238 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915071.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|48 01-14-2016 17:00:27.240 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.240 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.240 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.240 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.240 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.240 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.241 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy = 01-14-2016 17:00:27.241 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.249 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=296, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.250 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy, fetchTime=49, locations=[BlockLocation [offset=0, length=6702, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.250 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy:0+6702 01-14-2016 17:00:27.251 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.251 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.251 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy 01-14-2016 17:00:27.251 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.252 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=302, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1918, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=300, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=301, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.267 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.267 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.274 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.274 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.274 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.274 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.274 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.274 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.274 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.274 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.274 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.279 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.279 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.279 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.279 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.280 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.280 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.280 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.280 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.281 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.281 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.281 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|49" 01-14-2016 17:00:27.281 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|49" 01-14-2016 17:00:27.281 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|49" 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7794] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=303, msg=IgfsStreamControlRequest [streamId=51, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=303, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=51] 01-14-2016 17:00:27.281 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|49 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7794], readTime=25709141, userTime=5741810] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy:0+1793 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=304, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=304, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.281 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=52] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1793]] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.281 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy:0+1793 01-14-2016 17:00:27.281 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy:0+1793 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=305, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=305, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.281 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=306, msg=IgfsStreamControlRequest [streamId=52, pos=0, len=1793, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.281 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.282 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916339.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|49 01-14-2016 17:00:27.284 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.284 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.284 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.284 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.285 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.285 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.286 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy = 01-14-2016 17:00:27.286 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.298 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=302, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.298 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy, fetchTime=46, locations=[BlockLocation [offset=0, length=1918, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.299 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy:0+1918 01-14-2016 17:00:27.299 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.299 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.300 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy 01-14-2016 17:00:27.300 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.301 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=307, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1736, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.302 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=306, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.304 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1793] 01-14-2016 17:00:27.304 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=308, msg=IgfsStreamControlRequest [streamId=52, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.304 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=308, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.304 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=52] 01-14-2016 17:00:27.305 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1793], readTime=28449502, userTime=6148027] 01-14-2016 17:00:27.305 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy:0+8044 01-14-2016 17:00:27.307 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.309 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=309, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.314 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=309, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.315 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.315 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=53] 01-14-2016 17:00:27.315 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8044]] 01-14-2016 17:00:27.315 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.316 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy:0+8044 01-14-2016 17:00:27.316 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy:0+8044 01-14-2016 17:00:27.316 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.317 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=310, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.317 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.319 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=310, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.319 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=311, msg=IgfsStreamControlRequest [streamId=53, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.320 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=312, msg=IgfsStreamControlRequest [streamId=53, pos=4096, len=3948, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.329 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.329 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.329 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.329 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.330 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.330 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.330 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.330 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.331 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.331 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.331 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|50" 01-14-2016 17:00:27.331 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|50" 01-14-2016 17:00:27.331 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|50" 01-14-2016 17:00:27.331 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|50 01-14-2016 17:00:27.331 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.331 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.332 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915401.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|50 01-14-2016 17:00:27.334 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.334 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.334 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.334 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.334 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.334 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.335 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy = 01-14-2016 17:00:27.335 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=307, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.335 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.335 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy, fetchTime=35, locations=[BlockLocation [offset=0, length=1736, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.336 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy:0+1736 01-14-2016 17:00:27.336 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.336 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.337 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy 01-14-2016 17:00:27.337 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.337 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=313, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1752, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.356 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=311, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.356 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=312, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.358 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8044] 01-14-2016 17:00:27.358 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=314, msg=IgfsStreamControlRequest [streamId=53, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.359 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=314, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.359 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=53] 01-14-2016 17:00:27.359 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8044], readTime=38196442, userTime=6223381] 01-14-2016 17:00:27.360 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy:0+6434 01-14-2016 17:00:27.360 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.361 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.361 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.369 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=315, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.369 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=315, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.369 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.369 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=54] 01-14-2016 17:00:27.369 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6434]] 01-14-2016 17:00:27.370 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.370 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy:0+6434 01-14-2016 17:00:27.370 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy:0+6434 01-14-2016 17:00:27.371 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=316, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.373 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=316, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.373 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=317, msg=IgfsStreamControlRequest [streamId=54, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.374 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=318, msg=IgfsStreamControlRequest [streamId=54, pos=4096, len=2338, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.375 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.375 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.375 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.375 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.376 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.376 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.376 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.376 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.376 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.376 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.376 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|51" 01-14-2016 17:00:27.377 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|51" 01-14-2016 17:00:27.377 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|51" 01-14-2016 17:00:27.377 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|51 01-14-2016 17:00:27.377 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.377 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.378 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916012.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|51 01-14-2016 17:00:27.379 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.380 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.380 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.380 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.380 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.380 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.381 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy = 01-14-2016 17:00:27.381 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.409 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.409 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=313, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.410 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.410 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy, fetchTime=73, locations=[BlockLocation [offset=0, length=1752, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.411 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy:0+1752 01-14-2016 17:00:27.411 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.411 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=317, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.411 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.411 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy 01-14-2016 17:00:27.411 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.412 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=319, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6753, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.413 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=318, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.415 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6434] 01-14-2016 17:00:27.415 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=320, msg=IgfsStreamControlRequest [streamId=54, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.416 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=320, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.416 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=54] 01-14-2016 17:00:27.416 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6434], readTime=41135340, userTime=5755489] 01-14-2016 17:00:27.417 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.417 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.417 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.417 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.417 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.417 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.417 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.417 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.417 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.417 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy:0+7196 01-14-2016 17:00:27.418 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.420 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=321, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.424 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.424 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.424 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.424 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.425 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.425 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.425 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.425 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.425 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=321, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.425 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.425 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=55] 01-14-2016 17:00:27.425 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.425 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.425 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7196]] 01-14-2016 17:00:27.425 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|52" 01-14-2016 17:00:27.426 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|52" 01-14-2016 17:00:27.426 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|52" 01-14-2016 17:00:27.426 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|52 01-14-2016 17:00:27.426 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.426 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.426 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.426 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913894.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|52 01-14-2016 17:00:27.426 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy:0+7196 01-14-2016 17:00:27.426 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy:0+7196 01-14-2016 17:00:27.427 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=322, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.428 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.428 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.428 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.428 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.428 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.428 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.429 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy = 01-14-2016 17:00:27.429 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=322, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=323, msg=IgfsStreamControlRequest [streamId=55, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.431 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=324, msg=IgfsStreamControlRequest [streamId=55, pos=4096, len=3100, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.447 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=319, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.447 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy, fetchTime=35, locations=[BlockLocation [offset=0, length=6753, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.447 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy:0+6753 01-14-2016 17:00:27.448 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.448 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.449 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy 01-14-2016 17:00:27.449 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.449 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=325, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7433, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.451 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=323, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.452 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=324, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.454 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7196] 01-14-2016 17:00:27.455 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=326, msg=IgfsStreamControlRequest [streamId=55, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.463 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.464 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.478 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.478 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.478 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.478 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.479 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.479 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.479 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.479 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.480 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.480 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.480 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|53" 01-14-2016 17:00:27.480 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|53" 01-14-2016 17:00:27.480 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|53" 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=326, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=55] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7196], readTime=23280423, userTime=6543455] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy:0+7920 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=327, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=327, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=56] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7920]] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.480 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy:0+7920 01-14-2016 17:00:27.480 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy:0+7920 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=328, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=328, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=329, msg=IgfsStreamControlRequest [streamId=56, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=330, msg=IgfsStreamControlRequest [streamId=56, pos=4096, len=3824, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.480 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|53 01-14-2016 17:00:27.480 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.480 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.481 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915818.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|53 01-14-2016 17:00:27.483 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.483 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.483 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.483 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.483 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.483 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.485 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy = 01-14-2016 17:00:27.485 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.497 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=329, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.497 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=330, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.519 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.520 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.529 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.537 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.537 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.537 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.537 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.538 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.538 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.538 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.538 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.538 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.538 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.539 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|54" 01-14-2016 17:00:27.539 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|54" 01-14-2016 17:00:27.539 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|54" 01-14-2016 17:00:27.539 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|54 01-14-2016 17:00:27.539 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.539 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7920] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=331, msg=IgfsStreamControlRequest [streamId=56, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=325, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy, fetchTime=50, locations=[BlockLocation [offset=0, length=7433, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy:0+7433 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=332, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=8176, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=331, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=56] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7920], readTime=32675219, userTime=6306631] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy:0+6649 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=333, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=333, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=57] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6649]] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.539 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy:0+6649 01-14-2016 17:00:27.539 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy:0+6649 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=334, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=334, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=335, msg=IgfsStreamControlRequest [streamId=57, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=336, msg=IgfsStreamControlRequest [streamId=57, pos=4096, len=2553, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.540 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914981.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|54 01-14-2016 17:00:27.542 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.542 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.542 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.542 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.543 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.543 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.545 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy = 01-14-2016 17:00:27.545 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.548 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=332, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.548 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy, fetchTime=47, locations=[BlockLocation [offset=0, length=8176, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.549 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy:0+8176 01-14-2016 17:00:27.549 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.549 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.550 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy 01-14-2016 17:00:27.550 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.551 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=337, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7234, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.559 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=335, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.559 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=336, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.579 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.580 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.594 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.594 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.594 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.594 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.595 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.595 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.595 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.595 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.596 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.596 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.596 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|55" 01-14-2016 17:00:27.596 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|55" 01-14-2016 17:00:27.596 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|55" 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6649] 01-14-2016 17:00:27.596 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|55 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=338, msg=IgfsStreamControlRequest [streamId=57, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=338, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=57] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6649], readTime=36704220, userTime=6842414] 01-14-2016 17:00:27.596 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy:0+6594 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=339, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=339, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.596 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=58] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6594]] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.596 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy:0+6594 01-14-2016 17:00:27.596 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy:0+6594 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=340, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=340, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=341, msg=IgfsStreamControlRequest [streamId=58, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.596 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=342, msg=IgfsStreamControlRequest [streamId=58, pos=4096, len=2498, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.597 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916170.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|55 01-14-2016 17:00:27.598 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.598 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.598 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.598 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.599 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.599 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.600 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy = 01-14-2016 17:00:27.600 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=341, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.600 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=342, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.600 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.636 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.637 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.646 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.646 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.646 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.646 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.646 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.646 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.646 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.646 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.646 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.654 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.654 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.654 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.654 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.655 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.655 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.655 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.655 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.656 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.656 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.656 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|56" 01-14-2016 17:00:27.656 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|56" 01-14-2016 17:00:27.656 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|56" 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6594] 01-14-2016 17:00:27.656 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|56 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=343, msg=IgfsStreamControlRequest [streamId=58, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=337, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy, fetchTime=52, locations=[BlockLocation [offset=0, length=7234, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy:0+7234 01-14-2016 17:00:27.656 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=344, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1762, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=343, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=58] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6594], readTime=27370700, userTime=6163764] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy:0+6184 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=345, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.656 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=345, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=59] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6184]] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.656 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy:0+6184 01-14-2016 17:00:27.656 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy:0+6184 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=346, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=346, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=347, msg=IgfsStreamControlRequest [streamId=59, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=348, msg=IgfsStreamControlRequest [streamId=59, pos=4096, len=2088, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=344, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=1762, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy:0+1762 01-14-2016 17:00:27.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=349, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7039, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=347, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=348, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6184] 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=350, msg=IgfsStreamControlRequest [streamId=59, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=350, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=59] 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6184], readTime=28915802, userTime=6430070] 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy:0+7455 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=351, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.657 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915181.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|56 01-14-2016 17:00:27.659 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.659 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.659 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.659 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.659 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.659 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.661 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy = 01-14-2016 17:00:27.661 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.699 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.700 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.709 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.709 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.709 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.709 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.709 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.709 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.709 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.709 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.709 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.717 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.717 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.717 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.717 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.718 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.718 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.718 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.718 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.718 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.718 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.718 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|57" 01-14-2016 17:00:27.718 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|57" 01-14-2016 17:00:27.718 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|57" 01-14-2016 17:00:27.718 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=351, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.718 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.718 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|57 01-14-2016 17:00:27.718 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=60] 01-14-2016 17:00:27.718 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7455]] 01-14-2016 17:00:27.718 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.719 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.719 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy:0+7455 01-14-2016 17:00:27.719 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy:0+7455 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=352, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=352, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=353, msg=IgfsStreamControlRequest [streamId=60, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=354, msg=IgfsStreamControlRequest [streamId=60, pos=4096, len=3359, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=349, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=7039, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy:0+7039 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.719 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=355, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=8434, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=353, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=354, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7455] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=356, msg=IgfsStreamControlRequest [streamId=60, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=356, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=60] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7455], readTime=23540294, userTime=6968973] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy:0+6972 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=357, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=357, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=61] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6972]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.719 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy:0+6972 01-14-2016 17:00:27.719 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy:0+6972 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=358, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=358, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=359, msg=IgfsStreamControlRequest [streamId=61, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=360, msg=IgfsStreamControlRequest [streamId=61, pos=4096, len=2876, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.720 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915794.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|57 01-14-2016 17:00:27.721 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.721 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.721 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.721 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.722 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.722 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.723 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy = 01-14-2016 17:00:27.723 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.760 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.761 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.769 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.769 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.769 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.769 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.769 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.769 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.769 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.769 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.769 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.777 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.777 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.777 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.777 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.778 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.778 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.778 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.778 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.779 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.779 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.779 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|58" 01-14-2016 17:00:27.779 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|58" 01-14-2016 17:00:27.779 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|58" 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=355, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.779 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|58 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy, fetchTime=64, locations=[BlockLocation [offset=0, length=8434, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy:0+8434 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy 01-14-2016 17:00:27.779 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=361, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7135, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=359, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=360, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6972] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=362, msg=IgfsStreamControlRequest [streamId=61, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=362, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=61] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6972], readTime=46610192, userTime=5628483] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy:0+5653 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=363, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=363, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=62] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5653]] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.779 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy:0+5653 01-14-2016 17:00:27.779 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy:0+5653 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=364, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.779 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=364, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=365, msg=IgfsStreamControlRequest [streamId=62, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=366, msg=IgfsStreamControlRequest [streamId=62, pos=4096, len=1557, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.780 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915221.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|58 01-14-2016 17:00:27.782 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.782 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.782 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.782 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.782 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.782 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.783 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy = 01-14-2016 17:00:27.784 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.784 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:27.817 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.818 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.826 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.826 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.826 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.826 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.826 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.826 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.826 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.826 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.826 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.833 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.833 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.833 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.833 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.834 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.834 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.834 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.834 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.835 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.835 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.835 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|59" 01-14-2016 17:00:27.835 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|59" 01-14-2016 17:00:27.835 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|59" 01-14-2016 17:00:27.835 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|59 01-14-2016 17:00:27.835 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.835 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=361, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy, fetchTime=55, locations=[BlockLocation [offset=0, length=7135, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy:0+7135 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=365, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=367, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6306, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=366, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5653] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=368, msg=IgfsStreamControlRequest [streamId=62, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=368, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=62] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5653], readTime=41578584, userTime=7199146] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy:0+6577 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=369, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=369, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=63] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6577]] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.836 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy:0+6577 01-14-2016 17:00:27.836 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy:0+6577 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=370, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=370, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=371, msg=IgfsStreamControlRequest [streamId=63, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=372, msg=IgfsStreamControlRequest [streamId=63, pos=4096, len=2481, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.836 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916497.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|59 01-14-2016 17:00:27.838 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.838 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.838 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.838 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.838 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.838 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.840 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy = 01-14-2016 17:00:27.840 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.874 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.875 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.881 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.881 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.881 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.881 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.881 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.881 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.881 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.881 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.881 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.888 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.888 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.888 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.888 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.889 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.889 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.889 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.889 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.889 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.889 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.890 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|60" 01-14-2016 17:00:27.890 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|60" 01-14-2016 17:00:27.890 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|60" 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=367, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy, fetchTime=42, locations=[BlockLocation [offset=0, length=6306, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.890 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|60 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy:0+6306 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.890 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=373, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=9060, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=371, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=372, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6577] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=374, msg=IgfsStreamControlRequest [streamId=63, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=374, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=63] 01-14-2016 17:00:27.890 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6577], readTime=26017897, userTime=7904098] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy:0+7900 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=375, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=375, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=64] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7900]] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.890 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy:0+7900 01-14-2016 17:00:27.890 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy:0+7900 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=376, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=376, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=377, msg=IgfsStreamControlRequest [streamId=64, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.890 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=378, msg=IgfsStreamControlRequest [streamId=64, pos=4096, len=3804, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.891 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914762.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|60 01-14-2016 17:00:27.892 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.892 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.892 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.892 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.893 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.893 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.894 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy = 01-14-2016 17:00:27.894 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.924 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.925 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.933 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.934 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.940 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.940 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.940 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.940 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.941 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.941 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.941 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.941 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.942 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.942 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.942 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|61" 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=377, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=378, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.942 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|61" 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7900] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=379, msg=IgfsStreamControlRequest [streamId=64, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=373, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.942 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|61" 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy, fetchTime=48, locations=[BlockLocation [offset=0, length=9060, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy:0+9060 01-14-2016 17:00:27.942 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.942 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|61 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.942 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=380, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=7378, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=379, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=64] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7900], readTime=29886484, userTime=6150101] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy:0+7891 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=381, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=381, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=65] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7891]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:27.942 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy:0+7891 01-14-2016 17:00:27.942 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy:0+7891 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=382, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=382, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=383, msg=IgfsStreamControlRequest [streamId=65, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=384, msg=IgfsStreamControlRequest [streamId=65, pos=4096, len=3795, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=380, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy, fetchTime=36, locations=[BlockLocation [offset=0, length=7378, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy:0+7378 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=383, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=385, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1768, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.942 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=384, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.944 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915155.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|61 01-14-2016 17:00:27.945 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.945 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.945 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.945 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.946 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.946 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:27.947 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy = 01-14-2016 17:00:27.947 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:27.977 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:27.978 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:27.985 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:27.985 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:27.985 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:27.985 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:27.985 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:27.985 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:27.985 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:27.985 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:27.985 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:27.993 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:27.993 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:27.993 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.993 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.994 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.994 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:27.994 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:27.994 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:27.995 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:27.995 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:27.995 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|62" 01-14-2016 17:00:27.995 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|62" 01-14-2016 17:00:27.995 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|62" 01-14-2016 17:00:27.995 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=385, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:27.995 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy, fetchTime=47, locations=[BlockLocation [offset=0, length=1768, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:27.995 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|62 01-14-2016 17:00:27.995 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy:0+1768 01-14-2016 17:00:27.995 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.995 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:27.995 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:27.995 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy 01-14-2016 17:00:27.995 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:27.995 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=386, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=8411, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:27.995 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:27.996 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915734.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|62 01-14-2016 17:00:27.998 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.998 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.998 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.998 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:27.998 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:27.998 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.000 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy = 01-14-2016 17:00:28.000 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.038 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.039 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.048 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.048 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.048 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.048 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.048 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.048 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.048 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.048 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.048 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.055 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.055 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.055 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.055 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.056 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.056 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.056 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.056 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.057 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.057 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.057 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7891] 01-14-2016 17:00:28.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=387, msg=IgfsStreamControlRequest [streamId=65, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=387, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=65] 01-14-2016 17:00:28.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7891], readTime=55774360, userTime=62037952] 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy:0+7954 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=388, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=386, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy, fetchTime=47, locations=[BlockLocation [offset=0, length=8411, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy:0+8411 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=389, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6346, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=388, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=66] 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7954]] 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.058 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy:0+7954 01-14-2016 17:00:28.058 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy:0+7954 01-14-2016 17:00:28.058 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=390, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.058 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|63" 01-14-2016 17:00:28.058 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|63" 01-14-2016 17:00:28.058 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|63" 01-14-2016 17:00:28.058 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|63 01-14-2016 17:00:28.058 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.059 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915123.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|63 01-14-2016 17:00:28.061 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.061 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.061 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.061 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.061 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.061 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.063 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy = 01-14-2016 17:00:28.063 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.103 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.104 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.106 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=390, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.107 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=391, msg=IgfsStreamControlRequest [streamId=66, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.109 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=392, msg=IgfsStreamControlRequest [streamId=66, pos=4096, len=3858, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.113 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.113 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.113 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.113 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.113 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.113 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.113 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.113 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.113 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.121 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.121 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.121 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.121 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.122 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.122 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.122 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.122 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.123 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.123 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.123 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|64" 01-14-2016 17:00:28.123 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|64" 01-14-2016 17:00:28.123 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|64" 01-14-2016 17:00:28.123 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|64 01-14-2016 17:00:28.123 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.123 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.124 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.916545.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|64 01-14-2016 17:00:28.126 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.126 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.126 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.126 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.127 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.127 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.128 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy = 01-14-2016 17:00:28.129 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.137 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=391, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.168 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.169 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.177 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=392, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.177 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=389, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.177 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy, fetchTime=142, locations=[BlockLocation [offset=0, length=6346, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.178 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy:0+6346 01-14-2016 17:00:28.178 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.178 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.178 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.178 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.178 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.178 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.178 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.178 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.178 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.178 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.178 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.178 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy 01-14-2016 17:00:28.179 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7954] 01-14-2016 17:00:28.179 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.179 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=393, msg=IgfsStreamControlRequest [streamId=66, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.180 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=394, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5890, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.180 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=393, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.180 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=66] 01-14-2016 17:00:28.180 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7954], readTime=71485946, userTime=69703741] 01-14-2016 17:00:28.182 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy:0+7031 01-14-2016 17:00:28.184 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.186 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=395, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.187 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.187 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.187 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.187 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.188 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.188 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.188 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.188 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.189 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.189 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.189 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|65" 01-14-2016 17:00:28.189 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|65" 01-14-2016 17:00:28.189 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|65" 01-14-2016 17:00:28.189 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|65 01-14-2016 17:00:28.189 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.189 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.190 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|65 01-14-2016 17:00:28.191 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.191 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.191 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.191 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.192 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.192 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.193 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy = 01-14-2016 17:00:28.194 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.217 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=394, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.218 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy, fetchTime=39, locations=[BlockLocation [offset=0, length=5890, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.218 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy:0+5890 01-14-2016 17:00:28.218 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.219 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.219 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy 01-14-2016 17:00:28.219 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=396, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5675, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.223 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=395, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.224 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.224 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=67] 01-14-2016 17:00:28.224 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7031]] 01-14-2016 17:00:28.225 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.225 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy:0+7031 01-14-2016 17:00:28.225 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy:0+7031 01-14-2016 17:00:28.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=397, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.238 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.240 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.254 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=396, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.260 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=5675, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.260 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy:0+5675 01-14-2016 17:00:28.260 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.261 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=397, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.261 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.262 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=398, msg=IgfsStreamControlRequest [streamId=67, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.262 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy 01-14-2016 17:00:28.262 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.262 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=399, msg=IgfsStreamControlRequest [streamId=67, pos=4096, len=2935, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.262 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.262 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.263 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.263 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.263 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=400, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5284, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.264 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.264 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.264 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.264 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.265 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.265 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.265 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|66" 01-14-2016 17:00:28.265 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|66" 01-14-2016 17:00:28.265 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|66" 01-14-2016 17:00:28.265 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|66 01-14-2016 17:00:28.265 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.286 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=398, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.286 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=399, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.287 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.287 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.916214.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|66 01-14-2016 17:00:28.288 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7031] 01-14-2016 17:00:28.288 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=401, msg=IgfsStreamControlRequest [streamId=67, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.289 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.289 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.289 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.289 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.289 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.289 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.289 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=401, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.290 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=67] 01-14-2016 17:00:28.290 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7031], readTime=26528085, userTime=39032382] 01-14-2016 17:00:28.290 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy = 01-14-2016 17:00:28.291 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy:0+6948 01-14-2016 17:00:28.291 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.292 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.294 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=402, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.300 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=402, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.301 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.301 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=68] 01-14-2016 17:00:28.301 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6948]] 01-14-2016 17:00:28.301 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.302 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy:0+6948 01-14-2016 17:00:28.302 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy:0+6948 01-14-2016 17:00:28.303 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=403, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.306 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=403, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.306 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=404, msg=IgfsStreamControlRequest [streamId=68, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.306 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=405, msg=IgfsStreamControlRequest [streamId=68, pos=4096, len=2852, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=400, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.324 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy, fetchTime=61, locations=[BlockLocation [offset=0, length=5284, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.324 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy:0+5284 01-14-2016 17:00:28.324 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.324 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy 01-14-2016 17:00:28.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.326 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=406, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6426, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.330 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=404, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.330 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=405, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.332 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6948] 01-14-2016 17:00:28.332 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.333 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=407, msg=IgfsStreamControlRequest [streamId=68, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.333 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=407, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.333 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.333 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=68] 01-14-2016 17:00:28.334 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6948], readTime=25894264, userTime=6876132] 01-14-2016 17:00:28.334 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy:0+6107 01-14-2016 17:00:28.336 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.338 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=408, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.340 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.340 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.340 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.340 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.340 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.340 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.340 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.340 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.340 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.343 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=408, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.343 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.343 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=69] 01-14-2016 17:00:28.343 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6107]] 01-14-2016 17:00:28.344 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.344 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy:0+6107 01-14-2016 17:00:28.345 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy:0+6107 01-14-2016 17:00:28.346 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=409, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.346 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.346 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.346 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.347 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.347 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.347 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.347 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=409, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.348 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.348 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.348 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.348 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.348 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=410, msg=IgfsStreamControlRequest [streamId=69, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.348 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|67" 01-14-2016 17:00:28.348 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|67" 01-14-2016 17:00:28.348 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|67" 01-14-2016 17:00:28.348 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|67 01-14-2016 17:00:28.348 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.349 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.350 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.916254.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|67 01-14-2016 17:00:28.350 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=411, msg=IgfsStreamControlRequest [streamId=69, pos=4096, len=2011, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.351 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.351 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.351 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.351 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.352 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.352 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.353 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy = 01-14-2016 17:00:28.354 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.365 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=406, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.365 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=6426, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.366 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy:0+6426 01-14-2016 17:00:28.366 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.366 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.367 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy 01-14-2016 17:00:28.367 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.367 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=410, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.368 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=412, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6047, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.368 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=411, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.369 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6107] 01-14-2016 17:00:28.369 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=413, msg=IgfsStreamControlRequest [streamId=69, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.370 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=413, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.370 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=69] 01-14-2016 17:00:28.370 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6107], readTime=21000890, userTime=5879205] 01-14-2016 17:00:28.371 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy:0+6702 01-14-2016 17:00:28.372 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.374 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=414, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=414, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.379 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=70] 01-14-2016 17:00:28.380 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6702]] 01-14-2016 17:00:28.380 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.380 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy:0+6702 01-14-2016 17:00:28.381 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy:0+6702 01-14-2016 17:00:28.382 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=415, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.386 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=415, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.388 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.389 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=416, msg=IgfsStreamControlRequest [streamId=70, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.389 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=417, msg=IgfsStreamControlRequest [streamId=70, pos=4096, len=2606, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.389 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.400 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.400 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.400 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.400 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.400 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.400 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.400 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.400 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.400 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.409 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.409 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.410 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.410 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.410 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.410 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.411 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.411 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.411 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.411 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.411 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|68" 01-14-2016 17:00:28.411 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|68" 01-14-2016 17:00:28.411 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|68" 01-14-2016 17:00:28.411 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|68 01-14-2016 17:00:28.411 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.411 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.413 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.916110.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|68 01-14-2016 17:00:28.414 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.414 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.414 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.414 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.414 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.414 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.414 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=412, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.415 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy, fetchTime=48, locations=[BlockLocation [offset=0, length=6047, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.415 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=416, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.415 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy:0+6047 01-14-2016 17:00:28.415 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy = 01-14-2016 17:00:28.415 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.416 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.416 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.416 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy 01-14-2016 17:00:28.416 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.417 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=418, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6205, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.417 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=417, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6702] 01-14-2016 17:00:28.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=419, msg=IgfsStreamControlRequest [streamId=70, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.420 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=419, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.420 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=70] 01-14-2016 17:00:28.420 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6702], readTime=31802462, userTime=8771603] 01-14-2016 17:00:28.421 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy:0+1918 01-14-2016 17:00:28.422 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.424 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=420, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.429 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=420, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.429 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.429 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=71] 01-14-2016 17:00:28.430 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1918]] 01-14-2016 17:00:28.430 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.431 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy:0+1918 01-14-2016 17:00:28.431 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy:0+1918 01-14-2016 17:00:28.432 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=421, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.434 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=421, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.436 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=422, msg=IgfsStreamControlRequest [streamId=71, pos=0, len=1918, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.450 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.451 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=418, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.451 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=6205, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.451 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.451 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy:0+6205 01-14-2016 17:00:28.452 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.452 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.452 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy 01-14-2016 17:00:28.453 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.453 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=423, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5163, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.460 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.460 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.460 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.460 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.460 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.460 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.460 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.460 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.460 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.467 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=422, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.468 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.468 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.468 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1918] 01-14-2016 17:00:28.468 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.469 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.469 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=424, msg=IgfsStreamControlRequest [streamId=71, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.469 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=424, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.470 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.470 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.470 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=71] 01-14-2016 17:00:28.470 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1918], readTime=33460589, userTime=6756246] 01-14-2016 17:00:28.470 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.470 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.471 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.471 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.471 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.471 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|69" 01-14-2016 17:00:28.471 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy:0+1736 01-14-2016 17:00:28.471 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|69" 01-14-2016 17:00:28.471 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|69" 01-14-2016 17:00:28.471 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|69 01-14-2016 17:00:28.472 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.472 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.473 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915986.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|69 01-14-2016 17:00:28.474 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=425, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.475 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.475 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.475 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.475 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.475 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.475 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.477 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy = 01-14-2016 17:00:28.477 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=425, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.481 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=72] 01-14-2016 17:00:28.481 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1736]] 01-14-2016 17:00:28.481 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.481 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy:0+1736 01-14-2016 17:00:28.482 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy:0+1736 01-14-2016 17:00:28.483 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=426, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.485 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=426, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.486 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=427, msg=IgfsStreamControlRequest [streamId=72, pos=0, len=1736, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.494 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=423, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.494 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy, fetchTime=41, locations=[BlockLocation [offset=0, length=5163, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.494 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy:0+5163 01-14-2016 17:00:28.495 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.495 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.495 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy 01-14-2016 17:00:28.496 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.496 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=428, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5763, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.517 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.518 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.530 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=428, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.530 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=5763, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.530 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy:0+5763 01-14-2016 17:00:28.531 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.531 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.531 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy 01-14-2016 17:00:28.532 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.532 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=429, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1279, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.533 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=427, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.534 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1736] 01-14-2016 17:00:28.534 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=430, msg=IgfsStreamControlRequest [streamId=72, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.535 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=430, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.535 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=72] 01-14-2016 17:00:28.535 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1736], readTime=48604480, userTime=6318492] 01-14-2016 17:00:28.536 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.536 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.536 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.536 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.536 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy:0+1752 01-14-2016 17:00:28.537 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.537 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.537 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.537 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.537 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.538 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.538 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.538 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|70" 01-14-2016 17:00:28.538 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|70" 01-14-2016 17:00:28.538 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|70" 01-14-2016 17:00:28.538 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|70 01-14-2016 17:00:28.538 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.538 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.539 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914482.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|70 01-14-2016 17:00:28.539 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=431, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.541 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.541 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.541 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.541 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.541 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.541 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.542 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy = 01-14-2016 17:00:28.543 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.546 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=431, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.546 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.546 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=73] 01-14-2016 17:00:28.546 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1752]] 01-14-2016 17:00:28.547 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.547 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy:0+1752 01-14-2016 17:00:28.547 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy:0+1752 01-14-2016 17:00:28.548 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=432, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.550 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=432, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.551 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=433, msg=IgfsStreamControlRequest [streamId=73, pos=0, len=1752, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.573 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=429, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.573 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy, fetchTime=41, locations=[BlockLocation [offset=0, length=1279, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.573 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy:0+1279 01-14-2016 17:00:28.574 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.574 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.574 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy 01-14-2016 17:00:28.575 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.575 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=434, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5334, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.576 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=433, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.577 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1752] 01-14-2016 17:00:28.577 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=435, msg=IgfsStreamControlRequest [streamId=73, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.578 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=435, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.578 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=73] 01-14-2016 17:00:28.578 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1752], readTime=26094191, userTime=5642984] 01-14-2016 17:00:28.578 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.579 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy:0+6753 01-14-2016 17:00:28.579 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.580 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.582 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=436, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.588 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.588 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.588 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.588 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=436, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.588 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=74] 01-14-2016 17:00:28.589 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6753]] 01-14-2016 17:00:28.590 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.590 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy:0+6753 01-14-2016 17:00:28.590 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy:0+6753 01-14-2016 17:00:28.591 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=437, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.594 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=437, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.594 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=438, msg=IgfsStreamControlRequest [streamId=74, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.594 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=439, msg=IgfsStreamControlRequest [streamId=74, pos=4096, len=2657, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.595 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.595 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.596 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.596 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.596 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.596 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.596 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.596 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.597 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.597 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.597 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|71" 01-14-2016 17:00:28.597 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|71" 01-14-2016 17:00:28.597 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|71" 01-14-2016 17:00:28.597 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.597 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|71 01-14-2016 17:00:28.597 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.598 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914206.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|71 01-14-2016 17:00:28.599 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.599 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.599 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.599 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.599 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.599 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.600 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy = 01-14-2016 17:00:28.601 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.610 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=434, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.611 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy, fetchTime=35, locations=[BlockLocation [offset=0, length=5334, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.611 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy:0+5334 01-14-2016 17:00:28.611 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.612 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.612 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy 01-14-2016 17:00:28.612 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.613 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=440, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6597, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.615 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=438, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.616 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=439, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.617 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6753] 01-14-2016 17:00:28.618 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=441, msg=IgfsStreamControlRequest [streamId=74, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.618 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=441, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.619 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=74] 01-14-2016 17:00:28.619 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6753], readTime=22918087, userTime=7208275] 01-14-2016 17:00:28.619 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy:0+7433 01-14-2016 17:00:28.621 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.623 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=442, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.629 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=442, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.629 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.630 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=75] 01-14-2016 17:00:28.630 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7433]] 01-14-2016 17:00:28.630 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.631 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy:0+7433 01-14-2016 17:00:28.631 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy:0+7433 01-14-2016 17:00:28.632 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=443, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.634 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=443, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.635 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=444, msg=IgfsStreamControlRequest [streamId=75, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.635 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=445, msg=IgfsStreamControlRequest [streamId=75, pos=4096, len=3337, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.640 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.641 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.650 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.650 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.650 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.650 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.650 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.650 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.650 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.650 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.650 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=440, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=444, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.656 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy, fetchTime=44, locations=[BlockLocation [offset=0, length=6597, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.656 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy:0+6597 01-14-2016 17:00:28.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.658 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy 01-14-2016 17:00:28.658 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.658 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.658 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.658 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.658 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=446, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4783, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.659 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.659 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.659 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.659 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.659 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.659 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.659 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|72" 01-14-2016 17:00:28.660 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|72" 01-14-2016 17:00:28.660 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|72" 01-14-2016 17:00:28.660 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.660 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|72 01-14-2016 17:00:28.660 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.660 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914108.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|72 01-14-2016 17:00:28.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=445, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7433] 01-14-2016 17:00:28.661 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=447, msg=IgfsStreamControlRequest [streamId=75, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.661 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=447, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.661 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=75] 01-14-2016 17:00:28.662 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7433], readTime=25387007, userTime=6518813] 01-14-2016 17:00:28.662 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.662 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.662 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.662 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.662 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.662 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy:0+8176 01-14-2016 17:00:28.662 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.663 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.664 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy = 01-14-2016 17:00:28.664 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.665 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=448, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.670 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=448, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.670 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.670 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=76] 01-14-2016 17:00:28.671 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8176]] 01-14-2016 17:00:28.671 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.671 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy:0+8176 01-14-2016 17:00:28.672 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy:0+8176 01-14-2016 17:00:28.672 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=449, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=449, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=450, msg=IgfsStreamControlRequest [streamId=76, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=451, msg=IgfsStreamControlRequest [streamId=76, pos=4096, len=4080, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.692 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=446, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.692 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=4783, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.693 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy:0+4783 01-14-2016 17:00:28.693 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.693 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.694 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy 01-14-2016 17:00:28.694 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.694 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=450, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=452, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5708, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=451, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.697 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.698 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.714 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.714 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.714 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.714 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.715 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.715 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.716 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.716 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.716 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.716 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.716 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|73" 01-14-2016 17:00:28.716 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|73" 01-14-2016 17:00:28.716 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|73" 01-14-2016 17:00:28.716 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8176] 01-14-2016 17:00:28.716 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=453, msg=IgfsStreamControlRequest [streamId=76, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.716 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=453, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.716 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=76] 01-14-2016 17:00:28.716 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|73 01-14-2016 17:00:28.716 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8176], readTime=21299063, userTime=5879078] 01-14-2016 17:00:28.716 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy:0+7234 01-14-2016 17:00:28.716 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.716 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.716 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.716 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=454, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=454, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.717 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=77] 01-14-2016 17:00:28.717 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7234]] 01-14-2016 17:00:28.717 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.717 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy:0+7234 01-14-2016 17:00:28.717 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy:0+7234 01-14-2016 17:00:28.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=455, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=455, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=456, msg=IgfsStreamControlRequest [streamId=77, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=457, msg=IgfsStreamControlRequest [streamId=77, pos=4096, len=3138, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.717 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.913846.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|73 01-14-2016 17:00:28.719 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.719 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.719 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.719 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.719 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.719 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.720 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy = 01-14-2016 17:00:28.721 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.757 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.758 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.767 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.767 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.767 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.767 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.767 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.767 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.767 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.767 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.767 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.776 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.776 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.776 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.776 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.777 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.777 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.777 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.777 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.778 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.778 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.778 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|74" 01-14-2016 17:00:28.778 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|74" 01-14-2016 17:00:28.778 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|74" 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=452, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=5708, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy:0+5708 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=458, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5876, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=456, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.779 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=457, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.779 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.780 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7234] 01-14-2016 17:00:28.780 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=459, msg=IgfsStreamControlRequest [streamId=77, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.781 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|74 01-14-2016 17:00:28.781 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.782 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915379.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|74 01-14-2016 17:00:28.784 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.784 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.784 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.784 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.784 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.784 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.785 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:28.785 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy = 01-14-2016 17:00:28.786 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.821 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.822 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.831 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.832 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.832 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.832 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.832 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.832 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.832 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.832 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.832 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.840 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.840 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.840 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.840 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.841 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.841 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.841 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.841 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.842 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.842 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.842 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|75" 01-14-2016 17:00:28.842 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|75" 01-14-2016 17:00:28.842 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|75" 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=458, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.842 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|75 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy, fetchTime=45, locations=[BlockLocation [offset=0, length=5876, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy:0+5876 01-14-2016 17:00:28.842 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=460, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6378, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=459, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=77] 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7234], readTime=34911012, userTime=41023425] 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy:0+1762 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=461, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=461, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.842 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.842 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=78] 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1762]] 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.843 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy:0+1762 01-14-2016 17:00:28.843 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy:0+1762 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=462, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=462, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=463, msg=IgfsStreamControlRequest [streamId=78, pos=0, len=1762, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=460, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.843 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.23.915644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|75 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy, fetchTime=35, locations=[BlockLocation [offset=0, length=6378, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy:0+6378 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.843 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=464, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1271, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=463, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1762] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=465, msg=IgfsStreamControlRequest [streamId=78, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=465, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=78] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1762], readTime=23548706, userTime=5505448] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy:0+7039 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=466, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=466, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=79] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7039]] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.844 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy:0+7039 01-14-2016 17:00:28.844 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy:0+7039 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=467, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=467, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=468, msg=IgfsStreamControlRequest [streamId=79, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=469, msg=IgfsStreamControlRequest [streamId=79, pos=4096, len=2943, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.845 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.845 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.845 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.845 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.846 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.846 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.847 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy = 01-14-2016 17:00:28.848 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.855 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=464, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.856 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy, fetchTime=36, locations=[BlockLocation [offset=0, length=1271, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.856 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy:0+1271 01-14-2016 17:00:28.856 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.857 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.857 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy 01-14-2016 17:00:28.857 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.858 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=470, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4792, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.860 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=468, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.861 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=469, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.885 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.886 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.894 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.894 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.894 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.894 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.894 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.894 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.894 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.894 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.894 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.902 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.902 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.903 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.903 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.903 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.903 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.904 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.904 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.904 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.904 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.904 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|76" 01-14-2016 17:00:28.904 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|76" 01-14-2016 17:00:28.904 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|76" 01-14-2016 17:00:28.904 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|76 01-14-2016 17:00:28.904 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.904 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7039] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=471, msg=IgfsStreamControlRequest [streamId=79, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=471, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=79] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7039], readTime=22902335, userTime=6473301] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy:0+8434 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=472, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=472, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=80] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8434]] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.905 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy:0+8434 01-14-2016 17:00:28.905 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy:0+8434 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=473, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=473, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=474, msg=IgfsStreamControlRequest [streamId=80, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=475, msg=IgfsStreamControlRequest [streamId=80, pos=4096, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=470, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy, fetchTime=43, locations=[BlockLocation [offset=0, length=4792, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy:0+4792 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=476, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5757, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.906 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914610.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|76 01-14-2016 17:00:28.907 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=474, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.907 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=475, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.907 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.907 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.907 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.907 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=477, msg=IgfsStreamControlRequest [streamId=80, pos=8192, len=242, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.907 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.908 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.908 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.908 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=477, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.909 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy = 01-14-2016 17:00:28.909 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:28.944 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:28.945 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:28.951 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:28.951 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:28.951 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:28.951 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:28.951 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:28.951 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:28.951 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:28.951 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:28.951 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:28.958 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:28.958 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:28.959 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.959 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.959 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.959 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:28.959 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:28.960 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:28.960 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:28.960 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8434] 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=478, msg=IgfsStreamControlRequest [streamId=80, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:28.960 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|77" 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=478, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=80] 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8434], readTime=25610306, userTime=7752529] 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy:0+7135 01-14-2016 17:00:28.960 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|77" 01-14-2016 17:00:28.960 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|77" 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:28.960 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=479, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:28.960 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|77 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=479, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=81] 01-14-2016 17:00:28.960 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7135]] 01-14-2016 17:00:28.960 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:28.960 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy:0+7135 01-14-2016 17:00:28.960 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy:0+7135 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=480, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=480, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=481, msg=IgfsStreamControlRequest [streamId=81, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=482, msg=IgfsStreamControlRequest [streamId=81, pos=4096, len=3039, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=476, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy, fetchTime=38, locations=[BlockLocation [offset=0, length=5757, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy:0+5757 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=483, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6245, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=481, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=482, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:28.962 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.915245.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|77 01-14-2016 17:00:28.963 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.963 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.963 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.963 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:28.964 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:28.964 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:28.965 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy = 01-14-2016 17:00:28.965 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.005 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.006 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.023 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.023 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.023 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.023 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.024 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.024 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.024 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.024 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.025 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.025 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.025 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|78" 01-14-2016 17:00:29.025 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|78" 01-14-2016 17:00:29.025 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|78" 01-14-2016 17:00:29.025 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|78 01-14-2016 17:00:29.025 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.025 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.025 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7135] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=484, msg=IgfsStreamControlRequest [streamId=81, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=484, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=81] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7135], readTime=27129424, userTime=16027798] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy:0+6306 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=485, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=485, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=82] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6306]] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.026 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy:0+6306 01-14-2016 17:00:29.026 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy:0+6306 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=486, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=486, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=487, msg=IgfsStreamControlRequest [streamId=82, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=488, msg=IgfsStreamControlRequest [streamId=82, pos=4096, len=2210, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=483, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy, fetchTime=42, locations=[BlockLocation [offset=0, length=6245, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy:0+6245 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=489, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1282, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=487, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.026 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=488, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.026 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914118.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|78 01-14-2016 17:00:29.029 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.029 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.029 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.029 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.029 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.029 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.031 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy = 01-14-2016 17:00:29.031 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.072 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.073 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.082 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.082 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.082 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.082 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.082 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.082 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.082 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.082 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.082 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.090 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.091 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.091 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.091 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.092 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.092 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.092 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.092 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.093 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.093 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.093 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|79" 01-14-2016 17:00:29.093 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|79" 01-14-2016 17:00:29.093 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|79" 01-14-2016 17:00:29.093 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|79 01-14-2016 17:00:29.093 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=489, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy, fetchTime=56, locations=[BlockLocation [offset=0, length=1282, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy:0+1282 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=490, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1267, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=490, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy, fetchTime=37, locations=[BlockLocation [offset=0, length=1267, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.093 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy:0+1267 01-14-2016 17:00:29.093 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.094 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.094 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy 01-14-2016 17:00:29.094 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.094 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=491, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1290, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.094 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.24.914574.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|79 01-14-2016 17:00:29.096 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.096 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.096 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.096 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.096 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.096 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.097 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy = 01-14-2016 17:00:29.098 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.130 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.131 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.140 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.140 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.140 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.140 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.140 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.140 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.140 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.140 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.140 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.148 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.148 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.149 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.149 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.149 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.149 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.150 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.150 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.150 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.150 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.150 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|80" 01-14-2016 17:00:29.150 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6306] 01-14-2016 17:00:29.150 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|80" 01-14-2016 17:00:29.150 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=492, msg=IgfsStreamControlRequest [streamId=82, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.150 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=491, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.150 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|80" 01-14-2016 17:00:29.150 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.150 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=492, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy, fetchTime=38, locations=[BlockLocation [offset=0, length=1290, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=82] 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy:0+1290 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6306], readTime=51912975, userTime=98570688] 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy:0+9060 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=493, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6274, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.151 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|80 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.151 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=494, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.151 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.152 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.915621.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|80 01-14-2016 17:00:29.154 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.154 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.154 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.154 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.154 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.154 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.155 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy = 01-14-2016 17:00:29.156 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.156 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=493, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.156 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy, fetchTime=32, locations=[BlockLocation [offset=0, length=6274, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.157 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy:0+6274 01-14-2016 17:00:29.157 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.157 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.157 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy 01-14-2016 17:00:29.158 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.158 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=495, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5760, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.160 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=494, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.160 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.161 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=83] 01-14-2016 17:00:29.161 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=9060]] 01-14-2016 17:00:29.161 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.162 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy:0+9060 01-14-2016 17:00:29.162 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy:0+9060 01-14-2016 17:00:29.163 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=496, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.188 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.189 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.191 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=495, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.191 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=5760, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.192 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy:0+5760 01-14-2016 17:00:29.193 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.193 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.193 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy 01-14-2016 17:00:29.193 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.193 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=497, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5164, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.194 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=496, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.195 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=498, msg=IgfsStreamControlRequest [streamId=83, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.195 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=499, msg=IgfsStreamControlRequest [streamId=83, pos=4096, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.197 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.197 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.197 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.197 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.197 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.197 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.197 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.197 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.197 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.204 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.204 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.204 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.204 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.205 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.205 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.205 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.205 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.206 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.206 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.206 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|81" 01-14-2016 17:00:29.206 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|81" 01-14-2016 17:00:29.206 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|81" 01-14-2016 17:00:29.206 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|81 01-14-2016 17:00:29.206 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.206 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.207 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914522.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|81 01-14-2016 17:00:29.209 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.209 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.209 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.209 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.209 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.209 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.210 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy = 01-14-2016 17:00:29.211 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.223 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=497, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.224 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy, fetchTime=30, locations=[BlockLocation [offset=0, length=5164, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.224 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy:0+5164 01-14-2016 17:00:29.224 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy 01-14-2016 17:00:29.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=500, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5525, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.242 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.243 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.244 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=498, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.245 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=499, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.245 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=501, msg=IgfsStreamControlRequest [streamId=83, pos=8192, len=868, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.245 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=501, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.247 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=9060] 01-14-2016 17:00:29.247 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=502, msg=IgfsStreamControlRequest [streamId=83, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.248 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=502, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.248 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=83] 01-14-2016 17:00:29.248 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=9060], readTime=52375342, userTime=35191786] 01-14-2016 17:00:29.249 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy:0+7378 01-14-2016 17:00:29.251 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.251 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.251 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.251 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.251 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.251 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.251 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.251 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.251 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.251 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.252 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=503, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.257 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=503, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.257 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.257 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=84] 01-14-2016 17:00:29.258 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7378]] 01-14-2016 17:00:29.258 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.258 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy:0+7378 01-14-2016 17:00:29.259 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy:0+7378 01-14-2016 17:00:29.259 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.259 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.260 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.260 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.260 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=504, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.261 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.261 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.261 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.261 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.261 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=504, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.261 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.261 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.261 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|82" 01-14-2016 17:00:29.262 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|82" 01-14-2016 17:00:29.262 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|82" 01-14-2016 17:00:29.262 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|82 01-14-2016 17:00:29.262 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.262 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.262 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=505, msg=IgfsStreamControlRequest [streamId=84, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.262 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=506, msg=IgfsStreamControlRequest [streamId=84, pos=4096, len=3282, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.263 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.915756.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|82 01-14-2016 17:00:29.265 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.265 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.265 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.265 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.265 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.265 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.266 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy = 01-14-2016 17:00:29.267 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.275 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=500, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.276 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy, fetchTime=50, locations=[BlockLocation [offset=0, length=5525, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.276 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy:0+5525 01-14-2016 17:00:29.276 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.276 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.276 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy 01-14-2016 17:00:29.276 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.277 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=507, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6528, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.286 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=505, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.293 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=506, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.295 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7378] 01-14-2016 17:00:29.295 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=508, msg=IgfsStreamControlRequest [streamId=84, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.295 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=508, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.295 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=84] 01-14-2016 17:00:29.306 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.307 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.317 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.317 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.317 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.317 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.317 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.317 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.317 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.317 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.317 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.319 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=7378], readTime=32442300, userTime=5777256] 01-14-2016 17:00:29.320 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy:0+1768 01-14-2016 17:00:29.321 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=509, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.325 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.325 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.326 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.326 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.326 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=509, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.326 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.326 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=85] 01-14-2016 17:00:29.326 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1768]] 01-14-2016 17:00:29.327 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.327 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.327 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.327 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.327 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.327 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy:0+1768 01-14-2016 17:00:29.327 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.327 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.327 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy:0+1768 01-14-2016 17:00:29.327 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|83" 01-14-2016 17:00:29.327 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|83" 01-14-2016 17:00:29.327 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|83" 01-14-2016 17:00:29.327 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|83 01-14-2016 17:00:29.327 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.328 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.328 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=510, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.328 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.32.915485.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|83 01-14-2016 17:00:29.329 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=507, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.329 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy, fetchTime=53, locations=[BlockLocation [offset=0, length=6528, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.329 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy:0+6528 01-14-2016 17:00:29.329 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.330 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.330 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.330 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.330 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.330 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.330 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.330 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.330 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy 01-14-2016 17:00:29.330 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.331 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=511, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5815, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.331 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy = 01-14-2016 17:00:29.331 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=510, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.331 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.331 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=512, msg=IgfsStreamControlRequest [streamId=85, pos=0, len=1768, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.351 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=512, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.352 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1768] 01-14-2016 17:00:29.352 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=513, msg=IgfsStreamControlRequest [streamId=85, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.352 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=513, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.352 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=85] 01-14-2016 17:00:29.352 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1768], readTime=20403369, userTime=5742402] 01-14-2016 17:00:29.353 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy:0+8411 01-14-2016 17:00:29.354 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.356 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=514, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.356 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=511, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.356 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=5815, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.357 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy:0+5815 01-14-2016 17:00:29.357 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.357 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.357 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy 01-14-2016 17:00:29.358 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.358 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=515, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5625, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.359 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=514, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.360 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.360 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.360 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=86] 01-14-2016 17:00:29.360 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8411]] 01-14-2016 17:00:29.360 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.360 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy:0+8411 01-14-2016 17:00:29.361 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.361 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy:0+8411 01-14-2016 17:00:29.361 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=516, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.362 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=516, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.363 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=517, msg=IgfsStreamControlRequest [streamId=86, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.364 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=518, msg=IgfsStreamControlRequest [streamId=86, pos=4096, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.366 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.366 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.366 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.366 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.366 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.366 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.366 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.366 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.366 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.373 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.373 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.373 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.373 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.374 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.374 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.374 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.374 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.374 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.375 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.375 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|84" 01-14-2016 17:00:29.375 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|84" 01-14-2016 17:00:29.375 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|84" 01-14-2016 17:00:29.375 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|84 01-14-2016 17:00:29.375 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.375 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.376 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.26.914688.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|84 01-14-2016 17:00:29.377 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.377 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.377 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.377 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.378 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.378 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.379 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy = 01-14-2016 17:00:29.380 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.382 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=517, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.383 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=518, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=519, msg=IgfsStreamControlRequest [streamId=86, pos=8192, len=219, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=519, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.386 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8411] 01-14-2016 17:00:29.386 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=520, msg=IgfsStreamControlRequest [streamId=86, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.386 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=515, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.387 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=5625, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.387 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy:0+5625 01-14-2016 17:00:29.387 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.387 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.388 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy 01-14-2016 17:00:29.388 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.388 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=521, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6189, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.389 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=520, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.391 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=86] 01-14-2016 17:00:29.391 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=8411], readTime=24484342, userTime=4537014] 01-14-2016 17:00:29.391 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy:0+6346 01-14-2016 17:00:29.391 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.393 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=522, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.397 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=522, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.397 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.397 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=87] 01-14-2016 17:00:29.397 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6346]] 01-14-2016 17:00:29.397 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.398 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy:0+6346 01-14-2016 17:00:29.398 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy:0+6346 01-14-2016 17:00:29.398 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=523, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.399 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=523, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.400 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=524, msg=IgfsStreamControlRequest [streamId=87, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.400 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=525, msg=IgfsStreamControlRequest [streamId=87, pos=4096, len=2250, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.414 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=521, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.414 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=6189, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.415 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy:0+6189 01-14-2016 17:00:29.415 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.415 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.415 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy 01-14-2016 17:00:29.416 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.416 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=526, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5240, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=524, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=525, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.419 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.420 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6346] 01-14-2016 17:00:29.420 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=527, msg=IgfsStreamControlRequest [streamId=87, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.421 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.421 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=527, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.421 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=87] 01-14-2016 17:00:29.421 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6346], readTime=19929592, userTime=4141223] 01-14-2016 17:00:29.422 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy:0+5890 01-14-2016 17:00:29.423 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.425 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=528, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.428 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=528, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.429 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.429 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=88] 01-14-2016 17:00:29.429 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5890]] 01-14-2016 17:00:29.429 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.429 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.429 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.429 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.429 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.429 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.429 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.429 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.429 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.429 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.430 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy:0+5890 01-14-2016 17:00:29.430 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy:0+5890 01-14-2016 17:00:29.431 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=529, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.432 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=529, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.432 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=530, msg=IgfsStreamControlRequest [streamId=88, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.433 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=531, msg=IgfsStreamControlRequest [streamId=88, pos=4096, len=1794, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.436 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.436 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.437 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.437 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.437 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.437 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.437 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.437 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.438 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.438 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.438 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|85" 01-14-2016 17:00:29.438 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|85" 01-14-2016 17:00:29.438 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|85" 01-14-2016 17:00:29.438 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|85 01-14-2016 17:00:29.438 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.438 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.438 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.4.914200.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|85 01-14-2016 17:00:29.440 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.440 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.440 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.440 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.440 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.440 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.442 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy = 01-14-2016 17:00:29.442 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.443 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=526, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.444 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=5240, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.444 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy:0+5240 01-14-2016 17:00:29.444 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.445 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.445 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy 01-14-2016 17:00:29.445 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.446 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=532, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5277, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.468 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.469 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.475 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.475 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.475 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.475 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.475 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.475 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.475 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.475 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.475 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.480 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.480 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.480 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.480 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.481 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.481 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.481 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.481 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.481 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.481 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.481 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|86" 01-14-2016 17:00:29.481 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|86" 01-14-2016 17:00:29.481 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|86" 01-14-2016 17:00:29.481 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|86 01-14-2016 17:00:29.481 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.482 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.482 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.28.914550.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|86 01-14-2016 17:00:29.484 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.484 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.484 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.484 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.484 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.484 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.485 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy = 01-14-2016 17:00:29.485 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.509 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=532, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.510 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy, fetchTime=65, locations=[BlockLocation [offset=0, length=5277, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.510 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy:0+5277 01-14-2016 17:00:29.510 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy 01-14-2016 17:00:29.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.511 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=533, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5481, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.513 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.513 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.519 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.519 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.519 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.519 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.519 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.519 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.519 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.519 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.519 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.524 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.524 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.525 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.525 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.525 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.525 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.526 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.526 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.526 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.526 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.526 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|87" 01-14-2016 17:00:29.526 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|87" 01-14-2016 17:00:29.526 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|87" 01-14-2016 17:00:29.526 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|87 01-14-2016 17:00:29.526 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=533, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.536 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy, fetchTime=25, locations=[BlockLocation [offset=0, length=5481, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.536 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy:0+5481 01-14-2016 17:00:29.537 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.537 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.537 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy 01-14-2016 17:00:29.537 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.538 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=534, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1375, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.561 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=534, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.562 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy, fetchTime=24, locations=[BlockLocation [offset=0, length=1375, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.562 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy:0+1375 01-14-2016 17:00:29.562 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.562 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.563 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy 01-14-2016 17:00:29.563 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.563 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=535, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5241, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=530, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.626 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=531, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=535, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.627 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy, fetchTime=64, locations=[BlockLocation [offset=0, length=5241, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.627 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy:0+5241 01-14-2016 17:00:29.627 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.627 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916068.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|87 01-14-2016 17:00:29.628 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.628 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.628 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5890] 01-14-2016 17:00:29.628 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.628 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.628 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.628 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=536, msg=IgfsStreamControlRequest [streamId=88, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.628 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy 01-14-2016 17:00:29.628 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.628 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.628 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=536, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.629 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.629 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.629 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=88] 01-14-2016 17:00:29.629 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=537, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5523, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.629 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5890], readTime=195408743, userTime=4490369] 01-14-2016 17:00:29.629 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy:0+5675 01-14-2016 17:00:29.630 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy = 01-14-2016 17:00:29.630 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.631 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.632 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=538, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.655 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=537, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.655 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=5523, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.655 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy:0+5523 01-14-2016 17:00:29.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy 01-14-2016 17:00:29.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=539, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6119, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.658 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=538, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.658 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=89] 01-14-2016 17:00:29.659 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5675]] 01-14-2016 17:00:29.659 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.659 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy:0+5675 01-14-2016 17:00:29.660 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy:0+5675 01-14-2016 17:00:29.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=540, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.661 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.662 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.670 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.670 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.670 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.670 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.670 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.670 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.670 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.670 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.670 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.677 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.677 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.677 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.677 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.677 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.677 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.678 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.678 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.678 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.678 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.678 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|88" 01-14-2016 17:00:29.678 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|88" 01-14-2016 17:00:29.678 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|88" 01-14-2016 17:00:29.678 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|88 01-14-2016 17:00:29.678 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=539, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.685 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=6119, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.685 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy:0+6119 01-14-2016 17:00:29.685 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.686 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.686 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=540, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.686 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy 01-14-2016 17:00:29.686 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=541, msg=IgfsStreamControlRequest [streamId=89, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=542, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4833, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=543, msg=IgfsStreamControlRequest [streamId=89, pos=4096, len=1579, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.706 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=541, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.706 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=543, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.707 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.708 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915199.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|88 01-14-2016 17:00:29.708 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5675] 01-14-2016 17:00:29.708 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.708 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=544, msg=IgfsStreamControlRequest [streamId=89, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.708 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.708 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.708 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.709 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.709 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.709 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=544, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.709 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=89] 01-14-2016 17:00:29.709 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5675], readTime=21303422, userTime=29176002] 01-14-2016 17:00:29.710 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy = 01-14-2016 17:00:29.710 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy:0+5284 01-14-2016 17:00:29.710 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.711 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.713 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=545, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.716 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=545, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.716 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.716 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=90] 01-14-2016 17:00:29.716 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5284]] 01-14-2016 17:00:29.717 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.717 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy:0+5284 01-14-2016 17:00:29.717 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy:0+5284 01-14-2016 17:00:29.718 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=546, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=546, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.720 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=547, msg=IgfsStreamControlRequest [streamId=90, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.720 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=548, msg=IgfsStreamControlRequest [streamId=90, pos=4096, len=1188, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=542, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.732 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy, fetchTime=46, locations=[BlockLocation [offset=0, length=4833, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.732 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy:0+4833 01-14-2016 17:00:29.733 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.733 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.734 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy 01-14-2016 17:00:29.734 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.734 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=549, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5293, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.737 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.737 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=547, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.737 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=548, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.738 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.739 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5284] 01-14-2016 17:00:29.739 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=550, msg=IgfsStreamControlRequest [streamId=90, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.739 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=550, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.740 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=90] 01-14-2016 17:00:29.740 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5284], readTime=18392634, userTime=4860232] 01-14-2016 17:00:29.740 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy:0+6426 01-14-2016 17:00:29.742 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.743 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=551, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.744 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.744 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.744 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.744 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.744 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.744 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.744 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.744 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.744 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.747 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=551, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.747 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.747 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=91] 01-14-2016 17:00:29.748 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6426]] 01-14-2016 17:00:29.748 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.748 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy:0+6426 01-14-2016 17:00:29.748 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy:0+6426 01-14-2016 17:00:29.749 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=552, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.750 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=552, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.750 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.750 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.750 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.750 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.751 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=553, msg=IgfsStreamControlRequest [streamId=91, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.751 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=554, msg=IgfsStreamControlRequest [streamId=91, pos=4096, len=2330, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.751 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.751 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.751 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.751 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.752 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.752 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.752 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|89" 01-14-2016 17:00:29.752 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|89" 01-14-2016 17:00:29.752 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|89" 01-14-2016 17:00:29.752 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|89 01-14-2016 17:00:29.752 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.752 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.753 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915355.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|89 01-14-2016 17:00:29.754 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.754 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.755 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.755 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.755 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.755 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.756 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy = 01-14-2016 17:00:29.756 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.783 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.783 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.795 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=549, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.795 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy, fetchTime=61, locations=[BlockLocation [offset=0, length=5293, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.795 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy:0+5293 01-14-2016 17:00:29.795 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.796 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.796 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.796 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.796 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.796 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.796 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy 01-14-2016 17:00:29.796 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.797 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=555, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5871, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.797 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.797 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.797 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.797 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.797 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.797 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.797 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|90" 01-14-2016 17:00:29.797 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|90" 01-14-2016 17:00:29.797 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|90" 01-14-2016 17:00:29.797 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|90 01-14-2016 17:00:29.797 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.801 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=553, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.841 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=554, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=555, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.842 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy, fetchTime=46, locations=[BlockLocation [offset=0, length=5871, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.842 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy:0+5871 01-14-2016 17:00:29.842 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.842 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.842 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915337.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|90 01-14-2016 17:00:29.842 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.843 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy 01-14-2016 17:00:29.843 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6426] 01-14-2016 17:00:29.843 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.843 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.843 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.843 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=556, msg=IgfsStreamControlRequest [streamId=91, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.843 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.843 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.843 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=557, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5138, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=556, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=91] 01-14-2016 17:00:29.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6426], readTime=92451842, userTime=4427071] 01-14-2016 17:00:29.844 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy = 01-14-2016 17:00:29.845 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.845 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy:0+6047 01-14-2016 17:00:29.845 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:29.846 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.847 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=558, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.869 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=557, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.870 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=5138, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.870 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy:0+5138 01-14-2016 17:00:29.870 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.870 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.871 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy 01-14-2016 17:00:29.871 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.871 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.871 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=559, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5929, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.871 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.873 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=558, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.873 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.873 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=92] 01-14-2016 17:00:29.873 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6047]] 01-14-2016 17:00:29.873 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.873 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy:0+6047 01-14-2016 17:00:29.873 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy:0+6047 01-14-2016 17:00:29.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=560, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.877 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.877 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.877 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.877 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.877 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.877 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.877 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.877 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.877 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.882 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.882 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.882 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.882 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.883 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.883 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.883 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.883 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.884 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.884 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.884 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|91" 01-14-2016 17:00:29.884 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|91" 01-14-2016 17:00:29.884 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|91" 01-14-2016 17:00:29.884 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|91 01-14-2016 17:00:29.884 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.896 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=559, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.896 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy, fetchTime=25, locations=[BlockLocation [offset=0, length=5929, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.896 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=560, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.896 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy:0+5929 01-14-2016 17:00:29.896 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.897 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=561, msg=IgfsStreamControlRequest [streamId=92, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.897 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=562, msg=IgfsStreamControlRequest [streamId=92, pos=4096, len=1951, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy 01-14-2016 17:00:29.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.898 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=563, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=1264, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.914 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=561, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.914 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=562, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.915 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.915 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914644.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|91 01-14-2016 17:00:29.915 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6047] 01-14-2016 17:00:29.916 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=564, msg=IgfsStreamControlRequest [streamId=92, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.916 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.916 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.916 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.916 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.916 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=564, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.916 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.916 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.916 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=92] 01-14-2016 17:00:29.916 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6047], readTime=18472627, userTime=24897171] 01-14-2016 17:00:29.917 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy:0+6205 01-14-2016 17:00:29.917 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy = 01-14-2016 17:00:29.917 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.918 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.920 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=565, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.923 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=565, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.923 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.923 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=93] 01-14-2016 17:00:29.924 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6205]] 01-14-2016 17:00:29.924 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.924 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy:0+6205 01-14-2016 17:00:29.924 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy:0+6205 01-14-2016 17:00:29.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=566, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.926 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=566, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.927 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=567, msg=IgfsStreamControlRequest [streamId=93, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.927 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=568, msg=IgfsStreamControlRequest [streamId=93, pos=4096, len=2109, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.939 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=563, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.939 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy, fetchTime=41, locations=[BlockLocation [offset=0, length=1264, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.939 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy:0+1264 01-14-2016 17:00:29.939 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.940 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.940 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy 01-14-2016 17:00:29.940 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.940 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=569, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=6885, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.943 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=567, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.943 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=568, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.945 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6205] 01-14-2016 17:00:29.945 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=570, msg=IgfsStreamControlRequest [streamId=93, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.945 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=570, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.946 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=93] 01-14-2016 17:00:29.946 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6205], readTime=17824883, userTime=4219206] 01-14-2016 17:00:29.946 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy:0+5163 01-14-2016 17:00:29.947 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.947 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.948 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:29.949 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=571, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.952 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=571, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.952 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.952 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=94] 01-14-2016 17:00:29.952 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5163]] 01-14-2016 17:00:29.952 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.953 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy:0+5163 01-14-2016 17:00:29.953 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy:0+5163 01-14-2016 17:00:29.954 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=572, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.955 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=572, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.955 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:29.955 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:29.955 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=573, msg=IgfsStreamControlRequest [streamId=94, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.955 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:29.955 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:29.955 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:29.955 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:29.955 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:29.955 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:29.955 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:29.955 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=574, msg=IgfsStreamControlRequest [streamId=94, pos=4096, len=1067, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.962 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:29.962 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:29.962 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.962 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.963 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.963 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:29.963 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:29.963 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:29.963 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:29.963 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:29.963 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|92" 01-14-2016 17:00:29.963 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|92" 01-14-2016 17:00:29.963 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|92" 01-14-2016 17:00:29.963 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|92 01-14-2016 17:00:29.963 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:29.964 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:29.964 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.915854.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|92 01-14-2016 17:00:29.966 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.966 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.966 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.966 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:29.966 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:29.966 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:29.967 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy = 01-14-2016 17:00:29.967 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:29.968 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=569, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.968 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=6885, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.968 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy:0+6885 01-14-2016 17:00:29.968 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.969 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.969 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy 01-14-2016 17:00:29.969 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.969 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=575, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5171, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.972 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=573, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.972 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=574, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.973 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5163] 01-14-2016 17:00:29.974 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=576, msg=IgfsStreamControlRequest [streamId=94, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:29.974 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=576, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.974 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=94] 01-14-2016 17:00:29.974 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5163], readTime=17902058, userTime=4175391] 01-14-2016 17:00:29.975 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy:0+5763 01-14-2016 17:00:29.976 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:29.978 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=577, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:29.981 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=577, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.981 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:29.981 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=95] 01-14-2016 17:00:29.981 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5763]] 01-14-2016 17:00:29.982 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:29.982 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy:0+5763 01-14-2016 17:00:29.982 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy:0+5763 01-14-2016 17:00:29.983 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=578, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:29.983 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=578, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.984 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=579, msg=IgfsStreamControlRequest [streamId=95, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.984 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=580, msg=IgfsStreamControlRequest [streamId=95, pos=4096, len=1667, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:29.996 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=575, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:29.997 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=5171, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:29.997 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy:0+5171 01-14-2016 17:00:29.997 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.997 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:29.998 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy 01-14-2016 17:00:29.998 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:29.998 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:29.998 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=581, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5692, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:29.999 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.001 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=579, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.001 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=580, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.002 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5763] 01-14-2016 17:00:30.003 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=582, msg=IgfsStreamControlRequest [streamId=95, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.003 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=582, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.003 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=95] 01-14-2016 17:00:30.004 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5763], readTime=18422763, userTime=3784148] 01-14-2016 17:00:30.004 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy:0+1279 01-14-2016 17:00:30.005 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.007 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=583, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.012 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=583, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.012 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.012 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=96] 01-14-2016 17:00:30.012 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1279]] 01-14-2016 17:00:30.013 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.013 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy:0+1279 01-14-2016 17:00:30.013 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy:0+1279 01-14-2016 17:00:30.014 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=584, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.014 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.014 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.014 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.014 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.015 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.015 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.015 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.015 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.016 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.016 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.016 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|93" 01-14-2016 17:00:30.016 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|93" 01-14-2016 17:00:30.016 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|93" 01-14-2016 17:00:30.016 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|93 01-14-2016 17:00:30.016 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.016 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.016 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=584, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.017 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916188.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|93 01-14-2016 17:00:30.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=585, msg=IgfsStreamControlRequest [streamId=96, pos=0, len=1279, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.018 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.018 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.018 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.018 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.019 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.019 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.020 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy = 01-14-2016 17:00:30.020 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.031 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=581, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.031 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=5692, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.032 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy:0+5692 01-14-2016 17:00:30.032 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.032 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.033 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy 01-14-2016 17:00:30.033 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.033 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=586, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5309, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.042 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=585, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.044 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1279] 01-14-2016 17:00:30.045 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=587, msg=IgfsStreamControlRequest [streamId=96, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.045 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=587, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.045 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=96] 01-14-2016 17:00:30.046 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1279], readTime=27038665, userTime=6072103] 01-14-2016 17:00:30.047 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy:0+5334 01-14-2016 17:00:30.049 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.049 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.050 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.052 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=588, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=588, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.056 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=97] 01-14-2016 17:00:30.056 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5334]] 01-14-2016 17:00:30.057 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.057 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.057 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.057 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.057 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.057 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.057 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.057 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.057 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.057 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.057 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy:0+5334 01-14-2016 17:00:30.057 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy:0+5334 01-14-2016 17:00:30.058 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=589, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.060 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=586, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.061 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=5309, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.061 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy:0+5309 01-14-2016 17:00:30.061 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.062 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.062 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy 01-14-2016 17:00:30.062 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.062 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.062 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.063 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.063 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.063 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=590, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4219, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.063 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=589, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.063 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.063 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.064 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=591, msg=IgfsStreamControlRequest [streamId=97, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.064 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.064 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=592, msg=IgfsStreamControlRequest [streamId=97, pos=4096, len=1238, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.064 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.064 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.064 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.064 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|94" 01-14-2016 17:00:30.064 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|94" 01-14-2016 17:00:30.065 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|94" 01-14-2016 17:00:30.065 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|94 01-14-2016 17:00:30.065 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.065 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.065 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916389.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|94 01-14-2016 17:00:30.067 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.067 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.067 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.067 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.067 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.067 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.068 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy = 01-14-2016 17:00:30.069 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.083 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=591, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=592, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5334] 01-14-2016 17:00:30.085 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=593, msg=IgfsStreamControlRequest [streamId=97, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.086 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=593, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.086 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=97] 01-14-2016 17:00:30.086 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5334], readTime=21370689, userTime=8574163] 01-14-2016 17:00:30.087 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy:0+6597 01-14-2016 17:00:30.088 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.090 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=594, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.090 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=590, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.090 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=4219, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.091 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy:0+4219 01-14-2016 17:00:30.091 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.091 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.091 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy 01-14-2016 17:00:30.091 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.092 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=595, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3897, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.094 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=594, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.094 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.094 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=98] 01-14-2016 17:00:30.094 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6597]] 01-14-2016 17:00:30.095 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.095 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy:0+6597 01-14-2016 17:00:30.095 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy:0+6597 01-14-2016 17:00:30.096 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=596, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.097 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=596, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.097 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=597, msg=IgfsStreamControlRequest [streamId=98, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.098 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=598, msg=IgfsStreamControlRequest [streamId=98, pos=4096, len=2501, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.108 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.110 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.117 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.117 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.117 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.117 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.117 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.117 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.117 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.117 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.117 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.121 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=595, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.122 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy, fetchTime=30, locations=[BlockLocation [offset=0, length=3897, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.122 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy:0+3897 01-14-2016 17:00:30.122 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.122 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.123 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy 01-14-2016 17:00:30.123 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.124 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=599, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3682, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.124 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.124 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.125 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.125 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.126 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.126 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.126 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.126 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.126 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.126 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.126 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|95" 01-14-2016 17:00:30.126 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|95" 01-14-2016 17:00:30.126 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|95" 01-14-2016 17:00:30.126 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|95 01-14-2016 17:00:30.127 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.127 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=597, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.127 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.127 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=598, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.127 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916359.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|95 01-14-2016 17:00:30.129 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6597] 01-14-2016 17:00:30.129 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=600, msg=IgfsStreamControlRequest [streamId=98, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.129 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.129 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.129 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.129 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.129 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.129 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.130 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=600, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.130 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=98] 01-14-2016 17:00:30.130 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6597], readTime=31393074, userTime=4403029] 01-14-2016 17:00:30.131 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy = 01-14-2016 17:00:30.131 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy:0+4783 01-14-2016 17:00:30.131 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.132 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.133 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=601, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.137 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=601, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.137 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.138 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=99] 01-14-2016 17:00:30.138 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4783]] 01-14-2016 17:00:30.138 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.138 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy:0+4783 01-14-2016 17:00:30.138 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy:0+4783 01-14-2016 17:00:30.139 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=602, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.140 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=602, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.141 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=603, msg=IgfsStreamControlRequest [streamId=99, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.141 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=604, msg=IgfsStreamControlRequest [streamId=99, pos=4096, len=687, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.154 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=599, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.154 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy, fetchTime=31, locations=[BlockLocation [offset=0, length=3682, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.154 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy:0+3682 01-14-2016 17:00:30.155 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.155 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.155 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy 01-14-2016 17:00:30.155 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.156 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=605, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4975, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.158 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=603, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.159 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=604, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.159 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4783] 01-14-2016 17:00:30.159 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=606, msg=IgfsStreamControlRequest [streamId=99, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.160 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=606, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.160 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=99] 01-14-2016 17:00:30.160 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4783], readTime=18143914, userTime=4252105] 01-14-2016 17:00:30.161 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy:0+5708 01-14-2016 17:00:30.162 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.164 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=607, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.165 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.166 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.167 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=607, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.168 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.168 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=100] 01-14-2016 17:00:30.168 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5708]] 01-14-2016 17:00:30.168 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.169 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy:0+5708 01-14-2016 17:00:30.169 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy:0+5708 01-14-2016 17:00:30.170 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=608, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.171 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=608, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.172 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.172 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=609, msg=IgfsStreamControlRequest [streamId=100, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.172 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.172 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.172 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.172 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.172 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.172 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.172 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.172 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.172 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=610, msg=IgfsStreamControlRequest [streamId=100, pos=4096, len=1612, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.177 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.177 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.177 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.177 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.178 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.178 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.178 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.178 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.179 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.179 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.179 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|96" 01-14-2016 17:00:30.179 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|96" 01-14-2016 17:00:30.179 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|96" 01-14-2016 17:00:30.179 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.179 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|96 01-14-2016 17:00:30.179 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.179 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914104.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|96 01-14-2016 17:00:30.180 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.180 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.180 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.180 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.180 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.180 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.181 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy = 01-14-2016 17:00:30.181 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.184 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=605, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.184 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy, fetchTime=29, locations=[BlockLocation [offset=0, length=4975, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.184 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy:0+4975 01-14-2016 17:00:30.184 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.185 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.185 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy 01-14-2016 17:00:30.185 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.186 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=611, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4816, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.187 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=609, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.187 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=610, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.209 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.210 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.217 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.217 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.217 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.217 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.217 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.217 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.217 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.217 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.217 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.223 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.223 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.224 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.224 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.224 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.224 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.224 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.224 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.225 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.225 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5708] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=612, msg=IgfsStreamControlRequest [streamId=100, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=612, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=100] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5708], readTime=16879700, userTime=4774859] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy:0+5876 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=613, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=613, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=101] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5876]] 01-14-2016 17:00:30.225 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|97" 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.225 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|97" 01-14-2016 17:00:30.225 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy:0+5876 01-14-2016 17:00:30.225 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.225 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|97" 01-14-2016 17:00:30.225 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy:0+5876 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=614, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=614, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=615, msg=IgfsStreamControlRequest [streamId=101, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.225 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|97 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=616, msg=IgfsStreamControlRequest [streamId=101, pos=4096, len=1780, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=611, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=4816, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy:0+4816 01-14-2016 17:00:30.226 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=617, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5960, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=615, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=616, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5876] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=618, msg=IgfsStreamControlRequest [streamId=101, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=618, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=101] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5876], readTime=19387174, userTime=4284270] 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy:0+6378 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.226 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=619, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.226 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915674.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|97 01-14-2016 17:00:30.228 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.228 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.228 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.228 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.228 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.228 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.229 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy = 01-14-2016 17:00:30.229 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.256 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.257 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.264 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.264 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.264 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.264 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.264 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.264 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.264 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.264 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.264 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.270 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.270 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.271 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.271 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.271 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.271 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.271 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.272 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.272 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.272 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.272 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|98" 01-14-2016 17:00:30.272 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|98" 01-14-2016 17:00:30.272 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|98" 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=619, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.272 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|98 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=102] 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6378]] 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.272 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.272 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy:0+6378 01-14-2016 17:00:30.272 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy:0+6378 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=620, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=620, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=621, msg=IgfsStreamControlRequest [streamId=102, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=622, msg=IgfsStreamControlRequest [streamId=102, pos=4096, len=2282, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=617, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy, fetchTime=30, locations=[BlockLocation [offset=0, length=5960, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy:0+5960 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.272 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy 01-14-2016 17:00:30.272 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=623, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3341, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=621, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=622, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6378] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=624, msg=IgfsStreamControlRequest [streamId=102, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=624, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=102] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6378], readTime=18284136, userTime=4071840] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy:0+1271 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=625, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=625, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=103] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1271]] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.273 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy:0+1271 01-14-2016 17:00:30.273 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy:0+1271 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=626, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=626, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=627, msg=IgfsStreamControlRequest [streamId=103, pos=0, len=1271, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.273 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914920.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|98 01-14-2016 17:00:30.275 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.275 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.275 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.275 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.276 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.276 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.277 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy = 01-14-2016 17:00:30.277 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.308 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.309 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.316 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.316 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.316 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.316 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.316 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.316 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.316 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.316 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.316 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.323 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.323 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.323 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.323 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.324 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.324 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.324 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.324 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.325 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.325 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.325 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|99" 01-14-2016 17:00:30.325 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|99" 01-14-2016 17:00:30.325 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|99" 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=623, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy, fetchTime=29, locations=[BlockLocation [offset=0, length=3341, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.325 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|99 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy:0+3341 01-14-2016 17:00:30.325 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.325 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=628, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4458, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=627, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1271] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=629, msg=IgfsStreamControlRequest [streamId=103, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=628, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=4458, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy:0+4458 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=630, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5111, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=629, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=103] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1271], readTime=43208665, userTime=3976564] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy:0+4792 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=631, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=631, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=104] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4792]] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.325 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy:0+4792 01-14-2016 17:00:30.325 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy:0+4792 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=632, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=632, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=633, msg=IgfsStreamControlRequest [streamId=104, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.325 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=634, msg=IgfsStreamControlRequest [streamId=104, pos=4096, len=696, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.326 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916230.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|99 01-14-2016 17:00:30.327 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.327 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.327 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.327 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.327 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.327 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.329 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy = 01-14-2016 17:00:30.329 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.330 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=630, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.331 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=5111, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.331 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy:0+5111 01-14-2016 17:00:30.331 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.332 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=633, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy 01-14-2016 17:00:30.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.333 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=635, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4220, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.333 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=634, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.366 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.367 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.375 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.375 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.375 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.375 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.375 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.375 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.375 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.375 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.375 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.382 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.382 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.382 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.382 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.383 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.383 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.383 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.383 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.384 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.384 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.384 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|100" 01-14-2016 17:00:30.384 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|100" 01-14-2016 17:00:30.384 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|100" 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4792] 01-14-2016 17:00:30.384 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|100 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=636, msg=IgfsStreamControlRequest [streamId=104, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=636, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.384 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=104] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4792], readTime=19441285, userTime=4186541] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy:0+5757 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=637, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=637, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=105] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5757]] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.384 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy:0+5757 01-14-2016 17:00:30.384 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy:0+5757 01-14-2016 17:00:30.384 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=638, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=638, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=639, msg=IgfsStreamControlRequest [streamId=105, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=640, msg=IgfsStreamControlRequest [streamId=105, pos=4096, len=1661, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=635, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=4220, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy:0+4220 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=641, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4690, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=639, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=640, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5757] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=642, msg=IgfsStreamControlRequest [streamId=105, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=642, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=105] 01-14-2016 17:00:30.384 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5757], readTime=18181565, userTime=4179428] 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy:0+6245 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=643, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=643, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=106] 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6245]] 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.385 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy:0+6245 01-14-2016 17:00:30.385 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy:0+6245 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=644, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=644, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=645, msg=IgfsStreamControlRequest [streamId=106, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.385 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=646, msg=IgfsStreamControlRequest [streamId=106, pos=4096, len=2149, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.385 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.913942.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|100 01-14-2016 17:00:30.386 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.386 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.386 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.386 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.387 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.387 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.387 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy = 01-14-2016 17:00:30.388 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.413 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.414 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.422 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.423 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.423 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.423 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.423 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.428 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.428 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.428 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.428 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.429 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.429 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.429 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.429 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.429 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.429 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.429 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|101" 01-14-2016 17:00:30.430 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|101" 01-14-2016 17:00:30.429 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=641, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.430 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|101" 01-14-2016 17:00:30.430 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy, fetchTime=25, locations=[BlockLocation [offset=0, length=4690, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.430 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|101 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy:0+4690 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.430 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=647, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4037, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=645, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=646, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6245] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=648, msg=IgfsStreamControlRequest [streamId=106, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=648, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=106] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6245], readTime=33745373, userTime=4431987] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy:0+1282 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=649, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=649, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=107] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1282]] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.430 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy:0+1282 01-14-2016 17:00:30.430 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy:0+1282 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=650, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=650, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=651, msg=IgfsStreamControlRequest [streamId=107, pos=0, len=1282, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.430 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914868.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|101 01-14-2016 17:00:30.432 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.432 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.432 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.432 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.432 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.432 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.433 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy = 01-14-2016 17:00:30.434 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.464 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.465 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.472 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.472 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.472 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.472 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.472 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.472 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.472 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.472 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.472 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.478 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.478 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.478 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.478 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.479 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.479 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.479 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.479 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.479 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.480 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.480 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|102" 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=647, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.480 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|102" 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy, fetchTime=46, locations=[BlockLocation [offset=0, length=4037, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.480 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|102" 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy:0+4037 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy 01-14-2016 17:00:30.480 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|102 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=652, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3775, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.480 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.480 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=651, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1282] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=653, msg=IgfsStreamControlRequest [streamId=107, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=653, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=107] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1282], readTime=19160416, userTime=3827991] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy:0+1267 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=654, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=654, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=108] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1267]] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.480 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy:0+1267 01-14-2016 17:00:30.480 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy:0+1267 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=655, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=655, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=656, msg=IgfsStreamControlRequest [streamId=108, pos=0, len=1267, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=652, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy, fetchTime=25, locations=[BlockLocation [offset=0, length=3775, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy:0+3775 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=657, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5185, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.481 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|102 01-14-2016 17:00:30.482 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.482 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.482 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.482 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.482 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=656, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.482 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.482 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.483 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1267] 01-14-2016 17:00:30.483 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy = 01-14-2016 17:00:30.483 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=658, msg=IgfsStreamControlRequest [streamId=108, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.484 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.484 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=658, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.484 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=108] 01-14-2016 17:00:30.484 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1267], readTime=33110997, userTime=3903120] 01-14-2016 17:00:30.485 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy:0+1290 01-14-2016 17:00:30.486 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=659, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.490 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=657, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.490 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=5185, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.490 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy:0+5185 01-14-2016 17:00:30.491 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.491 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.491 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy 01-14-2016 17:00:30.491 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.492 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=660, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4710, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.492 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=659, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.492 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.492 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=109] 01-14-2016 17:00:30.493 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1290]] 01-14-2016 17:00:30.493 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.493 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy:0+1290 01-14-2016 17:00:30.493 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy:0+1290 01-14-2016 17:00:30.494 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=661, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.495 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=661, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.495 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=662, msg=IgfsStreamControlRequest [streamId=109, pos=0, len=1290, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.510 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.511 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.513 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=662, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.517 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.517 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.517 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.517 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.517 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.517 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.517 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.517 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.517 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.523 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.523 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.524 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.524 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.525 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.525 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.525 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.525 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.526 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.526 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.526 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|103" 01-14-2016 17:00:30.526 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|103" 01-14-2016 17:00:30.526 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|103" 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1290] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=663, msg=IgfsStreamControlRequest [streamId=109, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=663, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=109] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1290], readTime=18769939, userTime=3190802] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy:0+6274 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=664, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=660, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=4710, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy:0+4710 01-14-2016 17:00:30.526 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.526 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|103 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=665, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4167, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=664, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=110] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6274]] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.526 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.526 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy:0+6274 01-14-2016 17:00:30.526 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy:0+6274 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=666, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=666, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=667, msg=IgfsStreamControlRequest [streamId=110, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=668, msg=IgfsStreamControlRequest [streamId=110, pos=4096, len=2178, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.526 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914202.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|103 01-14-2016 17:00:30.527 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.527 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.527 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.527 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.527 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.527 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.528 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy = 01-14-2016 17:00:30.528 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.545 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=667, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.545 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=668, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.557 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.558 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.564 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.565 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.565 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.565 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.565 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.565 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.565 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.565 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.565 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.570 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.570 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.570 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.570 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.571 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.571 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.571 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.571 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.572 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.572 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.572 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|104" 01-14-2016 17:00:30.572 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|104" 01-14-2016 17:00:30.572 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|104" 01-14-2016 17:00:30.572 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|104 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6274] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=669, msg=IgfsStreamControlRequest [streamId=110, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=665, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.572 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=4167, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy:0+4167 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=670, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4679, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=669, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=110] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6274], readTime=24063658, userTime=4336475] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy:0+5760 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=671, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=671, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=111] 01-14-2016 17:00:30.572 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5760]] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.572 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy:0+5760 01-14-2016 17:00:30.572 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy:0+5760 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=672, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.572 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=672, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.573 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=673, msg=IgfsStreamControlRequest [streamId=111, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.573 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=674, msg=IgfsStreamControlRequest [streamId=111, pos=4096, len=1664, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.573 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916439.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|104 01-14-2016 17:00:30.574 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.575 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.575 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.575 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.575 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.575 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.576 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy = 01-14-2016 17:00:30.577 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.610 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.611 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.618 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.618 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.618 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.618 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.618 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.618 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.618 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.618 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.618 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.625 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.625 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.625 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.625 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.626 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.626 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.626 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.626 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.626 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.626 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.626 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|105" 01-14-2016 17:00:30.626 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|105" 01-14-2016 17:00:30.626 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|105" 01-14-2016 17:00:30.626 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=673, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=674, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5760] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=675, msg=IgfsStreamControlRequest [streamId=111, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=670, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.627 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|105 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=4679, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.627 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy:0+4679 01-14-2016 17:00:30.627 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=676, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3782, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=675, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=111] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5760], readTime=19362717, userTime=3499140] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy:0+5164 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=677, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=677, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=112] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5164]] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.627 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy:0+5164 01-14-2016 17:00:30.627 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy:0+5164 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=678, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=678, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=679, msg=IgfsStreamControlRequest [streamId=112, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=680, msg=IgfsStreamControlRequest [streamId=112, pos=4096, len=1068, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=676, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy, fetchTime=25, locations=[BlockLocation [offset=0, length=3782, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy:0+3782 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=681, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4741, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=679, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.627 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=680, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.627 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916563.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|105 01-14-2016 17:00:30.629 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.629 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.629 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.629 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.630 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.630 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.631 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy = 01-14-2016 17:00:30.631 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.660 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.661 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.667 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.667 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.667 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.667 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.667 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.667 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.667 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.667 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.667 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.673 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.673 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.673 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.673 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.673 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.673 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.674 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.674 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.674 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.674 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.674 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|106" 01-14-2016 17:00:30.674 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|106" 01-14-2016 17:00:30.674 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|106" 01-14-2016 17:00:30.674 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|106 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5164] 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=682, msg=IgfsStreamControlRequest [streamId=112, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.674 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=682, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.674 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=112] 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5164], readTime=19382326, userTime=23667598] 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy:0+5525 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=683, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=681, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=4741, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy:0+4741 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy 01-14-2016 17:00:30.674 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=684, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4673, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=683, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=113] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5525]] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.675 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy:0+5525 01-14-2016 17:00:30.675 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy:0+5525 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=685, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=685, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=686, msg=IgfsStreamControlRequest [streamId=113, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=687, msg=IgfsStreamControlRequest [streamId=113, pos=4096, len=1429, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=684, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=4673, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy:0+4673 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=688, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3435, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=686, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=687, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.675 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915529.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|106 01-14-2016 17:00:30.677 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.677 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.677 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.677 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.677 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.677 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.678 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy = 01-14-2016 17:00:30.678 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.712 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.713 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.719 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.719 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.719 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.719 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.719 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.719 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.719 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.719 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.719 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.725 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.725 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.725 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.725 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.726 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.726 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.726 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.726 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.726 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.726 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.726 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|107" 01-14-2016 17:00:30.726 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|107" 01-14-2016 17:00:30.726 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|107" 01-14-2016 17:00:30.726 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5525] 01-14-2016 17:00:30.727 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.727 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|107 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=689, msg=IgfsStreamControlRequest [streamId=113, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=689, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=113] 01-14-2016 17:00:30.727 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5525], readTime=30706805, userTime=9482750] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy:0+6528 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=690, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=690, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=114] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6528]] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.727 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy:0+6528 01-14-2016 17:00:30.727 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy:0+6528 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=691, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=691, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=692, msg=IgfsStreamControlRequest [streamId=114, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=693, msg=IgfsStreamControlRequest [streamId=114, pos=4096, len=2432, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=688, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy, fetchTime=31, locations=[BlockLocation [offset=0, length=3435, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy:0+3435 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=694, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3821, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=692, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.727 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=693, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.727 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913890.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|107 01-14-2016 17:00:30.727 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.728 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.728 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.728 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.728 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.728 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.729 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy = 01-14-2016 17:00:30.729 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.756 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.757 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.763 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.763 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.763 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.763 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.763 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.763 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.763 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.763 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.763 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.769 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.769 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.769 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.769 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.770 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.770 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.771 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.771 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.771 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.771 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.771 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|108" 01-14-2016 17:00:30.771 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=694, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.771 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|108" 01-14-2016 17:00:30.771 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy, fetchTime=48, locations=[BlockLocation [offset=0, length=3821, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.771 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|108" 01-14-2016 17:00:30.771 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy:0+3821 01-14-2016 17:00:30.771 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.771 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.771 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy 01-14-2016 17:00:30.771 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.771 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=695, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5053, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.771 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=695, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.773 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.773 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=5053, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.773 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy:0+5053 01-14-2016 17:00:30.773 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.773 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.773 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy 01-14-2016 17:00:30.773 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|108 01-14-2016 17:00:30.773 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.773 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.913880.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|108 01-14-2016 17:00:30.774 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.774 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.774 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.774 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.774 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.774 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.776 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy = 01-14-2016 17:00:30.776 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.805 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.805 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.812 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.818 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.818 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.818 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.818 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.819 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.819 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.819 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.819 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.819 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.819 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.819 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.819 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6528] 01-14-2016 17:00:30.819 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=696, msg=IgfsStreamControlRequest [streamId=114, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.819 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=697, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4305, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.819 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=696, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=114] 01-14-2016 17:00:30.819 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|109" 01-14-2016 17:00:30.820 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|109" 01-14-2016 17:00:30.820 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|109" 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6528], readTime=18320527, userTime=72528863] 01-14-2016 17:00:30.819 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.820 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|109 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy:0+5815 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.820 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=698, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=697, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=4305, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy:0+4305 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=699, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5253, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=698, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=115] 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5815]] 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.820 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy:0+5815 01-14-2016 17:00:30.820 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy:0+5815 01-14-2016 17:00:30.820 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=700, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.820 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914156.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|109 01-14-2016 17:00:30.821 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.821 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.821 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.821 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.821 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.821 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.822 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy = 01-14-2016 17:00:30.823 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.856 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.857 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.864 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.865 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.865 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.865 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.865 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.865 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.865 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.865 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.865 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.872 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.872 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.872 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.872 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.873 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.873 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.873 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.873 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.874 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.874 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.874 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|110" 01-14-2016 17:00:30.874 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|110" 01-14-2016 17:00:30.874 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|110" 01-14-2016 17:00:30.874 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|110 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=699, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy, fetchTime=25, locations=[BlockLocation [offset=0, length=5253, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy:0+5253 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=700, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=701, msg=IgfsStreamControlRequest [streamId=115, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=702, msg=IgfsStreamControlRequest [streamId=115, pos=4096, len=1719, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=703, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4296, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=701, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.874 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=702, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.874 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.874 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.875 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.19.916313.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|110 01-14-2016 17:00:30.877 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.877 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.877 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.877 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.877 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.877 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.879 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy = 01-14-2016 17:00:30.879 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.879 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:30.910 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.911 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.917 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.917 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.917 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.917 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.917 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.917 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.917 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.917 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.917 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.923 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.923 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.923 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.923 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.924 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.924 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.924 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.924 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.925 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.925 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.925 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|111" 01-14-2016 17:00:30.925 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|111" 01-14-2016 17:00:30.925 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|111" 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5815] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=704, msg=IgfsStreamControlRequest [streamId=115, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:30.925 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|111 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=704, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=115] 01-14-2016 17:00:30.925 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5815], readTime=37578077, userTime=44414702] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy:0+5625 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:30.925 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=705, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=705, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=116] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5625]] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:30.925 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy:0+5625 01-14-2016 17:00:30.925 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy:0+5625 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=706, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=706, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=707, msg=IgfsStreamControlRequest [streamId=116, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=708, msg=IgfsStreamControlRequest [streamId=116, pos=4096, len=1529, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=703, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy, fetchTime=79, locations=[BlockLocation [offset=0, length=4296, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy:0+4296 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=709, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4752, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=707, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=708, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.926 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916126.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|111 01-14-2016 17:00:30.927 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.927 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.927 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.927 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.927 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.927 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.928 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy = 01-14-2016 17:00:30.928 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:30.964 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:30.965 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:30.975 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:30.975 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:30.975 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:30.975 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:30.975 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:30.975 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:30.975 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:30.975 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:30.975 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:30.984 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:30.984 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:30.984 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.984 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.985 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.985 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:30.985 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:30.985 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:30.985 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:30.985 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:30.985 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|112" 01-14-2016 17:00:30.985 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|112" 01-14-2016 17:00:30.985 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|112" 01-14-2016 17:00:30.985 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|112 01-14-2016 17:00:30.985 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:30.985 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:30.985 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=709, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy, fetchTime=44, locations=[BlockLocation [offset=0, length=4752, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy:0+4752 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=710, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3566, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=710, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=3566, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy:0+3566 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:30.986 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=711, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4869, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:30.986 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914196.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|112 01-14-2016 17:00:30.987 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.988 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.988 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.988 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:30.988 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:30.988 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:30.989 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy = 01-14-2016 17:00:30.989 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.025 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.026 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.034 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.034 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.034 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.034 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.034 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.034 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.034 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.034 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.034 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.041 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.041 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.041 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.041 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.042 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.042 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.042 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.042 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.043 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.043 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.043 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|113" 01-14-2016 17:00:31.043 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|113" 01-14-2016 17:00:31.043 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|113" 01-14-2016 17:00:31.043 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|113 01-14-2016 17:00:31.043 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.043 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5625] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=712, msg=IgfsStreamControlRequest [streamId=116, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=711, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=712, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=4869, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=116] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy:0+4869 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5625], readTime=42626924, userTime=74217145] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy:0+6189 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=713, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4261, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=714, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=713, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=4261, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy:0+4261 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.043 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=715, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3854, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.044 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|113 01-14-2016 17:00:31.045 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=714, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.045 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.045 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=117] 01-14-2016 17:00:31.045 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6189]] 01-14-2016 17:00:31.045 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.046 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.046 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.046 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.046 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.046 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.046 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.046 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy:0+6189 01-14-2016 17:00:31.046 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy:0+6189 01-14-2016 17:00:31.047 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy = 01-14-2016 17:00:31.047 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=716, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.047 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.070 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=715, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.071 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy, fetchTime=29, locations=[BlockLocation [offset=0, length=3854, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.071 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy:0+3854 01-14-2016 17:00:31.071 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=716, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.071 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.072 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.072 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=717, msg=IgfsStreamControlRequest [streamId=117, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.072 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy 01-14-2016 17:00:31.072 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=718, msg=IgfsStreamControlRequest [streamId=117, pos=4096, len=2093, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.072 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.073 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=719, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4610, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.079 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.080 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.086 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.086 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.086 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.086 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.086 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.086 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.086 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.086 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.086 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.091 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.091 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.092 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.092 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.092 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.092 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.092 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.092 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.093 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.093 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.093 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|114" 01-14-2016 17:00:31.093 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|114" 01-14-2016 17:00:31.093 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|114" 01-14-2016 17:00:31.093 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|114 01-14-2016 17:00:31.093 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.093 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.094 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916088.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|114 01-14-2016 17:00:31.095 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.095 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.095 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.095 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.095 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.095 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.096 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy = 01-14-2016 17:00:31.097 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.100 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=717, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.100 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=718, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.102 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6189] 01-14-2016 17:00:31.102 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=720, msg=IgfsStreamControlRequest [streamId=117, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.102 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=720, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.103 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=117] 01-14-2016 17:00:31.103 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6189], readTime=29661071, userTime=27746402] 01-14-2016 17:00:31.103 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy:0+5240 01-14-2016 17:00:31.104 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.106 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=721, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.109 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=721, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.110 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=118] 01-14-2016 17:00:31.110 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5240]] 01-14-2016 17:00:31.110 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.110 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy:0+5240 01-14-2016 17:00:31.111 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy:0+5240 01-14-2016 17:00:31.111 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=722, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.112 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=722, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.113 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=723, msg=IgfsStreamControlRequest [streamId=118, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.113 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=724, msg=IgfsStreamControlRequest [streamId=118, pos=4096, len=1144, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.125 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=719, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.126 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy, fetchTime=53, locations=[BlockLocation [offset=0, length=4610, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.126 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy:0+4610 01-14-2016 17:00:31.126 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.127 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.127 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy 01-14-2016 17:00:31.127 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.127 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.128 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=725, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4356, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.128 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.130 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=723, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.130 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=724, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.136 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.136 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.136 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.136 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.136 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.136 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.136 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.136 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.136 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.144 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.144 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.144 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.144 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.145 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.145 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.145 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.145 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.146 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.146 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.146 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|115" 01-14-2016 17:00:31.146 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|115" 01-14-2016 17:00:31.146 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|115" 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5240] 01-14-2016 17:00:31.146 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|115 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=726, msg=IgfsStreamControlRequest [streamId=118, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=726, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=118] 01-14-2016 17:00:31.146 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5240], readTime=18637725, userTime=4054838] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy:0+5277 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=727, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=727, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.146 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=119] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5277]] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.146 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy:0+5277 01-14-2016 17:00:31.146 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy:0+5277 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=728, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=728, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=729, msg=IgfsStreamControlRequest [streamId=119, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.146 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=730, msg=IgfsStreamControlRequest [streamId=119, pos=4096, len=1181, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.147 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915419.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|115 01-14-2016 17:00:31.148 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.148 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.149 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.149 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.149 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.149 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.150 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy = 01-14-2016 17:00:31.150 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.156 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=725, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.157 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy, fetchTime=29, locations=[BlockLocation [offset=0, length=4356, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.157 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy:0+4356 01-14-2016 17:00:31.157 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.157 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.158 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy 01-14-2016 17:00:31.158 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.158 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=731, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4285, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.161 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=729, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=730, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.186 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.187 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.194 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.194 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.194 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.194 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.194 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.194 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.194 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.194 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.194 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.200 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.200 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.200 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.200 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.201 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.201 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.201 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.201 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.202 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.202 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.202 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|116" 01-14-2016 17:00:31.202 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|116" 01-14-2016 17:00:31.202 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|116" 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5277] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=732, msg=IgfsStreamControlRequest [streamId=119, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=732, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=119] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5277], readTime=18326959, userTime=4310171] 01-14-2016 17:00:31.202 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|116 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy:0+5481 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=733, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=733, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.202 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=120] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5481]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.202 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy:0+5481 01-14-2016 17:00:31.202 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy:0+5481 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=734, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=734, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=735, msg=IgfsStreamControlRequest [streamId=120, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=736, msg=IgfsStreamControlRequest [streamId=120, pos=4096, len=1385, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=731, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=4285, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy:0+4285 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=737, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3487, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=735, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=736, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5481] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=738, msg=IgfsStreamControlRequest [streamId=120, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=738, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=120] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5481], readTime=18160529, userTime=3811862] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy:0+1375 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=739, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=739, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=121] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1375]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.202 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy:0+1375 01-14-2016 17:00:31.202 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy:0+1375 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=740, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=740, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.202 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=741, msg=IgfsStreamControlRequest [streamId=121, pos=0, len=1375, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.202 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.203 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916032.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|116 01-14-2016 17:00:31.204 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.204 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.204 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.204 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.204 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.204 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.205 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy = 01-14-2016 17:00:31.205 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.240 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.240 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.249 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.249 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.249 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.249 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.249 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.249 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.249 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.249 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.249 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.256 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.256 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.256 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.257 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.257 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.257 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.257 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.257 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.258 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.258 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=737, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=3487, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy:0+3487 01-14-2016 17:00:31.258 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|117" 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.258 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|117" 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.258 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|117" 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=742, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4261, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=741, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1375] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=743, msg=IgfsStreamControlRequest [streamId=121, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=743, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=121] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1375], readTime=18188224, userTime=3667802] 01-14-2016 17:00:31.258 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|117 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy:0+5241 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.258 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=744, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=744, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.258 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=122] 01-14-2016 17:00:31.258 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5241]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.259 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy:0+5241 01-14-2016 17:00:31.259 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy:0+5241 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=745, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=745, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=746, msg=IgfsStreamControlRequest [streamId=122, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=747, msg=IgfsStreamControlRequest [streamId=122, pos=4096, len=1145, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=742, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=4261, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy:0+4261 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=746, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=748, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5241, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=747, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5241] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=749, msg=IgfsStreamControlRequest [streamId=122, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=749, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=122] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5241], readTime=18203175, userTime=3597499] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy:0+5523 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=750, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=750, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=123] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5523]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.259 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy:0+5523 01-14-2016 17:00:31.259 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy:0+5523 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=751, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=751, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=752, msg=IgfsStreamControlRequest [streamId=123, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=753, msg=IgfsStreamControlRequest [streamId=123, pos=4096, len=1427, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.259 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.914834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|117 01-14-2016 17:00:31.261 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.261 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.261 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.261 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.261 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.261 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.262 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy = 01-14-2016 17:00:31.262 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.300 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.301 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.311 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.311 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.312 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.312 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.312 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.312 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.312 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.312 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.312 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.320 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.320 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.321 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.321 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.321 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.321 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.322 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.322 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.322 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.322 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.322 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|118" 01-14-2016 17:00:31.322 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|118" 01-14-2016 17:00:31.322 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|118" 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=748, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=5241, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy:0+5241 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.322 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|118 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=754, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4747, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=752, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=753, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.322 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.322 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5523] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=755, msg=IgfsStreamControlRequest [streamId=123, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=755, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=123] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5523], readTime=18579238, userTime=3777728] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy:0+6119 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=756, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=756, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=124] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6119]] 01-14-2016 17:00:31.322 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.323 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy:0+6119 01-14-2016 17:00:31.323 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy:0+6119 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=757, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=757, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=758, msg=IgfsStreamControlRequest [streamId=124, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=759, msg=IgfsStreamControlRequest [streamId=124, pos=4096, len=2023, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=754, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy, fetchTime=32, locations=[BlockLocation [offset=0, length=4747, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy:0+4747 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=760, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3834, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=758, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.323 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=759, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.323 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916270.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|118 01-14-2016 17:00:31.325 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.325 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.325 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.325 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.325 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.325 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.326 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy = 01-14-2016 17:00:31.327 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.362 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.363 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.377 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.377 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.378 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.378 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.378 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.378 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.378 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.378 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.379 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.379 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.379 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|119" 01-14-2016 17:00:31.379 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|119" 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6119] 01-14-2016 17:00:31.379 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|119" 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=761, msg=IgfsStreamControlRequest [streamId=124, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=761, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=124] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6119], readTime=23652720, userTime=16628500] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy:0+4833 01-14-2016 17:00:31.379 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|119 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=762, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=762, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.379 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.379 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=125] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4833]] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.379 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy:0+4833 01-14-2016 17:00:31.379 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy:0+4833 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=763, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=763, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=764, msg=IgfsStreamControlRequest [streamId=125, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=765, msg=IgfsStreamControlRequest [streamId=125, pos=4096, len=737, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=760, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy, fetchTime=34, locations=[BlockLocation [offset=0, length=3834, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy:0+3834 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=766, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5136, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=764, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.379 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=765, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.380 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|119 01-14-2016 17:00:31.381 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.382 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.382 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.382 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.382 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.382 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.383 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy = 01-14-2016 17:00:31.383 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.412 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.413 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.428 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.428 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.428 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.428 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.428 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.428 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.428 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.428 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.428 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.435 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.435 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.435 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.435 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.436 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.436 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.436 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.436 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.437 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.437 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.437 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|120" 01-14-2016 17:00:31.437 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|120" 01-14-2016 17:00:31.437 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|120" 01-14-2016 17:00:31.437 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|120 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4833] 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=767, msg=IgfsStreamControlRequest [streamId=125, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=767, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=125] 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4833], readTime=22243719, userTime=26619689] 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy:0+5293 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.437 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.437 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=768, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=766, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy, fetchTime=43, locations=[BlockLocation [offset=0, length=5136, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy:0+5136 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy 01-14-2016 17:00:31.437 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=769, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4663, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=768, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=126] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5293]] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.438 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy:0+5293 01-14-2016 17:00:31.438 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy:0+5293 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=770, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=770, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=771, msg=IgfsStreamControlRequest [streamId=126, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=772, msg=IgfsStreamControlRequest [streamId=126, pos=4096, len=1197, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=771, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=772, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.438 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.913782.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|120 01-14-2016 17:00:31.440 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.440 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.440 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.440 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.440 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.440 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.441 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy = 01-14-2016 17:00:31.441 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.472 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.473 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.479 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.479 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.479 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.479 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.479 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.479 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.479 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.479 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.479 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.485 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.485 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.485 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.485 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.486 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.486 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.486 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.486 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.487 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.487 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.487 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|121" 01-14-2016 17:00:31.487 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|121" 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5293] 01-14-2016 17:00:31.487 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=773, msg=IgfsStreamControlRequest [streamId=126, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=769, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy, fetchTime=52, locations=[BlockLocation [offset=0, length=4663, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.487 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|121" 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy:0+4663 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy 01-14-2016 17:00:31.487 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|121 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=774, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4292, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=773, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=126] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5293], readTime=20825222, userTime=31450344] 01-14-2016 17:00:31.487 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy:0+5871 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=775, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=775, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=127] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5871]] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.487 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy:0+5871 01-14-2016 17:00:31.487 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy:0+5871 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=776, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=776, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=777, msg=IgfsStreamControlRequest [streamId=127, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=778, msg=IgfsStreamControlRequest [streamId=127, pos=4096, len=1775, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=774, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy, fetchTime=29, locations=[BlockLocation [offset=0, length=4292, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy:0+4292 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=779, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3821, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=777, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.487 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=778, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.487 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914004.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|121 01-14-2016 17:00:31.488 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.488 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.488 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.488 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.488 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.488 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.489 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy = 01-14-2016 17:00:31.490 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.519 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.520 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.527 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.534 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.534 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.534 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.534 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.535 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.535 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.535 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.535 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.536 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.536 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.536 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|122" 01-14-2016 17:00:31.536 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|122" 01-14-2016 17:00:31.536 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|122" 01-14-2016 17:00:31.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=779, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.536 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy, fetchTime=52, locations=[BlockLocation [offset=0, length=3821, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.536 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy:0+3821 01-14-2016 17:00:31.536 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.536 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.536 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy 01-14-2016 17:00:31.536 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.536 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|122 01-14-2016 17:00:31.536 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=780, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4835, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.536 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.536 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.537 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915437.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|122 01-14-2016 17:00:31.538 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.538 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.538 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.538 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.538 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.538 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.540 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy = 01-14-2016 17:00:31.541 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.573 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.574 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.580 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.580 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.580 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.580 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.580 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.580 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.580 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.580 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.580 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.586 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.586 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.587 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.587 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.587 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.587 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.587 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.587 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.588 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.588 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.588 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|123" 01-14-2016 17:00:31.588 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|123" 01-14-2016 17:00:31.588 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|123" 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5871] 01-14-2016 17:00:31.588 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|123 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=781, msg=IgfsStreamControlRequest [streamId=127, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=780, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=781, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.588 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=4835, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=127] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy:0+4835 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5871], readTime=46722057, userTime=56116964] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy:0+5138 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy 01-14-2016 17:00:31.588 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=782, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4268, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=783, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=782, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy, fetchTime=23, locations=[BlockLocation [offset=0, length=4268, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy:0+4268 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=784, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4796, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=783, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=128] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5138]] 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.588 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy:0+5138 01-14-2016 17:00:31.588 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy:0+5138 01-14-2016 17:00:31.588 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=785, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.589 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914662.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|123 01-14-2016 17:00:31.590 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.590 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.590 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.590 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.590 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.590 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.591 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy = 01-14-2016 17:00:31.592 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.620 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.621 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.628 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.628 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.628 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.628 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.628 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.628 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.628 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.628 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.628 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.634 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.634 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.634 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.634 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.635 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.635 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.635 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.635 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.636 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.636 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.636 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|124" 01-14-2016 17:00:31.636 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|124" 01-14-2016 17:00:31.636 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|124" 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=784, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy, fetchTime=25, locations=[BlockLocation [offset=0, length=4796, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy:0+4796 01-14-2016 17:00:31.636 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|124 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=785, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy 01-14-2016 17:00:31.636 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=786, msg=IgfsStreamControlRequest [streamId=128, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=787, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4835, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.636 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=788, msg=IgfsStreamControlRequest [streamId=128, pos=4096, len=1042, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=786, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=788, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5138] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=789, msg=IgfsStreamControlRequest [streamId=128, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=789, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=128] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5138], readTime=19250751, userTime=25897430] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy:0+5929 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=790, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=790, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=129] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5929]] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.636 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy:0+5929 01-14-2016 17:00:31.636 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy:0+5929 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=791, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=791, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=792, msg=IgfsStreamControlRequest [streamId=129, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.636 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=793, msg=IgfsStreamControlRequest [streamId=129, pos=4096, len=1833, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.637 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916517.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|124 01-14-2016 17:00:31.638 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.638 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.638 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.638 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.638 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.638 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.640 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy = 01-14-2016 17:00:31.640 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.670 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.670 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.677 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.677 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.677 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.677 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.677 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.677 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.677 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.677 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.677 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.683 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.684 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.684 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.684 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.684 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.684 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.685 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.685 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.685 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.685 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.685 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|125" 01-14-2016 17:00:31.685 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|125" 01-14-2016 17:00:31.685 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|125" 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=787, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy, fetchTime=45, locations=[BlockLocation [offset=0, length=4835, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy:0+4835 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.685 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|125 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=794, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=5461, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=792, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=793, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.685 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5929] 01-14-2016 17:00:31.685 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=795, msg=IgfsStreamControlRequest [streamId=129, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=795, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=129] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5929], readTime=18088268, userTime=3813763] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy:0+1264 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=796, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=796, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=130] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1264]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.685 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy:0+1264 01-14-2016 17:00:31.685 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy:0+1264 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=797, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=797, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=798, msg=IgfsStreamControlRequest [streamId=130, pos=0, len=1264, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=794, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy, fetchTime=25, locations=[BlockLocation [offset=0, length=5461, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy:0+5461 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=799, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4529, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=798, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1264] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=800, msg=IgfsStreamControlRequest [streamId=130, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=800, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=130] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=1264], readTime=17525332, userTime=3754672] 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy:0+6885 01-14-2016 17:00:31.685 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.686 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916405.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|125 01-14-2016 17:00:31.687 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.687 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.687 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.687 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.688 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.688 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.689 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy = 01-14-2016 17:00:31.689 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.717 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.718 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.724 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.724 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.724 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.724 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.725 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.725 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.725 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.725 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.725 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.730 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.730 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.730 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.730 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.731 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.731 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.731 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.731 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.732 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.732 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.732 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|126" 01-14-2016 17:00:31.732 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|126" 01-14-2016 17:00:31.732 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|126" 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=801, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=801, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.732 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|126 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.732 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.732 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=131] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6885]] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.732 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy:0+6885 01-14-2016 17:00:31.732 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy:0+6885 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=802, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=802, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=803, msg=IgfsStreamControlRequest [streamId=131, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=804, msg=IgfsStreamControlRequest [streamId=131, pos=4096, len=2789, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=799, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy, fetchTime=25, locations=[BlockLocation [offset=0, length=4529, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy:0+4529 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=805, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4224, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=803, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.732 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=804, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.733 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915882.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|126 01-14-2016 17:00:31.734 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.734 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.734 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.734 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.734 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.734 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.735 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy = 01-14-2016 17:00:31.736 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.766 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.766 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.774 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.774 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.774 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.774 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.774 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.774 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.774 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.774 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.774 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.781 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.781 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.781 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.781 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.781 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.781 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.782 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.782 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.782 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.782 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.782 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|127" 01-14-2016 17:00:31.782 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|127" 01-14-2016 17:00:31.782 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|127" 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6885] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=806, msg=IgfsStreamControlRequest [streamId=131, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=806, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=131] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=6885], readTime=17880576, userTime=26538882] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy:0+5171 01-14-2016 17:00:31.782 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|127 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=807, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=805, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.782 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy, fetchTime=33, locations=[BlockLocation [offset=0, length=4224, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.782 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy:0+4224 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=808, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3811, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=807, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=132] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5171]] 01-14-2016 17:00:31.782 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.782 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy:0+5171 01-14-2016 17:00:31.783 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy:0+5171 01-14-2016 17:00:31.783 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=809, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.783 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=809, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.783 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=810, msg=IgfsStreamControlRequest [streamId=132, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.783 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=811, msg=IgfsStreamControlRequest [streamId=132, pos=4096, len=1075, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.783 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=810, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.783 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=811, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.783 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914422.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|127 01-14-2016 17:00:31.784 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.784 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.784 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.784 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.785 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.785 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.785 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy = 01-14-2016 17:00:31.786 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.813 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.815 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.823 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.823 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.823 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.823 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.823 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.823 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.823 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.823 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.823 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.831 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.831 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.831 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.831 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.832 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.832 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.832 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.832 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.832 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.832 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.833 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|128" 01-14-2016 17:00:31.833 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|128" 01-14-2016 17:00:31.833 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|128" 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5171] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=812, msg=IgfsStreamControlRequest [streamId=132, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=808, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy, fetchTime=45, locations=[BlockLocation [offset=0, length=3811, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy:0+3811 01-14-2016 17:00:31.833 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|128 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.833 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.833 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=813, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3206, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=812, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=132] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5171], readTime=20125905, userTime=23281075] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy:0+5692 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=814, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=814, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=133] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5692]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.833 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy:0+5692 01-14-2016 17:00:31.833 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy:0+5692 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=815, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=815, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=816, msg=IgfsStreamControlRequest [streamId=133, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=817, msg=IgfsStreamControlRequest [streamId=133, pos=4096, len=1596, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=813, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=3206, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=816, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy:0+3206 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=818, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=4161, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=817, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.834 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.916048.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|128 01-14-2016 17:00:31.835 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.835 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.835 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.835 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.836 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.836 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.837 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy = 01-14-2016 17:00:31.837 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.865 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.866 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.872 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.872 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.872 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.872 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.872 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.872 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.872 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.872 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.872 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.879 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.879 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.879 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.879 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.880 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.880 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.880 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.880 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.881 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.881 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.881 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|129" 01-14-2016 17:00:31.881 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|129" 01-14-2016 17:00:31.881 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|129" 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5692] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=819, msg=IgfsStreamControlRequest [streamId=133, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.881 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|129 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=819, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=133] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5692], readTime=20634833, userTime=20726516] 01-14-2016 17:00:31.881 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy:0+5309 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=820, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=818, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=4161, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.881 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy:0+4161 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=821, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3598, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=820, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=134] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5309]] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.881 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy:0+5309 01-14-2016 17:00:31.881 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy:0+5309 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=822, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=822, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=823, msg=IgfsStreamControlRequest [streamId=134, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=824, msg=IgfsStreamControlRequest [streamId=134, pos=4096, len=1213, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=823, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=824, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.882 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.916423.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|129 01-14-2016 17:00:31.883 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.883 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.883 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.883 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.883 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.883 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.884 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:31.885 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy = 01-14-2016 17:00:31.885 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.917 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.918 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.927 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.927 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.927 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.927 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.927 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.927 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.927 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.927 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.927 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.935 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.935 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.935 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.935 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.935 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.936 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.936 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.936 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.936 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.936 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.936 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|130" 01-14-2016 17:00:31.936 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|130" 01-14-2016 17:00:31.936 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|130" 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5309] 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=825, msg=IgfsStreamControlRequest [streamId=134, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=821, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy, fetchTime=40, locations=[BlockLocation [offset=0, length=3598, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.936 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy:0+3598 01-14-2016 17:00:31.936 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|130 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=826, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3728, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=825, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.936 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=134] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5309], readTime=24033940, userTime=17372860] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy:0+4219 01-14-2016 17:00:31.937 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=827, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=827, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=135] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4219]] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.937 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy:0+4219 01-14-2016 17:00:31.937 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy:0+4219 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=828, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=828, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=829, msg=IgfsStreamControlRequest [streamId=135, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=830, msg=IgfsStreamControlRequest [streamId=135, pos=4096, len=123, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=826, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy, fetchTime=28, locations=[BlockLocation [offset=0, length=3728, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy:0+3728 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=831, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3311, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=829, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=830, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4219] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=832, msg=IgfsStreamControlRequest [streamId=135, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=832, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=135] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4219], readTime=19285927, userTime=5090236] 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy:0+3897 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:31.937 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=833, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:31.937 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.2.914148.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|130 01-14-2016 17:00:31.938 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.938 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.938 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.938 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.938 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.938 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.939 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy = 01-14-2016 17:00:31.939 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:31.973 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:31.974 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:31.983 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:31.983 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:31.983 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:31.983 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:31.983 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:31.983 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:31.984 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:31.984 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:31.984 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:31.991 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:31.991 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:31.991 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.992 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.992 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.992 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:31.992 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:31.992 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:31.993 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:31.993 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:31.993 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|131" 01-14-2016 17:00:31.993 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|131" 01-14-2016 17:00:31.993 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|131" 01-14-2016 17:00:31.993 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|131 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=833, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.993 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=136] 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3897]] 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:31.993 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy:0+3897 01-14-2016 17:00:31.993 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy:0+3897 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=834, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=834, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=835, msg=IgfsStreamControlRequest [streamId=136, pos=0, len=3897, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=831, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.993 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy, fetchTime=61, locations=[BlockLocation [offset=0, length=3311, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy:0+3311 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=836, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3218, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:31.993 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=835, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:31.994 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.22.914724.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|131 01-14-2016 17:00:31.995 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.995 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.995 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.995 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:31.995 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:31.996 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:31.997 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy = 01-14-2016 17:00:31.997 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.038 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.039 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.047 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.047 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.047 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.047 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.047 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.047 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.047 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.047 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.047 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.054 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.054 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.054 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.054 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.055 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.055 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.055 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.055 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.056 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.056 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.056 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|132" 01-14-2016 17:00:32.056 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|132" 01-14-2016 17:00:32.056 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|132" 01-14-2016 17:00:32.056 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|132 01-14-2016 17:00:32.056 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3897] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=837, msg=IgfsStreamControlRequest [streamId=136, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=837, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=136] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3897], readTime=20051501, userTime=20292763] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy:0+3682 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=838, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=838, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=137] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3682]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.056 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy:0+3682 01-14-2016 17:00:32.056 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy:0+3682 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=839, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=839, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=840, msg=IgfsStreamControlRequest [streamId=137, pos=0, len=3682, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=836, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy, fetchTime=30, locations=[BlockLocation [offset=0, length=3218, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy:0+3218 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy 01-14-2016 17:00:32.056 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.914902.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|132 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=841, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3390, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=840, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3682] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=842, msg=IgfsStreamControlRequest [streamId=137, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=842, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=137] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3682], readTime=19363174, userTime=4235051] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy:0+4975 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=843, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=843, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.056 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=138] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4975]] 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.056 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy:0+4975 01-14-2016 17:00:32.056 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy:0+4975 01-14-2016 17:00:32.056 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=844, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=841, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy, fetchTime=29, locations=[BlockLocation [offset=0, length=3390, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy:0+3390 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=845, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3342, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=844, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=846, msg=IgfsStreamControlRequest [streamId=138, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=847, msg=IgfsStreamControlRequest [streamId=138, pos=4096, len=879, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=846, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.057 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=847, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.058 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.058 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.058 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.058 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.058 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.058 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.059 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy = 01-14-2016 17:00:32.059 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.092 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.093 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.100 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.108 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.108 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.108 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.108 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.109 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.109 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.109 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.109 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.110 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.110 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.110 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|133" 01-14-2016 17:00:32.110 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|133" 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4975] 01-14-2016 17:00:32.110 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|133" 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=848, msg=IgfsStreamControlRequest [streamId=138, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=848, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=138] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4975], readTime=19301571, userTime=5295745] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy:0+4816 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=849, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.110 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|133 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=845, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=3342, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy:0+3342 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.110 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.110 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=850, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3780, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=849, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=139] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4816]] 01-14-2016 17:00:32.110 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.110 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy:0+4816 01-14-2016 17:00:32.110 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy:0+4816 01-14-2016 17:00:32.111 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=851, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.111 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=851, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.111 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=852, msg=IgfsStreamControlRequest [streamId=139, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.111 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=853, msg=IgfsStreamControlRequest [streamId=139, pos=4096, len=720, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.111 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=852, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.111 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=853, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.111 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.20.916146.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|133 01-14-2016 17:00:32.113 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.113 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.113 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.113 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.113 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.113 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.114 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy = 01-14-2016 17:00:32.115 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.148 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.148 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.155 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.155 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.155 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.155 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.155 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.155 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.155 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.155 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.155 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.160 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.160 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.161 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.161 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.161 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.161 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.162 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.162 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.162 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.162 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.162 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|134" 01-14-2016 17:00:32.162 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|134" 01-14-2016 17:00:32.162 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|134" 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4816] 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=854, msg=IgfsStreamControlRequest [streamId=139, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=850, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.162 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|134 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy, fetchTime=48, locations=[BlockLocation [offset=0, length=3780, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy:0+3780 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.162 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy 01-14-2016 17:00:32.162 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=855, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3336, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=854, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=139] 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4816], readTime=20757205, userTime=27219860] 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy:0+5960 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=856, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.162 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=856, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=140] 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5960]] 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.163 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy:0+5960 01-14-2016 17:00:32.163 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy:0+5960 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=857, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=857, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=858, msg=IgfsStreamControlRequest [streamId=140, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=859, msg=IgfsStreamControlRequest [streamId=140, pos=4096, len=1864, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=858, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.163 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=859, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.163 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.18.915049.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|134 01-14-2016 17:00:32.164 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.164 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.164 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.165 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.165 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.165 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.166 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy = 01-14-2016 17:00:32.166 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.204 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.205 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.215 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.215 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.215 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.215 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.215 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.215 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.215 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.215 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.215 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.223 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.223 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.223 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.223 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.224 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.224 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.224 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.224 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.224 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.225 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.225 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|135" 01-14-2016 17:00:32.225 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|135" 01-14-2016 17:00:32.225 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|135" 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5960] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=860, msg=IgfsStreamControlRequest [streamId=140, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=855, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy, fetchTime=50, locations=[BlockLocation [offset=0, length=3336, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy:0+3336 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:32.225 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|135 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.225 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.225 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=861, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3861, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=860, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=140] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5960], readTime=20174599, userTime=24752476] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy:0+3341 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=862, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=862, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=141] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3341]] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.225 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy:0+3341 01-14-2016 17:00:32.225 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy:0+3341 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=863, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=863, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=864, msg=IgfsStreamControlRequest [streamId=141, pos=0, len=3341, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=861, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy, fetchTime=27, locations=[BlockLocation [offset=0, length=3861, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy:0+3861 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=865, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3722, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:32.225 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=864, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.225 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914242.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|135 01-14-2016 17:00:32.227 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.227 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.227 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.227 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.227 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.227 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.229 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy = 01-14-2016 17:00:32.229 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.264 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.265 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.272 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.272 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.272 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.272 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.272 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.272 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.272 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.272 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.272 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.278 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.278 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.278 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.278 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.279 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.279 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.279 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.279 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.279 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.279 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.279 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|136" 01-14-2016 17:00:32.279 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|136" 01-14-2016 17:00:32.279 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|136" 01-14-2016 17:00:32.279 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|136 01-14-2016 17:00:32.279 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3341] 01-14-2016 17:00:32.279 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=866, msg=IgfsStreamControlRequest [streamId=141, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.279 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=865, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.279 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.279 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy, fetchTime=32, locations=[BlockLocation [offset=0, length=3722, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:32.279 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy:0+3722 01-14-2016 17:00:32.279 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.279 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.279 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy, search.et=1452787200, search.lt=1452790820, file.et=1452729600, file.lt=1452816000, file.mtime=1452790824 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - File meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXBucketSpecifier - Got bucket id for path: _no_id 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=867, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=3859, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=AFFINITY]] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=866, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=141] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3341], readTime=36745191, userTime=17126510] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy:0+4458 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=868, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=868, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=142] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4458]] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.280 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy:0+4458 01-14-2016 17:00:32.280 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy:0+4458 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=869, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=869, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=870, msg=IgfsStreamControlRequest [streamId=142, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=871, msg=IgfsStreamControlRequest [streamId=142, pos=4096, len=362, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=870, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=867, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Fetched file locations [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy, fetchTime=26, locations=[BlockLocation [offset=0, length=3859, hosts=[vruatsph001.iggroup.local, localhost.localdomain], names=[vruatsph001.iggroup.local:9001, localhost.localdomain:9001]]]] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy:0+3859 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/11/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/11 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/11, search.et=1452787200, search.lt=1452790820, file.et=1452470400, file.lt=1452556800, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/11, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/07/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/07 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/07, search.et=1452787200, search.lt=1452790820, file.et=1452124800, file.lt=1452211200, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/07, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/06/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/06 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/06, search.et=1452787200, search.lt=1452790820, file.et=1452038400, file.lt=1452124800, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/06, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/09/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/09 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/09, search.et=1452787200, search.lt=1452790820, file.et=1452297600, file.lt=1452384000, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/09, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/08/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/08 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/08, search.et=1452787200, search.lt=1452790820, file.et=1452211200, file.lt=1452297600, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/08, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/03/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/03 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/03, search.et=1452787200, search.lt=1452790820, file.et=1451779200, file.lt=1451865600, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/03, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/05/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/05 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/05, search.et=1452787200, search.lt=1452790820, file.et=1451952000, file.lt=1452038400, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/05, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/13/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/13 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/13, search.et=1452787200, search.lt=1452790820, file.et=1452643200, file.lt=1452729600, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/13, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/02/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/02 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/02, search.et=1452787200, search.lt=1452790820, file.et=1451692800, file.lt=1451779200, file.mtime=1452790823 01-14-2016 17:00:32.280 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915581.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|136 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/02, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/04/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/04 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/04, search.et=1452787200, search.lt=1452790820, file.et=1451865600, file.lt=1451952000, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/04, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/12/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/12 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/12, search.et=1452787200, search.lt=1452790820, file.et=1452556800, file.lt=1452643200, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/12, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/01/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/01 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/01, search.et=1452787200, search.lt=1452790820, file.et=1451606400, file.lt=1451692800, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/01, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/10/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/10 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/10, search.et=1452787200, search.lt=1452790820, file.et=1452384000, file.lt=1452470400, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/10, mtime=1452790823 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/ 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790823 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=872, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.280 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=871, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.282 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.282 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.282 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.282 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.282 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.282 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.283 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy = 01-14-2016 17:00:32.283 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.315 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.316 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.324 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.330 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.330 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.330 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.330 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.331 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.331 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.331 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.331 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.331 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.331 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.331 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|137" 01-14-2016 17:00:32.331 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|137" 01-14-2016 17:00:32.331 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4458] 01-14-2016 17:00:32.331 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|137" 01-14-2016 17:00:32.331 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=873, msg=IgfsStreamControlRequest [streamId=142, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.331 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=872, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.331 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/ 01-14-2016 17:00:32.331 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12 01-14-2016 17:00:32.331 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.331 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|137 01-14-2016 17:00:32.331 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=874, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.331 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=873, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.331 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.331 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=142] 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4458], readTime=31990922, userTime=17929677] 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy:0+5111 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=875, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=874, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/30/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/30 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/30, search.et=1452787200, search.lt=1452790820, file.et=1419897600, file.lt=1419984000, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/31/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/31 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/31, search.et=1452787200, search.lt=1452790820, file.et=1419984000, file.lt=1420070400, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/31, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/29/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/29 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/29, search.et=1452787200, search.lt=1452790820, file.et=1419811200, file.lt=1419897600, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/19/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/19 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/19, search.et=1452787200, search.lt=1452790820, file.et=1418947200, file.lt=1419033600, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/16/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/16 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/16, search.et=1452787200, search.lt=1452790820, file.et=1418688000, file.lt=1418774400, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/25/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/25 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/25, search.et=1452787200, search.lt=1452790820, file.et=1419465600, file.lt=1419552000, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/13/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/13 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/13, search.et=1452787200, search.lt=1452790820, file.et=1418428800, file.lt=1418515200, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/26/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/26 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/26, search.et=1452787200, search.lt=1452790820, file.et=1419552000, file.lt=1419638400, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/14/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/14 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/14, search.et=1452787200, search.lt=1452790820, file.et=1418515200, file.lt=1418601600, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/15/ 01-14-2016 17:00:32.332 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/15 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/15, search.et=1452787200, search.lt=1452790820, file.et=1418601600, file.lt=1418688000, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/27/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/27 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/27, search.et=1452787200, search.lt=1452790820, file.et=1419638400, file.lt=1419724800, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/28/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/28 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/28, search.et=1452787200, search.lt=1452790820, file.et=1419724800, file.lt=1419811200, file.mtime=1452790832 01-14-2016 17:00:32.332 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914736.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|137 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/24/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/24 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/24, search.et=1452787200, search.lt=1452790820, file.et=1419379200, file.lt=1419465600, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/23/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/23 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/23, search.et=1452787200, search.lt=1452790820, file.et=1419292800, file.lt=1419379200, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/18/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/18 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/18, search.et=1452787200, search.lt=1452790820, file.et=1418860800, file.lt=1418947200, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/21/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/21 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/21, search.et=1452787200, search.lt=1452790820, file.et=1419120000, file.lt=1419206400, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/17/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/17 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/17, search.et=1452787200, search.lt=1452790820, file.et=1418774400, file.lt=1418860800, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/12/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/12 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/12, search.et=1452787200, search.lt=1452790820, file.et=1418342400, file.lt=1418428800, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/20/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/20 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/20, search.et=1452787200, search.lt=1452790820, file.et=1419033600, file.lt=1419120000, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/10/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/10 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/10, search.et=1452787200, search.lt=1452790820, file.et=1418169600, file.lt=1418256000, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/22/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/22 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/22, search.et=1452787200, search.lt=1452790820, file.et=1419206400, file.lt=1419292800, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/11/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/11 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/11, search.et=1452787200, search.lt=1452790820, file.et=1418256000, file.lt=1418342400, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/12/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/10/ 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/10 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/10, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=876, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/10, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=875, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=143] 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5111]] 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.332 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy:0+5111 01-14-2016 17:00:32.332 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy:0+5111 01-14-2016 17:00:32.332 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=877, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.334 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.334 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.334 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.334 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.334 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.334 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.335 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy = 01-14-2016 17:00:32.335 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.364 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.365 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.371 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.378 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.378 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.378 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.378 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.379 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.379 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.379 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.379 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.379 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.379 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.380 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|138" 01-14-2016 17:00:32.380 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|138" 01-14-2016 17:00:32.380 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|138" 01-14-2016 17:00:32.380 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|138 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=876, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.380 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/10/01/ 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/10/01 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/10/01, search.et=1452787200, search.lt=1452790820, file.et=1412118000, file.lt=1412204400, file.mtime=1452790832 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2014/10/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/ 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790823 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=878, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=877, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=879, msg=IgfsStreamControlRequest [streamId=143, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=880, msg=IgfsStreamControlRequest [streamId=143, pos=4096, len=1015, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=878, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/ 01-14-2016 17:00:32.380 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.380 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=881, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.380 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915916.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|138 01-14-2016 17:00:32.382 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.382 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.382 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.382 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.382 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.382 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.383 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=879, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.383 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=880, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.383 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy = 01-14-2016 17:00:32.383 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.414 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.415 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.421 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.421 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.421 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.421 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.421 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.421 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.421 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.421 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.421 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.428 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.428 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.428 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.428 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.429 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.429 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.429 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.429 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.429 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.429 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.429 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|139" 01-14-2016 17:00:32.429 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|139" 01-14-2016 17:00:32.429 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|139" 01-14-2016 17:00:32.429 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|139 01-14-2016 17:00:32.429 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5111] 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=882, msg=IgfsStreamControlRequest [streamId=143, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=881, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/15/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/15 01-14-2016 17:00:32.430 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/15, search.et=1452787200, search.lt=1452790820, file.et=1442271600, file.lt=1442358000, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/14/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/14 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/14, search.et=1452787200, search.lt=1452790820, file.et=1442185200, file.lt=1442271600, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/22/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/22 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/22, search.et=1452787200, search.lt=1452790820, file.et=1442876400, file.lt=1442962800, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/19/ 01-14-2016 17:00:32.430 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/19 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/19, search.et=1452787200, search.lt=1452790820, file.et=1442617200, file.lt=1442703600, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/20/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/20 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/20, search.et=1452787200, search.lt=1452790820, file.et=1442703600, file.lt=1442790000, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/01/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/01 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/01, search.et=1452787200, search.lt=1452790820, file.et=1441062000, file.lt=1441148400, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/05/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/05 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/05, search.et=1452787200, search.lt=1452790820, file.et=1441407600, file.lt=1441494000, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/28/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/28 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/28, search.et=1452787200, search.lt=1452790820, file.et=1443394800, file.lt=1443481200, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/02/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/02 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/02, search.et=1452787200, search.lt=1452790820, file.et=1441148400, file.lt=1441234800, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/29/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/29 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/29, search.et=1452787200, search.lt=1452790820, file.et=1443481200, file.lt=1443567600, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/03/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/03 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/03, search.et=1452787200, search.lt=1452790820, file.et=1441234800, file.lt=1441321200, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/17/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/17 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/17, search.et=1452787200, search.lt=1452790820, file.et=1442444400, file.lt=1442530800, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/09/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/09 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/09, search.et=1452787200, search.lt=1452790820, file.et=1441753200, file.lt=1441839600, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/04/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/04 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/04, search.et=1452787200, search.lt=1452790820, file.et=1441321200, file.lt=1441407600, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/08/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/08 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/08, search.et=1452787200, search.lt=1452790820, file.et=1441666800, file.lt=1441753200, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/18/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/18 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/18, search.et=1452787200, search.lt=1452790820, file.et=1442530800, file.lt=1442617200, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/25/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/25 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/25, search.et=1452787200, search.lt=1452790820, file.et=1443135600, file.lt=1443222000, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/30/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/30 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/30, search.et=1452787200, search.lt=1452790820, file.et=1443567600, file.lt=1443654000, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/11/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/11 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/11, search.et=1452787200, search.lt=1452790820, file.et=1441926000, file.lt=1442012400, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/21/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/21 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/21, search.et=1452787200, search.lt=1452790820, file.et=1442790000, file.lt=1442876400, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/23/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/23 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/23, search.et=1452787200, search.lt=1452790820, file.et=1442962800, file.lt=1443049200, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/12/ 01-14-2016 17:00:32.430 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914814.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|139 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/12 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/12, search.et=1452787200, search.lt=1452790820, file.et=1442012400, file.lt=1442098800, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/10/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/10 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/10, search.et=1452787200, search.lt=1452790820, file.et=1441839600, file.lt=1441926000, file.mtime=1452790832 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/16/ 01-14-2016 17:00:32.430 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/16 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/16, search.et=1452787200, search.lt=1452790820, file.et=1442358000, file.lt=1442444400, file.mtime=1452790832 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/06/ 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/06 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/06, search.et=1452787200, search.lt=1452790820, file.et=1441494000, file.lt=1441580400, file.mtime=1452790832 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/24/ 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/24 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/24, search.et=1452787200, search.lt=1452790820, file.et=1443049200, file.lt=1443135600, file.mtime=1452790832 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/07/ 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/07 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/07, search.et=1452787200, search.lt=1452790820, file.et=1441580400, file.lt=1441666800, file.mtime=1452790832 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/13/ 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/13 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/13, search.et=1452787200, search.lt=1452790820, file.et=1442098800, file.lt=1442185200, file.mtime=1452790832 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/26/ 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/26 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/26, search.et=1452787200, search.lt=1452790820, file.et=1443222000, file.lt=1443308400, file.mtime=1452790832 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/27/ 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/27 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/27, search.et=1452787200, search.lt=1452790820, file.et=1443308400, file.lt=1443394800, file.mtime=1452790832 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/09/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/ 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=883, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=882, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=143] 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5111], readTime=82598390, userTime=22017862] 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy:0+4220 01-14-2016 17:00:32.431 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.432 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.432 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.432 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.432 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.432 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.432 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.433 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=884, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.433 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy = 01-14-2016 17:00:32.433 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.452 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=883, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.455 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/31/ 01-14-2016 17:00:32.455 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/31 01-14-2016 17:00:32.455 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/31, search.et=1452787200, search.lt=1452790820, file.et=1446249600, file.lt=1446336000, file.mtime=1452790832 01-14-2016 17:00:32.455 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/31, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.456 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/09/ 01-14-2016 17:00:32.456 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/09 01-14-2016 17:00:32.456 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/09, search.et=1452787200, search.lt=1452790820, file.et=1444345200, file.lt=1444431600, file.mtime=1452790832 01-14-2016 17:00:32.456 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.456 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/13/ 01-14-2016 17:00:32.457 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/13 01-14-2016 17:00:32.457 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/13, search.et=1452787200, search.lt=1452790820, file.et=1444690800, file.lt=1444777200, file.mtime=1452790832 01-14-2016 17:00:32.457 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.457 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/28/ 01-14-2016 17:00:32.457 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/28 01-14-2016 17:00:32.458 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/28, search.et=1452787200, search.lt=1452790820, file.et=1445990400, file.lt=1446076800, file.mtime=1452790832 01-14-2016 17:00:32.458 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.458 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/11/ 01-14-2016 17:00:32.458 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/11 01-14-2016 17:00:32.458 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/11, search.et=1452787200, search.lt=1452790820, file.et=1444518000, file.lt=1444604400, file.mtime=1452790832 01-14-2016 17:00:32.459 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.459 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/18/ 01-14-2016 17:00:32.459 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/18 01-14-2016 17:00:32.459 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/18, search.et=1452787200, search.lt=1452790820, file.et=1445122800, file.lt=1445209200, file.mtime=1452790832 01-14-2016 17:00:32.459 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.460 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/17/ 01-14-2016 17:00:32.460 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/17 01-14-2016 17:00:32.460 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/17, search.et=1452787200, search.lt=1452790820, file.et=1445036400, file.lt=1445122800, file.mtime=1452790832 01-14-2016 17:00:32.460 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.460 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/21/ 01-14-2016 17:00:32.461 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/21 01-14-2016 17:00:32.461 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/21, search.et=1452787200, search.lt=1452790820, file.et=1445382000, file.lt=1445468400, file.mtime=1452790832 01-14-2016 17:00:32.461 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.461 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/20/ 01-14-2016 17:00:32.461 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/20 01-14-2016 17:00:32.462 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/20, search.et=1452787200, search.lt=1452790820, file.et=1445295600, file.lt=1445382000, file.mtime=1452790832 01-14-2016 17:00:32.462 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.462 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/19/ 01-14-2016 17:00:32.462 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/19 01-14-2016 17:00:32.463 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/19, search.et=1452787200, search.lt=1452790820, file.et=1445209200, file.lt=1445295600, file.mtime=1452790832 01-14-2016 17:00:32.463 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.463 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/15/ 01-14-2016 17:00:32.463 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/15 01-14-2016 17:00:32.463 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.463 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/15, search.et=1452787200, search.lt=1452790820, file.et=1444863600, file.lt=1444950000, file.mtime=1452790832 01-14-2016 17:00:32.463 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.464 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/04/ 01-14-2016 17:00:32.464 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/04 01-14-2016 17:00:32.464 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.464 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/04, search.et=1452787200, search.lt=1452790820, file.et=1443913200, file.lt=1443999600, file.mtime=1452790832 01-14-2016 17:00:32.464 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.464 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/23/ 01-14-2016 17:00:32.465 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/23 01-14-2016 17:00:32.465 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/23, search.et=1452787200, search.lt=1452790820, file.et=1445554800, file.lt=1445641200, file.mtime=1452790832 01-14-2016 17:00:32.465 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.465 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/03/ 01-14-2016 17:00:32.465 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/03 01-14-2016 17:00:32.466 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/03, search.et=1452787200, search.lt=1452790820, file.et=1443826800, file.lt=1443913200, file.mtime=1452790832 01-14-2016 17:00:32.466 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.466 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/22/ 01-14-2016 17:00:32.466 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/22 01-14-2016 17:00:32.466 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/22, search.et=1452787200, search.lt=1452790820, file.et=1445468400, file.lt=1445554800, file.mtime=1452790832 01-14-2016 17:00:32.467 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.467 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/16/ 01-14-2016 17:00:32.467 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/16 01-14-2016 17:00:32.467 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/16, search.et=1452787200, search.lt=1452790820, file.et=1444950000, file.lt=1445036400, file.mtime=1452790832 01-14-2016 17:00:32.467 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.468 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/25/ 01-14-2016 17:00:32.468 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/25 01-14-2016 17:00:32.468 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/25, search.et=1452787200, search.lt=1452790820, file.et=1445727600, file.lt=1445814000, file.mtime=1452790832 01-14-2016 17:00:32.468 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.468 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/29/ 01-14-2016 17:00:32.468 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/29 01-14-2016 17:00:32.469 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/29, search.et=1452787200, search.lt=1452790820, file.et=1446076800, file.lt=1446163200, file.mtime=1452790832 01-14-2016 17:00:32.469 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.469 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/05/ 01-14-2016 17:00:32.469 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/05 01-14-2016 17:00:32.469 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/05, search.et=1452787200, search.lt=1452790820, file.et=1443999600, file.lt=1444086000, file.mtime=1452790832 01-14-2016 17:00:32.470 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.470 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/26/ 01-14-2016 17:00:32.470 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/26 01-14-2016 17:00:32.470 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/26, search.et=1452787200, search.lt=1452790820, file.et=1445817600, file.lt=1445904000, file.mtime=1452790832 01-14-2016 17:00:32.470 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.470 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/27/ 01-14-2016 17:00:32.471 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/27 01-14-2016 17:00:32.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.471 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/27, search.et=1452787200, search.lt=1452790820, file.et=1445904000, file.lt=1445990400, file.mtime=1452790832 01-14-2016 17:00:32.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.471 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.471 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/12/ 01-14-2016 17:00:32.471 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/12 01-14-2016 17:00:32.472 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/12, search.et=1452787200, search.lt=1452790820, file.et=1444604400, file.lt=1444690800, file.mtime=1452790832 01-14-2016 17:00:32.472 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.472 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/14/ 01-14-2016 17:00:32.472 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/14 01-14-2016 17:00:32.472 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/14, search.et=1452787200, search.lt=1452790820, file.et=1444777200, file.lt=1444863600, file.mtime=1452790832 01-14-2016 17:00:32.473 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.473 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/06/ 01-14-2016 17:00:32.473 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/06 01-14-2016 17:00:32.473 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/06, search.et=1452787200, search.lt=1452790820, file.et=1444086000, file.lt=1444172400, file.mtime=1452790832 01-14-2016 17:00:32.473 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.474 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/30/ 01-14-2016 17:00:32.474 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/30 01-14-2016 17:00:32.474 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/30, search.et=1452787200, search.lt=1452790820, file.et=1446163200, file.lt=1446249600, file.mtime=1452790832 01-14-2016 17:00:32.474 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.474 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/07/ 01-14-2016 17:00:32.474 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/07 01-14-2016 17:00:32.475 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/07, search.et=1452787200, search.lt=1452790820, file.et=1444172400, file.lt=1444258800, file.mtime=1452790832 01-14-2016 17:00:32.475 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.475 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/24/ 01-14-2016 17:00:32.475 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/24 01-14-2016 17:00:32.475 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/24, search.et=1452787200, search.lt=1452790820, file.et=1445641200, file.lt=1445727600, file.mtime=1452790832 01-14-2016 17:00:32.476 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.476 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/01/ 01-14-2016 17:00:32.476 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/01 01-14-2016 17:00:32.476 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/01, search.et=1452787200, search.lt=1452790820, file.et=1443654000, file.lt=1443740400, file.mtime=1452790832 01-14-2016 17:00:32.476 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.477 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/08/ 01-14-2016 17:00:32.477 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/08 01-14-2016 17:00:32.477 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/08, search.et=1452787200, search.lt=1452790820, file.et=1444258800, file.lt=1444345200, file.mtime=1452790832 01-14-2016 17:00:32.477 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.477 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/10/ 01-14-2016 17:00:32.477 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.477 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.477 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/10 01-14-2016 17:00:32.478 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.478 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.478 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/10, search.et=1452787200, search.lt=1452790820, file.et=1444431600, file.lt=1444518000, file.mtime=1452790832 01-14-2016 17:00:32.478 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.478 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/02/ 01-14-2016 17:00:32.478 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/02 01-14-2016 17:00:32.478 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.478 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.478 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/02, search.et=1452787200, search.lt=1452790820, file.et=1443740400, file.lt=1443826800, file.mtime=1452790832 01-14-2016 17:00:32.478 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/10/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.478 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.478 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.479 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/ 01-14-2016 17:00:32.479 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02 01-14-2016 17:00:32.479 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.479 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.479 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.479 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|140" 01-14-2016 17:00:32.479 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|140" 01-14-2016 17:00:32.479 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|140" 01-14-2016 17:00:32.479 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=885, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.479 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|140 01-14-2016 17:00:32.479 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.479 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=884, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.480 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=144] 01-14-2016 17:00:32.480 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4220]] 01-14-2016 17:00:32.480 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913822.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|140 01-14-2016 17:00:32.480 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.481 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy:0+4220 01-14-2016 17:00:32.481 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy:0+4220 01-14-2016 17:00:32.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=886, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.482 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.482 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.482 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.482 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.482 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.482 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.483 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy = 01-14-2016 17:00:32.483 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.502 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=885, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.504 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/28/ 01-14-2016 17:00:32.504 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/28 01-14-2016 17:00:32.505 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/28, search.et=1452787200, search.lt=1452790820, file.et=1425081600, file.lt=1425168000, file.mtime=1452790832 01-14-2016 17:00:32.505 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.505 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/25/ 01-14-2016 17:00:32.505 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/25 01-14-2016 17:00:32.505 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/25, search.et=1452787200, search.lt=1452790820, file.et=1424822400, file.lt=1424908800, file.mtime=1452790832 01-14-2016 17:00:32.505 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.506 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/23/ 01-14-2016 17:00:32.506 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/23 01-14-2016 17:00:32.506 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/23, search.et=1452787200, search.lt=1452790820, file.et=1424649600, file.lt=1424736000, file.mtime=1452790832 01-14-2016 17:00:32.506 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.506 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/24/ 01-14-2016 17:00:32.506 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/24 01-14-2016 17:00:32.507 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/24, search.et=1452787200, search.lt=1452790820, file.et=1424736000, file.lt=1424822400, file.mtime=1452790832 01-14-2016 17:00:32.507 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.507 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/27/ 01-14-2016 17:00:32.507 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/27 01-14-2016 17:00:32.507 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/27, search.et=1452787200, search.lt=1452790820, file.et=1424995200, file.lt=1425081600, file.mtime=1452790832 01-14-2016 17:00:32.507 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.507 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/26/ 01-14-2016 17:00:32.508 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/26 01-14-2016 17:00:32.508 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/26, search.et=1452787200, search.lt=1452790820, file.et=1424908800, file.lt=1424995200, file.mtime=1452790832 01-14-2016 17:00:32.508 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.508 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/22/ 01-14-2016 17:00:32.508 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/22 01-14-2016 17:00:32.508 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/22, search.et=1452787200, search.lt=1452790820, file.et=1424563200, file.lt=1424649600, file.mtime=1452790832 01-14-2016 17:00:32.509 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.509 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/01/ 01-14-2016 17:00:32.509 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/01 01-14-2016 17:00:32.509 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/01, search.et=1452787200, search.lt=1452790820, file.et=1422748800, file.lt=1422835200, file.mtime=1452790832 01-14-2016 17:00:32.509 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.509 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/18/ 01-14-2016 17:00:32.509 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/18 01-14-2016 17:00:32.510 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/18, search.et=1452787200, search.lt=1452790820, file.et=1424217600, file.lt=1424304000, file.mtime=1452790832 01-14-2016 17:00:32.510 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.510 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/19/ 01-14-2016 17:00:32.510 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/19 01-14-2016 17:00:32.510 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/19, search.et=1452787200, search.lt=1452790820, file.et=1424304000, file.lt=1424390400, file.mtime=1452790832 01-14-2016 17:00:32.510 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/16/ 01-14-2016 17:00:32.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/16 01-14-2016 17:00:32.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/16, search.et=1452787200, search.lt=1452790820, file.et=1424044800, file.lt=1424131200, file.mtime=1452790832 01-14-2016 17:00:32.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/02/ 01-14-2016 17:00:32.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/02 01-14-2016 17:00:32.511 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/02, search.et=1452787200, search.lt=1452790820, file.et=1422835200, file.lt=1422921600, file.mtime=1452790832 01-14-2016 17:00:32.512 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.512 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/14/ 01-14-2016 17:00:32.512 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/14 01-14-2016 17:00:32.512 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/14, search.et=1452787200, search.lt=1452790820, file.et=1423872000, file.lt=1423958400, file.mtime=1452790832 01-14-2016 17:00:32.512 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.512 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/20/ 01-14-2016 17:00:32.512 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.512 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/20 01-14-2016 17:00:32.513 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/20, search.et=1452787200, search.lt=1452790820, file.et=1424390400, file.lt=1424476800, file.mtime=1452790832 01-14-2016 17:00:32.513 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.513 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/05/ 01-14-2016 17:00:32.513 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/05 01-14-2016 17:00:32.513 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.513 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/05, search.et=1452787200, search.lt=1452790820, file.et=1423094400, file.lt=1423180800, file.mtime=1452790832 01-14-2016 17:00:32.513 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.513 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/06/ 01-14-2016 17:00:32.514 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/06 01-14-2016 17:00:32.514 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/06, search.et=1452787200, search.lt=1452790820, file.et=1423180800, file.lt=1423267200, file.mtime=1452790832 01-14-2016 17:00:32.514 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.514 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/13/ 01-14-2016 17:00:32.514 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/13 01-14-2016 17:00:32.514 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/13, search.et=1452787200, search.lt=1452790820, file.et=1423785600, file.lt=1423872000, file.mtime=1452790832 01-14-2016 17:00:32.515 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.515 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/07/ 01-14-2016 17:00:32.515 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/07 01-14-2016 17:00:32.515 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/07, search.et=1452787200, search.lt=1452790820, file.et=1423267200, file.lt=1423353600, file.mtime=1452790832 01-14-2016 17:00:32.515 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.515 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/04/ 01-14-2016 17:00:32.515 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/04 01-14-2016 17:00:32.516 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/04, search.et=1452787200, search.lt=1452790820, file.et=1423008000, file.lt=1423094400, file.mtime=1452790832 01-14-2016 17:00:32.516 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.516 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/03/ 01-14-2016 17:00:32.516 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/03 01-14-2016 17:00:32.516 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/03, search.et=1452787200, search.lt=1452790820, file.et=1422921600, file.lt=1423008000, file.mtime=1452790832 01-14-2016 17:00:32.516 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.517 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/12/ 01-14-2016 17:00:32.517 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/12 01-14-2016 17:00:32.517 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/12, search.et=1452787200, search.lt=1452790820, file.et=1423699200, file.lt=1423785600, file.mtime=1452790832 01-14-2016 17:00:32.517 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.517 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/09/ 01-14-2016 17:00:32.517 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/09 01-14-2016 17:00:32.518 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/09, search.et=1452787200, search.lt=1452790820, file.et=1423440000, file.lt=1423526400, file.mtime=1452790832 01-14-2016 17:00:32.518 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.518 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/10/ 01-14-2016 17:00:32.518 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/10 01-14-2016 17:00:32.518 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/10, search.et=1452787200, search.lt=1452790820, file.et=1423526400, file.lt=1423612800, file.mtime=1452790832 01-14-2016 17:00:32.518 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.518 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/11/ 01-14-2016 17:00:32.518 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/11 01-14-2016 17:00:32.519 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/11, search.et=1452787200, search.lt=1452790820, file.et=1423612800, file.lt=1423699200, file.mtime=1452790832 01-14-2016 17:00:32.519 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.519 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/08/ 01-14-2016 17:00:32.519 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/08 01-14-2016 17:00:32.519 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/08, search.et=1452787200, search.lt=1452790820, file.et=1423353600, file.lt=1423440000, file.mtime=1452790832 01-14-2016 17:00:32.519 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.520 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/17/ 01-14-2016 17:00:32.520 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/17 01-14-2016 17:00:32.520 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/17, search.et=1452787200, search.lt=1452790820, file.et=1424131200, file.lt=1424217600, file.mtime=1452790832 01-14-2016 17:00:32.520 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.520 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/15/ 01-14-2016 17:00:32.520 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/15 01-14-2016 17:00:32.520 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.520 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.520 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.520 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.520 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.520 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.520 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.520 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.520 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/15, search.et=1452787200, search.lt=1452790820, file.et=1423958400, file.lt=1424044800, file.mtime=1452790832 01-14-2016 17:00:32.520 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.521 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.521 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/21/ 01-14-2016 17:00:32.521 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/21 01-14-2016 17:00:32.521 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/21, search.et=1452787200, search.lt=1452790820, file.et=1424476800, file.lt=1424563200, file.mtime=1452790832 01-14-2016 17:00:32.521 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/02/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.521 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/ 01-14-2016 17:00:32.521 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01 01-14-2016 17:00:32.522 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.522 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=887, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.522 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=886, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.523 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=888, msg=IgfsStreamControlRequest [streamId=144, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.523 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=889, msg=IgfsStreamControlRequest [streamId=144, pos=4096, len=124, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.528 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.528 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.528 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.528 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.529 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.529 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.529 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.529 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.529 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.529 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.529 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|141" 01-14-2016 17:00:32.529 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|141" 01-14-2016 17:00:32.529 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|141" 01-14-2016 17:00:32.529 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|141 01-14-2016 17:00:32.530 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.530 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.530 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915684.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|141 01-14-2016 17:00:32.532 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.532 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.532 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.532 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.532 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.532 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.533 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy = 01-14-2016 17:00:32.534 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.545 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=887, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.548 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/13/ 01-14-2016 17:00:32.548 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/13 01-14-2016 17:00:32.548 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/13, search.et=1452787200, search.lt=1452790820, file.et=1421107200, file.lt=1421193600, file.mtime=1452790832 01-14-2016 17:00:32.548 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.548 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/14/ 01-14-2016 17:00:32.549 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/14 01-14-2016 17:00:32.549 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/14, search.et=1452787200, search.lt=1452790820, file.et=1421193600, file.lt=1421280000, file.mtime=1452790832 01-14-2016 17:00:32.549 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.549 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/10/ 01-14-2016 17:00:32.549 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/10 01-14-2016 17:00:32.550 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/10, search.et=1452787200, search.lt=1452790820, file.et=1420848000, file.lt=1420934400, file.mtime=1452790832 01-14-2016 17:00:32.550 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.550 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/27/ 01-14-2016 17:00:32.550 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/27 01-14-2016 17:00:32.550 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/27, search.et=1452787200, search.lt=1452790820, file.et=1422316800, file.lt=1422403200, file.mtime=1452790832 01-14-2016 17:00:32.551 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.551 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/24/ 01-14-2016 17:00:32.551 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/24 01-14-2016 17:00:32.551 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/24, search.et=1452787200, search.lt=1452790820, file.et=1422057600, file.lt=1422144000, file.mtime=1452790832 01-14-2016 17:00:32.551 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.551 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/19/ 01-14-2016 17:00:32.552 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/19 01-14-2016 17:00:32.552 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/19, search.et=1452787200, search.lt=1452790820, file.et=1421625600, file.lt=1421712000, file.mtime=1452790832 01-14-2016 17:00:32.552 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.552 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/25/ 01-14-2016 17:00:32.552 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/25 01-14-2016 17:00:32.553 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/25, search.et=1452787200, search.lt=1452790820, file.et=1422144000, file.lt=1422230400, file.mtime=1452790832 01-14-2016 17:00:32.553 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.553 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/01/ 01-14-2016 17:00:32.553 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/01 01-14-2016 17:00:32.553 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/01, search.et=1452787200, search.lt=1452790820, file.et=1420070400, file.lt=1420156800, file.mtime=1452790832 01-14-2016 17:00:32.553 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.553 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/29/ 01-14-2016 17:00:32.554 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/29 01-14-2016 17:00:32.554 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/29, search.et=1452787200, search.lt=1452790820, file.et=1422489600, file.lt=1422576000, file.mtime=1452790832 01-14-2016 17:00:32.554 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.554 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/28/ 01-14-2016 17:00:32.554 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/28 01-14-2016 17:00:32.554 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/28, search.et=1452787200, search.lt=1452790820, file.et=1422403200, file.lt=1422489600, file.mtime=1452790832 01-14-2016 17:00:32.554 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.555 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/07/ 01-14-2016 17:00:32.555 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/07 01-14-2016 17:00:32.555 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/07, search.et=1452787200, search.lt=1452790820, file.et=1420588800, file.lt=1420675200, file.mtime=1452790832 01-14-2016 17:00:32.555 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.555 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/30/ 01-14-2016 17:00:32.555 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/30 01-14-2016 17:00:32.556 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/30, search.et=1452787200, search.lt=1452790820, file.et=1422576000, file.lt=1422662400, file.mtime=1452790832 01-14-2016 17:00:32.556 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.556 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/06/ 01-14-2016 17:00:32.556 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/06 01-14-2016 17:00:32.556 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/06, search.et=1452787200, search.lt=1452790820, file.et=1420502400, file.lt=1420588800, file.mtime=1452790832 01-14-2016 17:00:32.556 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.557 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/12/ 01-14-2016 17:00:32.557 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/12 01-14-2016 17:00:32.557 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/12, search.et=1452787200, search.lt=1452790820, file.et=1421020800, file.lt=1421107200, file.mtime=1452790832 01-14-2016 17:00:32.557 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.557 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/08/ 01-14-2016 17:00:32.557 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/08 01-14-2016 17:00:32.557 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/08, search.et=1452787200, search.lt=1452790820, file.et=1420675200, file.lt=1420761600, file.mtime=1452790832 01-14-2016 17:00:32.558 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.558 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/21/ 01-14-2016 17:00:32.558 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/21 01-14-2016 17:00:32.558 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/21, search.et=1452787200, search.lt=1452790820, file.et=1421798400, file.lt=1421884800, file.mtime=1452790832 01-14-2016 17:00:32.558 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.558 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/02/ 01-14-2016 17:00:32.558 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/02 01-14-2016 17:00:32.559 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/02, search.et=1452787200, search.lt=1452790820, file.et=1420156800, file.lt=1420243200, file.mtime=1452790832 01-14-2016 17:00:32.559 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.559 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/11/ 01-14-2016 17:00:32.559 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/11 01-14-2016 17:00:32.559 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/11, search.et=1452787200, search.lt=1452790820, file.et=1420934400, file.lt=1421020800, file.mtime=1452790832 01-14-2016 17:00:32.559 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.559 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/04/ 01-14-2016 17:00:32.560 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/04 01-14-2016 17:00:32.560 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/04, search.et=1452787200, search.lt=1452790820, file.et=1420329600, file.lt=1420416000, file.mtime=1452790832 01-14-2016 17:00:32.560 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.560 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/20/ 01-14-2016 17:00:32.560 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/20 01-14-2016 17:00:32.561 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/20, search.et=1452787200, search.lt=1452790820, file.et=1421712000, file.lt=1421798400, file.mtime=1452790832 01-14-2016 17:00:32.561 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.561 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/23/ 01-14-2016 17:00:32.561 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/23 01-14-2016 17:00:32.561 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/23, search.et=1452787200, search.lt=1452790820, file.et=1421971200, file.lt=1422057600, file.mtime=1452790832 01-14-2016 17:00:32.562 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.562 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/22/ 01-14-2016 17:00:32.562 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/22 01-14-2016 17:00:32.562 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/22, search.et=1452787200, search.lt=1452790820, file.et=1421884800, file.lt=1421971200, file.mtime=1452790832 01-14-2016 17:00:32.563 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.563 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/26/ 01-14-2016 17:00:32.563 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/26 01-14-2016 17:00:32.563 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/26, search.et=1452787200, search.lt=1452790820, file.et=1422230400, file.lt=1422316800, file.mtime=1452790832 01-14-2016 17:00:32.563 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.564 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/31/ 01-14-2016 17:00:32.564 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/31 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/31, search.et=1452787200, search.lt=1452790820, file.et=1422662400, file.lt=1422748800, file.mtime=1452790832 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/31, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=888, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/15/ 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/15 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/15, search.et=1452787200, search.lt=1452790820, file.et=1421280000, file.lt=1421366400, file.mtime=1452790832 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/16/ 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/16 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/16, search.et=1452787200, search.lt=1452790820, file.et=1421366400, file.lt=1421452800, file.mtime=1452790832 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/18/ 01-14-2016 17:00:32.565 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/18 01-14-2016 17:00:32.566 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/18, search.et=1452787200, search.lt=1452790820, file.et=1421539200, file.lt=1421625600, file.mtime=1452790832 01-14-2016 17:00:32.566 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.566 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/09/ 01-14-2016 17:00:32.566 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/09 01-14-2016 17:00:32.566 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.566 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/09, search.et=1452787200, search.lt=1452790820, file.et=1420761600, file.lt=1420848000, file.mtime=1452790832 01-14-2016 17:00:32.566 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.566 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/05/ 01-14-2016 17:00:32.567 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/05 01-14-2016 17:00:32.567 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/05, search.et=1452787200, search.lt=1452790820, file.et=1420416000, file.lt=1420502400, file.mtime=1452790832 01-14-2016 17:00:32.567 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.567 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.567 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/03/ 01-14-2016 17:00:32.567 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/03 01-14-2016 17:00:32.567 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/03, search.et=1452787200, search.lt=1452790820, file.et=1420243200, file.lt=1420329600, file.mtime=1452790832 01-14-2016 17:00:32.567 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.568 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/17/ 01-14-2016 17:00:32.568 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/17 01-14-2016 17:00:32.568 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/17, search.et=1452787200, search.lt=1452790820, file.et=1421452800, file.lt=1421539200, file.mtime=1452790832 01-14-2016 17:00:32.568 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/01/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.568 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/ 01-14-2016 17:00:32.568 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12 01-14-2016 17:00:32.568 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.569 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=890, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.569 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=889, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.570 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4220] 01-14-2016 17:00:32.570 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=891, msg=IgfsStreamControlRequest [streamId=144, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.574 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.580 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.581 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.581 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.581 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.581 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.581 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.582 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.582 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.582 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.582 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.582 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|142" 01-14-2016 17:00:32.582 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|142" 01-14-2016 17:00:32.582 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|142" 01-14-2016 17:00:32.582 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|142 01-14-2016 17:00:32.582 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.582 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.583 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914496.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|142 01-14-2016 17:00:32.585 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.585 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.585 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.585 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.585 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.585 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.586 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy = 01-14-2016 17:00:32.586 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.590 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=890, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.593 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/10/ 01-14-2016 17:00:32.594 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/10 01-14-2016 17:00:32.594 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/10, search.et=1452787200, search.lt=1452790820, file.et=1449705600, file.lt=1449792000, file.mtime=1452790832 01-14-2016 17:00:32.594 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.594 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/18/ 01-14-2016 17:00:32.594 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/18 01-14-2016 17:00:32.594 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/18, search.et=1452787200, search.lt=1452790820, file.et=1450396800, file.lt=1450483200, file.mtime=1452790832 01-14-2016 17:00:32.595 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.595 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/17/ 01-14-2016 17:00:32.595 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/17 01-14-2016 17:00:32.595 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/17, search.et=1452787200, search.lt=1452790820, file.et=1450310400, file.lt=1450396800, file.mtime=1452790832 01-14-2016 17:00:32.595 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.595 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/19/ 01-14-2016 17:00:32.595 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/19 01-14-2016 17:00:32.596 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/19, search.et=1452787200, search.lt=1452790820, file.et=1450483200, file.lt=1450569600, file.mtime=1452790832 01-14-2016 17:00:32.596 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.596 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/30/ 01-14-2016 17:00:32.596 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/30 01-14-2016 17:00:32.596 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/30, search.et=1452787200, search.lt=1452790820, file.et=1451433600, file.lt=1451520000, file.mtime=1452790832 01-14-2016 17:00:32.596 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.596 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/13/ 01-14-2016 17:00:32.597 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/13 01-14-2016 17:00:32.597 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/13, search.et=1452787200, search.lt=1452790820, file.et=1449964800, file.lt=1450051200, file.mtime=1452790832 01-14-2016 17:00:32.597 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.597 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/07/ 01-14-2016 17:00:32.597 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/07 01-14-2016 17:00:32.597 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/07, search.et=1452787200, search.lt=1452790820, file.et=1449446400, file.lt=1449532800, file.mtime=1452790832 01-14-2016 17:00:32.598 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.598 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/25/ 01-14-2016 17:00:32.598 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/25 01-14-2016 17:00:32.598 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/25, search.et=1452787200, search.lt=1452790820, file.et=1451001600, file.lt=1451088000, file.mtime=1452790832 01-14-2016 17:00:32.598 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.598 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/20/ 01-14-2016 17:00:32.598 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/20 01-14-2016 17:00:32.599 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/20, search.et=1452787200, search.lt=1452790820, file.et=1450569600, file.lt=1450656000, file.mtime=1452790832 01-14-2016 17:00:32.599 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.599 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/21/ 01-14-2016 17:00:32.599 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/21 01-14-2016 17:00:32.599 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/21, search.et=1452787200, search.lt=1452790820, file.et=1450656000, file.lt=1450742400, file.mtime=1452790832 01-14-2016 17:00:32.599 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/22/ 01-14-2016 17:00:32.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/22 01-14-2016 17:00:32.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/22, search.et=1452787200, search.lt=1452790820, file.et=1450742400, file.lt=1450828800, file.mtime=1452790832 01-14-2016 17:00:32.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/23/ 01-14-2016 17:00:32.600 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/23 01-14-2016 17:00:32.601 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/23, search.et=1452787200, search.lt=1452790820, file.et=1450828800, file.lt=1450915200, file.mtime=1452790832 01-14-2016 17:00:32.601 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.601 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/15/ 01-14-2016 17:00:32.601 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/15 01-14-2016 17:00:32.601 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/15, search.et=1452787200, search.lt=1452790820, file.et=1450137600, file.lt=1450224000, file.mtime=1452790832 01-14-2016 17:00:32.601 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.602 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/05/ 01-14-2016 17:00:32.602 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/05 01-14-2016 17:00:32.602 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/05, search.et=1452787200, search.lt=1452790820, file.et=1449273600, file.lt=1449360000, file.mtime=1452790832 01-14-2016 17:00:32.602 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.602 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/16/ 01-14-2016 17:00:32.603 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/16 01-14-2016 17:00:32.603 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/16, search.et=1452787200, search.lt=1452790820, file.et=1450224000, file.lt=1450310400, file.mtime=1452790832 01-14-2016 17:00:32.603 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.603 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/03/ 01-14-2016 17:00:32.603 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/03 01-14-2016 17:00:32.604 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/03, search.et=1452787200, search.lt=1452790820, file.et=1449100800, file.lt=1449187200, file.mtime=1452790832 01-14-2016 17:00:32.604 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.604 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/26/ 01-14-2016 17:00:32.604 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/26 01-14-2016 17:00:32.604 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/26, search.et=1452787200, search.lt=1452790820, file.et=1451088000, file.lt=1451174400, file.mtime=1452790832 01-14-2016 17:00:32.604 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.605 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/02/ 01-14-2016 17:00:32.605 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/02 01-14-2016 17:00:32.605 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/02, search.et=1452787200, search.lt=1452790820, file.et=1449014400, file.lt=1449100800, file.mtime=1452790832 01-14-2016 17:00:32.605 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.605 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/14/ 01-14-2016 17:00:32.605 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/14 01-14-2016 17:00:32.606 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/14, search.et=1452787200, search.lt=1452790820, file.et=1450051200, file.lt=1450137600, file.mtime=1452790832 01-14-2016 17:00:32.606 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.606 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/09/ 01-14-2016 17:00:32.606 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/09 01-14-2016 17:00:32.606 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/09, search.et=1452787200, search.lt=1452790820, file.et=1449619200, file.lt=1449705600, file.mtime=1452790832 01-14-2016 17:00:32.606 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.607 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/08/ 01-14-2016 17:00:32.607 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/08 01-14-2016 17:00:32.607 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/08, search.et=1452787200, search.lt=1452790820, file.et=1449532800, file.lt=1449619200, file.mtime=1452790832 01-14-2016 17:00:32.607 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.607 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/12/ 01-14-2016 17:00:32.608 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/12 01-14-2016 17:00:32.608 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/12, search.et=1452787200, search.lt=1452790820, file.et=1449878400, file.lt=1449964800, file.mtime=1452790832 01-14-2016 17:00:32.608 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.608 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/27/ 01-14-2016 17:00:32.608 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/27 01-14-2016 17:00:32.609 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/27, search.et=1452787200, search.lt=1452790820, file.et=1451174400, file.lt=1451260800, file.mtime=1452790832 01-14-2016 17:00:32.609 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.609 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/28/ 01-14-2016 17:00:32.609 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/28 01-14-2016 17:00:32.609 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/28, search.et=1452787200, search.lt=1452790820, file.et=1451260800, file.lt=1451347200, file.mtime=1452790832 01-14-2016 17:00:32.609 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.610 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/11/ 01-14-2016 17:00:32.610 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/11 01-14-2016 17:00:32.610 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/11, search.et=1452787200, search.lt=1452790820, file.et=1449792000, file.lt=1449878400, file.mtime=1452790832 01-14-2016 17:00:32.610 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.610 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/24/ 01-14-2016 17:00:32.610 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/24 01-14-2016 17:00:32.611 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/24, search.et=1452787200, search.lt=1452790820, file.et=1450915200, file.lt=1451001600, file.mtime=1452790832 01-14-2016 17:00:32.611 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.611 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/01/ 01-14-2016 17:00:32.611 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/01 01-14-2016 17:00:32.612 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/01, search.et=1452787200, search.lt=1452790820, file.et=1448928000, file.lt=1449014400, file.mtime=1452790832 01-14-2016 17:00:32.612 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.612 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/04/ 01-14-2016 17:00:32.612 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/04 01-14-2016 17:00:32.612 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/04, search.et=1452787200, search.lt=1452790820, file.et=1449187200, file.lt=1449273600, file.mtime=1452790832 01-14-2016 17:00:32.612 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.613 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/31/ 01-14-2016 17:00:32.613 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/31 01-14-2016 17:00:32.613 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/31, search.et=1452787200, search.lt=1452790820, file.et=1451520000, file.lt=1451606400, file.mtime=1452790832 01-14-2016 17:00:32.613 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/31, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.613 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/29/ 01-14-2016 17:00:32.614 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/29 01-14-2016 17:00:32.614 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/29, search.et=1452787200, search.lt=1452790820, file.et=1451347200, file.lt=1451433600, file.mtime=1452790832 01-14-2016 17:00:32.614 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.614 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/06/ 01-14-2016 17:00:32.614 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/06 01-14-2016 17:00:32.615 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/06, search.et=1452787200, search.lt=1452790820, file.et=1449360000, file.lt=1449446400, file.mtime=1452790832 01-14-2016 17:00:32.615 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/12/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.615 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/ 01-14-2016 17:00:32.615 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.615 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06 01-14-2016 17:00:32.615 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.616 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=892, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.616 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.616 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=891, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.616 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=144] 01-14-2016 17:00:32.616 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4220], readTime=92645565, userTime=43714872] 01-14-2016 17:00:32.617 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy:0+4690 01-14-2016 17:00:32.618 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.620 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=893, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.622 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.623 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.623 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.623 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.623 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.623 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.623 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.623 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.623 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.629 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.629 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.629 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.629 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.630 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.630 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.630 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.630 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.630 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.630 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.630 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|143" 01-14-2016 17:00:32.630 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|143" 01-14-2016 17:00:32.630 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|143" 01-14-2016 17:00:32.630 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|143 01-14-2016 17:00:32.630 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.630 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.631 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914404.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|143 01-14-2016 17:00:32.632 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.633 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.633 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.633 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.633 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.633 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.634 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy = 01-14-2016 17:00:32.634 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=892, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.642 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/20/ 01-14-2016 17:00:32.642 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/20 01-14-2016 17:00:32.642 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/20, search.et=1452787200, search.lt=1452790820, file.et=1434754800, file.lt=1434841200, file.mtime=1452790832 01-14-2016 17:00:32.642 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.643 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/29/ 01-14-2016 17:00:32.643 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/29 01-14-2016 17:00:32.643 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/29, search.et=1452787200, search.lt=1452790820, file.et=1435532400, file.lt=1435618800, file.mtime=1452790832 01-14-2016 17:00:32.643 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.643 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/25/ 01-14-2016 17:00:32.643 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/25 01-14-2016 17:00:32.644 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/25, search.et=1452787200, search.lt=1452790820, file.et=1435186800, file.lt=1435273200, file.mtime=1452790832 01-14-2016 17:00:32.644 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.644 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/08/ 01-14-2016 17:00:32.644 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/08 01-14-2016 17:00:32.644 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/08, search.et=1452787200, search.lt=1452790820, file.et=1433718000, file.lt=1433804400, file.mtime=1452790832 01-14-2016 17:00:32.645 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.645 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/21/ 01-14-2016 17:00:32.645 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/21 01-14-2016 17:00:32.645 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/21, search.et=1452787200, search.lt=1452790820, file.et=1434841200, file.lt=1434927600, file.mtime=1452790832 01-14-2016 17:00:32.645 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.646 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/04/ 01-14-2016 17:00:32.646 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/04 01-14-2016 17:00:32.646 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/04, search.et=1452787200, search.lt=1452790820, file.et=1433372400, file.lt=1433458800, file.mtime=1452790832 01-14-2016 17:00:32.646 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.646 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/14/ 01-14-2016 17:00:32.646 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/14 01-14-2016 17:00:32.647 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/14, search.et=1452787200, search.lt=1452790820, file.et=1434236400, file.lt=1434322800, file.mtime=1452790832 01-14-2016 17:00:32.647 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.647 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/17/ 01-14-2016 17:00:32.647 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/17 01-14-2016 17:00:32.647 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/17, search.et=1452787200, search.lt=1452790820, file.et=1434495600, file.lt=1434582000, file.mtime=1452790832 01-14-2016 17:00:32.648 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.648 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/16/ 01-14-2016 17:00:32.648 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/16 01-14-2016 17:00:32.648 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/16, search.et=1452787200, search.lt=1452790820, file.et=1434409200, file.lt=1434495600, file.mtime=1452790832 01-14-2016 17:00:32.648 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.648 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/11/ 01-14-2016 17:00:32.648 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/11 01-14-2016 17:00:32.649 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/11, search.et=1452787200, search.lt=1452790820, file.et=1433977200, file.lt=1434063600, file.mtime=1452790832 01-14-2016 17:00:32.649 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.649 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/15/ 01-14-2016 17:00:32.649 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/15 01-14-2016 17:00:32.649 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/15, search.et=1452787200, search.lt=1452790820, file.et=1434322800, file.lt=1434409200, file.mtime=1452790832 01-14-2016 17:00:32.650 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.650 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/13/ 01-14-2016 17:00:32.650 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/13 01-14-2016 17:00:32.650 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/13, search.et=1452787200, search.lt=1452790820, file.et=1434150000, file.lt=1434236400, file.mtime=1452790832 01-14-2016 17:00:32.650 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.650 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/09/ 01-14-2016 17:00:32.651 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/09 01-14-2016 17:00:32.651 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/09, search.et=1452787200, search.lt=1452790820, file.et=1433804400, file.lt=1433890800, file.mtime=1452790832 01-14-2016 17:00:32.651 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.651 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/22/ 01-14-2016 17:00:32.651 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/22 01-14-2016 17:00:32.651 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/22, search.et=1452787200, search.lt=1452790820, file.et=1434927600, file.lt=1435014000, file.mtime=1452790832 01-14-2016 17:00:32.652 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.652 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/07/ 01-14-2016 17:00:32.652 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/07 01-14-2016 17:00:32.652 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/07, search.et=1452787200, search.lt=1452790820, file.et=1433631600, file.lt=1433718000, file.mtime=1452790832 01-14-2016 17:00:32.652 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.653 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/19/ 01-14-2016 17:00:32.653 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/19 01-14-2016 17:00:32.653 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/19, search.et=1452787200, search.lt=1452790820, file.et=1434668400, file.lt=1434754800, file.mtime=1452790832 01-14-2016 17:00:32.653 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.653 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/24/ 01-14-2016 17:00:32.653 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/24 01-14-2016 17:00:32.654 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/24, search.et=1452787200, search.lt=1452790820, file.et=1435100400, file.lt=1435186800, file.mtime=1452790832 01-14-2016 17:00:32.654 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.654 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/06/ 01-14-2016 17:00:32.654 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/06 01-14-2016 17:00:32.654 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/06, search.et=1452787200, search.lt=1452790820, file.et=1433545200, file.lt=1433631600, file.mtime=1452790832 01-14-2016 17:00:32.655 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.655 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/05/ 01-14-2016 17:00:32.655 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/05 01-14-2016 17:00:32.655 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/05, search.et=1452787200, search.lt=1452790820, file.et=1433458800, file.lt=1433545200, file.mtime=1452790832 01-14-2016 17:00:32.655 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/26/ 01-14-2016 17:00:32.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/26 01-14-2016 17:00:32.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/26, search.et=1452787200, search.lt=1452790820, file.et=1435273200, file.lt=1435359600, file.mtime=1452790832 01-14-2016 17:00:32.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/23/ 01-14-2016 17:00:32.656 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/23 01-14-2016 17:00:32.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/23, search.et=1452787200, search.lt=1452790820, file.et=1435014000, file.lt=1435100400, file.mtime=1452790832 01-14-2016 17:00:32.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/27/ 01-14-2016 17:00:32.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/27 01-14-2016 17:00:32.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/27, search.et=1452787200, search.lt=1452790820, file.et=1435359600, file.lt=1435446000, file.mtime=1452790832 01-14-2016 17:00:32.657 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.658 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/28/ 01-14-2016 17:00:32.658 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/28 01-14-2016 17:00:32.658 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/28, search.et=1452787200, search.lt=1452790820, file.et=1435446000, file.lt=1435532400, file.mtime=1452790832 01-14-2016 17:00:32.658 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.658 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/03/ 01-14-2016 17:00:32.658 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/03 01-14-2016 17:00:32.659 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/03, search.et=1452787200, search.lt=1452790820, file.et=1433286000, file.lt=1433372400, file.mtime=1452790832 01-14-2016 17:00:32.659 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.659 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/10/ 01-14-2016 17:00:32.659 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/10 01-14-2016 17:00:32.659 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/10, search.et=1452787200, search.lt=1452790820, file.et=1433890800, file.lt=1433977200, file.mtime=1452790832 01-14-2016 17:00:32.659 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.660 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/12/ 01-14-2016 17:00:32.660 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/12 01-14-2016 17:00:32.660 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/12, search.et=1452787200, search.lt=1452790820, file.et=1434063600, file.lt=1434150000, file.mtime=1452790832 01-14-2016 17:00:32.660 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.660 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/18/ 01-14-2016 17:00:32.660 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/18 01-14-2016 17:00:32.661 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/18, search.et=1452787200, search.lt=1452790820, file.et=1434582000, file.lt=1434668400, file.mtime=1452790832 01-14-2016 17:00:32.661 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.661 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/30/ 01-14-2016 17:00:32.661 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/30 01-14-2016 17:00:32.661 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/30, search.et=1452787200, search.lt=1452790820, file.et=1435618800, file.lt=1435705200, file.mtime=1452790832 01-14-2016 17:00:32.661 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.662 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/02/ 01-14-2016 17:00:32.662 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/02 01-14-2016 17:00:32.662 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/02, search.et=1452787200, search.lt=1452790820, file.et=1433199600, file.lt=1433286000, file.mtime=1452790832 01-14-2016 17:00:32.662 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.662 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/01/ 01-14-2016 17:00:32.662 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/01 01-14-2016 17:00:32.663 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/01, search.et=1452787200, search.lt=1452790820, file.et=1433113200, file.lt=1433199600, file.mtime=1452790832 01-14-2016 17:00:32.663 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/06/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.663 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/ 01-14-2016 17:00:32.663 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04 01-14-2016 17:00:32.663 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.663 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=894, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=893, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.664 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=145] 01-14-2016 17:00:32.664 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4690]] 01-14-2016 17:00:32.665 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.665 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy:0+4690 01-14-2016 17:00:32.665 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy:0+4690 01-14-2016 17:00:32.666 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=895, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.668 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.669 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.676 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.676 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.676 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.676 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.676 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.676 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.676 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.676 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.676 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.682 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.683 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.683 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.683 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.683 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.684 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.684 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.684 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.684 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.684 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.684 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|144" 01-14-2016 17:00:32.684 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|144" 01-14-2016 17:00:32.684 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|144" 01-14-2016 17:00:32.684 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|144 01-14-2016 17:00:32.684 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.686 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=894, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.689 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/30/ 01-14-2016 17:00:32.689 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/30 01-14-2016 17:00:32.689 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/30, search.et=1452787200, search.lt=1452790820, file.et=1430348400, file.lt=1430434800, file.mtime=1452790832 01-14-2016 17:00:32.689 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.690 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/27/ 01-14-2016 17:00:32.690 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/27 01-14-2016 17:00:32.690 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/27, search.et=1452787200, search.lt=1452790820, file.et=1430089200, file.lt=1430175600, file.mtime=1452790832 01-14-2016 17:00:32.690 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.690 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/12/ 01-14-2016 17:00:32.690 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/12 01-14-2016 17:00:32.690 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/12, search.et=1452787200, search.lt=1452790820, file.et=1428793200, file.lt=1428879600, file.mtime=1452790832 01-14-2016 17:00:32.691 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.691 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/15/ 01-14-2016 17:00:32.691 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/15 01-14-2016 17:00:32.691 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/15, search.et=1452787200, search.lt=1452790820, file.et=1429052400, file.lt=1429138800, file.mtime=1452790832 01-14-2016 17:00:32.691 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.691 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/28/ 01-14-2016 17:00:32.691 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/28 01-14-2016 17:00:32.692 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/28, search.et=1452787200, search.lt=1452790820, file.et=1430175600, file.lt=1430262000, file.mtime=1452790832 01-14-2016 17:00:32.692 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.692 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/22/ 01-14-2016 17:00:32.692 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/22 01-14-2016 17:00:32.692 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/22, search.et=1452787200, search.lt=1452790820, file.et=1429657200, file.lt=1429743600, file.mtime=1452790832 01-14-2016 17:00:32.692 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.692 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/16/ 01-14-2016 17:00:32.693 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/16 01-14-2016 17:00:32.693 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/16, search.et=1452787200, search.lt=1452790820, file.et=1429138800, file.lt=1429225200, file.mtime=1452790832 01-14-2016 17:00:32.693 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.693 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/19/ 01-14-2016 17:00:32.693 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/19 01-14-2016 17:00:32.693 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/19, search.et=1452787200, search.lt=1452790820, file.et=1429398000, file.lt=1429484400, file.mtime=1452790832 01-14-2016 17:00:32.693 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.694 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/11/ 01-14-2016 17:00:32.694 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/11 01-14-2016 17:00:32.694 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/11, search.et=1452787200, search.lt=1452790820, file.et=1428706800, file.lt=1428793200, file.mtime=1452790832 01-14-2016 17:00:32.694 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.694 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/17/ 01-14-2016 17:00:32.694 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/17 01-14-2016 17:00:32.694 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/17, search.et=1452787200, search.lt=1452790820, file.et=1429225200, file.lt=1429311600, file.mtime=1452790832 01-14-2016 17:00:32.695 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.695 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/10/ 01-14-2016 17:00:32.695 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/10 01-14-2016 17:00:32.695 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/10, search.et=1452787200, search.lt=1452790820, file.et=1428620400, file.lt=1428706800, file.mtime=1452790832 01-14-2016 17:00:32.695 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.695 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/14/ 01-14-2016 17:00:32.695 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/14 01-14-2016 17:00:32.696 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/14, search.et=1452787200, search.lt=1452790820, file.et=1428966000, file.lt=1429052400, file.mtime=1452790832 01-14-2016 17:00:32.696 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.696 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/09/ 01-14-2016 17:00:32.696 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/09 01-14-2016 17:00:32.696 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/09, search.et=1452787200, search.lt=1452790820, file.et=1428534000, file.lt=1428620400, file.mtime=1452790832 01-14-2016 17:00:32.696 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.696 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/07/ 01-14-2016 17:00:32.696 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/07 01-14-2016 17:00:32.697 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/07, search.et=1452787200, search.lt=1452790820, file.et=1428361200, file.lt=1428447600, file.mtime=1452790832 01-14-2016 17:00:32.697 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.697 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/25/ 01-14-2016 17:00:32.697 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/25 01-14-2016 17:00:32.697 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/25, search.et=1452787200, search.lt=1452790820, file.et=1429916400, file.lt=1430002800, file.mtime=1452790832 01-14-2016 17:00:32.697 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.698 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/26/ 01-14-2016 17:00:32.698 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/26 01-14-2016 17:00:32.698 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/26, search.et=1452787200, search.lt=1452790820, file.et=1430002800, file.lt=1430089200, file.mtime=1452790832 01-14-2016 17:00:32.698 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.698 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/05/ 01-14-2016 17:00:32.698 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/05 01-14-2016 17:00:32.698 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/05, search.et=1452787200, search.lt=1452790820, file.et=1428188400, file.lt=1428274800, file.mtime=1452790832 01-14-2016 17:00:32.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/21/ 01-14-2016 17:00:32.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/21 01-14-2016 17:00:32.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/21, search.et=1452787200, search.lt=1452790820, file.et=1429570800, file.lt=1429657200, file.mtime=1452790832 01-14-2016 17:00:32.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/13/ 01-14-2016 17:00:32.699 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/13 01-14-2016 17:00:32.700 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/13, search.et=1452787200, search.lt=1452790820, file.et=1428879600, file.lt=1428966000, file.mtime=1452790832 01-14-2016 17:00:32.700 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.700 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/06/ 01-14-2016 17:00:32.700 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/06 01-14-2016 17:00:32.700 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/06, search.et=1452787200, search.lt=1452790820, file.et=1428274800, file.lt=1428361200, file.mtime=1452790832 01-14-2016 17:00:32.700 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.700 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/29/ 01-14-2016 17:00:32.701 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/29 01-14-2016 17:00:32.701 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/29, search.et=1452787200, search.lt=1452790820, file.et=1430262000, file.lt=1430348400, file.mtime=1452790832 01-14-2016 17:00:32.701 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.701 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/20/ 01-14-2016 17:00:32.701 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/20 01-14-2016 17:00:32.701 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/20, search.et=1452787200, search.lt=1452790820, file.et=1429484400, file.lt=1429570800, file.mtime=1452790832 01-14-2016 17:00:32.701 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.702 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/08/ 01-14-2016 17:00:32.702 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/08 01-14-2016 17:00:32.702 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/08, search.et=1452787200, search.lt=1452790820, file.et=1428447600, file.lt=1428534000, file.mtime=1452790832 01-14-2016 17:00:32.702 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.702 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/18/ 01-14-2016 17:00:32.702 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/18 01-14-2016 17:00:32.702 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/18, search.et=1452787200, search.lt=1452790820, file.et=1429311600, file.lt=1429398000, file.mtime=1452790832 01-14-2016 17:00:32.703 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.703 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/23/ 01-14-2016 17:00:32.703 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/23 01-14-2016 17:00:32.703 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/23, search.et=1452787200, search.lt=1452790820, file.et=1429743600, file.lt=1429830000, file.mtime=1452790832 01-14-2016 17:00:32.703 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.703 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/24/ 01-14-2016 17:00:32.703 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/24 01-14-2016 17:00:32.704 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/24, search.et=1452787200, search.lt=1452790820, file.et=1429830000, file.lt=1429916400, file.mtime=1452790832 01-14-2016 17:00:32.704 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.704 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/01/ 01-14-2016 17:00:32.704 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/01 01-14-2016 17:00:32.704 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/01, search.et=1452787200, search.lt=1452790820, file.et=1427842800, file.lt=1427929200, file.mtime=1452790832 01-14-2016 17:00:32.704 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.704 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/02/ 01-14-2016 17:00:32.705 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/02 01-14-2016 17:00:32.705 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/02, search.et=1452787200, search.lt=1452790820, file.et=1427929200, file.lt=1428015600, file.mtime=1452790832 01-14-2016 17:00:32.705 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.705 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/03/ 01-14-2016 17:00:32.705 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/03 01-14-2016 17:00:32.705 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/03, search.et=1452787200, search.lt=1452790820, file.et=1428015600, file.lt=1428102000, file.mtime=1452790832 01-14-2016 17:00:32.705 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.706 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/04/ 01-14-2016 17:00:32.706 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/04 01-14-2016 17:00:32.706 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/04, search.et=1452787200, search.lt=1452790820, file.et=1428102000, file.lt=1428188400, file.mtime=1452790832 01-14-2016 17:00:32.706 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/04/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.706 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/ 01-14-2016 17:00:32.706 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07 01-14-2016 17:00:32.706 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.707 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=896, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.707 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=895, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.707 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=897, msg=IgfsStreamControlRequest [streamId=145, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.708 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=898, msg=IgfsStreamControlRequest [streamId=145, pos=4096, len=594, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.730 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=896, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.733 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/12/ 01-14-2016 17:00:32.733 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/12 01-14-2016 17:00:32.733 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/12, search.et=1452787200, search.lt=1452790820, file.et=1436655600, file.lt=1436742000, file.mtime=1452790832 01-14-2016 17:00:32.734 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.734 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/14/ 01-14-2016 17:00:32.734 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/14 01-14-2016 17:00:32.734 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/14, search.et=1452787200, search.lt=1452790820, file.et=1436828400, file.lt=1436914800, file.mtime=1452790832 01-14-2016 17:00:32.734 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.735 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/02/ 01-14-2016 17:00:32.735 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/02 01-14-2016 17:00:32.735 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/02, search.et=1452787200, search.lt=1452790820, file.et=1435791600, file.lt=1435878000, file.mtime=1452790832 01-14-2016 17:00:32.735 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.735 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/01/ 01-14-2016 17:00:32.736 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/01 01-14-2016 17:00:32.736 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/01, search.et=1452787200, search.lt=1452790820, file.et=1435705200, file.lt=1435791600, file.mtime=1452790832 01-14-2016 17:00:32.736 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.736 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/13/ 01-14-2016 17:00:32.736 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/13 01-14-2016 17:00:32.737 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/13, search.et=1452787200, search.lt=1452790820, file.et=1436742000, file.lt=1436828400, file.mtime=1452790832 01-14-2016 17:00:32.737 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.737 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/10/ 01-14-2016 17:00:32.737 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/10 01-14-2016 17:00:32.737 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/10, search.et=1452787200, search.lt=1452790820, file.et=1436482800, file.lt=1436569200, file.mtime=1452790832 01-14-2016 17:00:32.738 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.738 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/06/ 01-14-2016 17:00:32.738 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/06 01-14-2016 17:00:32.738 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/06, search.et=1452787200, search.lt=1452790820, file.et=1436137200, file.lt=1436223600, file.mtime=1452790832 01-14-2016 17:00:32.739 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.739 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/05/ 01-14-2016 17:00:32.739 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/05 01-14-2016 17:00:32.739 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/05, search.et=1452787200, search.lt=1452790820, file.et=1436050800, file.lt=1436137200, file.mtime=1452790832 01-14-2016 17:00:32.739 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.740 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/04/ 01-14-2016 17:00:32.740 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/04 01-14-2016 17:00:32.740 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/04, search.et=1452787200, search.lt=1452790820, file.et=1435964400, file.lt=1436050800, file.mtime=1452790832 01-14-2016 17:00:32.740 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.740 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/19/ 01-14-2016 17:00:32.741 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/19 01-14-2016 17:00:32.741 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/19, search.et=1452787200, search.lt=1452790820, file.et=1437260400, file.lt=1437346800, file.mtime=1452790832 01-14-2016 17:00:32.741 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.741 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/21/ 01-14-2016 17:00:32.741 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/21 01-14-2016 17:00:32.742 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/21, search.et=1452787200, search.lt=1452790820, file.et=1437433200, file.lt=1437519600, file.mtime=1452790832 01-14-2016 17:00:32.742 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.742 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/26/ 01-14-2016 17:00:32.742 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/26 01-14-2016 17:00:32.742 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/26, search.et=1452787200, search.lt=1452790820, file.et=1437865200, file.lt=1437951600, file.mtime=1452790832 01-14-2016 17:00:32.742 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.743 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/27/ 01-14-2016 17:00:32.743 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/27 01-14-2016 17:00:32.743 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/27, search.et=1452787200, search.lt=1452790820, file.et=1437951600, file.lt=1438038000, file.mtime=1452790832 01-14-2016 17:00:32.743 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.743 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/07/ 01-14-2016 17:00:32.743 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/07 01-14-2016 17:00:32.744 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/07, search.et=1452787200, search.lt=1452790820, file.et=1436223600, file.lt=1436310000, file.mtime=1452790832 01-14-2016 17:00:32.744 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.744 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/29/ 01-14-2016 17:00:32.744 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/29 01-14-2016 17:00:32.744 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/29, search.et=1452787200, search.lt=1452790820, file.et=1438124400, file.lt=1438210800, file.mtime=1452790832 01-14-2016 17:00:32.744 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.745 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/22/ 01-14-2016 17:00:32.745 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/22 01-14-2016 17:00:32.745 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/22, search.et=1452787200, search.lt=1452790820, file.et=1437519600, file.lt=1437606000, file.mtime=1452790832 01-14-2016 17:00:32.745 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.745 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/23/ 01-14-2016 17:00:32.745 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/23 01-14-2016 17:00:32.746 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/23, search.et=1452787200, search.lt=1452790820, file.et=1437606000, file.lt=1437692400, file.mtime=1452790832 01-14-2016 17:00:32.746 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.746 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/08/ 01-14-2016 17:00:32.746 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/08 01-14-2016 17:00:32.746 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/08, search.et=1452787200, search.lt=1452790820, file.et=1436310000, file.lt=1436396400, file.mtime=1452790832 01-14-2016 17:00:32.746 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.747 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/09/ 01-14-2016 17:00:32.747 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/09 01-14-2016 17:00:32.747 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/09, search.et=1452787200, search.lt=1452790820, file.et=1436396400, file.lt=1436482800, file.mtime=1452790832 01-14-2016 17:00:32.747 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.747 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/03/ 01-14-2016 17:00:32.748 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/03 01-14-2016 17:00:32.748 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=897, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.748 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/03, search.et=1452787200, search.lt=1452790820, file.et=1435878000, file.lt=1435964400, file.mtime=1452790832 01-14-2016 17:00:32.748 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.748 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/25/ 01-14-2016 17:00:32.748 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/25 01-14-2016 17:00:32.748 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/25, search.et=1452787200, search.lt=1452790820, file.et=1437778800, file.lt=1437865200, file.mtime=1452790832 01-14-2016 17:00:32.748 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.749 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/16/ 01-14-2016 17:00:32.749 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/16 01-14-2016 17:00:32.749 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/16, search.et=1452787200, search.lt=1452790820, file.et=1437001200, file.lt=1437087600, file.mtime=1452790832 01-14-2016 17:00:32.749 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.749 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/31/ 01-14-2016 17:00:32.749 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/31 01-14-2016 17:00:32.749 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/31, search.et=1452787200, search.lt=1452790820, file.et=1438297200, file.lt=1438383600, file.mtime=1452790832 01-14-2016 17:00:32.750 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/31, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.750 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/20/ 01-14-2016 17:00:32.750 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/20 01-14-2016 17:00:32.750 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/20, search.et=1452787200, search.lt=1452790820, file.et=1437346800, file.lt=1437433200, file.mtime=1452790832 01-14-2016 17:00:32.750 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.750 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/17/ 01-14-2016 17:00:32.750 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/17 01-14-2016 17:00:32.751 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/17, search.et=1452787200, search.lt=1452790820, file.et=1437087600, file.lt=1437174000, file.mtime=1452790832 01-14-2016 17:00:32.751 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.751 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/28/ 01-14-2016 17:00:32.751 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/28 01-14-2016 17:00:32.751 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/28, search.et=1452787200, search.lt=1452790820, file.et=1438038000, file.lt=1438124400, file.mtime=1452790832 01-14-2016 17:00:32.751 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.752 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/24/ 01-14-2016 17:00:32.752 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/24 01-14-2016 17:00:32.752 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/24, search.et=1452787200, search.lt=1452790820, file.et=1437692400, file.lt=1437778800, file.mtime=1452790832 01-14-2016 17:00:32.752 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.752 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/15/ 01-14-2016 17:00:32.753 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/15 01-14-2016 17:00:32.753 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/15, search.et=1452787200, search.lt=1452790820, file.et=1436914800, file.lt=1437001200, file.mtime=1452790832 01-14-2016 17:00:32.753 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.753 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/11/ 01-14-2016 17:00:32.753 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/11 01-14-2016 17:00:32.754 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/11, search.et=1452787200, search.lt=1452790820, file.et=1436569200, file.lt=1436655600, file.mtime=1452790832 01-14-2016 17:00:32.754 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.754 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/18/ 01-14-2016 17:00:32.754 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/18 01-14-2016 17:00:32.755 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/18, search.et=1452787200, search.lt=1452790820, file.et=1437174000, file.lt=1437260400, file.mtime=1452790832 01-14-2016 17:00:32.755 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.755 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/30/ 01-14-2016 17:00:32.755 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/30 01-14-2016 17:00:32.755 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/30, search.et=1452787200, search.lt=1452790820, file.et=1438210800, file.lt=1438297200, file.mtime=1452790832 01-14-2016 17:00:32.756 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/07/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.756 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/ 01-14-2016 17:00:32.756 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11 01-14-2016 17:00:32.756 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.756 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=899, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.757 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=898, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.758 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.758 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915866.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|144 01-14-2016 17:00:32.758 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4690] 01-14-2016 17:00:32.758 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=900, msg=IgfsStreamControlRequest [streamId=145, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.759 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.759 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.759 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.759 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.759 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.759 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.760 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy = 01-14-2016 17:00:32.761 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.786 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=899, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.789 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/28/ 01-14-2016 17:00:32.789 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/28 01-14-2016 17:00:32.789 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/28, search.et=1452787200, search.lt=1452790820, file.et=1448668800, file.lt=1448755200, file.mtime=1452790832 01-14-2016 17:00:32.790 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.790 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/20/ 01-14-2016 17:00:32.790 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/20 01-14-2016 17:00:32.790 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/20, search.et=1452787200, search.lt=1452790820, file.et=1447977600, file.lt=1448064000, file.mtime=1452790832 01-14-2016 17:00:32.790 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.791 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/21/ 01-14-2016 17:00:32.791 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/21 01-14-2016 17:00:32.791 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/21, search.et=1452787200, search.lt=1452790820, file.et=1448064000, file.lt=1448150400, file.mtime=1452790832 01-14-2016 17:00:32.791 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.791 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/29/ 01-14-2016 17:00:32.792 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/29 01-14-2016 17:00:32.792 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/29, search.et=1452787200, search.lt=1452790820, file.et=1448755200, file.lt=1448841600, file.mtime=1452790832 01-14-2016 17:00:32.792 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.792 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/17/ 01-14-2016 17:00:32.792 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/17 01-14-2016 17:00:32.793 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/17, search.et=1452787200, search.lt=1452790820, file.et=1447718400, file.lt=1447804800, file.mtime=1452790832 01-14-2016 17:00:32.793 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.793 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/16/ 01-14-2016 17:00:32.793 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/16 01-14-2016 17:00:32.793 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/16, search.et=1452787200, search.lt=1452790820, file.et=1447632000, file.lt=1447718400, file.mtime=1452790832 01-14-2016 17:00:32.794 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.794 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/19/ 01-14-2016 17:00:32.794 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/19 01-14-2016 17:00:32.794 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/19, search.et=1452787200, search.lt=1452790820, file.et=1447891200, file.lt=1447977600, file.mtime=1452790832 01-14-2016 17:00:32.794 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.794 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/18/ 01-14-2016 17:00:32.795 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/18 01-14-2016 17:00:32.795 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/18, search.et=1452787200, search.lt=1452790820, file.et=1447804800, file.lt=1447891200, file.mtime=1452790832 01-14-2016 17:00:32.795 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.795 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/13/ 01-14-2016 17:00:32.795 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/13 01-14-2016 17:00:32.796 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/13, search.et=1452787200, search.lt=1452790820, file.et=1447372800, file.lt=1447459200, file.mtime=1452790832 01-14-2016 17:00:32.796 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.796 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/12/ 01-14-2016 17:00:32.796 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/12 01-14-2016 17:00:32.796 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/12, search.et=1452787200, search.lt=1452790820, file.et=1447286400, file.lt=1447372800, file.mtime=1452790832 01-14-2016 17:00:32.797 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.797 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/15/ 01-14-2016 17:00:32.797 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/15 01-14-2016 17:00:32.797 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/15, search.et=1452787200, search.lt=1452790820, file.et=1447545600, file.lt=1447632000, file.mtime=1452790832 01-14-2016 17:00:32.797 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:32.797 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.798 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/24/ 01-14-2016 17:00:32.798 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/24 01-14-2016 17:00:32.798 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/24, search.et=1452787200, search.lt=1452790820, file.et=1448323200, file.lt=1448409600, file.mtime=1452790832 01-14-2016 17:00:32.798 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.798 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/30/ 01-14-2016 17:00:32.798 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:32.798 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/30 01-14-2016 17:00:32.799 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/30, search.et=1452787200, search.lt=1452790820, file.et=1448841600, file.lt=1448928000, file.mtime=1452790832 01-14-2016 17:00:32.799 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.799 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/10/ 01-14-2016 17:00:32.799 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/10 01-14-2016 17:00:32.800 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/10, search.et=1452787200, search.lt=1452790820, file.et=1447113600, file.lt=1447200000, file.mtime=1452790832 01-14-2016 17:00:32.800 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.800 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/11/ 01-14-2016 17:00:32.800 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/11 01-14-2016 17:00:32.800 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/11, search.et=1452787200, search.lt=1452790820, file.et=1447200000, file.lt=1447286400, file.mtime=1452790832 01-14-2016 17:00:32.800 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.801 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/04/ 01-14-2016 17:00:32.801 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/04 01-14-2016 17:00:32.801 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/04, search.et=1452787200, search.lt=1452790820, file.et=1446595200, file.lt=1446681600, file.mtime=1452790832 01-14-2016 17:00:32.801 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.801 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/07/ 01-14-2016 17:00:32.802 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/07 01-14-2016 17:00:32.802 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/07, search.et=1452787200, search.lt=1452790820, file.et=1446854400, file.lt=1446940800, file.mtime=1452790832 01-14-2016 17:00:32.802 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.802 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/22/ 01-14-2016 17:00:32.802 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/22 01-14-2016 17:00:32.803 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/22, search.et=1452787200, search.lt=1452790820, file.et=1448150400, file.lt=1448236800, file.mtime=1452790832 01-14-2016 17:00:32.803 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.803 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/05/ 01-14-2016 17:00:32.803 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/05 01-14-2016 17:00:32.803 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/05, search.et=1452787200, search.lt=1452790820, file.et=1446681600, file.lt=1446768000, file.mtime=1452790832 01-14-2016 17:00:32.804 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.804 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/06/ 01-14-2016 17:00:32.804 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/06 01-14-2016 17:00:32.804 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/06, search.et=1452787200, search.lt=1452790820, file.et=1446768000, file.lt=1446854400, file.mtime=1452790832 01-14-2016 17:00:32.804 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.804 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/03/ 01-14-2016 17:00:32.805 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/03 01-14-2016 17:00:32.805 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/03, search.et=1452787200, search.lt=1452790820, file.et=1446508800, file.lt=1446595200, file.mtime=1452790832 01-14-2016 17:00:32.805 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.805 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/02/ 01-14-2016 17:00:32.805 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/02 01-14-2016 17:00:32.806 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/02, search.et=1452787200, search.lt=1452790820, file.et=1446422400, file.lt=1446508800, file.mtime=1452790832 01-14-2016 17:00:32.806 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.806 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/01/ 01-14-2016 17:00:32.806 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/01 01-14-2016 17:00:32.806 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/01, search.et=1452787200, search.lt=1452790820, file.et=1446336000, file.lt=1446422400, file.mtime=1452790832 01-14-2016 17:00:32.806 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.807 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/14/ 01-14-2016 17:00:32.807 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/14 01-14-2016 17:00:32.807 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/14, search.et=1452787200, search.lt=1452790820, file.et=1447459200, file.lt=1447545600, file.mtime=1452790832 01-14-2016 17:00:32.808 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:32.808 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:32.808 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:32.808 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:32.808 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:32.808 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:32.808 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:32.808 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:32.808 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:32.808 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.808 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/26/ 01-14-2016 17:00:32.808 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/26 01-14-2016 17:00:32.808 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/26, search.et=1452787200, search.lt=1452790820, file.et=1448496000, file.lt=1448582400, file.mtime=1452790832 01-14-2016 17:00:32.808 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.808 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/23/ 01-14-2016 17:00:32.808 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/23 01-14-2016 17:00:32.809 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/23, search.et=1452787200, search.lt=1452790820, file.et=1448236800, file.lt=1448323200, file.mtime=1452790832 01-14-2016 17:00:32.809 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.809 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/08/ 01-14-2016 17:00:32.809 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/08 01-14-2016 17:00:32.809 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/08, search.et=1452787200, search.lt=1452790820, file.et=1446940800, file.lt=1447027200, file.mtime=1452790832 01-14-2016 17:00:32.809 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.810 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/09/ 01-14-2016 17:00:32.810 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/09 01-14-2016 17:00:32.810 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/09, search.et=1452787200, search.lt=1452790820, file.et=1447027200, file.lt=1447113600, file.mtime=1452790832 01-14-2016 17:00:32.810 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.810 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/27/ 01-14-2016 17:00:32.811 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/27 01-14-2016 17:00:32.811 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/27, search.et=1452787200, search.lt=1452790820, file.et=1448582400, file.lt=1448668800, file.mtime=1452790832 01-14-2016 17:00:32.811 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.811 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/25/ 01-14-2016 17:00:32.811 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/25 01-14-2016 17:00:32.812 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/25, search.et=1452787200, search.lt=1452790820, file.et=1448409600, file.lt=1448496000, file.mtime=1452790832 01-14-2016 17:00:32.812 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/11/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.812 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/ 01-14-2016 17:00:32.812 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08 01-14-2016 17:00:32.812 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.813 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=901, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.813 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=900, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.813 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=145] 01-14-2016 17:00:32.813 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4690], readTime=104490207, userTime=44334799] 01-14-2016 17:00:32.814 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy:0+4037 01-14-2016 17:00:32.815 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.815 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:32.815 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:32.816 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.816 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.816 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=902, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:32.816 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.816 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:32.817 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:32.817 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:32.817 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:32.817 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:32.817 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|145" 01-14-2016 17:00:32.817 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|145" 01-14-2016 17:00:32.817 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|145" 01-14-2016 17:00:32.817 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|145 01-14-2016 17:00:32.818 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:32.840 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=901, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.843 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/31/ 01-14-2016 17:00:32.843 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/31 01-14-2016 17:00:32.844 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/31, search.et=1452787200, search.lt=1452790820, file.et=1440975600, file.lt=1441062000, file.mtime=1452790832 01-14-2016 17:00:32.844 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/31, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.844 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/06/ 01-14-2016 17:00:32.844 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/06 01-14-2016 17:00:32.844 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/06, search.et=1452787200, search.lt=1452790820, file.et=1438815600, file.lt=1438902000, file.mtime=1452790832 01-14-2016 17:00:32.845 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.845 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/05/ 01-14-2016 17:00:32.845 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/05 01-14-2016 17:00:32.845 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/05, search.et=1452787200, search.lt=1452790820, file.et=1438729200, file.lt=1438815600, file.mtime=1452790832 01-14-2016 17:00:32.845 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.846 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/10/ 01-14-2016 17:00:32.846 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/10 01-14-2016 17:00:32.846 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/10, search.et=1452787200, search.lt=1452790820, file.et=1439161200, file.lt=1439247600, file.mtime=1452790832 01-14-2016 17:00:32.846 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.846 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/07/ 01-14-2016 17:00:32.847 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/07 01-14-2016 17:00:32.847 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/07, search.et=1452787200, search.lt=1452790820, file.et=1438902000, file.lt=1438988400, file.mtime=1452790832 01-14-2016 17:00:32.847 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.847 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/02/ 01-14-2016 17:00:32.847 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/02 01-14-2016 17:00:32.847 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/02, search.et=1452787200, search.lt=1452790820, file.et=1438470000, file.lt=1438556400, file.mtime=1452790832 01-14-2016 17:00:32.848 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.848 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/20/ 01-14-2016 17:00:32.848 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/20 01-14-2016 17:00:32.848 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/20, search.et=1452787200, search.lt=1452790820, file.et=1440025200, file.lt=1440111600, file.mtime=1452790832 01-14-2016 17:00:32.848 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.848 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/01/ 01-14-2016 17:00:32.848 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/01 01-14-2016 17:00:32.849 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/01, search.et=1452787200, search.lt=1452790820, file.et=1438383600, file.lt=1438470000, file.mtime=1452790832 01-14-2016 17:00:32.849 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.849 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/21/ 01-14-2016 17:00:32.849 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/21 01-14-2016 17:00:32.849 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/21, search.et=1452787200, search.lt=1452790820, file.et=1440111600, file.lt=1440198000, file.mtime=1452790832 01-14-2016 17:00:32.849 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.850 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/04/ 01-14-2016 17:00:32.850 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/04 01-14-2016 17:00:32.850 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/04, search.et=1452787200, search.lt=1452790820, file.et=1438642800, file.lt=1438729200, file.mtime=1452790832 01-14-2016 17:00:32.850 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.850 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/22/ 01-14-2016 17:00:32.850 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/22 01-14-2016 17:00:32.850 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/22, search.et=1452787200, search.lt=1452790820, file.et=1440198000, file.lt=1440284400, file.mtime=1452790832 01-14-2016 17:00:32.851 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.851 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/12/ 01-14-2016 17:00:32.851 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/12 01-14-2016 17:00:32.851 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/12, search.et=1452787200, search.lt=1452790820, file.et=1439334000, file.lt=1439420400, file.mtime=1452790832 01-14-2016 17:00:32.851 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.851 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/23/ 01-14-2016 17:00:32.851 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/23 01-14-2016 17:00:32.852 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/23, search.et=1452787200, search.lt=1452790820, file.et=1440284400, file.lt=1440370800, file.mtime=1452790832 01-14-2016 17:00:32.852 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.852 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/24/ 01-14-2016 17:00:32.852 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/24 01-14-2016 17:00:32.852 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/24, search.et=1452787200, search.lt=1452790820, file.et=1440370800, file.lt=1440457200, file.mtime=1452790832 01-14-2016 17:00:32.852 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.852 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/25/ 01-14-2016 17:00:32.853 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/25 01-14-2016 17:00:32.853 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/25, search.et=1452787200, search.lt=1452790820, file.et=1440457200, file.lt=1440543600, file.mtime=1452790832 01-14-2016 17:00:32.853 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.853 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/19/ 01-14-2016 17:00:32.853 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/19 01-14-2016 17:00:32.853 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/19, search.et=1452787200, search.lt=1452790820, file.et=1439938800, file.lt=1440025200, file.mtime=1452790832 01-14-2016 17:00:32.854 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.854 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/27/ 01-14-2016 17:00:32.854 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/27 01-14-2016 17:00:32.854 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/27, search.et=1452787200, search.lt=1452790820, file.et=1440630000, file.lt=1440716400, file.mtime=1452790832 01-14-2016 17:00:32.854 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.854 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/28/ 01-14-2016 17:00:32.855 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/28 01-14-2016 17:00:32.855 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/28, search.et=1452787200, search.lt=1452790820, file.et=1440716400, file.lt=1440802800, file.mtime=1452790832 01-14-2016 17:00:32.855 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.855 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/08/ 01-14-2016 17:00:32.855 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/08 01-14-2016 17:00:32.855 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/08, search.et=1452787200, search.lt=1452790820, file.et=1438988400, file.lt=1439074800, file.mtime=1452790832 01-14-2016 17:00:32.855 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.856 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/29/ 01-14-2016 17:00:32.856 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/29 01-14-2016 17:00:32.856 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/29, search.et=1452787200, search.lt=1452790820, file.et=1440802800, file.lt=1440889200, file.mtime=1452790832 01-14-2016 17:00:32.856 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.856 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/18/ 01-14-2016 17:00:32.857 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/18 01-14-2016 17:00:32.857 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/18, search.et=1452787200, search.lt=1452790820, file.et=1439852400, file.lt=1439938800, file.mtime=1452790832 01-14-2016 17:00:32.857 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.857 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/17/ 01-14-2016 17:00:32.857 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/17 01-14-2016 17:00:32.858 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/17, search.et=1452787200, search.lt=1452790820, file.et=1439766000, file.lt=1439852400, file.mtime=1452790832 01-14-2016 17:00:32.858 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.858 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/16/ 01-14-2016 17:00:32.858 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/16 01-14-2016 17:00:32.858 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/16, search.et=1452787200, search.lt=1452790820, file.et=1439679600, file.lt=1439766000, file.mtime=1452790832 01-14-2016 17:00:32.859 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.859 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/03/ 01-14-2016 17:00:32.859 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/03 01-14-2016 17:00:32.859 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/03, search.et=1452787200, search.lt=1452790820, file.et=1438556400, file.lt=1438642800, file.mtime=1452790832 01-14-2016 17:00:32.859 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.859 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/14/ 01-14-2016 17:00:32.860 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/14 01-14-2016 17:00:32.860 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/14, search.et=1452787200, search.lt=1452790820, file.et=1439506800, file.lt=1439593200, file.mtime=1452790832 01-14-2016 17:00:32.860 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.860 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/26/ 01-14-2016 17:00:32.860 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/26 01-14-2016 17:00:32.861 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/26, search.et=1452787200, search.lt=1452790820, file.et=1440543600, file.lt=1440630000, file.mtime=1452790832 01-14-2016 17:00:32.861 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.861 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/30/ 01-14-2016 17:00:32.861 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/30 01-14-2016 17:00:32.861 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/30, search.et=1452787200, search.lt=1452790820, file.et=1440889200, file.lt=1440975600, file.mtime=1452790832 01-14-2016 17:00:32.862 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.862 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/13/ 01-14-2016 17:00:32.862 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/13 01-14-2016 17:00:32.862 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/13, search.et=1452787200, search.lt=1452790820, file.et=1439420400, file.lt=1439506800, file.mtime=1452790832 01-14-2016 17:00:32.862 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.863 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/11/ 01-14-2016 17:00:32.863 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/11 01-14-2016 17:00:32.863 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/11, search.et=1452787200, search.lt=1452790820, file.et=1439247600, file.lt=1439334000, file.mtime=1452790832 01-14-2016 17:00:32.863 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.863 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/15/ 01-14-2016 17:00:32.864 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/15 01-14-2016 17:00:32.864 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/15, search.et=1452787200, search.lt=1452790820, file.et=1439593200, file.lt=1439679600, file.mtime=1452790832 01-14-2016 17:00:32.864 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.864 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/09/ 01-14-2016 17:00:32.864 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/09 01-14-2016 17:00:32.865 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/09, search.et=1452787200, search.lt=1452790820, file.et=1439074800, file.lt=1439161200, file.mtime=1452790832 01-14-2016 17:00:32.865 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/08/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.865 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/ 01-14-2016 17:00:32.865 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05 01-14-2016 17:00:32.865 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.866 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=903, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.866 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=902, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.866 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:32.866 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=146] 01-14-2016 17:00:32.867 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4037]] 01-14-2016 17:00:32.867 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:32.867 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy:0+4037 01-14-2016 17:00:32.867 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy:0+4037 01-14-2016 17:00:32.868 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=904, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:32.889 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=903, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.892 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/29/ 01-14-2016 17:00:32.892 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/29 01-14-2016 17:00:32.893 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/29, search.et=1452787200, search.lt=1452790820, file.et=1432854000, file.lt=1432940400, file.mtime=1452790832 01-14-2016 17:00:32.893 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.893 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/28/ 01-14-2016 17:00:32.893 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/28 01-14-2016 17:00:32.893 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/28, search.et=1452787200, search.lt=1452790820, file.et=1432767600, file.lt=1432854000, file.mtime=1452790832 01-14-2016 17:00:32.893 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.894 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/31/ 01-14-2016 17:00:32.894 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/31 01-14-2016 17:00:32.894 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/31, search.et=1452787200, search.lt=1452790820, file.et=1433026800, file.lt=1433113200, file.mtime=1452790832 01-14-2016 17:00:32.894 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/31, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.894 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/20/ 01-14-2016 17:00:32.895 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/20 01-14-2016 17:00:32.895 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/20, search.et=1452787200, search.lt=1452790820, file.et=1432076400, file.lt=1432162800, file.mtime=1452790832 01-14-2016 17:00:32.895 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.895 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/19/ 01-14-2016 17:00:32.895 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/19 01-14-2016 17:00:32.896 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/19, search.et=1452787200, search.lt=1452790820, file.et=1431990000, file.lt=1432076400, file.mtime=1452790832 01-14-2016 17:00:32.896 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.896 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/17/ 01-14-2016 17:00:32.896 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/17 01-14-2016 17:00:32.896 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/17, search.et=1452787200, search.lt=1452790820, file.et=1431817200, file.lt=1431903600, file.mtime=1452790832 01-14-2016 17:00:32.896 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/18/ 01-14-2016 17:00:32.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/18 01-14-2016 17:00:32.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/18, search.et=1452787200, search.lt=1452790820, file.et=1431903600, file.lt=1431990000, file.mtime=1452790832 01-14-2016 17:00:32.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.897 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/27/ 01-14-2016 17:00:32.898 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/27 01-14-2016 17:00:32.898 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/27, search.et=1452787200, search.lt=1452790820, file.et=1432681200, file.lt=1432767600, file.mtime=1452790832 01-14-2016 17:00:32.898 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.898 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/26/ 01-14-2016 17:00:32.898 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/26 01-14-2016 17:00:32.899 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/26, search.et=1452787200, search.lt=1452790820, file.et=1432594800, file.lt=1432681200, file.mtime=1452790832 01-14-2016 17:00:32.899 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.899 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/30/ 01-14-2016 17:00:32.899 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/30 01-14-2016 17:00:32.899 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/30, search.et=1452787200, search.lt=1452790820, file.et=1432940400, file.lt=1433026800, file.mtime=1452790832 01-14-2016 17:00:32.899 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.900 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/25/ 01-14-2016 17:00:32.900 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/25 01-14-2016 17:00:32.900 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/25, search.et=1452787200, search.lt=1452790820, file.et=1432508400, file.lt=1432594800, file.mtime=1452790832 01-14-2016 17:00:32.900 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.900 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/24/ 01-14-2016 17:00:32.901 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/24 01-14-2016 17:00:32.901 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/24, search.et=1452787200, search.lt=1452790820, file.et=1432422000, file.lt=1432508400, file.mtime=1452790832 01-14-2016 17:00:32.901 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.901 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/23/ 01-14-2016 17:00:32.901 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/23 01-14-2016 17:00:32.902 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/23, search.et=1452787200, search.lt=1452790820, file.et=1432335600, file.lt=1432422000, file.mtime=1452790832 01-14-2016 17:00:32.902 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.902 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/22/ 01-14-2016 17:00:32.902 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/22 01-14-2016 17:00:32.902 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/22, search.et=1452787200, search.lt=1452790820, file.et=1432249200, file.lt=1432335600, file.mtime=1452790832 01-14-2016 17:00:32.903 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.903 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/21/ 01-14-2016 17:00:32.903 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/21 01-14-2016 17:00:32.903 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/21, search.et=1452787200, search.lt=1452790820, file.et=1432162800, file.lt=1432249200, file.mtime=1452790832 01-14-2016 17:00:32.903 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.903 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/05/ 01-14-2016 17:00:32.904 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/05 01-14-2016 17:00:32.904 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/05, search.et=1452787200, search.lt=1452790820, file.et=1430780400, file.lt=1430866800, file.mtime=1452790832 01-14-2016 17:00:32.904 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.905 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/14/ 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/14 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/14, search.et=1452787200, search.lt=1452790820, file.et=1431558000, file.lt=1431644400, file.mtime=1452790832 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/11/ 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/11 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/11, search.et=1452787200, search.lt=1452790820, file.et=1431298800, file.lt=1431385200, file.mtime=1452790832 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/03/ 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/03 01-14-2016 17:00:32.906 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/03, search.et=1452787200, search.lt=1452790820, file.et=1430607600, file.lt=1430694000, file.mtime=1452790832 01-14-2016 17:00:32.907 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.907 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/01/ 01-14-2016 17:00:32.907 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/01 01-14-2016 17:00:32.907 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/01, search.et=1452787200, search.lt=1452790820, file.et=1430434800, file.lt=1430521200, file.mtime=1452790832 01-14-2016 17:00:32.907 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.907 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/07/ 01-14-2016 17:00:32.908 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/07 01-14-2016 17:00:32.908 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/07, search.et=1452787200, search.lt=1452790820, file.et=1430953200, file.lt=1431039600, file.mtime=1452790832 01-14-2016 17:00:32.908 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.908 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/02/ 01-14-2016 17:00:32.908 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/02 01-14-2016 17:00:32.909 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/02, search.et=1452787200, search.lt=1452790820, file.et=1430521200, file.lt=1430607600, file.mtime=1452790832 01-14-2016 17:00:32.909 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.909 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/15/ 01-14-2016 17:00:32.909 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/15 01-14-2016 17:00:32.909 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/15, search.et=1452787200, search.lt=1452790820, file.et=1431644400, file.lt=1431730800, file.mtime=1452790832 01-14-2016 17:00:32.910 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.910 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/04/ 01-14-2016 17:00:32.910 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/04 01-14-2016 17:00:32.910 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/04, search.et=1452787200, search.lt=1452790820, file.et=1430694000, file.lt=1430780400, file.mtime=1452790832 01-14-2016 17:00:32.910 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.910 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/12/ 01-14-2016 17:00:32.911 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/12 01-14-2016 17:00:32.911 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/12, search.et=1452787200, search.lt=1452790820, file.et=1431385200, file.lt=1431471600, file.mtime=1452790832 01-14-2016 17:00:32.911 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.911 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/09/ 01-14-2016 17:00:32.911 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/09 01-14-2016 17:00:32.911 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/09, search.et=1452787200, search.lt=1452790820, file.et=1431126000, file.lt=1431212400, file.mtime=1452790832 01-14-2016 17:00:32.912 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.912 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/08/ 01-14-2016 17:00:32.912 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/08 01-14-2016 17:00:32.912 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/08, search.et=1452787200, search.lt=1452790820, file.et=1431039600, file.lt=1431126000, file.mtime=1452790832 01-14-2016 17:00:32.912 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.912 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/06/ 01-14-2016 17:00:32.913 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/06 01-14-2016 17:00:32.913 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/06, search.et=1452787200, search.lt=1452790820, file.et=1430866800, file.lt=1430953200, file.mtime=1452790832 01-14-2016 17:00:32.913 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.913 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/16/ 01-14-2016 17:00:32.913 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/16 01-14-2016 17:00:32.914 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/16, search.et=1452787200, search.lt=1452790820, file.et=1431730800, file.lt=1431817200, file.mtime=1452790832 01-14-2016 17:00:32.914 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.914 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/10/ 01-14-2016 17:00:32.914 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/10 01-14-2016 17:00:32.914 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/10, search.et=1452787200, search.lt=1452790820, file.et=1431212400, file.lt=1431298800, file.mtime=1452790832 01-14-2016 17:00:32.914 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.915 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/13/ 01-14-2016 17:00:32.915 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/13 01-14-2016 17:00:32.915 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/13, search.et=1452787200, search.lt=1452790820, file.et=1431471600, file.lt=1431558000, file.mtime=1452790832 01-14-2016 17:00:32.915 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/05/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.915 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/ 01-14-2016 17:00:32.916 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03 01-14-2016 17:00:32.916 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.916 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=905, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.916 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=904, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.917 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=906, msg=IgfsStreamControlRequest [streamId=146, pos=0, len=4037, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:32.941 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=905, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.945 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/02/ 01-14-2016 17:00:32.945 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/02 01-14-2016 17:00:32.945 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/02, search.et=1452787200, search.lt=1452790820, file.et=1425254400, file.lt=1425340800, file.mtime=1452790832 01-14-2016 17:00:32.945 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/02, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.945 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/01/ 01-14-2016 17:00:32.945 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/01 01-14-2016 17:00:32.946 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/01, search.et=1452787200, search.lt=1452790820, file.et=1425168000, file.lt=1425254400, file.mtime=1452790832 01-14-2016 17:00:32.946 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/01, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.946 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/06/ 01-14-2016 17:00:32.946 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/06 01-14-2016 17:00:32.946 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/06, search.et=1452787200, search.lt=1452790820, file.et=1425600000, file.lt=1425686400, file.mtime=1452790832 01-14-2016 17:00:32.946 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/06, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.946 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/05/ 01-14-2016 17:00:32.946 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/05 01-14-2016 17:00:32.947 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/05, search.et=1452787200, search.lt=1452790820, file.et=1425513600, file.lt=1425600000, file.mtime=1452790832 01-14-2016 17:00:32.947 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/05, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.947 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/04/ 01-14-2016 17:00:32.947 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/04 01-14-2016 17:00:32.947 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/04, search.et=1452787200, search.lt=1452790820, file.et=1425427200, file.lt=1425513600, file.mtime=1452790832 01-14-2016 17:00:32.947 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/04, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.947 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/29/ 01-14-2016 17:00:32.947 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/29 01-14-2016 17:00:32.948 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/29, search.et=1452787200, search.lt=1452790820, file.et=1427587200, file.lt=1427673600, file.mtime=1452790832 01-14-2016 17:00:32.948 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/29, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.948 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/28/ 01-14-2016 17:00:32.948 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/28 01-14-2016 17:00:32.948 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/28, search.et=1452787200, search.lt=1452790820, file.et=1427500800, file.lt=1427587200, file.mtime=1452790832 01-14-2016 17:00:32.948 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/28, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.948 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/09/ 01-14-2016 17:00:32.949 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/09 01-14-2016 17:00:32.949 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/09, search.et=1452787200, search.lt=1452790820, file.et=1425859200, file.lt=1425945600, file.mtime=1452790832 01-14-2016 17:00:32.949 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/09, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.949 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/27/ 01-14-2016 17:00:32.949 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/27 01-14-2016 17:00:32.949 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/27, search.et=1452787200, search.lt=1452790820, file.et=1427414400, file.lt=1427500800, file.mtime=1452790832 01-14-2016 17:00:32.949 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/27, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.949 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/08/ 01-14-2016 17:00:32.950 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/08 01-14-2016 17:00:32.950 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/08, search.et=1452787200, search.lt=1452790820, file.et=1425772800, file.lt=1425859200, file.mtime=1452790832 01-14-2016 17:00:32.950 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/08, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.950 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/26/ 01-14-2016 17:00:32.950 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/26 01-14-2016 17:00:32.950 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/26, search.et=1452787200, search.lt=1452790820, file.et=1427328000, file.lt=1427414400, file.mtime=1452790832 01-14-2016 17:00:32.950 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/26, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.951 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/10/ 01-14-2016 17:00:32.951 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/10 01-14-2016 17:00:32.951 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/10, search.et=1452787200, search.lt=1452790820, file.et=1425945600, file.lt=1426032000, file.mtime=1452790832 01-14-2016 17:00:32.951 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/10, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.951 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/13/ 01-14-2016 17:00:32.951 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/13 01-14-2016 17:00:32.951 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/13, search.et=1452787200, search.lt=1452790820, file.et=1426204800, file.lt=1426291200, file.mtime=1452790832 01-14-2016 17:00:32.952 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/13, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.952 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/31/ 01-14-2016 17:00:32.952 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/31 01-14-2016 17:00:32.952 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/31, search.et=1452787200, search.lt=1452790820, file.et=1427756400, file.lt=1427842800, file.mtime=1452790832 01-14-2016 17:00:32.952 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/31, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.952 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/14/ 01-14-2016 17:00:32.952 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/14 01-14-2016 17:00:32.953 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/14, search.et=1452787200, search.lt=1452790820, file.et=1426291200, file.lt=1426377600, file.mtime=1452790832 01-14-2016 17:00:32.953 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/14, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.953 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/11/ 01-14-2016 17:00:32.953 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/11 01-14-2016 17:00:32.953 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/11, search.et=1452787200, search.lt=1452790820, file.et=1426032000, file.lt=1426118400, file.mtime=1452790832 01-14-2016 17:00:32.954 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/11, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.954 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/12/ 01-14-2016 17:00:32.954 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/12 01-14-2016 17:00:32.954 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/12, search.et=1452787200, search.lt=1452790820, file.et=1426118400, file.lt=1426204800, file.mtime=1452790832 01-14-2016 17:00:32.954 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/12, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.954 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/22/ 01-14-2016 17:00:32.955 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/22 01-14-2016 17:00:32.955 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/22, search.et=1452787200, search.lt=1452790820, file.et=1426982400, file.lt=1427068800, file.mtime=1452790832 01-14-2016 17:00:32.955 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/22, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.955 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/16/ 01-14-2016 17:00:32.955 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/16 01-14-2016 17:00:32.955 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/16, search.et=1452787200, search.lt=1452790820, file.et=1426464000, file.lt=1426550400, file.mtime=1452790832 01-14-2016 17:00:32.955 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/16, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.956 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/15/ 01-14-2016 17:00:32.956 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/15 01-14-2016 17:00:32.956 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/15, search.et=1452787200, search.lt=1452790820, file.et=1426377600, file.lt=1426464000, file.mtime=1452790832 01-14-2016 17:00:32.956 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/15, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.956 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/18/ 01-14-2016 17:00:32.956 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/18 01-14-2016 17:00:32.957 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/18, search.et=1452787200, search.lt=1452790820, file.et=1426636800, file.lt=1426723200, file.mtime=1452790832 01-14-2016 17:00:32.957 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/18, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.957 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/17/ 01-14-2016 17:00:32.957 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/17 01-14-2016 17:00:32.957 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/17, search.et=1452787200, search.lt=1452790820, file.et=1426550400, file.lt=1426636800, file.mtime=1452790832 01-14-2016 17:00:32.957 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/17, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.958 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/19/ 01-14-2016 17:00:32.958 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/19 01-14-2016 17:00:32.958 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/19, search.et=1452787200, search.lt=1452790820, file.et=1426723200, file.lt=1426809600, file.mtime=1452790832 01-14-2016 17:00:32.958 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/19, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.958 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/20/ 01-14-2016 17:00:32.958 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/20 01-14-2016 17:00:32.958 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/20, search.et=1452787200, search.lt=1452790820, file.et=1426809600, file.lt=1426896000, file.mtime=1452790832 01-14-2016 17:00:32.958 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/20, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.959 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/21/ 01-14-2016 17:00:32.959 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/21 01-14-2016 17:00:32.959 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/21, search.et=1452787200, search.lt=1452790820, file.et=1426896000, file.lt=1426982400, file.mtime=1452790832 01-14-2016 17:00:32.959 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/21, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.959 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/30/ 01-14-2016 17:00:32.959 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/30 01-14-2016 17:00:32.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/30, search.et=1452787200, search.lt=1452790820, file.et=1427670000, file.lt=1427756400, file.mtime=1452790832 01-14-2016 17:00:32.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/30, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/23/ 01-14-2016 17:00:32.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/23 01-14-2016 17:00:32.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/23, search.et=1452787200, search.lt=1452790820, file.et=1427068800, file.lt=1427155200, file.mtime=1452790832 01-14-2016 17:00:32.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/23, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/24/ 01-14-2016 17:00:32.960 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/24 01-14-2016 17:00:32.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/24, search.et=1452787200, search.lt=1452790820, file.et=1427155200, file.lt=1427241600, file.mtime=1452790832 01-14-2016 17:00:32.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/24, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/25/ 01-14-2016 17:00:32.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/25 01-14-2016 17:00:32.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/25, search.et=1452787200, search.lt=1452790820, file.et=1427241600, file.lt=1427328000, file.mtime=1452790832 01-14-2016 17:00:32.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/25, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/07/ 01-14-2016 17:00:32.961 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/07 01-14-2016 17:00:32.962 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/07, search.et=1452787200, search.lt=1452790820, file.et=1425686400, file.lt=1425772800, file.mtime=1452790832 01-14-2016 17:00:32.962 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/07, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.962 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/03/ 01-14-2016 17:00:32.962 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/03 01-14-2016 17:00:32.962 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/03, search.et=1452787200, search.lt=1452790820, file.et=1425340800, file.lt=1425427200, file.mtime=1452790832 01-14-2016 17:00:32.962 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2015/03/03, mtime=1452790832 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:32.962 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/ 01-14-2016 17:00:32.963 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL 01-14-2016 17:00:32.963 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790823 01-14-2016 17:00:32.963 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=907, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.965 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=906, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.966 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:32.966 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914993.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|145 01-14-2016 17:00:32.966 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4037] 01-14-2016 17:00:32.966 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=908, msg=IgfsStreamControlRequest [streamId=146, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:32.966 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.967 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.967 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.967 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:32.967 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:32.967 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:32.968 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy = 01-14-2016 17:00:32.968 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:32.969 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:32.981 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=907, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.982 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/ 01-14-2016 17:00:32.982 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily 01-14-2016 17:00:32.982 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790832 01-14-2016 17:00:32.983 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=909, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:32.983 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=908, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:32.983 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=146] 01-14-2016 17:00:32.984 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4037], readTime=65456585, userTime=51393144] 01-14-2016 17:00:32.984 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy:0+3775 01-14-2016 17:00:32.985 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:32.987 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=910, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.003 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=909, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.005 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/ 01-14-2016 17:00:33.006 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015 01-14-2016 17:00:33.006 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790833 01-14-2016 17:00:33.006 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.006 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=911, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:33.007 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.008 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=910, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.008 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.008 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=147] 01-14-2016 17:00:33.008 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3775]] 01-14-2016 17:00:33.008 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.009 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy:0+3775 01-14-2016 17:00:33.009 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy:0+3775 01-14-2016 17:00:33.010 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=912, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.016 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.016 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.016 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.016 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.016 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.016 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.016 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.016 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.016 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.024 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.024 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.024 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.024 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.025 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=911, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.025 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.025 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.025 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.025 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.026 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/12/ 01-14-2016 17:00:33.026 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.026 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.026 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|146" 01-14-2016 17:00:33.026 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|146" 01-14-2016 17:00:33.026 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|146" 01-14-2016 17:00:33.026 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|146 01-14-2016 17:00:33.026 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.027 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/12 01-14-2016 17:00:33.027 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/12, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790833 01-14-2016 17:00:33.027 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=913, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/12, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:33.027 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=912, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.027 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=914, msg=IgfsStreamControlRequest [streamId=147, pos=0, len=3775, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.044 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=913, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.045 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/12/11/ 01-14-2016 17:00:33.045 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/12/11 01-14-2016 17:00:33.045 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/12/11, search.et=1452787200, search.lt=1452790820, file.et=1449792000, file.lt=1449878400, file.mtime=1452790833 01-14-2016 17:00:33.045 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/12/11, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.045 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/ 01-14-2016 17:00:33.046 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11 01-14-2016 17:00:33.046 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790833 01-14-2016 17:00:33.046 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=915, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:33.061 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=914, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.061 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.061 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915083.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|146 01-14-2016 17:00:33.062 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3775] 01-14-2016 17:00:33.062 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=916, msg=IgfsStreamControlRequest [streamId=147, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.063 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.063 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.063 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.063 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.063 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.063 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.065 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy = 01-14-2016 17:00:33.065 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.066 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=915, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.068 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/13/ 01-14-2016 17:00:33.068 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/13 01-14-2016 17:00:33.069 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/13, search.et=1452787200, search.lt=1452790820, file.et=1447372800, file.lt=1447459200, file.mtime=1452790833 01-14-2016 17:00:33.069 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/13, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.069 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/19/ 01-14-2016 17:00:33.069 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/19 01-14-2016 17:00:33.069 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/19, search.et=1452787200, search.lt=1452790820, file.et=1447891200, file.lt=1447977600, file.mtime=1452790833 01-14-2016 17:00:33.069 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/19, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.070 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/12/ 01-14-2016 17:00:33.070 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/12 01-14-2016 17:00:33.070 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/12, search.et=1452787200, search.lt=1452790820, file.et=1447286400, file.lt=1447372800, file.mtime=1452790833 01-14-2016 17:00:33.070 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/12, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.070 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/18/ 01-14-2016 17:00:33.070 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/18 01-14-2016 17:00:33.071 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/18, search.et=1452787200, search.lt=1452790820, file.et=1447804800, file.lt=1447891200, file.mtime=1452790833 01-14-2016 17:00:33.071 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/18, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.071 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/08/ 01-14-2016 17:00:33.071 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/08 01-14-2016 17:00:33.071 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/08, search.et=1452787200, search.lt=1452790820, file.et=1446940800, file.lt=1447027200, file.mtime=1452790833 01-14-2016 17:00:33.071 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/08, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.072 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/07/ 01-14-2016 17:00:33.072 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/07 01-14-2016 17:00:33.072 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/07, search.et=1452787200, search.lt=1452790820, file.et=1446854400, file.lt=1446940800, file.mtime=1452790833 01-14-2016 17:00:33.072 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/07, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.072 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/20/ 01-14-2016 17:00:33.072 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/20 01-14-2016 17:00:33.073 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/20, search.et=1452787200, search.lt=1452790820, file.et=1447977600, file.lt=1448064000, file.mtime=1452790833 01-14-2016 17:00:33.073 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/20, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.073 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/14/ 01-14-2016 17:00:33.073 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/14 01-14-2016 17:00:33.073 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/14, search.et=1452787200, search.lt=1452790820, file.et=1447459200, file.lt=1447545600, file.mtime=1452790833 01-14-2016 17:00:33.073 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/14, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.073 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/05/ 01-14-2016 17:00:33.074 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/05 01-14-2016 17:00:33.074 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/05, search.et=1452787200, search.lt=1452790820, file.et=1446681600, file.lt=1446768000, file.mtime=1452790833 01-14-2016 17:00:33.074 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/05, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.074 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/22/ 01-14-2016 17:00:33.074 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/22 01-14-2016 17:00:33.074 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/22, search.et=1452787200, search.lt=1452790820, file.et=1448150400, file.lt=1448236800, file.mtime=1452790833 01-14-2016 17:00:33.074 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/22, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.075 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/06/ 01-14-2016 17:00:33.075 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/06 01-14-2016 17:00:33.075 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/06, search.et=1452787200, search.lt=1452790820, file.et=1446768000, file.lt=1446854400, file.mtime=1452790833 01-14-2016 17:00:33.075 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/06, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.075 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/15/ 01-14-2016 17:00:33.075 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/15 01-14-2016 17:00:33.075 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/15, search.et=1452787200, search.lt=1452790820, file.et=1447545600, file.lt=1447632000, file.mtime=1452790833 01-14-2016 17:00:33.075 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/15, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.076 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/24/ 01-14-2016 17:00:33.076 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/24 01-14-2016 17:00:33.076 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/24, search.et=1452787200, search.lt=1452790820, file.et=1448323200, file.lt=1448409600, file.mtime=1452790833 01-14-2016 17:00:33.076 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/24, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.076 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/03/ 01-14-2016 17:00:33.076 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/03 01-14-2016 17:00:33.076 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/03, search.et=1452787200, search.lt=1452790820, file.et=1446508800, file.lt=1446595200, file.mtime=1452790833 01-14-2016 17:00:33.076 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/03, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.077 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/09/ 01-14-2016 17:00:33.077 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/09 01-14-2016 17:00:33.077 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/09, search.et=1452787200, search.lt=1452790820, file.et=1447027200, file.lt=1447113600, file.mtime=1452790833 01-14-2016 17:00:33.077 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/09, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.077 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/21/ 01-14-2016 17:00:33.077 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/21 01-14-2016 17:00:33.077 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/21, search.et=1452787200, search.lt=1452790820, file.et=1448064000, file.lt=1448150400, file.mtime=1452790833 01-14-2016 17:00:33.078 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/21, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.078 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/04/ 01-14-2016 17:00:33.078 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/04 01-14-2016 17:00:33.078 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/04, search.et=1452787200, search.lt=1452790820, file.et=1446595200, file.lt=1446681600, file.mtime=1452790833 01-14-2016 17:00:33.078 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/04, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.078 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/23/ 01-14-2016 17:00:33.078 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/23 01-14-2016 17:00:33.079 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/23, search.et=1452787200, search.lt=1452790820, file.et=1448236800, file.lt=1448323200, file.mtime=1452790833 01-14-2016 17:00:33.079 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/23, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.079 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/17/ 01-14-2016 17:00:33.079 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/17 01-14-2016 17:00:33.079 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/17, search.et=1452787200, search.lt=1452790820, file.et=1447718400, file.lt=1447804800, file.mtime=1452790833 01-14-2016 17:00:33.079 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/17, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.080 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/10/ 01-14-2016 17:00:33.080 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/10 01-14-2016 17:00:33.080 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/10, search.et=1452787200, search.lt=1452790820, file.et=1447113600, file.lt=1447200000, file.mtime=1452790833 01-14-2016 17:00:33.080 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/10, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.080 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/16/ 01-14-2016 17:00:33.080 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/16 01-14-2016 17:00:33.081 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/16, search.et=1452787200, search.lt=1452790820, file.et=1447632000, file.lt=1447718400, file.mtime=1452790833 01-14-2016 17:00:33.081 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/16, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.081 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/02/ 01-14-2016 17:00:33.081 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/02 01-14-2016 17:00:33.081 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/02, search.et=1452787200, search.lt=1452790820, file.et=1446422400, file.lt=1446508800, file.mtime=1452790833 01-14-2016 17:00:33.081 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/02, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.081 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/11/ 01-14-2016 17:00:33.082 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/11 01-14-2016 17:00:33.082 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/11, search.et=1452787200, search.lt=1452790820, file.et=1447200000, file.lt=1447286400, file.mtime=1452790833 01-14-2016 17:00:33.082 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/11/11, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.082 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/03/ 01-14-2016 17:00:33.082 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/03 01-14-2016 17:00:33.082 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/03, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790833 01-14-2016 17:00:33.083 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=917, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/03, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:33.083 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=916, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.083 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=147] 01-14-2016 17:00:33.084 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3775], readTime=55284081, userTime=20284000] 01-14-2016 17:00:33.084 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy:0+5185 01-14-2016 17:00:33.085 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.087 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=918, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.104 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=917, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.104 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/03/27/ 01-14-2016 17:00:33.104 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/03/27 01-14-2016 17:00:33.105 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/03/27, search.et=1452787200, search.lt=1452790820, file.et=1427414400, file.lt=1427500800, file.mtime=1452790833 01-14-2016 17:00:33.105 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.105 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/03/27, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.105 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/10/ 01-14-2016 17:00:33.105 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/10 01-14-2016 17:00:33.105 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets time heuristic path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/10, search.et=1452787200, search.lt=1452790820, file.et=0, file.lt=9223372036854775807, file.mtime=1452790833 01-14-2016 17:00:33.106 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=919, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/10, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=LIST_FILES]] 01-14-2016 17:00:33.106 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.109 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=918, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.109 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.109 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=148] 01-14-2016 17:00:33.109 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5185]] 01-14-2016 17:00:33.109 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.109 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy:0+5185 01-14-2016 17:00:33.109 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy:0+5185 01-14-2016 17:00:33.110 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=920, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.115 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.115 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.115 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.115 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.115 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.116 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.116 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.116 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.116 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.124 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.124 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.124 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=919, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.125 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.125 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.125 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Updating source in search context to a dir=/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/10/29/ 01-14-2016 17:00:33.125 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir meets the search criteria. Will consider it, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/10/29 01-14-2016 17:00:33.125 DEBUG ERP.myuatmrigniteprovider - VirtualIndex - Dir does not satisfy time heuristic, path=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/10/29, search.et=1452787200, search.lt=1452790820, file.et=1446076800, file.lt=1446163200, file.mtime=1452790833 01-14-2016 17:00:33.125 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.126 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.126 DEBUG ERP.myuatmrigniteprovider - VirtualIndex$VIXPathSpecifier - dir=igfs://igfs@localhost/data/kafka/camus/ig/internal/attribution/event/DATA.APPSFLYER.INSTALL/daily/2015/10/29, mtime=1452790833 does not meet the time heuristic, ignoring ... 01-14-2016 17:00:33.126 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.126 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.126 INFO ERP.myuatmrigniteprovider - VirtualIndex - generateSplits done, vix.name=miker, files.total=198, files.time.filtered=0, files.search.filtered=0, files.mr=198, elapsed=9397ms 01-14-2016 17:00:33.126 DEBUG ERP.myuatmrigniteprovider - OutputProcessor - received: com.splunk.mr.cache.integration.CacheEvent$NoMoreEvents@6928613f 01-14-2016 17:00:33.126 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.126 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.126 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|147" 01-14-2016 17:00:33.126 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|147" 01-14-2016 17:00:33.126 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|147" 01-14-2016 17:00:33.126 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|147 01-14-2016 17:00:33.127 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.128 INFO ERP.myuatmrigniteprovider - JobSubmitter - finished called: _splits.count=198, total.count=198 01-14-2016 17:00:33.129 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - state=start, set up the required env in HDFS for MR spawning search 01-14-2016 17:00:33.129 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:splunk@IGI.IG.LOCAL (auth:KERBEROS) from:com.splunk.mr.SplunkMR.getProxyUserFileSystem(SplunkMR.java:438) 01-14-2016 17:00:33.135 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=921, msg=IgfsPathControlRequest [path=/user/splunk/packages, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=MAKE_DIRECTORIES]] 01-14-2016 17:00:33.139 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=920, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.140 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=922, msg=IgfsStreamControlRequest [streamId=148, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.140 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=923, msg=IgfsStreamControlRequest [streamId=148, pos=4096, len=1089, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.230 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=921, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.232 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=924, msg=IgfsPathControlRequest [path=/user/splunk/packages, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=UPDATE]] 01-14-2016 17:00:33.251 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=922, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.291 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=923, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.291 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=924, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.291 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.291 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916282.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|147 01-14-2016 17:00:33.291 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=925, msg=IgfsPathControlRequest [path=/user/splunk/bundles, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=MAKE_DIRECTORIES]] 01-14-2016 17:00:33.292 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5185] 01-14-2016 17:00:33.292 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=926, msg=IgfsStreamControlRequest [streamId=148, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.292 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.292 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.292 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.292 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.292 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.293 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.294 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy = 01-14-2016 17:00:33.294 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.328 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.329 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.335 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=925, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.335 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=927, msg=IgfsPathControlRequest [path=/user/splunk/bundles, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=UPDATE]] 01-14-2016 17:00:33.336 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=926, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.336 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=148] 01-14-2016 17:00:33.336 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.336 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.336 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.336 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.336 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.336 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.336 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.336 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.336 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.336 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5185], readTime=195294366, userTime=32674190] 01-14-2016 17:00:33.337 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy:0+4710 01-14-2016 17:00:33.338 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.340 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=928, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.344 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.344 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.344 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.344 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.345 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.345 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.345 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.345 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.345 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=928, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.345 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.345 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.345 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=149] 01-14-2016 17:00:33.345 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.345 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|148" 01-14-2016 17:00:33.345 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|148" 01-14-2016 17:00:33.345 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|148" 01-14-2016 17:00:33.346 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4710]] 01-14-2016 17:00:33.346 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|148 01-14-2016 17:00:33.346 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.346 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.346 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy:0+4710 01-14-2016 17:00:33.346 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy:0+4710 01-14-2016 17:00:33.347 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=929, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.350 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=929, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.351 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=930, msg=IgfsStreamControlRequest [streamId=149, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.351 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=931, msg=IgfsStreamControlRequest [streamId=149, pos=4096, len=614, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.360 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=927, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.361 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=932, msg=IgfsPathControlRequest [path=/user/splunk/dispatch, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=MAKE_DIRECTORIES]] 01-14-2016 17:00:33.369 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=930, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.369 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=931, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.369 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.370 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915099.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|148 01-14-2016 17:00:33.370 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4710] 01-14-2016 17:00:33.370 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=933, msg=IgfsStreamControlRequest [streamId=149, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.370 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.371 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.371 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.371 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.371 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.371 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.372 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy = 01-14-2016 17:00:33.372 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.405 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.406 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.412 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=932, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.412 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=934, msg=IgfsPathControlRequest [path=/user/splunk/dispatch, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=UPDATE]] 01-14-2016 17:00:33.412 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=933, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.413 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=149] 01-14-2016 17:00:33.413 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4710], readTime=61251343, userTime=6091368] 01-14-2016 17:00:33.413 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy:0+4167 01-14-2016 17:00:33.414 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.414 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.414 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.414 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.415 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.415 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.415 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.415 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.415 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.415 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.416 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=935, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.423 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.423 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.423 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.423 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.423 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=935, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.424 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.424 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.424 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.424 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=150] 01-14-2016 17:00:33.424 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.424 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.424 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4167]] 01-14-2016 17:00:33.424 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.424 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.424 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.424 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|149" 01-14-2016 17:00:33.425 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|149" 01-14-2016 17:00:33.425 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|149" 01-14-2016 17:00:33.425 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|149 01-14-2016 17:00:33.425 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.425 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy:0+4167 01-14-2016 17:00:33.425 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy:0+4167 01-14-2016 17:00:33.426 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=936, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.428 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=936, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.428 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=937, msg=IgfsStreamControlRequest [streamId=150, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.428 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=938, msg=IgfsStreamControlRequest [streamId=150, pos=4096, len=71, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.437 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=934, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.438 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=939, msg=IgfsPathControlRequest [path=/user/splunk/packages/hunk-6.2.4-271114-linux-2.6-x86_64.tgz, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.446 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=937, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.446 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=938, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.447 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.447 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914334.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|149 01-14-2016 17:00:33.448 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4167] 01-14-2016 17:00:33.448 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=940, msg=IgfsStreamControlRequest [streamId=150, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.448 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=940, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.448 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.448 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.448 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.448 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=150] 01-14-2016 17:00:33.448 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.449 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4167], readTime=19219896, userTime=5253685] 01-14-2016 17:00:33.449 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.449 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.449 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy:0+4679 01-14-2016 17:00:33.450 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy = 01-14-2016 17:00:33.450 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.451 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.452 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=941, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.456 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=941, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.457 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.457 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=151] 01-14-2016 17:00:33.457 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4679]] 01-14-2016 17:00:33.457 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.458 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy:0+4679 01-14-2016 17:00:33.458 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy:0+4679 01-14-2016 17:00:33.458 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=942, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.461 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=942, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.461 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=943, msg=IgfsStreamControlRequest [streamId=151, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.461 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=944, msg=IgfsStreamControlRequest [streamId=151, pos=4096, len=583, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.464 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=939, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.465 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=945, msg=IgfsPathControlRequest [path=/user/splunk/bundles/vruatsph001.iggroup.local-1452790201.bundle, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.478 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=943, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.478 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=944, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.479 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4679] 01-14-2016 17:00:33.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=946, msg=IgfsStreamControlRequest [streamId=151, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=946, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=151] 01-14-2016 17:00:33.480 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4679], readTime=18293721, userTime=5044018] 01-14-2016 17:00:33.481 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy:0+3782 01-14-2016 17:00:33.482 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.484 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=947, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.489 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=947, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.489 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.490 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=152] 01-14-2016 17:00:33.490 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3782]] 01-14-2016 17:00:33.490 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.490 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy:0+3782 01-14-2016 17:00:33.491 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy:0+3782 01-14-2016 17:00:33.491 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=948, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.494 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=948, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.494 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=949, msg=IgfsStreamControlRequest [streamId=152, pos=0, len=3782, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.496 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=945, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.497 INFO ERP.myuatmrigniteprovider - BundleReplicationCommandHandler - running bundle setup ... 01-14-2016 17:00:33.497 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:splunk@IGI.IG.LOCAL (auth:KERBEROS) from:com.splunk.mr.BundleReplicationCommandHandler.handleSetupOnSearch(BundleReplicationCommandHandler.java:133) 01-14-2016 17:00:33.498 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.499 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=950, msg=IgfsPathControlRequest [path=/user/splunk/bundles/vruatsph001.iggroup.local-1452790201.bundle, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=INFO]] 01-14-2016 17:00:33.499 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.509 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.509 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.509 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.509 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.509 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.509 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.509 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.509 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.509 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.512 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=949, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.513 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3782] 01-14-2016 17:00:33.514 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=951, msg=IgfsStreamControlRequest [streamId=152, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.514 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=951, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.514 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=152] 01-14-2016 17:00:33.514 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3782], readTime=18876334, userTime=5735675] 01-14-2016 17:00:33.515 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy:0+4741 01-14-2016 17:00:33.516 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.517 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=952, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.518 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=950, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.518 INFO ERP.myuatmrigniteprovider - SetupCommandHandler - Copying src=/opt/hunk/var/run/vruatsph001.iggroup.local-1452790201.bundle to dst=igfs://igfs@localhost/user/splunk/bundles/vruatsph001.iggroup.local-1452790201.bundle 01-14-2016 17:00:33.519 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.519 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.519 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.519 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.520 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.520 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.520 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.520 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.521 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.521 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.521 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|150" 01-14-2016 17:00:33.521 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|150" 01-14-2016 17:00:33.521 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|150" 01-14-2016 17:00:33.521 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|150 01-14-2016 17:00:33.521 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.521 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.522 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=953, msg=IgfsPathControlRequest [path=/user/splunk/bundles/vruatsph001.iggroup.local-1452790201.bundle.369449.tmp, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=INFO]] 01-14-2016 17:00:33.522 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914622.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|150 01-14-2016 17:00:33.522 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=952, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.522 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.522 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=153] 01-14-2016 17:00:33.522 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4741]] 01-14-2016 17:00:33.523 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.523 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy:0+4741 01-14-2016 17:00:33.523 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy:0+4741 01-14-2016 17:00:33.524 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=954, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.524 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.524 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.524 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.524 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.524 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.524 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.525 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=954, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.525 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy = 01-14-2016 17:00:33.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=955, msg=IgfsStreamControlRequest [streamId=153, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.526 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.526 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=956, msg=IgfsStreamControlRequest [streamId=153, pos=4096, len=645, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.540 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=953, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.542 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=955, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.542 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening output stream in create [thread=mainpath=/user/splunk/bundles/vruatsph001.iggroup.local-1452790201.bundle.369449.tmp, overwrite=true, bufSize=4096] 01-14-2016 17:00:33.545 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=957, msg=IgfsPathControlRequest [path=/user/splunk/bundles/vruatsph001.iggroup.local-1452790201.bundle.369449.tmp, destPath=null, flag=true, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=3, blockSize=67108864, accessTime=0, modificationTime=0, userName=splunk, cmd=OPEN_CREATE]] 01-14-2016 17:00:33.546 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=956, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.548 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4741] 01-14-2016 17:00:33.548 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=958, msg=IgfsStreamControlRequest [streamId=153, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.548 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=958, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.548 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=153] 01-14-2016 17:00:33.549 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4741], readTime=21641119, userTime=4463631] 01-14-2016 17:00:33.549 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy:0+4673 01-14-2016 17:00:33.550 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.551 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=959, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.556 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=959, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.556 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.556 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=154] 01-14-2016 17:00:33.557 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4673]] 01-14-2016 17:00:33.557 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.557 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy:0+4673 01-14-2016 17:00:33.557 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy:0+4673 01-14-2016 17:00:33.558 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=960, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.560 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=960, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.561 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=961, msg=IgfsStreamControlRequest [streamId=154, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.561 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=962, msg=IgfsStreamControlRequest [streamId=154, pos=4096, len=577, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.573 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.575 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.585 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.585 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.585 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.585 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.585 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.585 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.585 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.585 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.585 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.591 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=957, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.591 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened output stream in create [path=/user/splunk/bundles/vruatsph001.iggroup.local-1452790201.bundle.369449.tmp, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@d32f43e, len=-1]] 01-14-2016 17:00:33.592 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=155] 01-14-2016 17:00:33.595 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.595 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.595 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.595 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.596 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.596 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.596 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.596 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.597 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.597 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.597 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.597 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|151" 01-14-2016 17:00:33.597 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|151" 01-14-2016 17:00:33.597 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|151" 01-14-2016 17:00:33.597 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|151 01-14-2016 17:00:33.597 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.598 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914042.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|151 01-14-2016 17:00:33.601 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.601 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.601 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.601 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.601 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.601 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.602 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy = 01-14-2016 17:00:33.602 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.628 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=961, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.628 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=962, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.629 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4673] 01-14-2016 17:00:33.630 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=963, msg=IgfsStreamControlRequest [streamId=154, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=963, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=154] 01-14-2016 17:00:33.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4673], readTime=75072869, userTime=5628793] 01-14-2016 17:00:33.638 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy:0+3435 01-14-2016 17:00:33.639 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.639 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.640 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=964, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.645 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=964, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.645 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.645 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=156] 01-14-2016 17:00:33.646 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3435]] 01-14-2016 17:00:33.646 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.646 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy:0+3435 01-14-2016 17:00:33.646 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy:0+3435 01-14-2016 17:00:33.647 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=965, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.648 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.648 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.648 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.648 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.648 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.648 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.648 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.648 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.648 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.649 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=965, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.650 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=966, msg=IgfsStreamControlRequest [streamId=156, pos=0, len=3435, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.656 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.656 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.656 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.656 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.657 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.657 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.657 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.657 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.658 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.658 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.658 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|152" 01-14-2016 17:00:33.658 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|152" 01-14-2016 17:00:33.658 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|152" 01-14-2016 17:00:33.658 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|152 01-14-2016 17:00:33.658 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.658 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.658 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913974.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|152 01-14-2016 17:00:33.659 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:00:33.660 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.660 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.660 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.660 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.660 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.660 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.661 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy = 01-14-2016 17:00:33.662 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.670 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=966, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.671 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3435] 01-14-2016 17:00:33.671 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=967, msg=IgfsStreamControlRequest [streamId=156, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.672 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=967, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.672 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=156] 01-14-2016 17:00:33.672 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3435], readTime=21404808, userTime=5309800] 01-14-2016 17:00:33.675 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy:0+3821 01-14-2016 17:00:33.675 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=968, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.681 WARN ERP.myuatmrigniteprovider - SearchController - Failed to get license:Did not get a 2xx status code when executing request. Got status_code=403. See SplunkResponseException.getResponse() for more info. 01-14-2016 17:00:33.682 WARN ERP.myuatmrigniteprovider - SearchController - Could not parse enforce_max_nodes=null 01-14-2016 17:00:33.684 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=968, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.685 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=157] 01-14-2016 17:00:33.685 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3821]] 01-14-2016 17:00:33.685 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.685 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy:0+3821 01-14-2016 17:00:33.686 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy:0+3821 01-14-2016 17:00:33.686 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=969, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.688 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=969, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=970, msg=IgfsStreamControlRequest [streamId=157, pos=0, len=3821, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.704 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.705 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.708 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=970, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.709 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3821] 01-14-2016 17:00:33.710 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=971, msg=IgfsStreamControlRequest [streamId=157, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.710 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=971, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.711 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=157] 01-14-2016 17:00:33.711 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3821], readTime=20868559, userTime=5017404] 01-14-2016 17:00:33.712 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy:0+5053 01-14-2016 17:00:33.713 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.714 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.714 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.714 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.714 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.714 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.714 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.714 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.714 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.714 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.714 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=972, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=972, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.719 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=158] 01-14-2016 17:00:33.719 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5053]] 01-14-2016 17:00:33.719 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.719 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy:0+5053 01-14-2016 17:00:33.720 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy:0+5053 01-14-2016 17:00:33.720 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=973, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.720 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.720 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.720 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.720 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.721 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.721 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.721 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.721 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.722 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=973, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.722 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.722 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.722 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|153" 01-14-2016 17:00:33.722 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|153" 01-14-2016 17:00:33.722 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|153" 01-14-2016 17:00:33.722 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|153 01-14-2016 17:00:33.722 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.722 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.722 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=974, msg=IgfsStreamControlRequest [streamId=158, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.722 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=975, msg=IgfsStreamControlRequest [streamId=158, pos=4096, len=957, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.723 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914256.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|153 01-14-2016 17:00:33.725 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.725 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.725 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.725 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.725 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.725 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.726 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy = 01-14-2016 17:00:33.727 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.740 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=974, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.740 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=975, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.742 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5053] 01-14-2016 17:00:33.742 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=976, msg=IgfsStreamControlRequest [streamId=158, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.742 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=976, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.742 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=158] 01-14-2016 17:00:33.743 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5053], readTime=19289729, userTime=4296179] 01-14-2016 17:00:33.743 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy:0+4305 01-14-2016 17:00:33.744 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closing output stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@d32f43e, len=-1] 01-14-2016 17:00:33.744 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.744 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=977, msg=IgfsStreamControlRequest [streamId=155, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.745 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=978, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.765 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.766 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.776 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.776 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.776 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.776 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.776 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.776 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.776 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.776 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.776 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.784 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.784 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.784 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.784 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.785 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.786 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.786 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.786 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.786 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.786 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.786 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|154" 01-14-2016 17:00:33.787 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|154" 01-14-2016 17:00:33.787 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|154" 01-14-2016 17:00:33.787 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|154 01-14-2016 17:00:33.787 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.787 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.787 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914388.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|154 01-14-2016 17:00:33.789 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.789 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=978, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.789 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.789 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.789 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.789 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.790 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.790 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=159] 01-14-2016 17:00:33.790 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.790 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4305]] 01-14-2016 17:00:33.790 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.790 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy:0+4305 01-14-2016 17:00:33.790 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy:0+4305 01-14-2016 17:00:33.791 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy = 01-14-2016 17:00:33.791 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.791 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=979, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.793 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=979, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.794 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=980, msg=IgfsStreamControlRequest [streamId=159, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.794 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=981, msg=IgfsStreamControlRequest [streamId=159, pos=4096, len=209, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.830 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.831 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.839 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.839 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.839 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.839 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.839 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.839 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.839 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.839 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.839 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.847 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.847 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.848 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.848 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.848 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.848 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.848 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.848 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.849 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.849 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.849 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.855 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|155" 01-14-2016 17:00:33.855 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|155" 01-14-2016 17:00:33.855 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|155" 01-14-2016 17:00:33.855 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|155 01-14-2016 17:00:33.855 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.856 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915828.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|155 01-14-2016 17:00:33.861 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.861 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.861 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.861 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.861 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.861 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.862 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy = 01-14-2016 17:00:33.863 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.880 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=980, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.906 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.907 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.915 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.915 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.915 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.915 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.915 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.915 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.915 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.915 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.915 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.920 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=981, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.920 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=977, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.920 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=155] 01-14-2016 17:00:33.921 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closed output stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@d32f43e, len=-1], writeTime=277122, userTime=51703] 01-14-2016 17:00:33.921 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4305] 01-14-2016 17:00:33.921 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=982, msg=IgfsStreamControlRequest [streamId=159, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.922 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=982, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.922 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=159] 01-14-2016 17:00:33.922 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4305], readTime=127172342, userTime=5221067] 01-14-2016 17:00:33.922 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=983, msg=IgfsPathControlRequest [path=/user/splunk/bundles/vruatsph001.iggroup.local-1452790201.bundle.369449.tmp, destPath=/user/splunk/bundles/vruatsph001.iggroup.local-1452790201.bundle, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=RENAME]] 01-14-2016 17:00:33.923 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy:0+5253 01-14-2016 17:00:33.924 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.924 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.924 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.924 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.924 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.925 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.925 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.925 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=984, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.926 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.926 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.926 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.926 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.926 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|156" 01-14-2016 17:00:33.926 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|156" 01-14-2016 17:00:33.926 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|156" 01-14-2016 17:00:33.927 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|156 01-14-2016 17:00:33.927 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.927 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.927 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914434.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|156 01-14-2016 17:00:33.929 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.929 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.929 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.929 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.929 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.929 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.930 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy = 01-14-2016 17:00:33.930 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.962 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:33.963 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:33.966 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=984, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.966 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.966 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=160] 01-14-2016 17:00:33.966 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5253]] 01-14-2016 17:00:33.967 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.967 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy:0+5253 01-14-2016 17:00:33.967 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy:0+5253 01-14-2016 17:00:33.968 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=985, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:33.969 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=985, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.969 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=986, msg=IgfsStreamControlRequest [streamId=160, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.970 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=987, msg=IgfsStreamControlRequest [streamId=160, pos=4096, len=1157, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:33.971 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:33.971 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:33.971 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:33.971 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:33.971 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:33.971 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:33.971 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:33.971 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:33.971 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:33.977 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:33.977 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:33.977 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.977 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.978 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.978 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:33.978 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:33.978 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:33.978 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:33.979 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:33.979 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|157" 01-14-2016 17:00:33.979 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|157" 01-14-2016 17:00:33.979 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|157" 01-14-2016 17:00:33.979 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|157 01-14-2016 17:00:33.979 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:33.979 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:33.979 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.913798.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|157 01-14-2016 17:00:33.981 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.981 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.981 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.981 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:33.981 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:33.981 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:33.981 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:33.982 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy = 01-14-2016 17:00:33.982 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:33.988 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=986, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.989 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=987, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.990 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5253] 01-14-2016 17:00:33.990 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=988, msg=IgfsStreamControlRequest [streamId=160, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:33.990 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=988, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.991 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=160] 01-14-2016 17:00:33.991 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5253], readTime=20484493, userTime=3868075] 01-14-2016 17:00:33.991 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy:0+4296 01-14-2016 17:00:33.992 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:33.994 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=989, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:33.998 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=989, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:33.998 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:33.998 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=161] 01-14-2016 17:00:33.999 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4296]] 01-14-2016 17:00:33.999 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:33.999 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy:0+4296 01-14-2016 17:00:33.999 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy:0+4296 01-14-2016 17:00:34.000 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=990, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.002 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=990, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.002 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=991, msg=IgfsStreamControlRequest [streamId=161, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.002 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=992, msg=IgfsStreamControlRequest [streamId=161, pos=4096, len=200, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.021 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.021 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=991, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.021 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=992, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.022 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.023 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4296] 01-14-2016 17:00:34.023 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=993, msg=IgfsStreamControlRequest [streamId=161, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.023 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=993, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.023 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=161] 01-14-2016 17:00:34.024 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4296], readTime=20348169, userTime=4533668] 01-14-2016 17:00:34.024 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy:0+4752 01-14-2016 17:00:34.025 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.027 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=994, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.031 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.039 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.039 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.039 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.039 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.040 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.040 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.040 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.040 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.041 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.041 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.041 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.041 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|158" 01-14-2016 17:00:34.041 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|158" 01-14-2016 17:00:34.041 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|158" 01-14-2016 17:00:34.041 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|158 01-14-2016 17:00:34.041 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.042 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915896.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|158 01-14-2016 17:00:34.053 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.053 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.053 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.053 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.054 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.054 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.055 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy = 01-14-2016 17:00:34.056 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.103 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.104 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.114 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.114 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.114 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.114 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.114 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.114 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.114 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.114 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.114 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.124 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.124 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.124 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.124 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.125 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.125 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.125 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.125 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.126 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.126 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.126 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.126 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|159" 01-14-2016 17:00:34.126 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|159" 01-14-2016 17:00:34.126 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|159" 01-14-2016 17:00:34.126 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|159 01-14-2016 17:00:34.126 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.127 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|159 01-14-2016 17:00:34.128 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.128 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.128 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.128 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.128 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.128 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.129 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy = 01-14-2016 17:00:34.130 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.134 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=994, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.134 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.135 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=162] 01-14-2016 17:00:34.135 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4752]] 01-14-2016 17:00:34.135 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.135 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy:0+4752 01-14-2016 17:00:34.136 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy:0+4752 01-14-2016 17:00:34.136 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=995, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.138 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=995, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.138 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=996, msg=IgfsStreamControlRequest [streamId=162, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.138 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=997, msg=IgfsStreamControlRequest [streamId=162, pos=4096, len=656, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.177 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.178 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.181 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=996, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.188 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.188 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.188 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.188 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.188 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.188 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.188 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.188 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.188 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.198 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.198 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.198 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.198 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.199 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.199 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.199 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.199 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.200 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.200 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.200 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|160" 01-14-2016 17:00:34.200 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|160" 01-14-2016 17:00:34.200 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|160" 01-14-2016 17:00:34.200 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|160 01-14-2016 17:00:34.200 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.219 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=997, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.220 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.220 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.916453.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|160 01-14-2016 17:00:34.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4752] 01-14-2016 17:00:34.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=998, msg=IgfsStreamControlRequest [streamId=162, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=998, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.221 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.221 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.221 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.221 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=162] 01-14-2016 17:00:34.221 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.221 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4752], readTime=81862330, userTime=4624328] 01-14-2016 17:00:34.222 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy:0+3566 01-14-2016 17:00:34.223 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy = 01-14-2016 17:00:34.223 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.223 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.224 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=999, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.232 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=999, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.232 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.232 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=163] 01-14-2016 17:00:34.232 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3566]] 01-14-2016 17:00:34.232 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.232 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy:0+3566 01-14-2016 17:00:34.232 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy:0+3566 01-14-2016 17:00:34.232 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1000, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.233 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1000, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.234 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1001, msg=IgfsStreamControlRequest [streamId=163, pos=0, len=3566, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1001, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3566] 01-14-2016 17:00:34.260 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1002, msg=IgfsStreamControlRequest [streamId=163, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.260 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1002, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.260 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=163] 01-14-2016 17:00:34.260 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3566], readTime=25724864, userTime=4523943] 01-14-2016 17:00:34.261 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy:0+4869 01-14-2016 17:00:34.262 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.264 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1003, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.268 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1003, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.268 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.269 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.273 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=164] 01-14-2016 17:00:34.273 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4869]] 01-14-2016 17:00:34.273 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.274 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy:0+4869 01-14-2016 17:00:34.274 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy:0+4869 01-14-2016 17:00:34.274 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1004, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.275 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1004, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.276 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1005, msg=IgfsStreamControlRequest [streamId=164, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.276 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1006, msg=IgfsStreamControlRequest [streamId=164, pos=4096, len=773, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.277 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.277 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.277 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.278 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.278 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.278 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.278 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.278 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.278 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.285 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.285 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.293 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.293 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.294 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.294 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.294 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.294 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.295 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.295 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.295 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|161" 01-14-2016 17:00:34.295 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|161" 01-14-2016 17:00:34.295 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|161" 01-14-2016 17:00:34.295 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|161 01-14-2016 17:00:34.295 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.295 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.295 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915307.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|161 01-14-2016 17:00:34.297 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.297 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.297 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.297 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.297 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.297 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.298 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy = 01-14-2016 17:00:34.299 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.305 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1005, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.305 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1006, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.306 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4869] 01-14-2016 17:00:34.306 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1007, msg=IgfsStreamControlRequest [streamId=164, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.307 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1007, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.307 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=164] 01-14-2016 17:00:34.307 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4869], readTime=30219947, userTime=4033104] 01-14-2016 17:00:34.308 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy:0+4261 01-14-2016 17:00:34.309 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.310 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1008, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.315 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1008, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.315 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.315 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=165] 01-14-2016 17:00:34.315 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4261]] 01-14-2016 17:00:34.316 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.316 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy:0+4261 01-14-2016 17:00:34.316 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy:0+4261 01-14-2016 17:00:34.317 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1009, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.319 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1009, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.319 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1010, msg=IgfsStreamControlRequest [streamId=165, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.320 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1011, msg=IgfsStreamControlRequest [streamId=165, pos=4096, len=165, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.333 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.334 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.338 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1010, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.338 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1011, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.340 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4261] 01-14-2016 17:00:34.340 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1012, msg=IgfsStreamControlRequest [streamId=165, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.340 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1012, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=165] 01-14-2016 17:00:34.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4261], readTime=20246564, userTime=4862846] 01-14-2016 17:00:34.341 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.341 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.341 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.341 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.341 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.341 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.341 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.341 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.341 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.341 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy:0+3854 01-14-2016 17:00:34.342 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.344 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1013, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.348 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.348 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.348 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.348 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.348 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1013, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.349 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.349 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=166] 01-14-2016 17:00:34.349 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.349 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.349 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3854]] 01-14-2016 17:00:34.349 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.349 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.349 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.350 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy:0+3854 01-14-2016 17:00:34.350 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.350 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.350 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|162" 01-14-2016 17:00:34.350 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|162" 01-14-2016 17:00:34.350 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|162" 01-14-2016 17:00:34.350 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|162 01-14-2016 17:00:34.350 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.350 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.350 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy:0+3854 01-14-2016 17:00:34.350 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915712.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|162 01-14-2016 17:00:34.350 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1014, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.352 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1014, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.352 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.352 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.352 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.352 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.352 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.352 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.352 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1015, msg=IgfsStreamControlRequest [streamId=166, pos=0, len=3854, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.353 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy = 01-14-2016 17:00:34.354 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.371 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1015, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.372 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3854] 01-14-2016 17:00:34.372 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1016, msg=IgfsStreamControlRequest [streamId=166, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.373 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1016, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.373 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=166] 01-14-2016 17:00:34.373 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3854], readTime=19877762, userTime=4446145] 01-14-2016 17:00:34.374 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy:0+4610 01-14-2016 17:00:34.375 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.377 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1017, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.381 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1017, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.381 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.381 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=167] 01-14-2016 17:00:34.382 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4610]] 01-14-2016 17:00:34.382 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.382 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy:0+4610 01-14-2016 17:00:34.382 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy:0+4610 01-14-2016 17:00:34.383 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1018, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.385 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1018, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.386 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1019, msg=IgfsStreamControlRequest [streamId=167, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.386 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1020, msg=IgfsStreamControlRequest [streamId=167, pos=4096, len=514, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.393 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.394 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.403 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.403 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.403 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.403 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.403 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.403 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.403 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.403 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.403 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.404 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1019, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.404 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1020, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.405 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4610] 01-14-2016 17:00:34.405 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1021, msg=IgfsStreamControlRequest [streamId=167, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.406 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1021, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.406 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=167] 01-14-2016 17:00:34.406 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4610], readTime=19477326, userTime=4821869] 01-14-2016 17:00:34.406 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy:0+4356 01-14-2016 17:00:34.407 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.409 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1022, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.411 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.411 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.411 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.411 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.412 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.412 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.412 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.412 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.413 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.413 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.413 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|163" 01-14-2016 17:00:34.413 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|163" 01-14-2016 17:00:34.413 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|163" 01-14-2016 17:00:34.413 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|163 01-14-2016 17:00:34.413 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.413 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.413 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1022, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.414 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.915559.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|163 01-14-2016 17:00:34.414 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.414 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=168] 01-14-2016 17:00:34.414 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4356]] 01-14-2016 17:00:34.414 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.414 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy:0+4356 01-14-2016 17:00:34.415 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy:0+4356 01-14-2016 17:00:34.415 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.415 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.415 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.415 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.415 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1023, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.415 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.415 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.416 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy = 01-14-2016 17:00:34.417 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.417 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1023, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.417 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1024, msg=IgfsStreamControlRequest [streamId=168, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.418 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1025, msg=IgfsStreamControlRequest [streamId=168, pos=4096, len=260, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.440 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1024, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.440 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1025, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.441 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4356] 01-14-2016 17:00:34.441 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1026, msg=IgfsStreamControlRequest [streamId=168, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.441 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1026, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.442 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=168] 01-14-2016 17:00:34.442 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4356], readTime=23470714, userTime=4406260] 01-14-2016 17:00:34.442 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy:0+4285 01-14-2016 17:00:34.443 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.445 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1027, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.449 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1027, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.449 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.449 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=169] 01-14-2016 17:00:34.449 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4285]] 01-14-2016 17:00:34.449 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.450 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy:0+4285 01-14-2016 17:00:34.450 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy:0+4285 01-14-2016 17:00:34.450 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1028, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.451 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.452 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1028, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.452 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.452 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1029, msg=IgfsStreamControlRequest [streamId=169, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.452 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1030, msg=IgfsStreamControlRequest [streamId=169, pos=4096, len=189, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.459 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.459 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.459 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.459 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.459 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.459 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.459 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.459 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.459 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.466 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.466 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.467 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.467 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.467 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.467 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.468 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.468 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.468 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.468 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.468 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|164" 01-14-2016 17:00:34.468 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|164" 01-14-2016 17:00:34.468 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|164" 01-14-2016 17:00:34.468 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|164 01-14-2016 17:00:34.468 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.468 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.469 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913862.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|164 01-14-2016 17:00:34.470 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.470 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.470 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.470 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.471 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.471 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.472 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy = 01-14-2016 17:00:34.472 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.491 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1029, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.491 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1030, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.492 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4285] 01-14-2016 17:00:34.493 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1031, msg=IgfsStreamControlRequest [streamId=169, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.493 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1031, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.493 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=169] 01-14-2016 17:00:34.493 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4285], readTime=40134393, userTime=4084880] 01-14-2016 17:00:34.494 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy:0+3487 01-14-2016 17:00:34.495 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.496 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1032, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.500 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1032, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.500 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.500 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=170] 01-14-2016 17:00:34.501 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3487]] 01-14-2016 17:00:34.501 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.501 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy:0+3487 01-14-2016 17:00:34.501 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy:0+3487 01-14-2016 17:00:34.502 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1033, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.503 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1033, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.504 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1034, msg=IgfsStreamControlRequest [streamId=170, pos=0, len=3487, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.505 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.506 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.513 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.513 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.513 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.513 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.513 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.513 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.513 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.513 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.513 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.519 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.519 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.520 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.520 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.520 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.520 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.520 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.520 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.521 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.521 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.521 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|165" 01-14-2016 17:00:34.521 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|165" 01-14-2016 17:00:34.521 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|165" 01-14-2016 17:00:34.521 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|165 01-14-2016 17:00:34.521 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.521 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.522 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915293.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|165 01-14-2016 17:00:34.522 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1034, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.524 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3487] 01-14-2016 17:00:34.524 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.524 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.524 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.524 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.524 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1035, msg=IgfsStreamControlRequest [streamId=170, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.524 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.524 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.524 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1035, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.524 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=170] 01-14-2016 17:00:34.524 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3487], readTime=19930477, userTime=3995575] 01-14-2016 17:00:34.525 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy = 01-14-2016 17:00:34.525 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.525 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy:0+4261 01-14-2016 17:00:34.526 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.528 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1036, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.532 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1036, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.532 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.532 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=171] 01-14-2016 17:00:34.532 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4261]] 01-14-2016 17:00:34.532 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.533 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy:0+4261 01-14-2016 17:00:34.533 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy:0+4261 01-14-2016 17:00:34.533 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1037, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.534 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1037, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.535 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1038, msg=IgfsStreamControlRequest [streamId=171, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.535 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1039, msg=IgfsStreamControlRequest [streamId=171, pos=4096, len=165, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.562 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1038, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.563 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1039, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.563 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.564 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.575 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.585 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.585 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.585 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.585 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.586 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.586 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.586 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.586 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.587 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.587 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.587 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|166" 01-14-2016 17:00:34.587 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|166" 01-14-2016 17:00:34.587 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|166" 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4261] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1040, msg=IgfsStreamControlRequest [streamId=171, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.587 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|166 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1040, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=171] 01-14-2016 17:00:34.587 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4261], readTime=28718598, userTime=4031677] 01-14-2016 17:00:34.587 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy:0+5241 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1041, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1041, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=172] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5241]] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.587 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy:0+5241 01-14-2016 17:00:34.587 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy:0+5241 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1042, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1042, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1043, msg=IgfsStreamControlRequest [streamId=172, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.587 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1044, msg=IgfsStreamControlRequest [streamId=172, pos=4096, len=1145, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.588 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916294.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|166 01-14-2016 17:00:34.589 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.590 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.590 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.590 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.590 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.590 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.591 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy = 01-14-2016 17:00:34.591 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.594 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1043, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.594 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1044, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.623 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.624 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.632 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.639 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.639 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.640 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.640 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.640 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.640 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.641 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.641 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.641 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.641 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.641 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|167" 01-14-2016 17:00:34.641 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|167" 01-14-2016 17:00:34.641 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|167" 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5241] 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1045, msg=IgfsStreamControlRequest [streamId=172, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1045, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=172] 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5241], readTime=19919341, userTime=3913185] 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy:0+4747 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.641 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|167 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1046, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1046, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.641 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.641 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.641 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=173] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4747]] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.642 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy:0+4747 01-14-2016 17:00:34.642 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy:0+4747 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1047, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1047, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1048, msg=IgfsStreamControlRequest [streamId=173, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1049, msg=IgfsStreamControlRequest [streamId=173, pos=4096, len=651, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1048, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1049, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4747] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1050, msg=IgfsStreamControlRequest [streamId=173, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1050, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=173] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4747], readTime=19034381, userTime=3958887] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy:0+3834 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1051, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1051, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=174] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3834]] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.642 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy:0+3834 01-14-2016 17:00:34.642 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy:0+3834 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1052, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1052, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1053, msg=IgfsStreamControlRequest [streamId=174, pos=0, len=3834, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.642 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914458.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|167 01-14-2016 17:00:34.644 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.644 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.644 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.644 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.644 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.644 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.645 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy = 01-14-2016 17:00:34.646 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.679 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.680 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.687 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.687 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.687 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.687 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.687 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.687 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.687 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.687 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.687 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.693 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.693 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.693 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.693 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.694 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.694 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.694 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.694 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.695 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.695 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.695 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|168" 01-14-2016 17:00:34.695 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|168" 01-14-2016 17:00:34.695 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|168" 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1053, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3834] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1054, msg=IgfsStreamControlRequest [streamId=174, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1054, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=174] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3834], readTime=18117700, userTime=3964709] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy:0+5136 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1055, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1055, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.695 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=175] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5136]] 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.695 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|168 01-14-2016 17:00:34.695 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy:0+5136 01-14-2016 17:00:34.695 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy:0+5136 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1056, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.695 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1056, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.696 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1057, msg=IgfsStreamControlRequest [streamId=175, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.696 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1058, msg=IgfsStreamControlRequest [streamId=175, pos=4096, len=1040, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.696 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1057, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.696 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1058, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.696 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914094.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|168 01-14-2016 17:00:34.697 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.697 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.697 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.698 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.698 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.698 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.699 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy = 01-14-2016 17:00:34.699 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.729 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.730 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.737 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.737 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.737 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.737 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.737 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.737 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.737 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.737 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.737 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.744 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.744 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.744 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.744 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.744 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.745 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.745 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.745 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.745 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.745 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.745 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|169" 01-14-2016 17:00:34.745 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|169" 01-14-2016 17:00:34.745 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|169" 01-14-2016 17:00:34.745 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5136] 01-14-2016 17:00:34.745 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|169 01-14-2016 17:00:34.745 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1059, msg=IgfsStreamControlRequest [streamId=175, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.745 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1059, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.745 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=175] 01-14-2016 17:00:34.745 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5136], readTime=18025799, userTime=13512098] 01-14-2016 17:00:34.745 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.745 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy:0+4663 01-14-2016 17:00:34.745 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.745 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.745 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1060, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1060, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=176] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4663]] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.746 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy:0+4663 01-14-2016 17:00:34.746 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy:0+4663 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1061, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1061, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1062, msg=IgfsStreamControlRequest [streamId=176, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1063, msg=IgfsStreamControlRequest [streamId=176, pos=4096, len=567, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1062, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1063, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4663] 01-14-2016 17:00:34.746 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1064, msg=IgfsStreamControlRequest [streamId=176, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.746 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915926.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|169 01-14-2016 17:00:34.748 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.748 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.748 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.748 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.748 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.748 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.749 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy = 01-14-2016 17:00:34.749 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.781 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.782 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.790 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.796 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.797 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.797 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.797 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.797 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.797 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.797 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.797 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.798 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.798 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.798 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|170" 01-14-2016 17:00:34.798 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|170" 01-14-2016 17:00:34.798 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|170" 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1064, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.798 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|170 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=176] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4663], readTime=35393584, userTime=7001814] 01-14-2016 17:00:34.798 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy:0+4292 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1065, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1065, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=177] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4292]] 01-14-2016 17:00:34.798 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.798 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy:0+4292 01-14-2016 17:00:34.798 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy:0+4292 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1066, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1066, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1067, msg=IgfsStreamControlRequest [streamId=177, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1068, msg=IgfsStreamControlRequest [streamId=177, pos=4096, len=196, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1067, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1068, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.799 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915319.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|170 01-14-2016 17:00:34.800 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.800 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.800 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.800 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.801 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.801 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.802 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy = 01-14-2016 17:00:34.802 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.834 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.835 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.842 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.842 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.842 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.842 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.842 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.842 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.842 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.842 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.842 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.848 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.848 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.849 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.849 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.849 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.849 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.850 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.850 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.850 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.850 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.850 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|171" 01-14-2016 17:00:34.850 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|171" 01-14-2016 17:00:34.850 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|171" 01-14-2016 17:00:34.850 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|171 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4292] 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1069, msg=IgfsStreamControlRequest [streamId=177, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.850 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1069, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=177] 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4292], readTime=20522462, userTime=26071471] 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy:0+3821 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1070, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1070, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=178] 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3821]] 01-14-2016 17:00:34.850 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.850 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy:0+3821 01-14-2016 17:00:34.850 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy:0+3821 01-14-2016 17:00:34.851 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1071, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.851 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1071, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.851 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1072, msg=IgfsStreamControlRequest [streamId=178, pos=0, len=3821, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.851 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1072, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.851 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.851 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914850.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|171 01-14-2016 17:00:34.853 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.853 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.853 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.853 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.853 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.853 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.854 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy = 01-14-2016 17:00:34.854 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.888 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.889 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.896 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.896 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.896 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.896 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.896 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.896 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.896 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.896 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.896 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.902 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.902 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.902 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.902 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.903 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.903 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.904 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.904 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.904 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.904 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.904 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|172" 01-14-2016 17:00:34.904 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|172" 01-14-2016 17:00:34.904 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|172" 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3821] 01-14-2016 17:00:34.904 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|172 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1073, msg=IgfsStreamControlRequest [streamId=178, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1073, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=178] 01-14-2016 17:00:34.904 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3821], readTime=22008205, userTime=21425047] 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy:0+4835 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1074, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1074, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=179] 01-14-2016 17:00:34.905 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4835]] 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.905 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy:0+4835 01-14-2016 17:00:34.905 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy:0+4835 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1075, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1075, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1076, msg=IgfsStreamControlRequest [streamId=179, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1077, msg=IgfsStreamControlRequest [streamId=179, pos=4096, len=739, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=983, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1076, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.905 INFO ERP.myuatmrigniteprovider - BundleReplicationCommandHandler - running bundle setup ... done 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:splunk@IGI.IG.LOCAL (auth:KERBEROS) from:com.splunk.mr.BundleReplicationCommandHandler.handleSetupOnSearch(BundleReplicationCommandHandler.java:135) 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1078, msg=IgfsPathControlRequest [path=/user/splunk/bundles, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=LIST_FILES]] 01-14-2016 17:00:34.905 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1077, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.905 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914702.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|172 01-14-2016 17:00:34.907 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.907 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.907 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.907 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.907 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.907 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.908 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy = 01-14-2016 17:00:34.908 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.944 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.945 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:34.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:34.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:34.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:34.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:34.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:34.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:34.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:34.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:34.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:34.960 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:34.960 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:34.960 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.960 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.961 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.961 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:34.961 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:34.961 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:34.961 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:34.961 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:34.961 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|173" 01-14-2016 17:00:34.961 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|173" 01-14-2016 17:00:34.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4835] 01-14-2016 17:00:34.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1079, msg=IgfsStreamControlRequest [streamId=179, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:34.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1078, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.961 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|173" 01-14-2016 17:00:34.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1080, msg=IgfsPathControlRequest [path=/user/splunk/bundles/vruatsph001.iggroup.local-1450436401.bundle, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=DELETE]] 01-14-2016 17:00:34.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1079, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=179] 01-14-2016 17:00:34.961 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4835], readTime=64995272, userTime=25030531] 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy:0+4268 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:34.962 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|173 01-14-2016 17:00:34.962 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1081, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1081, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=180] 01-14-2016 17:00:34.962 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4268]] 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:34.962 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy:0+4268 01-14-2016 17:00:34.962 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy:0+4268 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1082, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1082, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1083, msg=IgfsStreamControlRequest [streamId=180, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.962 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1084, msg=IgfsStreamControlRequest [streamId=180, pos=4096, len=172, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:34.962 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.916371.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|173 01-14-2016 17:00:34.964 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.964 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.964 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.964 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:34.964 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:34.964 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:34.965 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy = 01-14-2016 17:00:34.965 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:34.998 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:34.999 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.007 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.015 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.015 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.015 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.015 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.016 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.016 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.016 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.016 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.017 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.017 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.017 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|174" 01-14-2016 17:00:35.017 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|174" 01-14-2016 17:00:35.017 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|174" 01-14-2016 17:00:35.017 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|174 01-14-2016 17:00:35.017 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.017 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1083, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1084, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4268] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1085, msg=IgfsStreamControlRequest [streamId=180, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1085, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=180] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4268], readTime=18613520, userTime=4488583] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy:0+4796 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1086, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1086, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=181] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4796]] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.017 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy:0+4796 01-14-2016 17:00:35.017 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy:0+4796 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1087, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1087, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1088, msg=IgfsStreamControlRequest [streamId=181, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1089, msg=IgfsStreamControlRequest [streamId=181, pos=4096, len=700, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1080, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.017 INFO ERP.myuatmrigniteprovider - BundleReplicationCommandHandler - Deleted HDFS bundle=igfs://igfs@localhost/user/splunk/bundles/vruatsph001.iggroup.local-1450436401.bundle 01-14-2016 17:00:35.017 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1090, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.018 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915595.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|174 01-14-2016 17:00:35.019 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.019 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.019 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.019 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.020 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.020 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.021 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy = 01-14-2016 17:00:35.021 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.021 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:35.061 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.062 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.071 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.071 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.071 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.071 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.071 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.071 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.071 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.071 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.071 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.079 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.079 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.079 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.079 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.080 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.080 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.080 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.080 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.080 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.080 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.080 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|175" 01-14-2016 17:00:35.080 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|175" 01-14-2016 17:00:35.080 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|175" 01-14-2016 17:00:35.080 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1088, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1089, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.081 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|175 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4796] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1091, msg=IgfsStreamControlRequest [streamId=181, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1091, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=181] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4796], readTime=45422977, userTime=4545153] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy:0+4835 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.081 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1092, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1092, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=182] 01-14-2016 17:00:35.081 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4835]] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.081 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy:0+4835 01-14-2016 17:00:35.081 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy:0+4835 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1093, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1093, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1094, msg=IgfsStreamControlRequest [streamId=182, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1095, msg=IgfsStreamControlRequest [streamId=182, pos=4096, len=739, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1090, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1096, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1094, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.081 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1095, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.081 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914374.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|175 01-14-2016 17:00:35.083 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.083 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.083 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.083 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.083 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.083 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.084 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy = 01-14-2016 17:00:35.085 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.124 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.125 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.135 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.135 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.135 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.135 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.135 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.135 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.135 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.135 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.135 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.143 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.143 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.143 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.143 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.144 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.144 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.144 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.144 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.145 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.145 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.145 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|176" 01-14-2016 17:00:35.145 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|176" 01-14-2016 17:00:35.145 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|176" 01-14-2016 17:00:35.145 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|176 01-14-2016 17:00:35.145 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4835] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1097, msg=IgfsStreamControlRequest [streamId=182, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1097, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=182] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4835], readTime=18775351, userTime=18496908] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy:0+5461 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1098, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1096, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1099, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=MAKE_DIRECTORIES]] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1098, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=183] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5461]] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.145 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.145 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy:0+5461 01-14-2016 17:00:35.145 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy:0+5461 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1100, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1099, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening output stream in create [thread=mainpath=/user/splunk/dispatch/1452790820.13/0.hb, overwrite=true, bufSize=4096] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1101, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/0.hb, destPath=null, flag=true, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=3, blockSize=67108864, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_CREATE]] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1100, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1102, msg=IgfsStreamControlRequest [streamId=183, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.145 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1103, msg=IgfsStreamControlRequest [streamId=183, pos=4096, len=1365, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.146 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.914140.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|176 01-14-2016 17:00:35.147 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.147 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.147 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.147 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.148 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.148 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.149 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy = 01-14-2016 17:00:35.149 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.187 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.188 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.196 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.196 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.196 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.196 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.196 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.196 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.196 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.196 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.196 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.204 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.204 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.204 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.204 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.205 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.205 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.205 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.205 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.205 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.205 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.206 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|177" 01-14-2016 17:00:35.206 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|177" 01-14-2016 17:00:35.206 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|177" 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1102, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1103, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5461] 01-14-2016 17:00:35.206 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|177 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1104, msg=IgfsStreamControlRequest [streamId=183, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1104, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=183] 01-14-2016 17:00:35.206 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.206 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=5461], readTime=32273649, userTime=38457782] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy:0+4529 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1105, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1105, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=184] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4529]] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.206 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy:0+4529 01-14-2016 17:00:35.206 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy:0+4529 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1106, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1106, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1107, msg=IgfsStreamControlRequest [streamId=184, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1108, msg=IgfsStreamControlRequest [streamId=184, pos=4096, len=433, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1101, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened output stream in create [path=/user/splunk/dispatch/1452790820.13/0.hb, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1]] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=185] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closing output stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1109, msg=IgfsStreamControlRequest [streamId=185, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1107, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.206 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1108, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.206 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.915656.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|177 01-14-2016 17:00:35.208 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.208 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.208 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.208 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.208 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.208 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.209 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy = 01-14-2016 17:00:35.209 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.251 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.252 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.260 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.260 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.260 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.260 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.260 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.260 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.260 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.261 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.261 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.267 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.267 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.268 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.268 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.268 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.268 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.269 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.269 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.269 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.269 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.269 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4529] 01-14-2016 17:00:35.269 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1110, msg=IgfsStreamControlRequest [streamId=184, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.269 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|178" 01-14-2016 17:00:35.269 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|178" 01-14-2016 17:00:35.269 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|178" 01-14-2016 17:00:35.269 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.269 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1109, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.269 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=185] 01-14-2016 17:00:35.269 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|178 01-14-2016 17:00:35.269 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closed output stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1], writeTime=16856, userTime=300] 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - FileBasedHeartBeat - starting hearbeat thread, path=/user/splunk/dispatch/1452790820.13, interval=1000, _startIndex=0, _index=0 01-14-2016 17:00:35.270 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - SplunkMR - Using file system with currentUser's realUser as cache fs 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1111, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/0.hb, destPath=/user/splunk/dispatch/1452790820.13/1.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:splunk@IGI.IG.LOCAL (auth:KERBEROS) from:com.splunk.mr.SplunkMR.getProxyUserFileSystem(SplunkMR.java:438) 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1110, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=184] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4529], readTime=27257721, userTime=13774299] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1112, msg=IgfsPathControlRequest [path=/user/splunk/jars, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=INFO]] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy:0+4224 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1113, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1112, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1114, msg=IgfsPathControlRequest [path=/user/splunk/jars, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=splunk, cmd=LIST_FILES]] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1113, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=186] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4224]] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy:0+4224 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy:0+4224 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1115, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1114, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.270 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1111, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Setting jars to remote classpath. jarDirs=/user/splunk/jars 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding avro-1.7.4.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding avro-mapred-1.7.4.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding commons-compress-1.5.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding commons-io-2.1.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding libfb303-0.9.0.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding parquet-hive-bundle-1.5.0.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding snappy-java-1.0.5.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding hive-exec-0.12.0.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding hive-metastore-0.12.0.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - Adding hive-serde-0.12.0.jar 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - SplunkMR$SearchHandler - state=done, set up the required env in HDFS for MR spawning search 01-14-2016 17:00:35.270 INFO ERP.myuatmrigniteprovider - JobSubmitter - creating new job, curent split.count=198 01-14-2016 17:00:35.270 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915007.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|178 01-14-2016 17:00:35.272 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.272 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.272 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.272 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.272 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.272 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.273 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy = 01-14-2016 17:00:35.278 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.316 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.318 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.328 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.328 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.328 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.329 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.329 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.329 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.329 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.329 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.329 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.338 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.338 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.339 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.339 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.340 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.340 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.340 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.340 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.340 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.340 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.340 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|179" 01-14-2016 17:00:35.340 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|179" 01-14-2016 17:00:35.340 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|179" 01-14-2016 17:00:35.340 INFO ERP.myuatmrigniteprovider - JobSubmitter - submitting new job, name=SPLK_vruatsph001.iggroup.local_1452790820.13_0 01-14-2016 17:00:35.340 INFO ERP.myuatmrigniteprovider - AsyncMRJob - AsyncMRJob job.name=SPLK_vruatsph001.iggroup.local_1452790820.13_0 running ... 01-14-2016 17:00:35.340 INFO ERP.myuatmrigniteprovider - AsyncMRJob - Submitting job.name=SPLK_vruatsph001.iggroup.local_1452790820.13_0 ... 01-14-2016 17:00:35.340 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.connect(Job.java:1255) 01-14-2016 17:00:35.340 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|179 01-14-2016 17:00:35.341 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.340 DEBUG ERP.myuatmrigniteprovider - Cluster - Trying ClientProtocolProvider : org.apache.hadoop.mapred.YarnClientProtocolProvider 01-14-2016 17:00:35.341 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - Cluster - Cannot pick org.apache.hadoop.mapred.YarnClientProtocolProvider as the ClientProtocolProvider - returned null protocol 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - Cluster - Trying ClientProtocolProvider : org.apache.hadoop.mapred.LocalClientProtocolProvider 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - Cluster - Cannot pick org.apache.hadoop.mapred.LocalClientProtocolProvider as the ClientProtocolProvider - returned null protocol 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - Cluster - Trying ClientProtocolProvider : org.apache.ignite.hadoop.mapreduce.IgniteHadoopClientProtocolProvider 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - Cluster - Picked org.apache.ignite.hadoop.mapreduce.IgniteHadoopClientProtocolProvider as the ClientProtocolProvider 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Cluster.getFileSystem(Cluster.java:162) 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1116, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/0, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1115, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1117, msg=IgfsStreamControlRequest [streamId=186, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1118, msg=IgfsStreamControlRequest [streamId=186, pos=4096, len=128, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1116, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1117, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1119, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1118, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4224] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1120, msg=IgfsStreamControlRequest [streamId=186, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1120, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=186] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4224], readTime=34202870, userTime=46228261] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy:0+3811 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1121, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1121, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=187] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3811]] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.341 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy:0+3811 01-14-2016 17:00:35.341 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy:0+3811 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1122, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1122, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1123, msg=IgfsStreamControlRequest [streamId=187, pos=0, len=3811, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1119, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.341 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1124, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.341 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913962.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|179 01-14-2016 17:00:35.343 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.343 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.343 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.344 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.344 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.344 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.345 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy = 01-14-2016 17:00:35.346 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.396 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.398 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.407 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.407 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.407 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.407 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.407 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.407 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.407 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.407 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.407 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.417 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.417 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.417 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.417 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.418 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.418 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.418 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.418 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.419 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.419 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.419 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|180" 01-14-2016 17:00:35.419 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|180" 01-14-2016 17:00:35.419 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|180" 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1124, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1123, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3811] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1125, msg=IgfsStreamControlRequest [streamId=187, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1125, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.419 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|180 01-14-2016 17:00:35.419 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=187] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3811], readTime=72506120, userTime=4830045] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy:0+3206 01-14-2016 17:00:35.419 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1126, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1126, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=188] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3206]] 01-14-2016 17:00:35.419 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.419 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy:0+3206 01-14-2016 17:00:35.419 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy:0+3206 01-14-2016 17:00:35.420 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1127, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.420 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.14.915543.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|180 01-14-2016 17:00:35.421 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.422 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.422 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.422 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.422 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.422 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.423 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy = 01-14-2016 17:00:35.423 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.462 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.463 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.471 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.479 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.479 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.479 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.479 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.480 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.480 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.480 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.480 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.480 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.480 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.481 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|181" 01-14-2016 17:00:35.481 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|181" 01-14-2016 17:00:35.481 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|181" 01-14-2016 17:00:35.481 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|181 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1127, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1128, msg=IgfsStreamControlRequest [streamId=188, pos=0, len=3206, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - Configuring job job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001 with /tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001 as the submit dir 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - adding the following namenodes' delegation tokens:[igfs://igfs@localhost] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - JobResourceUploader - default FileSystem: igfs://igfs@localhost 01-14-2016 17:00:35.481 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.481 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1129, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1128, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3206] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1130, msg=IgfsStreamControlRequest [streamId=188, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1129, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1130, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=188] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1131, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=MAKE_DIRECTORIES]] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3206], readTime=47298489, userTime=5808023] 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy:0+4161 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.481 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1132, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.481 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.913834.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|181 01-14-2016 17:00:35.483 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.483 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.483 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.483 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.483 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.483 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.484 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy = 01-14-2016 17:00:35.484 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.514 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.515 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.522 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.522 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.522 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.522 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.522 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.522 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.522 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.522 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.522 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.529 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.529 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.529 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.529 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.530 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.530 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.530 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.530 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.531 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.531 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.531 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|182" 01-14-2016 17:00:35.531 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|182" 01-14-2016 17:00:35.531 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|182" 01-14-2016 17:00:35.531 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|182 01-14-2016 17:00:35.531 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.531 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.532 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.16.914959.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|182 01-14-2016 17:00:35.533 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.533 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.533 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.533 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.533 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.533 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.534 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy = 01-14-2016 17:00:35.535 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.576 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.578 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.587 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.598 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.598 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.598 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.598 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.598 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.598 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.599 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.599 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.599 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.599 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.599 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|183" 01-14-2016 17:00:35.599 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|183" 01-14-2016 17:00:35.599 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|183" 01-14-2016 17:00:35.599 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|183 01-14-2016 17:00:35.599 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.599 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.600 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.12.914082.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|183 01-14-2016 17:00:35.602 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.602 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.602 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.602 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.602 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.602 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.603 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy = 01-14-2016 17:00:35.604 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.641 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.641 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.649 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.649 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.649 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.649 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.649 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.649 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.649 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.649 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.649 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.652 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1131, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.652 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1133, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=UPDATE]] 01-14-2016 17:00:35.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1132, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.656 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=189] 01-14-2016 17:00:35.656 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4161]] 01-14-2016 17:00:35.656 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.657 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy:0+4161 01-14-2016 17:00:35.657 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy:0+4161 01-14-2016 17:00:35.658 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.658 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1134, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.658 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.658 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.658 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.659 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.659 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.659 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.659 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1134, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.659 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.659 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.659 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|184" 01-14-2016 17:00:35.659 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|184" 01-14-2016 17:00:35.659 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|184" 01-14-2016 17:00:35.660 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|184 01-14-2016 17:00:35.660 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.660 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1135, msg=IgfsStreamControlRequest [streamId=189, pos=0, len=4096, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1136, msg=IgfsStreamControlRequest [streamId=189, pos=4096, len=65, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.660 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914310.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|184 01-14-2016 17:00:35.662 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.662 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.662 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.662 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.662 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.662 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.663 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy = 01-14-2016 17:00:35.663 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1133, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.676 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1135, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.676 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1137, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.677 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1136, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.678 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4161] 01-14-2016 17:00:35.678 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1138, msg=IgfsStreamControlRequest [streamId=189, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.678 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1138, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.678 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=189] 01-14-2016 17:00:35.678 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=4161], readTime=18024656, userTime=4258406] 01-14-2016 17:00:35.679 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy:0+3598 01-14-2016 17:00:35.680 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.682 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1139, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1139, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.687 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=190] 01-14-2016 17:00:35.687 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3598]] 01-14-2016 17:00:35.688 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.688 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy:0+3598 01-14-2016 17:00:35.688 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy:0+3598 01-14-2016 17:00:35.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1140, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.691 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1140, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.691 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1141, msg=IgfsStreamControlRequest [streamId=190, pos=0, len=3598, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.697 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.698 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.706 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1137, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.706 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.709 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening output stream in create [thread=Thread-9path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.jar, overwrite=true, bufSize=4096] 01-14-2016 17:00:35.709 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1142, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.jar, destPath=null, flag=true, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=3, blockSize=67108864, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_CREATE]] 01-14-2016 17:00:35.709 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1141, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.710 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3598] 01-14-2016 17:00:35.710 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1143, msg=IgfsStreamControlRequest [streamId=190, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.711 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1143, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.711 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=190] 01-14-2016 17:00:35.711 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3598], readTime=19273205, userTime=4623249] 01-14-2016 17:00:35.712 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy:0+3728 01-14-2016 17:00:35.713 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.714 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1144, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.714 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.714 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.714 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.714 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.715 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.715 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.715 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.715 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.716 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.716 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.716 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|185" 01-14-2016 17:00:35.716 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|185" 01-14-2016 17:00:35.716 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|185" 01-14-2016 17:00:35.716 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|185 01-14-2016 17:00:35.716 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.716 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.716 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915569.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|185 01-14-2016 17:00:35.718 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1144, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.718 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.718 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.718 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.718 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.718 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.718 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=191] 01-14-2016 17:00:35.718 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.718 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.718 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3728]] 01-14-2016 17:00:35.719 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.719 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy:0+3728 01-14-2016 17:00:35.719 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy:0+3728 01-14-2016 17:00:35.719 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy = 01-14-2016 17:00:35.719 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1145, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.720 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.721 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1145, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.721 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1146, msg=IgfsStreamControlRequest [streamId=191, pos=0, len=3728, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.750 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1146, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.751 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3728] 01-14-2016 17:00:35.751 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1147, msg=IgfsStreamControlRequest [streamId=191, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.752 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1142, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.752 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened output stream in create [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.jar, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1]] 01-14-2016 17:00:35.752 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=192] 01-14-2016 17:00:35.753 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1147, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.753 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=191] 01-14-2016 17:00:35.753 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3728], readTime=30737489, userTime=4014538] 01-14-2016 17:00:35.753 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy:0+3311 01-14-2016 17:00:35.754 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.755 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.756 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.756 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1148, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.763 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closing output stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1] 01-14-2016 17:00:35.763 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1149, msg=IgfsStreamControlRequest [streamId=192, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.765 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.765 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.765 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.765 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.765 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.765 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.765 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.765 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.765 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.768 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1148, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.769 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.769 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=193] 01-14-2016 17:00:35.769 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3311]] 01-14-2016 17:00:35.769 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.770 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy:0+3311 01-14-2016 17:00:35.770 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy:0+3311 01-14-2016 17:00:35.771 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1150, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.771 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1149, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.771 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=192] 01-14-2016 17:00:35.771 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closed output stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1], writeTime=16458, userTime=2640] 01-14-2016 17:00:35.772 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1151, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=UPDATE]] 01-14-2016 17:00:35.772 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1150, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.773 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1152, msg=IgfsStreamControlRequest [streamId=193, pos=0, len=3311, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.774 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.774 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.774 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.774 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.775 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.775 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.775 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.775 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.775 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.775 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.775 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|186" 01-14-2016 17:00:35.775 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|186" 01-14-2016 17:00:35.775 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|186" 01-14-2016 17:00:35.775 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|186 01-14-2016 17:00:35.775 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.775 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.776 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913872.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|186 01-14-2016 17:00:35.777 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.777 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.777 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.777 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.778 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.778 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.779 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy = 01-14-2016 17:00:35.779 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.796 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1152, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.797 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3311] 01-14-2016 17:00:35.797 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1153, msg=IgfsStreamControlRequest [streamId=193, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1153, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=193] 01-14-2016 17:00:35.798 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3311], readTime=24350294, userTime=4608033] 01-14-2016 17:00:35.801 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy:0+3218 01-14-2016 17:00:35.802 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.804 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1154, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.807 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1154, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.808 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.808 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=194] 01-14-2016 17:00:35.808 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3218]] 01-14-2016 17:00:35.808 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.809 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy:0+3218 01-14-2016 17:00:35.809 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy:0+3218 01-14-2016 17:00:35.809 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1155, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.811 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1155, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.811 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1156, msg=IgfsStreamControlRequest [streamId=194, pos=0, len=3218, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.817 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.818 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.827 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.827 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.827 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.827 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.827 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.827 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.827 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.827 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.827 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.828 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1156, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.830 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3218] 01-14-2016 17:00:35.830 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1157, msg=IgfsStreamControlRequest [streamId=194, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.830 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1151, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.832 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1158, msg=IgfsPathControlRequest [path=/user/splunk/jars/avro-1.7.4.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.835 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1157, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.835 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=194] 01-14-2016 17:00:35.835 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3218], readTime=20748256, userTime=4392259] 01-14-2016 17:00:35.835 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy:0+3390 01-14-2016 17:00:35.835 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.835 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.835 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.835 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.835 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.836 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.836 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.836 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.836 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.836 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1159, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.837 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.837 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.837 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|187" 01-14-2016 17:00:35.837 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|187" 01-14-2016 17:00:35.837 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|187" 01-14-2016 17:00:35.837 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|187 01-14-2016 17:00:35.837 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.837 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.837 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914226.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|187 01-14-2016 17:00:35.839 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.839 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.839 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.839 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.839 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.839 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.840 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1159, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.840 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.840 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=195] 01-14-2016 17:00:35.840 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy = 01-14-2016 17:00:35.841 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3390]] 01-14-2016 17:00:35.841 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.841 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy:0+3390 01-14-2016 17:00:35.841 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.841 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy:0+3390 01-14-2016 17:00:35.842 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1160, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1160, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.844 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1161, msg=IgfsStreamControlRequest [streamId=195, pos=0, len=3390, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.854 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1158, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.855 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1162, msg=IgfsPathControlRequest [path=/user/splunk/jars/avro-mapred-1.7.4.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.871 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1161, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.872 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3390] 01-14-2016 17:00:35.872 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1163, msg=IgfsStreamControlRequest [streamId=195, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.872 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1163, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.873 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=195] 01-14-2016 17:00:35.873 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3390], readTime=27647804, userTime=4561193] 01-14-2016 17:00:35.873 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy:0+3342 01-14-2016 17:00:35.874 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.876 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1164, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.876 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1162, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.877 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1165, msg=IgfsPathControlRequest [path=/user/splunk/jars/commons-compress-1.5.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.879 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.880 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1164, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.881 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.881 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=196] 01-14-2016 17:00:35.881 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3342]] 01-14-2016 17:00:35.882 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.882 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy:0+3342 01-14-2016 17:00:35.882 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy:0+3342 01-14-2016 17:00:35.883 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1166, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.884 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1166, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.885 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1167, msg=IgfsStreamControlRequest [streamId=196, pos=0, len=3342, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.890 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.890 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.890 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.890 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.890 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.890 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.890 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.890 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.890 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.895 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1165, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.896 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1168, msg=IgfsPathControlRequest [path=/user/splunk/jars/commons-io-2.1.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.899 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.899 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.899 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.899 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.900 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.900 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.900 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.900 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.901 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.901 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.901 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|188" 01-14-2016 17:00:35.901 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|188" 01-14-2016 17:00:35.901 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|188" 01-14-2016 17:00:35.901 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|188 01-14-2016 17:00:35.901 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.901 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.901 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913912.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|188 01-14-2016 17:00:35.902 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1167, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.903 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.903 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.903 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.903 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.903 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3342] 01-14-2016 17:00:35.903 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.903 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.903 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1169, msg=IgfsStreamControlRequest [streamId=196, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1169, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=196] 01-14-2016 17:00:35.904 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3342], readTime=18762197, userTime=4218886] 01-14-2016 17:00:35.904 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy = 01-14-2016 17:00:35.905 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy:0+3780 01-14-2016 17:00:35.905 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.906 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.907 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1170, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.911 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1170, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.911 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.911 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=197] 01-14-2016 17:00:35.911 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3780]] 01-14-2016 17:00:35.912 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.912 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy:0+3780 01-14-2016 17:00:35.912 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy:0+3780 01-14-2016 17:00:35.913 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1171, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.914 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1171, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.914 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1172, msg=IgfsStreamControlRequest [streamId=197, pos=0, len=3780, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.916 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1168, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.917 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1173, msg=IgfsPathControlRequest [path=/user/splunk/jars/libfb303-0.9.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.939 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1173, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.939 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1174, msg=IgfsPathControlRequest [path=/user/splunk/jars/parquet-hive-bundle-1.5.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.942 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:35.943 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:35.945 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1172, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:35.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:35.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:35.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:35.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:35.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:35.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:35.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:35.952 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:35.960 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:35.960 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:35.962 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.962 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.963 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.963 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:35.963 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:35.963 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:35.963 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:35.963 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:35.964 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|189" 01-14-2016 17:00:35.964 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|189" 01-14-2016 17:00:35.964 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|189" 01-14-2016 17:00:35.964 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|189 01-14-2016 17:00:35.964 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3780] 01-14-2016 17:00:35.964 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1175, msg=IgfsStreamControlRequest [streamId=197, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1175, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=197] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3780], readTime=32061344, userTime=3794311] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy:0+3336 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1176, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1176, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=198] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3336]] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.964 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy:0+3336 01-14-2016 17:00:35.964 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy:0+3336 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1177, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1174, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1178, msg=IgfsPathControlRequest [path=/user/splunk/jars/snappy-java-1.0.5.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1177, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.964 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1179, msg=IgfsStreamControlRequest [streamId=198, pos=0, len=3336, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.964 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914216.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|189 01-14-2016 17:00:35.966 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.966 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.966 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.966 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:35.966 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:35.966 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:35.968 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy = 01-14-2016 17:00:35.968 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:35.975 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1179, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.976 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3336] 01-14-2016 17:00:35.976 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1180, msg=IgfsStreamControlRequest [streamId=198, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:35.976 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1178, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.977 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1181, msg=IgfsPathControlRequest [path=/user/splunk/jars/hive-exec-0.12.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.977 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1180, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.977 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=198] 01-14-2016 17:00:35.977 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3336], readTime=19151646, userTime=4394322] 01-14-2016 17:00:35.978 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy:0+3861 01-14-2016 17:00:35.979 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:35.980 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1182, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:35.984 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1182, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.984 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:35.984 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=199] 01-14-2016 17:00:35.984 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3861]] 01-14-2016 17:00:35.985 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:35.985 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy:0+3861 01-14-2016 17:00:35.985 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy:0+3861 01-14-2016 17:00:35.986 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1183, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:35.987 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1183, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.988 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1184, msg=IgfsStreamControlRequest [streamId=199, pos=0, len=3861, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:35.996 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1181, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:35.996 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1185, msg=IgfsPathControlRequest [path=/user/splunk/jars/hive-metastore-0.12.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.004 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:36.005 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1184, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.005 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:36.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:36.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:36.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:36.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:36.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:36.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:36.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:36.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:36.015 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:36.023 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:36.023 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:36.023 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.023 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.023 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.023 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:36.023 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.024 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.024 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.024 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3861] 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1186, msg=IgfsStreamControlRequest [streamId=199, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1186, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=199] 01-14-2016 17:00:36.024 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|190" 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3861], readTime=18535479, userTime=4642464] 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy:0+3722 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:36.024 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1187, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1187, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.024 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|190" 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:36.024 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|190" 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=200] 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3722]] 01-14-2016 17:00:36.024 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:36.024 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy:0+3722 01-14-2016 17:00:36.025 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy:0+3722 01-14-2016 17:00:36.025 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|190 01-14-2016 17:00:36.025 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1188, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.025 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1185, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.025 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1189, msg=IgfsPathControlRequest [path=/user/splunk/jars/hive-serde-0.12.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.025 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1188, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.025 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1190, msg=IgfsStreamControlRequest [streamId=200, pos=0, len=3722, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:36.025 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:36.025 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914300.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|190 01-14-2016 17:00:36.027 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.027 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.027 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.027 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.027 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:36.027 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:36.028 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:36.028 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy = 01-14-2016 17:00:36.029 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:36.035 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1189, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.036 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1191, msg=IgfsPathControlRequest [path=/user/splunk/jars/avro-1.7.4.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.052 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1190, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.072 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:36.073 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:36.083 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:36.083 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:36.083 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:36.083 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:36.083 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:36.083 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:36.083 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:36.083 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:36.083 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:36.093 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:36.093 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:36.093 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.093 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.094 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.094 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:36.094 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.094 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.094 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.094 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:36.095 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|191" 01-14-2016 17:00:36.095 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|191" 01-14-2016 17:00:36.095 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|191" 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3722] 01-14-2016 17:00:36.095 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|191 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1192, msg=IgfsStreamControlRequest [streamId=200, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1192, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=200] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3722], readTime=34767886, userTime=4587433] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - JobSubmitterInputFormat - createRecordReader: /data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy:0+3859 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - SplunkBaseMapper - RecordReader list, index=miker, inputId=1, list=SplunkLineRecordReader 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1193, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_READ]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1191, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1194, msg=IgfsPathControlRequest [path=/user/splunk/jars, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1193, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening input stream [thread=OutputProcessor-mixed, path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy, bufSize=4096] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=201] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened input stream [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3859]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - CodecPool - Got recycled decompressor 01-14-2016 17:00:36.095 INFO ERP.myuatmrigniteprovider - JobSubmitterInputFormat - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy:0+3859 01-14-2016 17:00:36.095 INFO ERP.myuatmrigniteprovider - SplunkBaseMapper - using class=com.splunk.mr.input.SplunkLineRecordReader to process split=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy:0+3859 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1195, msg=IgfsPathControlRequest [path=/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1195, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1196, msg=IgfsStreamControlRequest [streamId=201, pos=0, len=3859, cmd=READ_BLOCK, dataLen=0]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1194, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1197, msg=IgfsPathControlRequest [path=/user/splunk, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1197, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1198, msg=IgfsPathControlRequest [path=/user, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1198, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1199, msg=IgfsPathControlRequest [path=/, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1199, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1200, msg=IgfsPathControlRequest [path=/user/splunk/jars/avro-mapred-1.7.4.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1196, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closing input stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3859] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1201, msg=IgfsStreamControlRequest [streamId=201, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1201, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=201] 01-14-2016 17:00:36.095 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsInputStream - Closed stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=3859], readTime=19617420, userTime=4318067] 01-14-2016 17:00:36.095 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914362.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|191 01-14-2016 17:00:36.097 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.097 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.097 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.097 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.097 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:36.097 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:36.098 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy = 01-14-2016 17:00:36.099 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:36.136 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:36.137 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:36.145 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:36.145 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:36.145 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:36.145 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:36.145 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:36.145 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:36.145 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:36.145 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:36.145 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:36.152 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:36.152 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:36.153 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.153 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.153 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.153 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:36.153 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.154 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.154 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.154 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:36.154 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|192" 01-14-2016 17:00:36.154 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|192" 01-14-2016 17:00:36.154 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|192" 01-14-2016 17:00:36.154 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1200, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.154 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|192 01-14-2016 17:00:36.154 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1202, msg=IgfsPathControlRequest [path=/user/splunk/jars/commons-compress-1.5.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.154 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1202, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.154 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1203, msg=IgfsPathControlRequest [path=/user/splunk/jars/commons-io-2.1.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.154 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:36.154 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:36.155 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914172.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|192 01-14-2016 17:00:36.156 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.156 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.156 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.156 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.157 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:36.157 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:36.158 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy = 01-14-2016 17:00:36.158 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:36.192 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:36.193 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:36.201 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:36.201 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:36.201 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:36.201 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:36.201 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:36.201 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:36.201 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:36.201 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:36.201 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:36.208 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:36.208 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:36.209 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.209 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.210 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.210 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:36.210 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.210 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.210 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.210 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:36.210 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|193" 01-14-2016 17:00:36.210 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|193" 01-14-2016 17:00:36.210 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|193" 01-14-2016 17:00:36.210 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|193 01-14-2016 17:00:36.210 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1203, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.210 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1204, msg=IgfsPathControlRequest [path=/user/splunk/jars/libfb303-0.9.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.210 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1204, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.210 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:36.211 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1205, msg=IgfsPathControlRequest [path=/user/splunk/jars/parquet-hive-bundle-1.5.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.211 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:36.211 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914444.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|193 01-14-2016 17:00:36.213 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1206, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/1.hb, destPath=/user/splunk/dispatch/1452790820.13/2.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:36.213 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.213 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.213 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.213 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.213 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:36.213 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:36.214 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1205, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.215 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy = 01-14-2016 17:00:36.215 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1207, msg=IgfsPathControlRequest [path=/user/splunk/jars/snappy-java-1.0.5.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.215 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:36.253 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:36.254 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:36.257 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1206, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.262 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:36.262 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:36.262 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:36.262 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:36.262 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:36.262 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:36.262 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:36.262 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:36.262 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:36.269 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:36.269 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:36.270 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.270 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.270 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.270 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:36.270 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.270 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.271 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.271 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:36.271 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|194" 01-14-2016 17:00:36.271 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|194" 01-14-2016 17:00:36.271 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|194" 01-14-2016 17:00:36.271 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|194 01-14-2016 17:00:36.271 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:36.271 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:36.271 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914772.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|194 01-14-2016 17:00:36.273 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.273 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.273 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.273 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.273 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:36.273 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:36.274 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy = 01-14-2016 17:00:36.274 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:36.296 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1207, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.297 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1208, msg=IgfsPathControlRequest [path=/user/splunk/jars/hive-exec-0.12.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.305 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:36.306 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:36.315 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:36.315 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:36.315 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:36.315 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:36.315 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:36.315 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:36.315 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:36.315 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:36.315 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:36.317 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1208, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.318 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1209, msg=IgfsPathControlRequest [path=/user/splunk/jars/hive-metastore-0.12.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.321 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:36.321 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:36.322 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.322 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.322 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.322 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:36.322 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.322 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.323 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.323 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:36.323 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|195" 01-14-2016 17:00:36.323 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|195" 01-14-2016 17:00:36.323 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|195" 01-14-2016 17:00:36.323 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:36.323 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|195 01-14-2016 17:00:36.323 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:36.324 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.913984.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|195 01-14-2016 17:00:36.325 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.325 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.325 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.325 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.325 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:36.325 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:36.326 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy = 01-14-2016 17:00:36.326 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:36.335 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1209, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.336 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1210, msg=IgfsPathControlRequest [path=/user/splunk/jars/hive-serde-0.12.0.jar, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=INFO]] 01-14-2016 17:00:36.353 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1210, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.355 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - Creating splits at igfs://igfs@localhost/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001 01-14-2016 17:00:36.360 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:36.360 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:36.361 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening output stream in create [thread=Thread-9path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.split, overwrite=true, bufSize=4096] 01-14-2016 17:00:36.361 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1211, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.split, destPath=null, flag=true, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=3, blockSize=67108864, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_CREATE]] 01-14-2016 17:00:36.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:36.368 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:36.369 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:36.369 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:36.369 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:36.369 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:36.369 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:36.369 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:36.369 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:36.376 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:36.376 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:36.376 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.376 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.377 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.377 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:36.377 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.377 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.378 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.378 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:36.378 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|196" 01-14-2016 17:00:36.378 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|196" 01-14-2016 17:00:36.378 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|196" 01-14-2016 17:00:36.378 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|196 01-14-2016 17:00:36.378 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:36.378 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:36.379 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914352.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|196 01-14-2016 17:00:36.380 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.380 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.380 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.380 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.380 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:36.380 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:36.381 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy = 01-14-2016 17:00:36.382 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:36.417 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1211, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.417 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened output stream in create [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.split, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1]] 01-14-2016 17:00:36.421 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=202] 01-14-2016 17:00:36.421 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1212, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.split, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=UPDATE]] 01-14-2016 17:00:36.422 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:36.423 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:36.431 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:36.431 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:36.431 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:36.431 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:36.431 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:36.431 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:36.431 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:36.431 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:36.431 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:36.439 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:36.439 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:36.439 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.439 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.440 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.440 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:36.440 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1212, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.440 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.440 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.440 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.440 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:36.440 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|197" 01-14-2016 17:00:36.440 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|197" 01-14-2016 17:00:36.440 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|197" 01-14-2016 17:00:36.441 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|197 01-14-2016 17:00:36.441 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:36.441 INFO SearchOperator:stdin - StdinDataProvider::finish called 01-14-2016 17:00:36.441 INFO AggregatorMiningProcessor - Got done message for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.915133.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|197 01-14-2016 17:00:36.443 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.443 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.443 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.443 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:36.443 INFO SearchOperator:stdin - preview completed, resetting state and writer ... 01-14-2016 17:00:36.443 INFO SearchOperator:stdin - setting up new preview state and writer ... 01-14-2016 17:00:36.444 INFO ConfPathMapper - /opt/hunk/etc/system/local: Skipping on-disk modification, keeping changes in memory only for write of: /nobody/system/props/source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy = 01-14-2016 17:00:36.444 INFO ConfObjectManagerDB - /opt/hunk/etc/system/metadata/local.meta: Skipping flush, keeping changes in memory only 01-14-2016 17:00:36.480 INFO SearchParser - PARSING: typer | tags 01-14-2016 17:00:36.481 INFO FastTyper - found nodes count: comparisons=6, unique_comparisons=5, terms=4, unique_terms=4, phrases=12, unique_phrases=12, total leaves=22 01-14-2016 17:00:36.489 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'audittrail' because the output fields are not referenced. 01-14-2016 17:00:36.489 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'kvstore' because the output fields are not referenced. 01-14-2016 17:00:36.489 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'mongod' because the output fields are not referenced. 01-14-2016 17:00:36.489 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'scheduler' because the output fields are not referenced. 01-14-2016 17:00:36.489 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_disk_objects' because the output fields are not referenced. 01-14-2016 17:00:36.489 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunk_resource_usage' because the output fields are not referenced. 01-14-2016 17:00:36.489 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd' because the output fields are not referenced. 01-14-2016 17:00:36.489 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_access' because the output fields are not referenced. 01-14-2016 17:00:36.489 INFO LookupOperator - Disabling automatic lookup of table 'dmc_assets' for conf 'splunkd_remote_searches' because the output fields are not referenced. 01-14-2016 17:00:36.496 INFO SearchOperator:stdin - setting _need_timestamp_fields=0, required time field name= 01-14-2016 17:00:36.496 INFO SearchOperator:stdin - required fields list = Message,_raw,_time,host,index,prestats_reserved_*,psrsvd_*,source,sourcetype,topic 01-14-2016 17:00:36.496 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.496 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.497 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.497 INFO SearchOperator:stdin - started writer thread, conf=source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json| ... 01-14-2016 17:00:36.497 INFO UserManager - Setting user context: splunk-system-user 01-14-2016 17:00:36.497 INFO UserManager - Done setting user context: NULL -> splunk-system-user 01-14-2016 17:00:36.498 INFO UserManager - Unwound user context: splunk-system-user -> NULL 01-14-2016 17:00:36.498 ERROR IndexedExtractionsConfig - Invalid value='' for parameter='INDEXED_EXTRACTIONS'. 01-14-2016 17:00:36.498 INFO UTF8Processor - Converting using CHARSET="UTF-8" for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|198" 01-14-2016 17:00:36.498 INFO LineBreakingProcessor - Using truncation length 999999 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|198" 01-14-2016 17:00:36.498 INFO LineBreakingProcessor - Using lookbehind 100 for conf "source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|198" 01-14-2016 17:00:36.498 INFO AggregatorMiningProcessor - Setting up line merging apparatus for: source::/data/kafka/camus/ig/internal/attribution/event/DATA.IG.APPSFLYER.INSTALL/daily/2016/01/14/DATA.IG.APPSFLYER.INSTALL.1.0.10.914014.1452729600000.snappy|host::vruatsph001.iggroup.local|kafka_json|198 01-14-2016 17:00:36.498 INFO DateParser - Set timezone to: UTC 01-14-2016 17:00:36.505 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closing output stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1] 01-14-2016 17:00:36.505 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1213, msg=IgfsStreamControlRequest [streamId=202, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:36.546 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1213, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.546 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=202] 01-14-2016 17:00:36.547 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closed output stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1], writeTime=44664, userTime=84390] 01-14-2016 17:00:36.547 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening output stream in create [thread=Thread-9path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.splitmetainfo, overwrite=true, bufSize=4096] 01-14-2016 17:00:36.547 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1214, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.splitmetainfo, destPath=null, flag=true, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=3, blockSize=67108864, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_CREATE]] 01-14-2016 17:00:36.589 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1214, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.589 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened output stream in create [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.splitmetainfo, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1]] 01-14-2016 17:00:36.589 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=203] 01-14-2016 17:00:36.589 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1215, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.splitmetainfo, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=UPDATE]] 01-14-2016 17:00:36.612 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1215, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.619 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closing output stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1] 01-14-2016 17:00:36.619 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1216, msg=IgfsStreamControlRequest [streamId=203, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:36.665 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1216, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.665 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=203] 01-14-2016 17:00:36.665 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closed output stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1], writeTime=46277, userTime=30045] 01-14-2016 17:00:36.665 INFO ERP.myuatmrigniteprovider - JobSubmitter - number of splits:198 01-14-2016 17:00:36.671 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opening output stream in create [thread=Thread-9path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.xml, overwrite=true, bufSize=4096] 01-14-2016 17:00:36.671 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1217, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.xml, destPath=null, flag=true, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=3, blockSize=67108864, accessTime=0, modificationTime=0, userName=pearcem, cmd=OPEN_CREATE]] 01-14-2016 17:00:36.716 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1217, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.717 DEBUG ERP.myuatmrigniteprovider - IgniteHadoopFileSystem - Opened output stream in create [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.xml, delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1]] 01-14-2016 17:00:36.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Added stream event listener [streamId=204] 01-14-2016 17:00:36.717 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1218, msg=IgfsPathControlRequest [path=/tmp/hadoop-yarn/staging/pearcem/.staging/job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001/job.xml, destPath=null, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=UPDATE]] 01-14-2016 17:00:36.740 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1218, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.744 INFO ERP.myuatmrigniteprovider - Configuration - mapred.job.reduce.memory.mb is deprecated. Instead, use mapreduce.reduce.memory.mb 01-14-2016 17:00:36.744 INFO ERP.myuatmrigniteprovider - Configuration - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename 01-14-2016 17:00:36.745 INFO ERP.myuatmrigniteprovider - Configuration - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 01-14-2016 17:00:36.746 INFO ERP.myuatmrigniteprovider - Configuration - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks 01-14-2016 17:00:36.746 INFO ERP.myuatmrigniteprovider - Configuration - mapred.job.map.memory.mb is deprecated. Instead, use mapreduce.map.memory.mb 01-14-2016 17:00:36.887 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closing output stream: HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1] 01-14-2016 17:00:36.887 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1219, msg=IgfsStreamControlRequest [streamId=204, pos=0, len=0, cmd=CLOSE, dataLen=0]] 01-14-2016 17:00:36.893 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1219, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:36.894 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutProc - Removed stream event listener [streamId=204] 01-14-2016 17:00:36.894 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsOutputStream - Closed output stream [delegate=HadoopIgfsStreamDelegate [hadoop=org.apache.ignite.internal.processors.hadoop.igfs.HadoopIgfsOutProc@519e51ea, len=-1], writeTime=7428, userTime=169507] 01-14-2016 17:00:36.894 INFO ERP.myuatmrigniteprovider - JobSubmitter - Submitting tokens for job: job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001 01-14-2016 17:00:37.212 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1220, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/2.hb, destPath=/user/splunk/dispatch/1452790820.13/3.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:37.261 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1220, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:38.212 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1221, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/3.hb, destPath=/user/splunk/dispatch/1452790820.13/4.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:38.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1221, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:38.497 WARN SearchOperator:kv - host is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:38.497 WARN SearchOperator:kv - index is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:38.498 WARN SearchOperator:kv - source is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:38.498 WARN SearchOperator:kv - sourcetype is an indexed field, ignoring TOKENIZER 01-14-2016 17:00:38.500 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:39.213 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1222, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/4.hb, destPath=/user/splunk/dispatch/1452790820.13/5.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:39.263 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1222, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:40.214 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1223, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/5.hb, destPath=/user/splunk/dispatch/1452790820.13/6.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:40.264 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1223, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:40.449 INFO ERP.myuatmrigniteprovider - Job - The url to track the job: N/A 01-14-2016 17:00:40.449 INFO ERP.myuatmrigniteprovider - AsyncMRJob - Done submitting job.name=SPLK_vruatsph001.iggroup.local_1452790820.13_0, url=N/A 01-14-2016 17:00:40.449 DEBUG ERP.myuatmrigniteprovider - Cluster - Trying ClientProtocolProvider : org.apache.hadoop.mapred.YarnClientProtocolProvider 01-14-2016 17:00:40.449 DEBUG ERP.myuatmrigniteprovider - Cluster - Cannot pick org.apache.hadoop.mapred.YarnClientProtocolProvider as the ClientProtocolProvider - returned null protocol 01-14-2016 17:00:40.450 DEBUG ERP.myuatmrigniteprovider - Cluster - Trying ClientProtocolProvider : org.apache.hadoop.mapred.LocalClientProtocolProvider 01-14-2016 17:00:40.450 DEBUG ERP.myuatmrigniteprovider - Cluster - Cannot pick org.apache.hadoop.mapred.LocalClientProtocolProvider as the ClientProtocolProvider - returned null protocol 01-14-2016 17:00:40.450 DEBUG ERP.myuatmrigniteprovider - Cluster - Trying ClientProtocolProvider : org.apache.ignite.hadoop.mapreduce.IgniteHadoopClientProtocolProvider 01-14-2016 17:00:40.450 DEBUG ERP.myuatmrigniteprovider - Cluster - Picked org.apache.ignite.hadoop.mapreduce.IgniteHadoopClientProtocolProvider as the ClientProtocolProvider 01-14-2016 17:00:40.451 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapred.JobClient.getJobUsingCluster(JobClient.java:591) 01-14-2016 17:00:40.619 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:40.736 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:40.861 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:40.982 INFO ERP.myuatmrigniteprovider - JobSubmitter - waiting for job to complete job.name=SPLK_vruatsph001.iggroup.local_1452790820.13_0 01-14-2016 17:00:40.983 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:41.215 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1224, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/6.hb, destPath=/user/splunk/dispatch/1452790820.13/7.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:41.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1224, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:42.215 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1225, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/7.hb, destPath=/user/splunk/dispatch/1452790820.13/8.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:42.300 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1225, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:43.103 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:43.215 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1226, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/8.hb, destPath=/user/splunk/dispatch/1452790820.13/9.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:43.240 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:00:43.241 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:00:43.243 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:00:43.243 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:43.320 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1226, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:43.690 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:00:44.215 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1227, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/9.hb, destPath=/user/splunk/dispatch/1452790820.13/10.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:44.349 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1227, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:45.215 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1228, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/10.hb, destPath=/user/splunk/dispatch/1452790820.13/11.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:45.262 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1228, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:45.378 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:45.505 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:00:45.505 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:00:45.505 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:00:45.505 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:46.219 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1229, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/11.hb, destPath=/user/splunk/dispatch/1452790820.13/12.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:46.833 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1229, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:47.217 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1230, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/12.hb, destPath=/user/splunk/dispatch/1452790820.13/13.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:47.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1230, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:47.617 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:47.730 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:00:47.731 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:00:47.731 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:00:47.731 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:48.218 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1231, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/13.hb, destPath=/user/splunk/dispatch/1452790820.13/14.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:48.257 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1231, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:48.504 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:49.218 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1232, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/14.hb, destPath=/user/splunk/dispatch/1452790820.13/15.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:49.256 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1232, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:49.842 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:49.964 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:00:49.964 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:00:49.964 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:00:49.964 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:50.219 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1233, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/15.hb, destPath=/user/splunk/dispatch/1452790820.13/16.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:50.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1233, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:51.219 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1234, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/16.hb, destPath=/user/splunk/dispatch/1452790820.13/17.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:51.267 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1234, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:52.075 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:52.189 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:00:52.189 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:00:52.189 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:00:52.189 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:52.219 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1235, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/17.hb, destPath=/user/splunk/dispatch/1452790820.13/18.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:52.260 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1235, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:53.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1236, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/18.hb, destPath=/user/splunk/dispatch/1452790820.13/19.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:53.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1236, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:53.688 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:00:54.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1237, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/19.hb, destPath=/user/splunk/dispatch/1452790820.13/20.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:54.262 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1237, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:54.301 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:54.303 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:00:54 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection close 01-14-2016 17:00:54.303 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection closed: localhost/127.0.0.1:11211 01-14-2016 17:00:54.306 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:00:54 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection 01-14-2016 17:00:54.306 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection established: /127.0.0.1:11211 01-14-2016 17:00:54.417 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:00:54.418 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:00:54.418 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:00:54.418 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:55.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1238, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/20.hb, destPath=/user/splunk/dispatch/1452790820.13/21.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:55.267 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1238, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:56.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1239, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/21.hb, destPath=/user/splunk/dispatch/1452790820.13/22.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:56.261 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1239, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:56.536 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:56.656 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:00:56.656 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:00:56.656 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:00:56.656 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:57.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1240, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/22.hb, destPath=/user/splunk/dispatch/1452790820.13/23.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:57.260 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1240, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:58.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1241, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/23.hb, destPath=/user/splunk/dispatch/1452790820.13/24.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:58.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1241, cmd=CONTROL_RESPONSE] 01-14-2016 17:00:58.508 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:00:58.778 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:58.890 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:00:58.890 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:00:58.890 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:00:58.891 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:00:59.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1242, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/24.hb, destPath=/user/splunk/dispatch/1452790820.13/25.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:00:59.261 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1242, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:00.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1243, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/25.hb, destPath=/user/splunk/dispatch/1452790820.13/26.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:00.260 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1243, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:01.000 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:01.113 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:01.113 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:01.113 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:01.113 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:01.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1244, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/26.hb, destPath=/user/splunk/dispatch/1452790820.13/27.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:01.265 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1244, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:02.227 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1245, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/27.hb, destPath=/user/splunk/dispatch/1452790820.13/28.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:02.273 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1245, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:03.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1246, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/28.hb, destPath=/user/splunk/dispatch/1452790820.13/29.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:03.224 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:03.264 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1246, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:03.336 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:03.336 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:03.336 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:03.336 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:03.689 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:01:04.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1247, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/29.hb, destPath=/user/splunk/dispatch/1452790820.13/30.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:04.271 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1247, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:05.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1248, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/30.hb, destPath=/user/splunk/dispatch/1452790820.13/31.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:05.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1248, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:05.448 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:05.558 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:05.558 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:05.559 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:05.559 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:06.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1249, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/31.hb, destPath=/user/splunk/dispatch/1452790820.13/32.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:06.259 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1249, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:07.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1250, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/32.hb, destPath=/user/splunk/dispatch/1452790820.13/33.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:07.257 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1250, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:07.669 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:07.781 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:07.782 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:07.782 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:07.782 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:08.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1251, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/33.hb, destPath=/user/splunk/dispatch/1452790820.13/34.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:08.257 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1251, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:08.513 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:01:09.221 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1252, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/34.hb, destPath=/user/splunk/dispatch/1452790820.13/35.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:09.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1252, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:09.893 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:10.007 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:10.007 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:10.007 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:10.007 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:10.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1253, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/35.hb, destPath=/user/splunk/dispatch/1452790820.13/36.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:10.258 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1253, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:11.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1254, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/36.hb, destPath=/user/splunk/dispatch/1452790820.13/37.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:11.260 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1254, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:12.118 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:12.220 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1255, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/37.hb, destPath=/user/splunk/dispatch/1452790820.13/38.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:12.229 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:12.230 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:12.230 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:12.230 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:13.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1255, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:13.637 WARN ERP.myuatmrigniteprovider - FileBasedHeartBeat - Filesystem rename operation took longer than the heartbeat interval.Please increase the value of splunk.heartbeat.interval so that MR job won't mistakenly think SH is dead and kill itself. In addition, you could also decrease the value of splunk.heartbeat.threshold to avoid slowing down the MR job reaction to a real SH dead situation 01-14-2016 17:01:13.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1256, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/38.hb, destPath=/user/splunk/dispatch/1452790820.13/39.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:13.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1256, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:13.689 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:01:14.340 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:14.450 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:14.450 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:14.450 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:14.450 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:14.638 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1257, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/39.hb, destPath=/user/splunk/dispatch/1452790820.13/40.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:14.688 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1257, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:15.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1258, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/40.hb, destPath=/user/splunk/dispatch/1452790820.13/41.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:15.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1258, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:16.560 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:16.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1259, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/41.hb, destPath=/user/splunk/dispatch/1452790820.13/42.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:16.670 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:16.670 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:16.670 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:16.670 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:16.676 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1259, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:17.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1260, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/42.hb, destPath=/user/splunk/dispatch/1452790820.13/43.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:17.673 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1260, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:18.516 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:01:18.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1261, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/43.hb, destPath=/user/splunk/dispatch/1452790820.13/44.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:18.672 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1261, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:18.781 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:18.894 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:18.894 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:18.894 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:18.894 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:19.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1262, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/44.hb, destPath=/user/splunk/dispatch/1452790820.13/45.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:19.672 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1262, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:20.638 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1263, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/45.hb, destPath=/user/splunk/dispatch/1452790820.13/46.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:20.673 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1263, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:21.004 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:21.113 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:21.113 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:21.113 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:21.113 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:21.638 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1264, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/46.hb, destPath=/user/splunk/dispatch/1452790820.13/47.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:21.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1264, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:22.637 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1265, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/47.hb, destPath=/user/splunk/dispatch/1452790820.13/48.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:22.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1265, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:23.222 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:23.331 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:23.331 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:23.331 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:23.331 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:23.638 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1266, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/48.hb, destPath=/user/splunk/dispatch/1452790820.13/49.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:23.673 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1266, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:23.690 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:01:24.638 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1267, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/49.hb, destPath=/user/splunk/dispatch/1452790820.13/50.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:24.673 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1267, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:25.440 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:25.442 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:01:25 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection close 01-14-2016 17:01:25.442 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection closed: /127.0.0.1:11211 01-14-2016 17:01:25.447 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:01:25 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection 01-14-2016 17:01:25.447 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection established: /127.0.0.1:11211 01-14-2016 17:01:25.556 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:25.556 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:25.556 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:25.556 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:25.638 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1268, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/50.hb, destPath=/user/splunk/dispatch/1452790820.13/51.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:25.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1268, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:26.638 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1269, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/51.hb, destPath=/user/splunk/dispatch/1452790820.13/52.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:26.676 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1269, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:27.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1270, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/52.hb, destPath=/user/splunk/dispatch/1452790820.13/53.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:27.664 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:27.676 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1270, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:27.773 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:27.773 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:27.773 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:27.773 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:28.521 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:01:28.638 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1271, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/53.hb, destPath=/user/splunk/dispatch/1452790820.13/54.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:28.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1271, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:29.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1272, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/54.hb, destPath=/user/splunk/dispatch/1452790820.13/55.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:29.678 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1272, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:29.881 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:29.991 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:29.991 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:29.991 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:29.992 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:30.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1273, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/55.hb, destPath=/user/splunk/dispatch/1452790820.13/56.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:30.675 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1273, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:31.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1274, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/56.hb, destPath=/user/splunk/dispatch/1452790820.13/57.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:31.681 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1274, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:32.101 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:32.209 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:32.209 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:32.209 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:32.210 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:32.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1275, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/57.hb, destPath=/user/splunk/dispatch/1452790820.13/58.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:32.676 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1275, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:33.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1276, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/58.hb, destPath=/user/splunk/dispatch/1452790820.13/59.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:33.679 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1276, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:33.690 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:01:34.324 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:34.440 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:34.440 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:34.440 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:34.440 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:34.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1277, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/59.hb, destPath=/user/splunk/dispatch/1452790820.13/60.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:34.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1277, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:35.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1278, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/60.hb, destPath=/user/splunk/dispatch/1452790820.13/61.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:35.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1278, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:36.549 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:36.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1279, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/61.hb, destPath=/user/splunk/dispatch/1452790820.13/62.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:36.663 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:36.664 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:36.664 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:36.664 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:36.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1279, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:37.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1280, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/62.hb, destPath=/user/splunk/dispatch/1452790820.13/63.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:37.674 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1280, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:38.526 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:01:38.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1281, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/63.hb, destPath=/user/splunk/dispatch/1452790820.13/64.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:38.677 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1281, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:38.772 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:38.880 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:38.880 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:38.880 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:38.881 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:39.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1282, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/64.hb, destPath=/user/splunk/dispatch/1452790820.13/65.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:39.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1282, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:40.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1283, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/65.hb, destPath=/user/splunk/dispatch/1452790820.13/66.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:40.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1283, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:40.989 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:41.126 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:41.126 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:41.126 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:41.127 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:41.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1284, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/66.hb, destPath=/user/splunk/dispatch/1452790820.13/67.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:41.676 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1284, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:42.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1285, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/67.hb, destPath=/user/splunk/dispatch/1452790820.13/68.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:42.678 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1285, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:43.235 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:43.344 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:43.345 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:43.345 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:43.345 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:43.639 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1286, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/68.hb, destPath=/user/splunk/dispatch/1452790820.13/69.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:43.676 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1286, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:43.691 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:01:44.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1287, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/69.hb, destPath=/user/splunk/dispatch/1452790820.13/70.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:44.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1287, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:45.453 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:45.562 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:45.562 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:45.562 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:45.562 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:45.640 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1288, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/70.hb, destPath=/user/splunk/dispatch/1452790820.13/71.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:45.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1288, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:46.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1289, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/71.hb, destPath=/user/splunk/dispatch/1452790820.13/72.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:46.679 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1289, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:47.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1290, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/72.hb, destPath=/user/splunk/dispatch/1452790820.13/73.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:47.679 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1290, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:47.682 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:47.792 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:47.792 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:47.792 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:47.792 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:48.530 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:01:48.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1291, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/73.hb, destPath=/user/splunk/dispatch/1452790820.13/74.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:48.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1291, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:49.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1292, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/74.hb, destPath=/user/splunk/dispatch/1452790820.13/75.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:49.677 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1292, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:49.911 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:50.013 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:50.013 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:50.013 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:50.013 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:50.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1293, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/75.hb, destPath=/user/splunk/dispatch/1452790820.13/76.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:50.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1293, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:51.641 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1294, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/76.hb, destPath=/user/splunk/dispatch/1452790820.13/77.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:51.678 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1294, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:52.123 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:52.231 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:52.231 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:52.231 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:52.231 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:52.642 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1295, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/77.hb, destPath=/user/splunk/dispatch/1452790820.13/78.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:52.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1295, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:53.643 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1296, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/78.hb, destPath=/user/splunk/dispatch/1452790820.13/79.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:53.681 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1296, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:53.691 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:01:54.341 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:54.450 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:54.450 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:54.450 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:54.450 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:54.644 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1297, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/79.hb, destPath=/user/splunk/dispatch/1452790820.13/80.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:54.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1297, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:55.643 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1298, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/80.hb, destPath=/user/splunk/dispatch/1452790820.13/81.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:55.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1298, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:56.559 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:56.560 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:01:56 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection close 01-14-2016 17:01:56.560 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection closed: /127.0.0.1:11211 01-14-2016 17:01:56.563 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:01:56 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection 01-14-2016 17:01:56.563 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection established: /127.0.0.1:11211 01-14-2016 17:01:56.644 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1299, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/81.hb, destPath=/user/splunk/dispatch/1452790820.13/82.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:56.671 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:56.671 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:56.671 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:56.672 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:56.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1299, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:57.645 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1300, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/82.hb, destPath=/user/splunk/dispatch/1452790820.13/83.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:57.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1300, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:58.534 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:01:58.645 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1301, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/83.hb, destPath=/user/splunk/dispatch/1452790820.13/84.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:58.686 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1301, cmd=CONTROL_RESPONSE] 01-14-2016 17:01:58.781 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:58.891 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:01:58.891 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:01:58.891 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:01:58.892 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:01:59.645 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1302, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/84.hb, destPath=/user/splunk/dispatch/1452790820.13/85.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:01:59.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1302, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:00.646 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1303, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/85.hb, destPath=/user/splunk/dispatch/1452790820.13/86.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:00.686 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1303, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:01.000 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:01.111 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:01.111 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:01.112 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:01.112 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:01.654 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1304, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/86.hb, destPath=/user/splunk/dispatch/1452790820.13/87.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:01.705 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1304, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:02.647 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1305, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/87.hb, destPath=/user/splunk/dispatch/1452790820.13/88.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:02.684 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1305, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:03.222 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:03.331 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:03.332 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:03.332 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:03.332 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:03.647 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1306, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/88.hb, destPath=/user/splunk/dispatch/1452790820.13/89.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:03.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1306, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:03.693 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:02:04.647 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1307, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/89.hb, destPath=/user/splunk/dispatch/1452790820.13/90.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:04.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1307, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:05.441 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:05.549 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:05.549 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:05.550 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:05.550 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:05.647 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1308, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/90.hb, destPath=/user/splunk/dispatch/1452790820.13/91.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:05.683 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1308, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:06.646 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1309, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/91.hb, destPath=/user/splunk/dispatch/1452790820.13/92.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:06.683 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1309, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:07.647 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1310, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/92.hb, destPath=/user/splunk/dispatch/1452790820.13/93.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:07.658 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:07.706 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1310, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:07.788 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:07.788 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:07.789 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:07.789 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:08.539 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:02:08.648 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1311, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/93.hb, destPath=/user/splunk/dispatch/1452790820.13/94.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:08.686 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1311, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:09.648 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1312, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/94.hb, destPath=/user/splunk/dispatch/1452790820.13/95.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:09.707 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1312, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:09.898 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:10.009 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:10.009 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:10.009 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:10.009 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:10.648 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1313, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/95.hb, destPath=/user/splunk/dispatch/1452790820.13/96.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:10.683 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1313, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:11.649 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1314, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/96.hb, destPath=/user/splunk/dispatch/1452790820.13/97.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:11.688 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1314, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:12.120 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:12.229 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:12.229 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:12.229 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:12.230 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:12.648 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1315, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/97.hb, destPath=/user/splunk/dispatch/1452790820.13/98.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:12.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1315, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:13.648 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1316, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/98.hb, destPath=/user/splunk/dispatch/1452790820.13/99.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:13.685 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1316, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:13.693 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:02:14.338 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:14.447 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:14.447 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:14.448 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:14.448 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:14.648 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1317, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/99.hb, destPath=/user/splunk/dispatch/1452790820.13/100.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:14.680 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1317, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:15.649 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1318, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/100.hb, destPath=/user/splunk/dispatch/1452790820.13/101.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:15.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1318, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:16.565 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:16.648 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1319, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/101.hb, destPath=/user/splunk/dispatch/1452790820.13/102.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:16.674 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:16.675 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:16.675 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:16.675 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:16.686 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1319, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:17.649 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1320, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/102.hb, destPath=/user/splunk/dispatch/1452790820.13/103.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:17.682 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1320, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:18.543 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:02:18.649 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1321, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/103.hb, destPath=/user/splunk/dispatch/1452790820.13/104.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:18.691 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1321, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:18.783 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:18.892 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:18.892 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:18.892 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:18.892 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:19.650 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1322, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/104.hb, destPath=/user/splunk/dispatch/1452790820.13/105.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:19.687 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1322, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:20.650 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1323, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/105.hb, destPath=/user/splunk/dispatch/1452790820.13/106.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:20.686 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1323, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:21.002 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:21.110 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:21.110 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:21.111 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:21.111 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:21.650 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1324, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/106.hb, destPath=/user/splunk/dispatch/1452790820.13/107.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:21.690 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1324, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:22.651 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1325, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/107.hb, destPath=/user/splunk/dispatch/1452790820.13/108.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:22.692 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1325, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:23.219 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:23.329 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:23.329 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:23.329 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:23.329 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:23.651 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1326, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/108.hb, destPath=/user/splunk/dispatch/1452790820.13/109.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:23.691 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1326, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:23.693 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:02:24.651 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1327, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/109.hb, destPath=/user/splunk/dispatch/1452790820.13/110.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:24.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1327, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:25.437 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:25.546 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:25.546 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:25.546 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:25.546 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:25.651 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1328, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/110.hb, destPath=/user/splunk/dispatch/1452790820.13/111.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:25.729 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1328, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:26.652 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1329, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/111.hb, destPath=/user/splunk/dispatch/1452790820.13/112.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:26.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1329, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:27.653 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1330, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/112.hb, destPath=/user/splunk/dispatch/1452790820.13/113.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:27.655 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:27.656 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:02:27 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection close 01-14-2016 17:02:27.656 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection closed: /127.0.0.1:11211 01-14-2016 17:02:27.658 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:02:27 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection 01-14-2016 17:02:27.658 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection established: /127.0.0.1:11211 01-14-2016 17:02:27.688 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1330, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:27.766 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:27.766 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:27.767 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:27.767 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:28.548 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:02:28.652 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1331, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/113.hb, destPath=/user/splunk/dispatch/1452790820.13/114.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:28.690 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1331, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:29.653 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1332, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/114.hb, destPath=/user/splunk/dispatch/1452790820.13/115.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:29.692 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1332, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:29.875 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:29.986 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:29.986 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:29.986 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:29.987 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:30.654 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1333, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/115.hb, destPath=/user/splunk/dispatch/1452790820.13/116.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:30.695 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1333, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:31.654 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1334, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/116.hb, destPath=/user/splunk/dispatch/1452790820.13/117.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:31.692 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1334, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:32.095 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:32.200 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:32.200 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:32.200 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:32.200 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:32.662 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1335, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/117.hb, destPath=/user/splunk/dispatch/1452790820.13/118.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:32.698 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1335, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:33.655 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1336, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/118.hb, destPath=/user/splunk/dispatch/1452790820.13/119.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:33.693 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1336, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:33.694 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:02:34.309 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:34.417 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:34.417 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:34.417 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:34.418 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:34.655 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1337, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/119.hb, destPath=/user/splunk/dispatch/1452790820.13/120.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:34.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1337, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:35.654 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1338, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/120.hb, destPath=/user/splunk/dispatch/1452790820.13/121.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:35.694 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1338, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:36.525 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:36.634 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:36.634 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:36.634 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:36.634 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:36.654 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1339, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/121.hb, destPath=/user/splunk/dispatch/1452790820.13/122.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:36.690 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1339, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:37.655 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1340, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/122.hb, destPath=/user/splunk/dispatch/1452790820.13/123.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:37.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1340, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:38.552 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:02:38.655 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1341, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/123.hb, destPath=/user/splunk/dispatch/1452790820.13/124.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:38.694 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1341, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:38.742 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:38.850 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:38.850 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:38.850 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:38.850 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:39.655 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1342, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/124.hb, destPath=/user/splunk/dispatch/1452790820.13/125.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:39.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1342, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:40.655 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1343, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/125.hb, destPath=/user/splunk/dispatch/1452790820.13/126.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:40.689 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1343, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:40.958 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:41.067 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:41.067 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:41.068 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:41.068 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:41.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1344, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/126.hb, destPath=/user/splunk/dispatch/1452790820.13/127.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:41.691 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1344, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:42.656 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1345, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/127.hb, destPath=/user/splunk/dispatch/1452790820.13/128.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:42.692 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1345, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:43.177 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:43.285 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:43.286 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:43.286 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:43.286 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:43.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1346, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/128.hb, destPath=/user/splunk/dispatch/1452790820.13/129.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:43.691 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1346, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:43.695 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:02:44.658 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1347, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/129.hb, destPath=/user/splunk/dispatch/1452790820.13/130.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:44.694 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1347, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:45.393 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:45.503 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:45.503 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:45.503 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:45.503 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:45.658 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1348, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/130.hb, destPath=/user/splunk/dispatch/1452790820.13/131.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:45.692 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1348, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:46.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1349, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/131.hb, destPath=/user/splunk/dispatch/1452790820.13/132.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:46.691 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1349, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:47.612 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:47.657 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1350, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/132.hb, destPath=/user/splunk/dispatch/1452790820.13/133.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:47.692 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1350, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:47.720 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:47.720 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:47.720 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:47.720 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:48.557 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:02:48.658 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1351, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/133.hb, destPath=/user/splunk/dispatch/1452790820.13/134.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:48.696 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1351, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:49.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1352, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/134.hb, destPath=/user/splunk/dispatch/1452790820.13/135.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:49.698 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1352, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:49.829 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:49.947 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:49.948 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:49.948 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:49.948 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:50.658 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1353, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/135.hb, destPath=/user/splunk/dispatch/1452790820.13/136.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:50.696 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1353, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:51.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1354, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/136.hb, destPath=/user/splunk/dispatch/1452790820.13/137.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:51.698 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1354, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:52.056 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:52.165 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:52.165 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:52.165 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:52.166 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:52.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1355, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/137.hb, destPath=/user/splunk/dispatch/1452790820.13/138.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:52.697 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1355, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:53.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1356, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/138.hb, destPath=/user/splunk/dispatch/1452790820.13/139.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:53.695 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:02:53.698 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1356, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:54.276 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:54.381 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:54.381 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:54.381 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:54.381 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:54.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1357, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/139.hb, destPath=/user/splunk/dispatch/1452790820.13/140.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:54.700 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1357, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:55.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1358, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/140.hb, destPath=/user/splunk/dispatch/1452790820.13/141.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:55.720 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1358, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:56.490 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:56.608 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:56.608 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:56.608 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:56.609 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:56.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1359, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/141.hb, destPath=/user/splunk/dispatch/1452790820.13/142.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:56.699 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1359, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:57.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1360, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/142.hb, destPath=/user/splunk/dispatch/1452790820.13/143.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:57.697 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1360, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:58.562 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:02:58.659 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1361, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/143.hb, destPath=/user/splunk/dispatch/1452790820.13/144.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:58.696 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1361, cmd=CONTROL_RESPONSE] 01-14-2016 17:02:58.717 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:58.718 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:02:58 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection close 01-14-2016 17:02:58.718 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection closed: /127.0.0.1:11211 01-14-2016 17:02:58.721 DEBUG ERP.myuatmrigniteprovider - Jan 14, 2016 5:02:58 PM org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection 01-14-2016 17:02:58.721 DEBUG ERP.myuatmrigniteprovider - INFO: Client TCP connection established: /127.0.0.1:11211 01-14-2016 17:02:58.828 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:02:58.829 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:02:58.829 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:02:58.829 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:02:59.660 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1362, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/144.hb, destPath=/user/splunk/dispatch/1452790820.13/145.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:02:59.699 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1362, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:00.661 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1363, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/145.hb, destPath=/user/splunk/dispatch/1452790820.13/146.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:00.697 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1363, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:00.939 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:01.082 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:03:01.082 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:03:01.082 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:03:01.082 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:01.668 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1364, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/146.hb, destPath=/user/splunk/dispatch/1452790820.13/147.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:01.709 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1364, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:02.661 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1365, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/147.hb, destPath=/user/splunk/dispatch/1452790820.13/148.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:02.702 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1365, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:03.191 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:03.298 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:03:03.299 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:03:03.299 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:03:03.299 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:03.662 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1366, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/148.hb, destPath=/user/splunk/dispatch/1452790820.13/149.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:03.695 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:03:03.699 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1366, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:04.662 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1367, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/149.hb, destPath=/user/splunk/dispatch/1452790820.13/150.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:04.699 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1367, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:05.407 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:05.515 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:03:05.515 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:03:05.516 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:03:05.516 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:05.663 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1368, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/150.hb, destPath=/user/splunk/dispatch/1452790820.13/151.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:05.699 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1368, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:06.663 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1369, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/151.hb, destPath=/user/splunk/dispatch/1452790820.13/152.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:06.707 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1369, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:07.624 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:07.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1370, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/152.hb, destPath=/user/splunk/dispatch/1452790820.13/153.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:07.703 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1370, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:07.733 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:03:07.733 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:03:07.733 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:03:07.733 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:08.566 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:03:08.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1371, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/153.hb, destPath=/user/splunk/dispatch/1452790820.13/154.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:08.700 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1371, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:09.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1372, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/154.hb, destPath=/user/splunk/dispatch/1452790820.13/155.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:09.698 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1372, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:09.841 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:09.950 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:03:09.950 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:03:09.950 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:03:09.951 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:10.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1373, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/155.hb, destPath=/user/splunk/dispatch/1452790820.13/156.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:10.701 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1373, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:11.665 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1374, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/156.hb, destPath=/user/splunk/dispatch/1452790820.13/157.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:11.703 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1374, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:12.058 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:12.167 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:03:12.167 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:03:12.167 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:03:12.167 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:12.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1375, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/157.hb, destPath=/user/splunk/dispatch/1452790820.13/158.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:12.699 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1375, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:13.665 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1376, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/158.hb, destPath=/user/splunk/dispatch/1452790820.13/159.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:13.696 DEBUG ERP.myuatmrigniteprovider - SearchController - stopOnMaxHadoopNodesExceedingLicense ... 01-14-2016 17:03:13.705 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1376, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:14.276 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:14.386 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:03:14.387 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:03:14.387 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:03:14.387 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:14.664 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1377, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/159.hb, destPath=/user/splunk/dispatch/1452790820.13/160.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:14.711 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1377, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:15.665 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1378, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/160.hb, destPath=/user/splunk/dispatch/1452790820.13/161.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:15.705 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1378, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:16.496 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:16.614 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:03:16.614 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:03:16.614 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:03:16.614 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:16.666 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1379, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/161.hb, destPath=/user/splunk/dispatch/1452790820.13/162.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:16.705 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1379, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:17.667 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1380, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/162.hb, destPath=/user/splunk/dispatch/1452790820.13/163.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:17.703 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1380, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:18.571 INFO DispatchThread - Generating results preview took 1 ms 01-14-2016 17:03:18.667 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo - Sending IGFS message [reqId=1381, msg=IgfsPathControlRequest [path=/user/splunk/dispatch/1452790820.13/163.hb, destPath=/user/splunk/dispatch/1452790820.13/164.hb, flag=false, colocate=false, seqReadsBeforePrefetch=0, start=0, len=0, replication=0, blockSize=0, accessTime=0, modificationTime=0, userName=pearcem, cmd=RENAME]] 01-14-2016 17:03:18.702 DEBUG ERP.myuatmrigniteprovider - HadoopIgfsIpcIo$ReaderThread - Received IGFS response [reqId=1381, cmd=CONTROL_RESPONSE] 01-14-2016 17:03:18.723 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320) 01-14-2016 17:03:18.831 INFO ERP.myuatmrigniteprovider - JobSubmitter - JobId=job_2bcc8d7c-0e2f-492f-9946-f320a78b4d52_0001, Map: 0.00%, Reduce: 0.00% 01-14-2016 17:03:18.831 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.getTaskCompletionEvents(Job.java:670) 01-14-2016 17:03:18.831 DEBUG ERP.myuatmrigniteprovider - JobSubmitter - finished processing until eventId=0, processed total=0 01-14-2016 17:03:18.831 DEBUG ERP.myuatmrigniteprovider - UserGroupInformation - PrivilegedAction as:pearcem (auth:PROXY) via splunk@IGI.IG.LOCAL (auth:KERBEROS) from:org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:320)