Details
-
Bug
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
None
-
None
-
None
Description
According to the documentation at the Operational Analytics there is a reputation module that can be disabled by changing the content of the reputation_config.json to an empty json (i. e. {}). But even if you disable it generates the following error.
[spot@ip-10-0-0-53 oa]$ python2.7 start_oa.py -d 20160707 -t dns -l 3000
2017-01-13 07:01:08,612 - OA - INFO - -------------------- STARTING OA ---------------------
2017-01-13 07:01:08,612 - OA - INFO - Validating input parameter values
2017-01-13 07:01:08,884 - OA.DATA - INFO - Reading data component configuration: /home/spot/spot-oa/oa/components/data/engine.json
2017-01-13 07:01:08,884 - OA.DATA - INFO - Initializating impala instance
Starting Impala Shell without Kerberos authentication
Starting Impala Shell without Kerberos authentication
2017-01-13 07:01:09,614 - OA.DNS - INFO - Creating folder structure for OA (data and ipynb)
2017-01-13 07:01:09,615 - OA.DNS - INFO - Adding edge investigation IPython Notebook
2017-01-13 07:01:09,615 - OA.DNS - INFO - Adding threat investigation IPython Notebook
2017-01-13 07:01:09,616 - OA.DNS - INFO - Getting 20160707 Machine Learning Results from HDFS
2017-01-13 07:01:11,872 - OA.DNS - INFO - hadoop fs -get /user/spot/dns/scored_results/20160707/scores/dns_results.csv /home/spot/spot-oa/data/dns/20160707/.
2017-01-13 07:01:11,873 - OA.DNS - INFO - Reading 20160707 dns results file: /home/spot/spot-oa/data/dns/20160707/dns_results.csv
2017-01-13 07:01:11,883 - OA.DNS - INFO - Adding headers
2017-01-13 07:01:11,969 - OA.DNS - INFO - Reading reputation configuration file: /home/spot/spot-oa/oa/components/reputation/reputation_config.json
2017-01-13 07:01:11,969 - OA.DNS - INFO - Initializing reputation services.
2017-01-13 07:01:11,969 - OA.DNS - INFO - Getting columns to add reputation based on config file: dns_conf.json
2017-01-13 07:01:11,970 - OA.DNS - INFO - Getting reputation for each service in config
Traceback (most recent call last):
File "start_oa.py", line 64, in <module>
main()
File "start_oa.py", line 22, in main
start_oa(args)
File "start_oa.py", line 37, in start_oa
oa_process.start()
File "/home/spot/spot-oa/oa/dns/dns_oa.py", line 67, in start
self._add_reputation()
File "/home/spot/spot-oa/oa/dns/dns_oa.py", line 192, in _add_reputation
self._dns_scores = [ conn + [ rep_results[conn[key]] ] for conn in self._dns_scores ]
KeyError: 'static-acs-24-154-120-165.zoominternet.net'
FIX: comment the line self._add_reputation() at the dns_oa.py
