The script fails when run on Solaris/OpenIndiana with:
03-13-2014 11:43:30.257 +0100 ERROR ExecProcessor - message from "/splunk/search_head_pool/etc/apps/sos/bin/ps_sos.sh" sh: line 1: /usr/ucb/ps: not found
03-13-2014 11:43:30.382 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" Traceback (most recent call last):
03-13-2014 11:43:30.382 +0100 ERROR ExecProcessor - message from "python /splunk_shared/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" File "/splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py", line 646, in <module>
03-13-2014 11:43:30.382 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" iostat_command(prog)
03-13-2014 11:43:30.382 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" File "/splunk_shared/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py", line 518, in iostat_command
03-13-2014 11:43:30.382 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" mountstats = parse_stats_file('/proc/self/mountstats')
03-13-2014 11:43:30.382 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" File "/splunk_shared/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py", line 427, in parse_stats_file
03-13-2014 11:43:30.382 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" f = file(filename)
03-13-2014 11:43:30.382 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" IOError: [Errno 2] No such file or directory: '/proc/self/mountstats'
03-13-2014 11:43:35.319 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" Traceback (most recent call last):
03-13-2014 11:43:35.319 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" File "/splunk_shared/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py", line 646, in <module>
03-13-2014 11:43:35.319 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" iostat_command(prog)
03-13-2014 11:43:35.320 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" File "/splunk_shared/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py", line 518, in iostat_command
03-13-2014 11:43:35.320 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" mountstats = parse_stats_file('/proc/self/mountstats')
03-13-2014 11:43:35.320 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" File "/splunk_shared/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py", line 427, in parse_stats_file
03-13-2014 11:43:35.320 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" f = file(filename)
03-13-2014 11:43:35.320 +0100 ERROR ExecProcessor - message from "python /splunk/search_head_pool/etc/apps/sos/bin/nfs-iostat_sos.py" IOError: [Errno 2] No such file or directory: '/proc/self/mountstats'
The search head pool consists of both OpenIndiana hosts and Linux hosts and enabling the script on one of them enables it on both, so I can't exclude it. Any hints?
This script was not designed to run on systems other than Linux, so it's not entirely surprising that it wouldn't work on Solaris.
I think you should be able to locally disable the execution of the scripted input on your Solaris instance in $SPLUNK_HOME/etc/system/local/inputs.conf
rather than on the pool shared directory.