Splunk Dev

Why am I getting "Could not setup handler 'spmeta' due to missing file 'rh_spmeta.py'" and similar errors, causing a Splunk Web timeout?

hagjos43
Contributor

I'm getting a few errors on the search head and trying to narrow down what the issues are. One thing I noticed on the indexers was a large replication bundle size (150MB). We have quite a few apps so that could be causing the large size. (I've extracted the errors I'm seeing in the splunkd.log and posting them at the bottom).

Here's what I've done so far:
My distsearch.conf on the search head is posted below (note the change I made was the blacklist portion) but it is still sending the contents of the bin folders to the indexers as part of the bundle replication. Am I doing something wrong or do I need to make this change elsewhere?

[distributedSearch:dmc_group_cluster_master]

[distributedSearch:dmc_group_license_master]
servers = server.domain:8089

[distributedSearch:dmc_group_search_head]
servers = localhost:localhost

[distributedSearch:dmc_group_deployment_server]

[distributedSearch:dmc_group_kv_store]

[distributedSearch:dmc_group_indexer]
default = false
servers = server.domain:8089

[replicationSettings]
sendRcvTimeout = 120

[distributedSearch]
disabled = 0

[replicationBlacklist]
noBinDir = (...\bin\*)

ERROR / WARN:

11-25-2015 08:10:50.129 -0500 WARN  DistributedBundleReplicationManager - Asynchronous bundle replication to 2 peer(s) succeeded; however it took too long (longer than 10 seconds): elapsed_ms=186163, tar_elapsed_ms=84934, bundle_file_size=154000KB, replication_id=1448456863, replication_reason="async replication allowed"

11-25-2015 08:12:29.781 -0500 ERROR AdminManager - Could not setup handler 'spmeta' due to missing file 'rh_spmeta.py'.  Please ensure that it is in the bin subdirectory of the appropriate Splunk app path.

11-25-2015 08:12:41.709 -0500 ERROR ExecProcessor - Couldn't start command ""D:\Program Files\Splunk\bin\scripts\splunkd.bat"": The system cannot find the file specified.
11-25-2015 08:12:41.820 -0500 ERROR ExecProcessor - Couldn't start command ""D:\Program Files\Splunk\bin\scripts\spooler.bat"": The system cannot find the file specified.


11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py"" Traceback (most recent call last):
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""   File "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py", line 76, in <module>
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""     process = java.execute("com.splunk.bridge.JavaBridgeServer", [str(os.getpid())])
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""   File "D:\Program Files\Splunk\etc\apps\dbx\bin\spp\java\__init__.py", line 148, in execute
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""     return JavaProcess(Popen(cmd + self.options + [main_class] + args, **options))
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""   File "D:\Program Files\Splunk\Python-2.7\Lib\subprocess.py", line 710, in __init__
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""     errread, errwrite)
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""   File "D:\Program Files\Splunk\Python-2.7\Lib\subprocess.py", line 958, in _execute_child
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py""     startupinfo)
11-25-2015 08:12:47.315 -0500 ERROR ExecProcessor - message from "python "D:\Program Files\Splunk\etc\apps\dbx\bin\jbridge_server.py"" WindowsError: [Error 2] The system cannot find the file specified

11-25-2015 08:12:47.961 -0500 ERROR ApplicationUpdater - Error checking for update, URL=/api/apps:resolve/checkforupgrade: Connect to=https://apps.splunk.com timed out; exceeded 10sec
0 Karma
1 Solution

hagjos43
Contributor
0 Karma

hagjos43
Contributor

I seem to have resolved my python issue by following the guidance suggested here:
https://answers.splunk.com/answers/65914/an-error-occurred-while-rendering-the-page-template-see-web...

0 Karma
Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...