Deployment Architecture

Unable to add the search peer to Cluster master

marisstella
Explorer

Hello,

Getting this error message everytime when I'm trying to add the search peer to master.
Failed to register with cluster master reason: failed method=POST path=/services/cluster/master/peers/?output_mode=json master=113.134.117.122:8089 rv=0 gotConnectionError=0 gotUnexpectedStatusCode=1 actual_response_code=500 expected_response_code=2xx status_line="Internal Server Error" socket_error="No error" remote_error=Cannot add peer=18.218.129.11 mgmtport=9089 (reason: http client error=Connect Timeout, while trying to reach https://18.218.129.11:9089/services/cluster/config). [ event=addPeer status=retrying AddPeerRequest: { _id= _indexVec=''active_bundle_id=3BA0B5A63B5F98681601E92106214CBE add_type=Initial-Add base_generation_id=0 batch_serialno=1 batch_size=2 last_complete_generation_id=0 latest_bundle_id=3BA0B5A63B5F98681601E92106214CBE mgmt_port=9089 name=EE4D1ED7-70B3-4AAC-A5E6-0A920EEE2FFC register_forwarder_address= register_replication_address= register_search_address= replication_port=8080 replication_use_ssl=0 replications= server_name=ip-12-31-4-60.us-east-2.compute.internal site=default splunk_version=8.0.2.1 splunkd_build_number=f002026bad55 status=Up } ].
3/27/2020, 2:15:20 AM

Can someone help me with this?
I tried, remove the old configuration in server.conf and restarted many ties but no use.

0 Karma

harsmarvania57
Ultra Champion

Are you running Cluster master on management port 9089 ? Based on logs I can see mgmtport=9089, maybe you had typo in your configuration file. By default splunk management port is 8089.

skalliger
Motivator

Didn't see that one, good point 🙂

0 Karma

skalliger
Motivator

Which Splunk version? Did you create your own app configuration for this or are you using the server.conf specified under $SPLUNK_HOME/system/local/?

In either case, I'd suggest to remove the configuration and try to add the peer again by running the CLI command and see if that works. Reference: described here in the docs.

Skalli

Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...