Splunk Search

Is there anyway to push data from Elasticsearch or Logstash to Splunk?

ant_ony10
Explorer

Hi,

We have 2 separate stacks
1) Splunk forwarder with Splunk
2) ELK stack
We want to understand if there is any way to push the data from Elasticsearch or Logstash to Splunk.

larmesto
Path Finder

This might be helpful for anyone visiting; I have started working on an addon for Elasticsearch instances, feel free to use it!
https://splunkbase.splunk.com/app/4175/

0 Karma

kace
Engager

I've been researching this question myself, and the best I can tell from doc.s there is no mechanism to push all data from Elasticsearch to another destination. ... However, having worked with Logstash before, I can say that it would definitely support sending all data to a second destination -- and with special handling (filtering, transformation, etc.) if you desired. Search "logstash output-plugins" and you should find what you need.

0 Karma

dkeesling
Explorer

Can you install a Splunk forwarder on Elastic Search server?

Then monitor the location of the logs.

Just add this to /SplunkForwarderHome/etc/system/local/inputs.conf

# Example of forwarder /inputs.conf

[default]
host = yourelastichostname

# Main Logstashlogs are written to /LS_HOME/logs/[cluster_name].log
[monitor:///var/log/logstash/*.log]
index=logstash
sourcetype=logstash

# Main Elasticsearch logs are written to /ES_HOME/logs/[cluster_name].log
[monitor:///var/log/elastic/*.log]
index=elastic
sourcetype=elastic


# Folder might be called log not logs Example
# /var/log/elasticsearch.log
# /var/log/elasticsearch-access.log
# /var/log/elasticsearch_deprecation.log
  1. Just make sure to check the location of the log - add the config.
  2. Then restart the forwarder.
  3. Profit

Good luck

0 Karma

DaddyRat
New Member

Would love to know if anyone has found an answer for this. Same situation here...using ELK for logging and want to forward logs from the ELK Syslog NG servers to Splunk. No problems getting the data to Splunk, but since we want to use Splunk as the SIEM (for monitoring), it's got to be in a very specific format. Usually the Splunk universal forwarders put the data into this format, but we're trying to get the info to Splunk (in a format usable for the SIEM) without having to load the Splunk UF onto every device to be monitored. Has anyone been successful at this?

0 Karma

robertlynch2020
Motivator

Did you get n answer to this? I have the same situation.

0 Karma

nickstone
Path Finder

I have always wondered if there would ever be an app like DBx that would allow you to connect into an Elastic cluster for searching, but I'm not sure how Splunk would feel about that considering it's license model...

Many times have I needed something to "filter" all the noise, but I've had a requirement to still keep the noise.

0 Karma

s2_splunk
Splunk Employee
Splunk Employee

See if this post helps.

0 Karma

ant_ony10
Explorer

No we want these 2 stack will be separated.I want is there any way to get the data from elasticsearch from Splunk .

0 Karma

alacercogitatus
SplunkTrust
SplunkTrust

So you want to be able to use the SPL Search bar to search elastic search peers? Is that correct?

0 Karma

ant_ony10
Explorer

On top of that Splunk will be used for Monitoring and alerting while ELK is used for debugging.

0 Karma

robertlynch2020
Motivator

Hi.

Did you get an answer for this. I have the same issue.

Thanks
Robert Lynch

0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...