Getting Data In

How to keep original sourcetype in summary index?

grodaas
Explorer

I have multiple scheduled searches that run on large indexes and save the results to a summary index. There is no aggregation in the searches, only filtering. An example search would be something like "index=http google.com".

My problem is that when I save the search to the summary index the sourcetype is changed to "stash". I would like to keep the old sourcetype. Is there a way to tell Splunk to keep the original sourcetype?

Labels (1)
0 Karma

jfuller19
Loves-to-Learn

| collect index='indexname' sourcetype='sourcetypename'

 

works fine..i  just tried it

0 Karma

somesoni2
Revered Legend

Any particular reason for doing the filtering into it's own index/sourcetype combination? 

0 Karma

jagadeeshm
Contributor

Summary Indexing by default change the sourcetype to stash. This is how splunk knows that data is already in splunk and your summary data will not be account for your additional license.
You can change the sourcetype, but remember the data will go against your license.
I guess one of the practices is to re-use the source field and set it to sourcetype for summary indexes.
For example :
index=xyz result=success | stats count .... | collect index=summary source=sourcetype

0 Karma

johandk
Path Finder

A workaround for this could be simply doing something like this

index=http google.com | eval orig_sourcetype=sourcetype

Tipmoose
Explorer

This does not work for me either. I posted a question about it yesterday. any use of the collect command throws your stuff into "stash". How convenient.

0 Karma

grodaas
Explorer

This does not seem to work for me. No matter what I do I can't get the Splunk to use the orgin sourcetype when reading from the summary index.

This is the command that is stored in Manager » Searches and reports » View Recent » "latest" :

index="pdns" | search "google" | eval orig_sourcetype=sourcetype | summaryindex spool=t uselb=t addtime=t index="testalarms" file="google_645699260.stash_new" name="google" marker=""

I have also tried updating props.conf:

[source::/opt/splunk/var/spool/splunk/*]
sourcetype = pdns2

or

[stash]
sourcetype = pdns2
priority = 101

0 Karma

ss026381
Communicator

Add following lines in savedsearches.conf under the stanza for saved search you create

    action.summary_index.sourcetype = cerner:millennium:audit

 

or add new filed under summary index

ss026381_0-1633439979532.png

 

0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...