Getting Data In

Can some data coming into Splunk via HTTP Event Collector be filtered to nullqueue based on sourcetype?

simpkins1958
Contributor

When data is coming into Splunk through the HTTP Event Collector, can some of it be routed to the nullqueue based on sourcetype to avoid indexing?

http://docs.splunk.com/Documentation/Splunk/6.4.1/Forwarding/Routeandfilterdatad#Filter_event_data_a...

0 Karma
1 Solution

renjith_nair
Legend

Hi @simpkins1958 ,

Yes it's possible. HEC is another input type and transformations can be applied to that as well. here is an example

props.conf

[nullq]
TRANSFORMS-set= setnull

transforms.conf

[setnull]
REGEX=.
DEST_KEY = queue
FORMAT = nullQueue

and my HEC conf from inputs.conf

[http://Test]
disabled = 0
index = main
token = myrandomtoken
sourcetype = nullq
Happy Splunking!

View solution in original post

renjith_nair
Legend

Hi @simpkins1958 ,

Yes it's possible. HEC is another input type and transformations can be applied to that as well. here is an example

props.conf

[nullq]
TRANSFORMS-set= setnull

transforms.conf

[setnull]
REGEX=.
DEST_KEY = queue
FORMAT = nullQueue

and my HEC conf from inputs.conf

[http://Test]
disabled = 0
index = main
token = myrandomtoken
sourcetype = nullq
Happy Splunking!

maciep
Champion

I haven't done anything with http event collector myself, but I would think you could do that. I could be wrong, but it's worth trying anyway, right? I think the event collector has to be installed on a Splunk Enterprise instance, so that's probably where you would need to configure the props/transforms to do the routing.

If you need help trying to set that up, feel free to give us some more details like the sourcetype and sample events you'd like to discard.

0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...