Splunk Search

How to apply rex for a field on mutiple sources

theouhuios
Motivator

Hello

I am trying to change the data of the host field which has already been indexed. The host field has values in 3 different formats . What I am looking to do is to take the value of IP as it is and then for any FQDN's just extract the first part and ignore rest.

  1. IP Address : 10.1.1.1
  2. FQDN 1 = abc123.company.com
  3. FQDN 2 = abc123.ntwrk.company.com

So when I use this regex on the SH rex field=host "(?P<host>\d+\.\d+\.\d+\.\d+|([A-Za-z0-9]+))" it works without any issues. I have to apply this on /var/log/splunk/.../.../.../*.log a path which is being used as a source for multiple indexes.

So the props.conf I have as

[source::/var/log/splunk/.../.../.../*.log]
TRANSFORMS-replacehostname = replace_host

and transforms .conf as

   [replace_host]
    SOURCE_KEY=fields:host
    REGEX = ^host::(\d+\.\d+\.\d+\.\d+|([A-Za-z0-9]+))
    FORMAT = host::$1
    DEST_KEY = Metadata:Host

I am sending this to SH and it looks like it doesn't make any change. Any help on why its not working?

Tags (1)
0 Karma

krish3
Contributor

And also as an alternative you can place your rex command in the props.conf as this:

[sourcetype]
.....
EXTRACT-host = (?P<host>\d+\.\d+\.\d+\.\d+|([A-Za-z0-9]+))

no need of using transforms.conf here

0 Karma

krish3
Contributor

place it on the indexer as well... Since splunk refers transforms.conf during index time.

0 Karma

krish3
Contributor

Try this...

In props.conf:

REPORT-gethost = gethost

In transforms.conf:

[gethost]
SOURCE_KEY = _raw
REGEX = (?<extracted_newhost>(\d+\.\d+\.\d+\.\d+|([A-Za-z0-9]+))$
0 Karma

theouhuios
Motivator

Even this doesn't work, when I try it on [source::/var/log/splunk/.../.../.../*.log]

0 Karma

theouhuios
Motivator

searchhead

0 Karma

krish3
Contributor

where are you placing your props.conf and transforms.conf..

0 Karma
Get Updates on the Splunk Community!

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...