Splunk Dev

How to approach custom field extractions for new source with deployment server

uhaba
Explorer

New to Splunk Enterprise. Confused as to what the best approach for configuring multiple field extractions for a new sourcetype in a multihost deployment. Looking for search time extractions on a log like the one below. We have a deployment server and non-clustered search heads. I can build field extractions using the built in GUI tool but was told I need to migrate these to props/transforms conf files to get them working across my SH deployment. I've read through some these files included in the TAs we've onboarded but not sure I'm following the mapping correct.

  1. What files need what content to get a new key/value pair mapped out?
  2. I can use the built in tool to extract >1 field in the regular expression. Do I break these out or use a consolidated expression?
  3. For search time expressions do I need to deploy the config to any other location other than search heads?

Example log:
INFO | jvm 3 | 2017/03/12 22:07:13 | ERROR [QueryExecutor[sourcesystem] ] [22:07:13,198]: No historical information could be found for any of the specified paths. Check that paths are correct. Paths: [example/path]

Existing props.conf file put in by PS to handle the wonky jvm log format:

[widget]
SHOULD_LINEMERGE=false
NO_BINARY_CHECK=true
CHARSET=UTF-8
MAX_TIMESTAMP_LOOKAHEAD=50
TRUNCATE=99999
disabled=false
TIME_FORMAT=%Y/%m/%d %H:%M:%S
TIME_PREFIX=^.jvm\s1\s+|\s
LINE_BREAKER=([\r\n]+).
\d{4}/\d{2}/\d{2}\s\d{2}:\d{2}:\d{2}\s| \w

Tags (1)
0 Karma

cmeerbeek
Path Finder

Hi uhaba,

The prop.conf you show here contain fields which are not related to search time field extractions but have to do with how Splunk should store the data in the index.

For props.conf and transforms.conf the docs are very good. The same for deployment.

0 Karma
Get Updates on the Splunk Community!

Welcome to the Splunk Community!

(view in My Videos) We're so glad you're here! The Splunk Community is place to connect, learn, give back, and ...

Tech Talk | Elevating Digital Service Excellence: The Synergy of Splunk RUM & APM

Elevating Digital Service Excellence: The Synergy of Real User Monitoring and Application Performance ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...