Getting Data In

Splunk as a simple indexer

bulliarda
Explorer

We have a requirement to index a DFS folder containing a lot of subfolders and files from different servers. The goal is to be able to do simple keywords based search against these logs. The logs are different in format, so we will not try to add knowledge by extracting fields. The questions we have are: 1) can we configure Splunk to give the indexing time as the timestamp to an event? We do not want to let him calculate the event timestamp. 2) can we schedule when Splunk has to do the indexing? We would like to run it once per hour, we don't need real time. 3) do you have any tips to apply when you index a lot of files and folders, with many subfolders?

I know it is not really what Splunk is for, but the goal is to have the same tool to do different research and Splunk is now THE tool for log analysis. If he is not able to do this "simple" thing, people would not understand.

Many thanks for your inputs.

0 Karma
1 Solution

ziegfried
Influencer

1) Can be configured in props.conf

[your_sourcetype]
DATETIME_CONFIG=CURRENT

You have to reference the sourcetype in your inputs.conf as well:

[montior:///path/to/monitored/directory]
sourcetype = your_sourcetype

2) No, there is no way to configure a schedule for file monitoring in Splunk.

View solution in original post

ziegfried
Influencer

1) Can be configured in props.conf

[your_sourcetype]
DATETIME_CONFIG=CURRENT

You have to reference the sourcetype in your inputs.conf as well:

[montior:///path/to/monitored/directory]
sourcetype = your_sourcetype

2) No, there is no way to configure a schedule for file monitoring in Splunk.

bulliarda
Explorer

Perfect! Thanks

0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...