Getting Data In

The file count for my monitored directory is higher than expected. Is my (black|white)list not being taken into account?

hexx
Splunk Employee
Splunk Employee

When I look in Manager >> Data Inputs >> Files & Directories, the entry for the monitored directory I have defined with a (white|black)list shows a count of "number of files" much higher than expected. In fact, that count is equal to all files and directories to be found recursively in the monitored directory, seemingly disregarding my (white|black)list setting!

1 Solution

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

View solution in original post

Afef
Communicator

Hi,
Please Could someone tell me how to count the number of files and directories in a folder in splunk ?
Regards

0 Karma

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

hulahoop
Splunk Employee
Splunk Employee

I guess monitoring does not necessarily mean indexing.

Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...