Getting Data In

The file count for my monitored directory is higher than expected. Is my (black|white)list not being taken into account?

hexx
Splunk Employee
Splunk Employee

When I look in Manager >> Data Inputs >> Files & Directories, the entry for the monitored directory I have defined with a (white|black)list shows a count of "number of files" much higher than expected. In fact, that count is equal to all files and directories to be found recursively in the monitored directory, seemingly disregarding my (white|black)list setting!

1 Solution

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

View solution in original post

Afef
Communicator

Hi,
Please Could someone tell me how to count the number of files and directories in a folder in splunk ?
Regards

0 Karma

hexx
Splunk Employee
Splunk Employee

When using a whitelist or a blacklist in the definition of a [monitor] input, the total count of monitored files for that input in SplunkWeb doesn't subtract the files excluded by the white|blacklist. That count also includes directories traversed. This results in a very inflated number of monitored files displayed by SplunkWeb in Manager >> Data Inputs >> Files & Directories therefore doesn't reflect the actual number of monitored files.

We currently (as of 4.1.4) have a bug opened against this behavior : SPL-32930

An accurate reading of the files Splunk is monitoring can be obtained by running :

$SPLUNK_HOME/bin/splunk list monitor

hulahoop
Splunk Employee
Splunk Employee

I guess monitoring does not necessarily mean indexing.

Get Updates on the Splunk Community!

Join Us for Splunk University and Get Your Bootcamp Game On!

If you know, you know! Splunk University is the vibe this summer so register today for bootcamps galore ...

.conf24 | Learning Tracks for Security, Observability, Platform, and Developers!

.conf24 is taking place at The Venetian in Las Vegas from June 11 - 14. Continue reading to learn about the ...

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...