I thought Splunk always assigned a source and at least guessed a sourcetype for ALL data.
Why am I seeing data in Splunk with no source or sourcetype?
This can happen when metadata gets corrupted in Splunk. It's related to an issue when using the Delete command. (i've seen this in 4.2). Engineering is aware of the problem and working on a fix.
You can verify this by looking in your indexers splunkd.log for 'safeService' warnings. If you see these, stop splunk and issue:
$SPLUNK_HOME/bin/splunk cmd splunkd fsck --all --mode metadata --repair
This will rebuild your metadata files for each of your indexes. It's similar to the 'recovery' process you see during unclean shutdowns.
Just occasional data. I couldn't discern a specific pattern.
This can happen when metadata gets corrupted in Splunk. It's related to an issue when using the Delete command. (i've seen this in 4.2). Engineering is aware of the problem and working on a fix.
You can verify this by looking in your indexers splunkd.log for 'safeService' warnings. If you see these, stop splunk and issue:
$SPLUNK_HOME/bin/splunk cmd splunkd fsck --all --mode metadata --repair
This will rebuild your metadata files for each of your indexes. It's similar to the 'recovery' process you see during unclean shutdowns.
can you give some details? what data are you not seeing this for?