Getting Data In

watched file not being indexed completely (data being indexed is truncated)

Conradj
Path Finder

Hi,

I have a file on a server that i want to index. I have an app that watches this file and indexes it.

The file contains an output of server metric data and is essentially in the format of "key = value","key = value" and so on.

This file gets overwritten with new data every 60s.

Recently I noticed that the some metrics were dropping off, i checked the file and it is complete. but when i check the source in Splunk i can clearly see that it has been truncated.

Nothing else on the server has changed. I have checked the logs on the universal forwarder, but I could not see anything that stood out.

ideas welcome!

C.

0 Karma

lguinn2
Legend

How long are your events? If your events are many lines long, or a single line is very long, you may need to increase some limits. Here is a great entry that covers this:
Size limit for an event

0 Karma
Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...