Getting Data In

Is there any way to NOT duplicate the data when adding CSV file?

jannsenagustin
New Member

Hello,

Are there any way? In my dashboard the data comes from a CSV file and in order for the dashboard to update, I need to upload the fresh CSV file via Sharepoint, the problem is, when I upload the data, it is duplicated and I don't want to manually filter the old data through Excel and I don't want it duplicated. Any help will be appreciated

Regards,
Jannsen

0 Karma

HiroshiSatoh
Champion

If it is unique in _raw

Search without searching for duplicates.
(your searcvh)|sort _raw| dedup _raw|(your searcvh)

Periodically delete duplicates.
(your searcvh)|sort _raw|streamstats count by _raw|table count _raw|where count>1|delete

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...