Splunk Search

I have duplicate entries in a CSV file. How to write a search that extracts the FIRST entry?

dbcase
Motivator

Hi,

I have a CSV file that looks like this

Date,Version
01-24-2017 12:09:26,7_3_10_000500_3851898
01-25-2017 12:09:26,7_3_10_000500_3851898
01-26-2017 12:09:26,7_3_10_000500_3851898
01-27-2017 12:09:26,7_3_10_000500_3851899
01-28-2017 12:09:26,7_3_10_000500_3851899
01-29-2017 12:09:26,7_3_10_000500_3851899
01-30-2017 12:09:26,7_3_10_000500_3851899

How can I write a search that extracts the FIRST entry so the final results would look like this

 Date,Version
 01-24-2017 12:09:26,7_3_10_000500_3851898
 01-27-2017 12:09:26,7_3_10_000500_3851899

Thank you!!!

0 Karma
1 Solution

dbcase
Motivator

Found it.....

dedup Version sortby +_time

View solution in original post

0 Karma

gokadroid
Motivator

How about using the last which returns the last seen (oldest) version as search is in reverse chronological order, something like this:

| inputlookup your csv name
| stats last(Date) by Version
| sort Version

Alternatively you can use first to reverse the affect:

| inputlookup your csv name
| stats first(Date) by Version
| sort Version
0 Karma

dbcase
Motivator

Found it.....

dedup Version sortby +_time
0 Karma

dbcase
Motivator

Final query looks like this

(index=allmsos  source=*Beta.csv*) |dedup Version sortby +_time|where Date!="Date" and Version!="Version"|eval newdatefield=strftime(strptime(Date, "%m-%d-%Y %H:%M:%S"), "%m-%d-%Y %a")|stats values(newdatefield) as Date values(Version) as Version
0 Karma

DalJeanis
Legend

Well done. Please mark your answer accepted.

0 Karma

dbcase
Motivator

Note the version number change betweeen the 24th and the 27th

0 Karma
Get Updates on the Splunk Community!

Detecting Remote Code Executions With the Splunk Threat Research Team

REGISTER NOWRemote code execution (RCE) vulnerabilities pose a significant risk to organizations. If ...

Observability | Use Synthetic Monitoring for Website Metadata Verification

If you are on Splunk Observability Cloud, you may already have Synthetic Monitoringin your observability ...

More Ways To Control Your Costs With Archived Metrics | Register for Tech Talk

Tuesday, May 14, 2024  |  11AM PT / 2PM ET Register to Attend Join us for this Tech Talk and learn how to ...