Splunk Search

Why isnt the dedup command not working in some fields?

payton_tayvion
Path Finder

Im having an issue where my contact field and l2 field is showing duplicates of the same name and when i use the dedup command nothing happens. Here's the command:
| tstats count(Vulnerabilities.signature) as "Total Vulnerabilities" from datamodel="Vulnerabilities" where (nodename="Vulnerabilities" Vulnerabilities.severity="high" OR Vulnerabilities.severity="critical" Vulnerabilities.dest_bunit IN (*) Vulnerabilities.property IN (*)) by Vulnerabilities.signature Vulnerabilities.property
| rename Vulnerabilities.property AS Property
| lookup kv_opsdb property as Property output contact
| lookup aws_accounts account_number AS Property OUTPUT account_name
| eval Property=if(isnull(account_name), Property, account_name)
| lookup workday.csv shortid as contact output l2
| sort - "Total Vulnerabilities"
| dedeup l2

Heres the result:
Vulnerabilities.signature Total Vulnerabilities Contact L2
CentOS 7 : bind (CESA-2019:1294) 129345 Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe
Jane Doe John Doe

and it goes on for a couple more hundred times. i just need the contact name and l2 showing once

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi payton_tayvion,
ay first probably it's a copy error, but at the end you have dedeup instead dedup.
Then are there differences using or not the sort command?
Then have you more than 50,000 results? if yes add 0 to the sort command ( | sort 0 l2 ).

Bye.
Giuseppe

0 Karma
Get Updates on the Splunk Community!

Introducing the Splunk Community Dashboard Challenge!

Welcome to Splunk Community Dashboard Challenge! This is your chance to showcase your skills in creating ...

Wondering How to Build Resiliency in the Cloud?

IT leaders are choosing Splunk Cloud as an ideal cloud transformation platform to drive business resilience,  ...

Updated Data Management and AWS GDI Inventory in Splunk Observability

We’re making some changes to Data Management and Infrastructure Inventory for AWS. The Data Management page, ...