Splunk Search

How to use multiple regular expressions in a single search query to extract only the URLs in my data?

neelakanta
Explorer

I would like to use multiple regexes in single query. source data is full of random logs which has many fields. I am interested only on URL.

regex url="(:1000\/[a-zA-Z0-9]{10,20}\?[a-zA-Z0-9]{30} OR \/\/[0-9a-zA-Z.]{50,80}\/[0-9a-zA-Z.]{32}\/)"
regex url="(:1000\/[a-zA-Z0-9]{10,20}\?[a-zA-Z0-9]{30} | \/\/[0-9a-zA-Z.]{50,80}\/[0-9a-zA-Z.]{32}\/)"

does not return any results whereas individual regex fetches results.

0 Karma
1 Solution

neelakanta
Explorer

those who would want to use multiple regex they can do this way:

index= source_index |regex url=":1000/[a-zA-Z0-9]{10,20}?[a-zA-Z0-9]{30}|[0-9a-zA-Z.]{50,80}/[0-9a-zA-Z.]{32}/" |table fields1 field2 field3

make sure no spaces around "|"

View solution in original post

tachifelix
Path Finder

you can use pipe character to separate it

regex url="(:1000/[a-zA-Z0-9]{10,20}?[a-zA-Z0-9]{30} OR //[0-9a-zA-Z.]{50,80}/[0-9a-zA-Z.]{32}/)|(:1000/[a-zA-Z0-9]{10,20}?[a-zA-Z0-9]{30} | //[0-9a-zA-Z.]{50,80}/[0-9a-zA-Z.]{32}/)"
0 Karma

neelakanta
Explorer

those who would want to use multiple regex they can do this way:

index= source_index |regex url=":1000/[a-zA-Z0-9]{10,20}?[a-zA-Z0-9]{30}|[0-9a-zA-Z.]{50,80}/[0-9a-zA-Z.]{32}/" |table fields1 field2 field3

make sure no spaces around "|"

neelakanta
Explorer

Fields are ip time host url accesstype
xx.xxx.xx.xx "01/06/2012:HH:MM:SS IST" hostname "ip:1000/abcd01234?/abcd1234/"
yy.yyy.yy.yy "01/06/2012:HH:MM:SS IST" hostname "domainname/abcd01234?/abcd1234/.php"

0 Karma

richgalloway
SplunkTrust
SplunkTrust

Can you provide some samples of the data you are trying to search?

---
If this reply helps you, Karma would be appreciated.
0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...