Getting Data In

How to ingest only those lines from the log that start with "date/time"

mlevsh
Builder

We have logs , where first few lines needs to be omitted from ingesting.
We only need to on-board the events , that start with the date/time in the following format:
"%m/%d/%Y@%H:%M"

Appreciate all the ideas and suggestions.


Here is  the log example (there are also empty lines
before first "#-----------------------------------------" and
after last "#-----------------------------------------"):



      #-----------------------------------------
      #DATE CREATED:  11/02/2021@04:16
      #SUBJECT:       REPORT ON THE GENERAL STATUS OF AUTOSYS JOBS
      #ENVIRONMENT:   CBA
      #-----------------------------------------

      11/02/2021@04:16,CBA,OTHER,CBA_CLIENT_REPORT_BOX,OI
      11/02/2021@04:16,CBA,OTHER,CBA_copy_file_job,OI
      11/02/2021@04:16,CBA,OTHER,CBA_ABC_SCHEDULER_BOX,OI
      11/02/2021@04:16,CBA,OTHER,CBA_ABC_REPORT_BOX,OI

Labels (2)
Tags (1)
0 Karma

badrinath_itrs
Communicator

@mlevsh , This question is already answered in the past. 

Can you please look into below link and see that helps. 

Ignoring-any-data-record-that-begins-with-a-quot-quot-character

You can do this with props and Transforms as mentioned in the above post. 

0 Karma
Get Updates on the Splunk Community!

Threat Hunting Unlocked: How to Uplevel Your Threat Hunting With the PEAK Framework ...

WATCH NOWAs AI starts tackling low level alerts, it's more critical than ever to uplevel your threat hunting ...

Splunk APM: New Product Features + Community Office Hours Recap!

Howdy Splunk Community! Over the past few months, we’ve had a lot going on in the world of Splunk Application ...

Index This | Forward, I’m heavy; backward, I’m not. What am I?

April 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...