Getting Data In

HTTPS authenticated input source

vijayansundarar
New Member

I have some data that I can access from Web Browser (via authenticated HTTPS). The data is plain text. I would like to use this data as an input source form my Splunk server.

Is there an app that can do this? Is there a way to accomplish this?

Tags (2)
0 Karma
1 Solution

Damien_Dallimor
Ultra Champion

Although it is not REST per say , it is most likely HTTP(s) Get , you should be able to leverage my REST API Modular Input to poll this data for you.

This modular input also supports all standard authentication schemes.

View solution in original post

0 Karma

MuS
Legend

Hi vijayansundararajan,

have you tried the App Web Page Monitor? Within it you can choose whether it will index the page content or not. It supports basic authentication as well as HTTPS.

Otherwise you can write a Python script which will grab the Webpage and do what ever you want with it within Splunk.

hope this helps...

cheers, MuS

0 Karma

MuS
Legend

take a look at the script used by this App, it is a simple Python script using the urllib2 module. For Docs about urllib2 module goto http://docs.python.org/2/library/urllib2.html

0 Karma

vijayansundarar
New Member

Is there any documentation/instructions for the basic authentication?

0 Karma

Damien_Dallimor
Ultra Champion

Although it is not REST per say , it is most likely HTTP(s) Get , you should be able to leverage my REST API Modular Input to poll this data for you.

This modular input also supports all standard authentication schemes.

0 Karma

Damien_Dallimor
Ultra Champion

Modular Inputs were not available in the product until version 5.

0 Karma

vijayansundarar
New Member

Have you had any luck with this on Splunk 4.3.2?

0 Karma

lukejadamec
Super Champion

If you cannot access the server that holds the data and install/configure a forwarder on it with ssl certificates, then your best bet would be to go to the site, down load the data from the site with the secure https connection and save it to a computer that does have a forwarder.

Verify the data is indexable (csv, key=value, etc...) and then monitor that directory/file.

0 Karma

vijayansundarar
New Member

I should have mentioned, that I this is actually a log file and it is continuous. Will this still work? Do I need to provide the difference or can Splunk handle this like it does a file that is forwarded?

0 Karma

ddarmand
Communicator

you can monitore a file in Manager > Data inputs

0 Karma

vijayansundarar
New Member

Do you mean this will work via https with authentication? I do not have access to the filesystem on the remote machine.

0 Karma
Get Updates on the Splunk Community!

Introducing Splunk Enterprise 9.2

WATCH HERE! Watch this Tech Talk to learn about the latest features and enhancements shipped in the new Splunk ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...