Is it possible to bulk import URLs into the Website Monitoring App?

[atari1050]

I'd like to import a large number of URLs for monitoring. Is this possible in this app?

[LukeMurphey]

Its not possible with the app yet. However, you could write a simple script to create a inputs.conf file and then deploy it on your Splunk boxes.

That said, I have a ticket to look into a method to make this possible natively within the app in the future. See http://lukemurphey.net/issues/1106. I'll update this answer when I get this feature created.

Update:

I added the ability to batch create inputs in version 1.6. It isn't the default version yet so you will need to manually select it. Let me know if this works for you.

[vkumar2016]

Hi Luke,

Does this app work in clustered env?
Our cluster env has a Master node (Distributed Management console) with multiple search heads and indexers.

So if I install this App on all search heads in the cluster will it start running on all search heads parallel? In other words if I schedule 100 URL's to be hit every 5 mins on 6 search heads over a cluster, will it start hitting 6*100 URLs every 5 mins?

FYI: All our attempts to make the app working in the clustered env have failed. We tried the master node deployment and pushing search head as well as pushing to each member individually.

We need to take a decision on this soon hence a quick reply would be appreciated.

Thanks
Vishal

[prachisaxena]

Hi Luke,

I need to bulk import a list of URLs but do not want to configure it from Web GUi.

This list of urls is available in CMDB, we need to query this data from CMDB and then configure website monitoring from its output.

Is there a way we can achieve it ?

[LukeMurphey]

FYI: I started on this now. Not sure what the ETA will be but I do have working code. If things go well, I might be done this weekend.

[swayam_phani]

Hello Luke, Please let me know where and in which conf/lookup file do I need to update for Bulk set of urls.

Thanks,
Phani Kumar S

[LukeMurphey]

It isn't handled in a lookup file in the current version. There is a UI in version 1.6 for adding lots of URL's/ The view is called "Create Inputs". You can copy and paste in a list of URLs to make the inputs.

That said, if you really need to create them from a lookup then I could likely create a search command that would take a lookup and create the inputs. Let me know if the new batch creation UI isn't sufficient for you.

[swayam_phani]

Thanks Luke, I have tried using Create Inputs, and I am able to add all the urls from UI, but I see one issue is like those inputs configs are moving to search/local/inputs.conf. Is this expected or odd behavior?

I expected them to be under website_monitoring/local/inputs.conf. Please let me know If I am missing anything.

Appreciate your help!

[LukeMurphey]

@swayam_phani: that issue is now fixed in version 1.6.3; the inputs are created under the website_monitoring context. Note that you may have to clear your browsers cache to get the update to work (the fix is in call invoked by the web-browser).

[swayam_phani]

@LukeMurphey : Thanks for the fix.
We have Cluster environment where we have different set of Search heads, Indexers and deployment servers, now I installed this app in master node and pushed it to all search heads. And trying to create inputs from load balanced url (for all search heads), but it is not creating here and Creating Inputs popup is just holding.

And even not able to see Website Availability Check link also under Settings->Data Inputs and tried from inputs.conf, which also not working.

Please help me to proceed in cluster environment!

[atari1050]

Looks like someone already asked a similar question here:
https://answers.splunk.com/answers/323263/can-i-add-website-monitors-directly-to-config-file.html