Website Monitoring: Why are newly added URLs triggering continuously irrespective of Interval time?

[Vamshireddy]

The URLs which i have added sometime ago are working fine (Triggering as per the given interval time). But the newly added URLs are triggering continuously (keep on triggering all the new URLs) irrespective of the Interval time (While creating input i gave "1h" interval).
I need all the URLs to be triggered at the interval time.

Could someone please let me know how to overcome this issue? Do i need to do any kind of setting changes?

Thanks in advance.

[LukeMurphey · Accepted solution]

This can happen when the app doesn't have access to the modular input checkpoint directory. Check the permissions of the modular input checkpoint directory (e.g. "C:\Program Files\Splunk\var\lib\splunk\modinputs\web_ping") to see if the account that Splunk runs under has read/write access to it.

If it doesn't, edit the permissions. The input should begin functioning correctly as soon as the permissions are set correctly.

[LukeMurphey]

Can see if any logs exist which may indicate the source of the problem by running the following search:

index=_internal sourcetype=web_availability_modular_input

Let me know what you see.

[Vamshireddy]

Do i need to do any setting changes to over come "permission denied" issue (IOError: [Errno 13] Permission denied: u'C:\Program Files\Splunk\var\lib\splunk\modinputs\web_ping\a4c0e95fd726d61a17401c674457f508.json').
Am expecting URL's are triggering continuously because of permission denied issue.

Could you please guide me, how to over come this issue.

Thanks in advance.

[LukeMurphey]

The permission error is almost certainly the problem. Have you checked the permissions on the directory "C:\Program Files\Splunk\var\lib\splunk\modinputs\web_ping" to see if the account that Splunk runs under has read/write access to it?

It would appear that the user account that Splunk is running under cannot create and edit files in the directory. I tried reproducing this on a Windows host but it works for me.

[Vamshireddy]

Thanks Luke.
After providing edit access to web_ping folder, it's working fine.

[LukeMurphey]

@Vamshireddy: cool.

Could you let me know some information about your environment that may help me figure out why this issue occurred? I want to reproduce the issue and figure out why the file permissions were being set wrong so that no one has to adjust these permissions manually.

I'm looking for the following:

• Operating System
• Splunk version
• How was the app installed (through the UI or through deployment server, SHC, etc.)
• What user Splunk was running under (System, Domain Account, etc)

I tried to reproduce this on Windows 10 Pro but it worked for me. Once I get a reproduction, I should be able to design a better workaround.

[Vamshireddy]

Hello Luke,

Please find the details below:
Operating System:- Windows Server 2012
Splunk version :- 6.5.2
Website Monitoring version :- 2.1.1
How was the app installed (through the UI or through deployment server, SHC, etc.)
I have upgraded new version of the website monitoring app using UI
What user Splunk was running under (System, Domain Account, etc)
Administrator

Let me know if you want any more information.

[Vamshireddy]

Thanks Luke for reply.
I'm not seeing any result for the above search in last 10 days window.

But in "web_availability_modular_input.log" file am seeing below error message:
"
INFO Added thread to the queue for stanza=web_ping://, thread_count=1
INFO Added thread to the queue for stanza=web_ping://, thread_count=2
.....
WARNING Thread limit has been reached and thus this execution will be skipped for stanza=web_ping://, thread_count=20
.....
DEBUG No need to execute this stanza since a thread already running for stanza=web_ping://
.....
ERROR Failed to save checkpoint directory
Traceback (most recent call last):
File "C:\Program Files\Splunk\etc\apps\website_monitoring\bin\modular_input.py", line 1191, in save_checkpoint_data
fp = open( self.get_file_path(checkpoint_dir, stanza), 'w' )
IOError: [Errno 13] Permission denied: u'C:\Program Files\Splunk\var\lib\splunk\modinputs\web_ping\e55e2172d516522608c07669aaceae7d.json'
"
Let me know if you need any other log info.

Thanks in advance.