Normally, we populate search results in real time into the summary index. But a research question came up about historical data that resides in the main index. Trying to run a search over a period of one month results in "Timed out waiting for peer xxx.xxx.com. If this occurs frequently, receiveTimeout in distsearch.conf may need to be increased. Search results might be incomplete!" The same search runs fine in 24 hours.
So the thought I had would be to run a search by calendar day or less, put the result in the summary index, go back one day, repeat for 90 past days.
Once the single count by day or less is in the summary index, then I can easily graph it.
The is called running repeated searches in a loop over different time periods: looping repeated searches by time.
I may have to do it by hour, if I get timeouts. I don't have access to change the search timeouts.
... View more