Splunk Enterprise

Splunk SDK for Java comparatively fetching result is slower

pchinnasamy
New Member

Comparatively elastic search fetches result faster then splunk.
Is it due to HTTP request call?

Tags (1)
0 Karma
1 Solution

jkat54
SplunkTrust
SplunkTrust

Elasticsearch uses lucene indexes where schema is applied at index time. This results in painful structuring of data, painful learning of search syntax, and yes it's also faster in many cases. Elasticsearch has an API call too.

However, Splunk can be fast too. It's much easier to build and expand horizontally, has a much easier search syntax, and many more enterprise level features out of the box.

You should share your architecture, java code, sample data, and how you're loading your data into splunk (inputs, props, transforms, etc) so that we can teach you how to get quicker results

View solution in original post

0 Karma

jkat54
SplunkTrust
SplunkTrust

Elasticsearch uses lucene indexes where schema is applied at index time. This results in painful structuring of data, painful learning of search syntax, and yes it's also faster in many cases. Elasticsearch has an API call too.

However, Splunk can be fast too. It's much easier to build and expand horizontally, has a much easier search syntax, and many more enterprise level features out of the box.

You should share your architecture, java code, sample data, and how you're loading your data into splunk (inputs, props, transforms, etc) so that we can teach you how to get quicker results

0 Karma

pchinnasamy
New Member

Hi,

I am using the same fetching results from splunk doc provided

InputStream resultsNormalSearch = job.getResults();

    ResultsReaderXml resultsReaderNormalSearch;

    System.out.println("Results from the search job fetch logs :\n");
    try {
        resultsReaderNormalSearch = new ResultsReaderXml(resultsNormalSearch);
        HashMap<String, String> event;

        while ((event = resultsReaderNormalSearch.getNextEvent()) != null) {

            LogEntry logEntry = new LogEntry();
            for (String key : event.keySet()) {
                String field = key;
                String value = event.get(key);

                logEntry.put(field, value);
                logs.add(logEntry);
            }
        }

It hits the search query and results is gets loaded to my GUI after every search entry is finished that is too long time taken

0 Karma
Get Updates on the Splunk Community!

They're back! Join the SplunkTrust and MVP at .conf24

With our highly anticipated annual conference, .conf, comes the fez-wearers you can trust! The SplunkTrust, as ...

Enterprise Security Content Update (ESCU) | New Releases

Last month, the Splunk Threat Research Team had two releases of new security content via the Enterprise ...

Detecting Remote Code Executions With the Splunk Threat Research Team

REGISTER NOWRemote code execution (RCE) vulnerabilities pose a significant risk to organizations. If ...