Splunk Enterprise

Splunk SDK for Java comparatively fetching result is slower

pchinnasamy
New Member

Comparatively elastic search fetches result faster then splunk.
Is it due to HTTP request call?

Tags (1)
0 Karma
1 Solution

jkat54
SplunkTrust
SplunkTrust

Elasticsearch uses lucene indexes where schema is applied at index time. This results in painful structuring of data, painful learning of search syntax, and yes it's also faster in many cases. Elasticsearch has an API call too.

However, Splunk can be fast too. It's much easier to build and expand horizontally, has a much easier search syntax, and many more enterprise level features out of the box.

You should share your architecture, java code, sample data, and how you're loading your data into splunk (inputs, props, transforms, etc) so that we can teach you how to get quicker results

View solution in original post

0 Karma

jkat54
SplunkTrust
SplunkTrust

Elasticsearch uses lucene indexes where schema is applied at index time. This results in painful structuring of data, painful learning of search syntax, and yes it's also faster in many cases. Elasticsearch has an API call too.

However, Splunk can be fast too. It's much easier to build and expand horizontally, has a much easier search syntax, and many more enterprise level features out of the box.

You should share your architecture, java code, sample data, and how you're loading your data into splunk (inputs, props, transforms, etc) so that we can teach you how to get quicker results

0 Karma

pchinnasamy
New Member

Hi,

I am using the same fetching results from splunk doc provided

InputStream resultsNormalSearch = job.getResults();

    ResultsReaderXml resultsReaderNormalSearch;

    System.out.println("Results from the search job fetch logs :\n");
    try {
        resultsReaderNormalSearch = new ResultsReaderXml(resultsNormalSearch);
        HashMap<String, String> event;

        while ((event = resultsReaderNormalSearch.getNextEvent()) != null) {

            LogEntry logEntry = new LogEntry();
            for (String key : event.keySet()) {
                String field = key;
                String value = event.get(key);

                logEntry.put(field, value);
                logs.add(logEntry);
            }
        }

It hits the search query and results is gets loaded to my GUI after every search entry is finished that is too long time taken

0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...