Deployment Architecture

Database performance impact due to DB Connect

sgupta80
Engager

Hi,

Since DB Connect has abilities to run queries against a database and access schemas, what sort of performance impact could I expect on my Postgresql database? I will be exposing my standby database to DB Conenct, but it could slow down certain processes like db replication on that database right? Wouldn't an ETL layer be beneficial in this regard?

Dan
Splunk Employee
Splunk Employee

There's a section in the docs about performance.

http://docs.splunk.com/Documentation/DBX/1.0.8/DeployDBX/Otherdeploymentconsiderations#Performance_c...

Because Splunk DB Connect queries your database, there is a possiblity that your queries may impact that database's performance. In particular, if the initial run of your query to the database retrieves a lot of data, this may affect the performance of your database. Subsequent runs of the query should generally be less impactful, as they are only retrieving data that is new since the previous run of the query. To mitigate this, you can set the tail.follow.only directive, which is only exposed in inputs.conf.

Lookups generate multiple selects that should be within the expected workload for a database and should not affect performance. Splunk DB Connect will execute a separate SELECT statement for each unique combination of input fields. This may happen more than once per search, because the search preview function in Splunk may invoke the lookup multiple times during execution of a search for parts of the results. Splunk will not cache the results between invocations of the lookup.

Get Updates on the Splunk Community!

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...

Welcome to the Splunk Community!

(view in My Videos) We're so glad you're here! The Splunk Community is place to connect, learn, give back, and ...

Tech Talk | Elevating Digital Service Excellence: The Synergy of Splunk RUM & APM

Elevating Digital Service Excellence: The Synergy of Real User Monitoring and Application Performance ...