Reporting

Splunk as a CDC Solution and Reporting BI Tool?

dhineshv
Engager

I have a question about using Splunk as a CDC solution (Change Data Capture) from relational transactional database and as a reporting BI tool.

The use case I am looking for is, Splunk acts as a CDC tool fetching change data from a relation database and import Database table data into Splunk. Then perform complex ETL and join operations on the data to create simplified data structure.

Splunk also act as a BI tool to generate reports to end users by performing multilevel joins on the simplified data from the previous step.

Can some one point me to some use cases of Splunk in this area or to any blogs from Splunk users in this area?
Or please suggest your thoughts on if Splunk is the right tool for such scenario?

Thanks in Advance

Tags (1)
0 Karma
1 Solution

xavierashe
Contributor

The short answer is, yes. The nice thing about Splunk is that you don't have to worry about schema. The same data can be ETL-ed over and over.

The most experience I have with working with data from relational databases on Splunk is with ServiceNow. I often do multiple joins, unions and appends. Once you start building data models, you can simply much of the complexity.

You asked for some blog posts:
http://capnjosh.com/blog/using-splunk-as-an-etl-tool-for-data-residing-in-a-relational-database/
https://www.splunk.com/blog/2012/04/24/from-etl-to-splunktl.html
https://www.splunk.com/en_us/solutions/solution-areas/business-analytics.html

View solution in original post

xavierashe
Contributor

The short answer is, yes. The nice thing about Splunk is that you don't have to worry about schema. The same data can be ETL-ed over and over.

The most experience I have with working with data from relational databases on Splunk is with ServiceNow. I often do multiple joins, unions and appends. Once you start building data models, you can simply much of the complexity.

You asked for some blog posts:
http://capnjosh.com/blog/using-splunk-as-an-etl-tool-for-data-residing-in-a-relational-database/
https://www.splunk.com/blog/2012/04/24/from-etl-to-splunktl.html
https://www.splunk.com/en_us/solutions/solution-areas/business-analytics.html

Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...