Getting Data In

What is CLONE_SOURCETYPE used for in transforms.conf? Are there examples?

acharlieh
Influencer

It gets dangerous when I start looking at docs and start seeing features that I hadn't noticed before. So I was looking at the spec for transforms.conf and I noticed this paragraph stuck in here:

CLONE_SOURCETYPE = <string>
* Specifies the sourcetype of a cloned data stream.
* The value string must be nonempty.
* The value string should be different from the sourcetype of the original data stream.
  If it is the same, no cloning happens and a warning will be logged.

I don't see it mentioned on the Indexing wiki and I'm thinking, could this be used somehow for multi-pass parsing? It also raises the question on how to get a cloned data stream, if I could somehow send to multiple queues after the typing pipeline, or do I have to adjust _TCP_ROUTING and forward data back to myself (possibly also twiddling my routes or something), or I'm completely off, and this doesn't have to do with parsing.

Does anyone know more about the intended use of this setting and/or have examples of how they've used it?

Lucas_K
Motivator

So did you figure out a full config example on how this was used?

Can you clone to a different index?

0 Karma

woodcock
Esteemed Legend

Let's say that you must clone an index (and possibly modify it somehow, maybe to anonymize it) so that some users have access to one version and others to the modified version. This is how that could be done.

Get Updates on the Splunk Community!

Introducing the Splunk Community Dashboard Challenge!

Welcome to Splunk Community Dashboard Challenge! This is your chance to showcase your skills in creating ...

Wondering How to Build Resiliency in the Cloud?

IT leaders are choosing Splunk Cloud as an ideal cloud transformation platform to drive business resilience,  ...

Updated Data Management and AWS GDI Inventory in Splunk Observability

We’re making some changes to Data Management and Infrastructure Inventory for AWS. The Data Management page, ...