Getting Data In

can a forwarder send data to hadoop

a212830
Champion

Hi,

Is a UFW capable of sending data to Hadoop? Is there a supported integration between the two at this level? I know that Hadoop Connect can do it, but we are looking at all our options.

0 Karma

rdagan_splunk
Splunk Employee
Splunk Employee

Currently there is no supported integration between forwarders and Hadoop. However, you can write some sort of a solution that uses ' Forwarders into a file -> every few seconds or minutes you stop the streaming into the file and create an actual file -> use Hadoop command line to copy the file into HDFS '.

0 Karma

martin_mueller
SplunkTrust
SplunkTrust

A Universal Forwarder can send data to any third party system that can receive TCP: http://docs.splunk.com/Documentation/Splunk/6.0.3/Forwarding/Forwarddatatothird-partysystemsd#Forwar...

0 Karma
Get Updates on the Splunk Community!

Webinar Recap | Revolutionizing IT Operations: The Transformative Power of AI and ML ...

The Transformative Power of AI and ML in Enhancing Observability   In the realm of IT operations, the ...

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...