Knowledge Management

How to upload large json format data into kv-store?

rashid47010
Communicator

Hi, everyone,

The customer shared one last JSON formatted file. there are more than 1000 records. Customers want it as a lookup. my thought process is saying that I should use the kV-store approach. but how can I upload a large amount of data into the kV store?

 

Labels (1)
Tags (2)
0 Karma

kamlesh_vaghela
SplunkTrust
SplunkTrust

@rashid47010 

You can store JSON data using KVStore REST API.

Please go through  https://dev.splunk.com/enterprise/docs/developapps/manageknowledge/kvstore/usetherestapitomanagekv and check the Run multiple save operations section.

I have tried the below JSON with my curl command. You can try it in a local machine and validate the data.

 

[{
	"id": "1",
	"name": "Splunk Sweden"
}, {
	"id": "2",
	"name": "Splunk Singapore"
}]

 

Curl

 

curl -k -u admin:admin123     https://localhost:8089/servicesNS/nobody/APP_NAME/storage/collections/data/KV_STORE_COLLECTION/batch_save     -H 'Content-Type: application/json'     -d 'VALID_JSON_DATA'

 

My example Curl.

curl -k -u admin:admin123     https://localhost:8089/servicesNS/nobody/search/storage/collections/data/kvstorecoll/batch_save     -H 'Content-Type: application/json'     -d '[{"id":"1","name": "Splunk Sweden"}, {"id":"2","name": "Splunk Singapore"}]'

 

I hope this will help you.

 

Thanks
KV


If any of my replies help you to solve the problem Or gain knowledge, an upvote would be appreciated.

0 Karma
Get Updates on the Splunk Community!

Threat Hunting Unlocked: How to Uplevel Your Threat Hunting With the PEAK Framework ...

WATCH NOWAs AI starts tackling low level alerts, it's more critical than ever to uplevel your threat hunting ...

Splunk APM: New Product Features + Community Office Hours Recap!

Howdy Splunk Community! Over the past few months, we’ve had a lot going on in the world of Splunk Application ...

Index This | Forward, I’m heavy; backward, I’m not. What am I?

April 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...