I'm trying to bring our Jira data which is around 300K records, and I assume the data is around 3GB. We have enough daily usage limit (enterprise) so I guess it is not the issue. However the process stops in splunk exact at 37K records (24MB), and we're missing very large of data.
The query I run is;
| jirarest issues 666666
Any opinion is appreciated
That's an oddly specific number of results to stop on. Are you given any error messages (such as "could not read results from generating streaming command") that can indicate where this limit could be occurring? There is no limit for results in the jirarest command itself. You may be hitting a limit with Splunk. I would suggest writing the author of the app (fdeboer@splunk.com) and I'm quite sure he'll be happy to assist you with this.