Hi WStallWood,
There is two parts to the AWS billing features in the new splunk app. I learned the hard way, as well. The issue your having is with the lack of the Cloudwatch based billing reports. Unfortunately this is only available to the consolidated billing account and would require you to be permitted access to those cloudwatch metrics.
However, The historical reports should work via the dashboard.
... View more