The format is now:
For a single account use the following style of aws.yaml:
accounts:
- account_number : 123456
billing_bucket : company-billing
aws_access_key : AAAAAAAAAAAA
aws_secret_key : AAAAAAAAAAAABBBBBBBBBBBBBBCC
For multiple accounts use the following style of aws.yaml:
accounts:
- account_number : 123456
billing_bucket : company-one-billing
aws_access_key : AAAAAAAAAAAA
aws_secret_key : AAAAAAAAAAAABBBBBBBBBBBBBBCC
- account_number : 654321
billing_bucket : company-two-billing
aws_access_key : AAAAAAAAAAAA
aws_secret_key : AAAAAAAAAAAABBBBBBBBBBBBBBCC
... View more
It does not fetch the cost allocation reports from your billing bucket, but you can pivot on all the same information. In my opinion, the app has better breakdowns than the cost allocation report and you don't have to predefine your tags.
Seeing as the cost allocation report is a summary of the Line Items contained in the Detailed Report it's a moot point.
... View more
Hi , I am not sure if this is still and issue, but I have released a newer version of the application that avoids these import problems. The application was very sensitive to file permissions so quite often files would not import if they did not have the correct ownership.
The incremental approach to importing files was not ideal and could cause duplicates; this has also been replaced.
... View more
The AWS billing provides dashboards and views for either report type. But essentially you must know the type of billing you have setup for your account to choose the right type.
... View more
If you have a single AWS account and you don't use Consolidated billing your report only contains the Rate and Cost Fields.
eg NON-CONSOLIDATED: Your search should look like this:
index=aws-bill | timechart sum(Cost) as $ by ItemDescription
If you have have multiple AWS accounts and use Consolidated billing your report contains BlendedRate, BlendedCost, UnBlendedRate and UnBlendedCost fields BUT not the Cost and Rate fields.
eg CONSOLIDATED: Your search should look like this:
index=aws-bill | timechart sum(BlendedCost) as $ by ItemDescription
This means you need different searches and dashboards for the different billing reports eg a Consolidated OR a Single billing account report.
From Amazon's own documentation:
Keep in mind that blended rates apply only to Consolidated Billing customers.
http://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/con-bill-blended-rates.html
... View more
Hi, I have released a new version that takes multiple accounts , you can download it here:
https://splunkbase.splunk.com/app/1577/#/overview (version 2.0.0)
RELEASE NOTES
- Supports multiple accounts
- events are streamed in json
- file positions are tracked using yaml files, to reduce the likelihood of double ups
- all functions have been moved to classes
- boto has been updated to 2.38.0
... View more
Whichever application you use the ports are pretty much the same. The billing component of both apps requires access to the programmatic billing bucket located in S3. The ports required for this are HTTP and HTTPS (80 and 443).
The URL endpoint will depend on which region you setup your billing bucket. A full list can be accessed here:
http://docs.aws.amazon.com/general/latest/gr/rande.html
There is also some API access as well but the ports do not change they are still HTTP and HTTPS.,The billing component of the app requires access to the billing reports bucket in s3 on port numbers 80 and 443.
The URLs can be regional depending on where you setup your billing bucket:
- US Standard s3.amazonaws.com (N.Virginia or Pacific Northwest) or s3-external-1.amazonaws.com (N.Virginia only)
- US West ( Oregon) s3-us-west-2.amazonaws.com
- US West (N.California) s3-us-west-1.amazonaws.com
- EU (Ireland) s3-eu-west-1.amazonaws.com
- EU (Frankfurt) s3-eu-central-1.amazonaws.com
- Asia Pacific (Singapore) s3-ap-southeast-1.amazonaws.com
- Asia Pacific (Sydney) s3-ap-southeast-2.amazonaws.com
- Asia Pacific (Tokyo) s3-ap-northeast-1.amazonaws.com
The API component still uses port numbers 80 and 443 but can hit regional endpoints as defined here:
http://docs.aws.amazon.com/general/latest/gr/rande.html
... View more
Hi gbacs, I am rewriting the app to handle this. There is some basic support for this but it is not sufficient and can cause duplicate data. I will let you know when i have released the new version - it is not too far away.
... View more