Connecting AWS CUR
Step-by-step guide on how to enable AWS CUR
PerfectScale has created a detailed guide to help you effortlessly enable AWS CUR.
In order to start using AWS CUR, follow the steps provided below:
Create Cost and Usage Reports
Sign in to the Billing and Cost Management console.
Go to
Data Exportsin the navigation pane and chooseCreate.In the Export type choose
Legacy CUR export.Enter a
Report namefor your report (for example:cur-perfectscale-example).Select
Refresh automaticallyin the Export Content / Data refresh settings .In the Data export delivery options for Report data time granularity choose one of the following options:
Hourlyto aggregate the line items in the report by hour.Dailyto aggregate the line items in the report by day.Monthlyto aggregate the line items in the report by month.
For Report data integration choose Amazon Athena.
In the Data export storage settings, configure the section following one of these steps:
Select the existing bucket (if you already have S3 bucket).
Select Create a bucket, enter a bucket name, and choose the Region for the new bucket.
For the S3 path prefix, enter the report path prefix you want to prepend to the name of your report.
Add Tags if needed.
Review the settings for your report and click
Create report.
CUR master account support
If your AWS account is a part of an AWS Organization or if you manage multiple AWS accounts within the same organization, you can centralize billing data using the management (primary) account of the AWS Organization. This setup allows you to configure AWS CUR only once and get a detailed view of costs and usage across all accounts, enabling better cost management across your entire organization.
When CUR is enabled at the organization level, it automatically collects cost and usage data from all member accounts, simplifying expense tracking and management across multiple accounts in a centralized way. This setup allows you to utilize a single AWS CUR for all pricing profiles, requiring only a change in the region where your Kubernetes cluster is installed.
Set up Amazon Athena
Set up Amazon Athena using AWS CloudFormation templates.
Go to the Amazon S3 console.
In the S3 bucket that you opted to receive the AWS CUR report (cur-perfectscale-example) in the folder report path prefix(your-report-path-prefix)/report name (your-report-name) you will find template file crawler-cfn.yml.
Go to Object actions, and click
Download as.Navigate to the AWS CloudFormation console.
In case of using AWS CloudFormation for the first time, select
Create New Stackand clickWith new resources (standard)in the dropdown list.Otherwise -
Create Stack.Select
Choose an existing templatein Prerequisite - Prepare template.Select
Upload a template filein Specify template.After clicking
Choose fileselect the downloaded.ymltemplate, and clickOpen.As a next step, enter the Stack name for your template, name
cur-perfectscale-example, add tags, if needed, and go to the next page.The template creates the following resources:
Three IAM roles
An AWS Glue database
An AWS Glue crawler
Two Lambda functions
An Amazon S3 notification
To ensure the template is configured properly, check the
statusinstack info.
Run Amazon Athena queries
Go to the Amazon Athena service and select Query editor.
Click
Edit settingson the top right cornerIn the
Query result location and encryptionwrite down the path to the created for the CUR bucket, or use another bucket (for example,s3://cur-perfectscale-example/athena/) and clickSave.Return to the Query editor and run the following query to ensure the configuration works properly:
select status from cost_and_usage_data_status
Configure the authentication method
There are two ways to grant us access to your CUR:
Delegate access across AWS accounts using IAM roles (recommended).
Create a separate IAM user.
How to delegate access with IAM roles
Go to AWS IAM service
Chose
Policyand clickCreate Policy.Add the following JSON permissions to the policy.
Choose
Rolesand then choose toCreate a Rolein the navigation pane.Choose the
An AWS accountrole type.Select
Another AWS account.For
Account ID, enter 888061904880.In the Options, choose
Require external IDand write down your External IDChoose
Next: Permissionsto set the permissions associated with the role.Select the check box next to the policy you created before.
Name the user and click
Next.(Optional) Add description and metadata to the role by attaching tags as key-value pairs (you may need it for more information about using tags in IAM).
After reviewing the role, choose
Create role.You should now obtain the role's Amazon Resource Name (ARN), a unique identifier for the role you need to add to the PerfectScale AWS CUR Profile. Example: arn:aws:iam::989068116150:role/access-perfectscale-account-to-cur).
How to create IAM user for CUR integration
Go to AWS IAM service.
Go to
Policyand clickCreate Policy.Add the following JSON permissions to the policy and move to the next step.
Name your policy and click
Create Policy.Go to User and click
Create User.Name the user and click
Next.Select your policy in the
Attach policies directlyand move to the next step.Create User
Select just created user, go to Security_credentials, and click
Create access key.Copy the generated Access key/Secret access key and paste it into the CUR profile.
Visit the official AWS documentation for more details
AWS CUR configuration set
After enabling CUR, in order to start using the integration, you need to create a AWS CUR Pricing Profile and apply it to the desired cluster.
There are two options for creating a Profile: from the Settings tab or directly from the Overview.
From the Settings tab
Go to the Settings tab on the left panel -> select Pricing -> click the +Add Profile button -> select AWS CUR -> name the profile and put the needed values in the relevant fields -> click Save button.
From the Overview tab
Go to the Overview tab on the left panel -> find the cluster to which you want to apply the custom Pricing Profile and click three dots button -> select Cluster Settings -> go to Customizations -> click on Add New Profile in the Pricing Profile drop-down list -> select AWS CUR type -> name and configure your profile -> click the Save And Apply button -> click the Save Changes button.
AWS CUR Pricing Profile configuration
athena_result_bucket: the S3 bucket, where Athena stores query results.
athena_region: the AWS region where Athena is running.
athena_database: the name of the database created on Athena setup.
athena_table: the name of the table, created on Athena setup.
aws_account_id: AWS account, where the cluster is running.
aws_external_id: the ID for cross-account access in AWS Identity and Access Management (IAM).
role_arn: the Amazon Resource Name associated with the role possessing the necessary credentials to execute calls on your behalf.
AWS CUR configuration verification
To verify if AWS CUR is configured properly, click the Test Integration button.
Apply to a single cluster
To apply AWS CUR Pricing Profile to the cluster, go to the Overview tab on the left panel -> find the cluster to which you want to apply the AWS CUR Pricing Profile and click three dots button -> select Cluster Settings -> go to Customizations -> select the needed profile in the Pricing Profile drop-down list.
Apply to multiple clusters
To apply the profile to multiple clusters from a single view, use the Manage Assignments feature.
Go to the Settings tab on the left panel -> select the Pricing -> click the Manage Assignments button -> apply the profiles for the needed clusters -> click the Save Changes button.
Last updated
