![]() ![]() For more information about concurrency scaling, please visit Figure 5 AWS Console > Redshift > Config in LHS menu > Workload managemenbt > Select Parameter Group > Parameters With careful workload management planning and variance prediction in ETL, BI and Data Science workloads, concurrency scaling can end up being free for most Redshift clients due to the available free credit limit.īelow is a screenshot of the Redshift configuration page to adjust the number of concurrency scaling clusters in the AWS Management Console. In most cases, cost savings result from AWS providing 1 hour of free concurrency scaling credits for every 24 hours that the main cluster runs. Costs are accrued on a per-second basis for the uptime of each concurrency scaling cluster (we can provision 1 – 10 of these clusters as shown in the screenshot below). Write operations still run on the main cluster. The concurrency scaling feature in Redshift allows for the elastic scaling, up and down, of a set of “concurrency clusters” that are separate from the main cluster to manage short-burst read requests. For more information about this feature, please visit Figure 1 AWS Console > Amazon Redshift > Select Cluster > Actions drop down menu > Pause Figure 2 Pause Option 1 – Option to pause the cluster immediately Figure 3 Pause Option 2 – Option to pause the cluster after a period of timeįigure 4 Pause Option 3 – Set up a recurring Pause and Resume schedule Tip 2 – Leverage concurrency scaling ![]() While a cluster is paused, on-demand compute billing is suspended, while storage costs are still incurred.īelow are some screenshots of implementing this Pause and Resume functionality via the AWS Management Console. You no longer need these manual workarounds as AWS now provides us the ability to Pause and Resume the Redshift cluster via the AWS Management Console and/or CLI commands. This involved backing up the Redshift cluster, terminating it and restoring the cluster from the snapshot before it is next required. Historically, we’ve written scripts to implement this Pause and Resume functionality for our clients. It simply does not make sense to accrue costs when these non-PROD environments are not being used, especially over weekends and the longer business holiday periods. While Production Redshift clusters in enterprises are typically run all the time, this is not required for Development, UAT or Pre-PROD environments. Please reach out to us at if you would like to chat with our Data & Analytics Team to learn more.Īs of this writing, the top five ways we’ve successfully slashed Redshift run costs are: Tip 1 – Pausing and Resuming Redshift non-prod clusters We believe that clients can realise between 20% – 60% reduction in their Redshift spend by employing some of the proven techniques below. Our Versent Data Advisory and Managed Services teams continuously monitor, test and prototype these Redshift platform innovations with the intent of guiding clients towards realising the immediate business benefits in terms of cost and performance management. The team at Amazon are continuously releasing new updates to Redshift that reduce overall costs, whilst improving performance, scalability, ease of use and Data Lake integration.
0 Comments
Leave a Reply. |