Skip to main content

Auto Scaling Group

This post is part of a bigger topic Autoscaling Publishers in AWS.

Now that we have a Launch Configuration, based on it, we can create an Auto Scaling Group. This will be in charge of creating/terminating publisher instances based on some rules (Scaling Policies).

We base our Auto Scaling Group on the Launch Configuration created earlier (sdl_publisher_lc). The very important properties are the Desired, Min and Max number of instances in the group. The Desired is set usually by the Scaling Policies, but more about those later. The Min and Max are the limits of this group. In my case I use Min=1 and Max=3, meaning that I want to have 1 publisher running at all times and when needed, based on load, 2 additional publishers can be added to the group by an 'Increasing size' Scaling Policy.

Once load passes, a 'Decreasing size' Scaling Policy reduces the number of instances in the group.


Scaling Policies

These policies represent the rules for adding/removing instances to the group. They can monitor metrics on the instance itself (e.g. CPU), CloudWatch metrics, or even CloudWatch alarms (e.g. Publish Alarm defined earlier) in order to increase and decrease the number of instances.

We define an 'increase_group_size' as a Scaling Policy with Steps in order to add more publisher instances as the size of the Publish Queue increases.

We also define a 'decrease_group_size' as Simple Scaling Policy that reduces the size of the group. But more details about these policies in a followup post.




Lifecycle Hooks

We are going to use a lifecycle hook when scaling-in (decreasing) the size of out group, when publishing load has passed.

More details about the termination hook in a later post. For now, we create one hook that is going to be raised when the group attempts to terminate an instance. This hook can be intercepted in a CloudWatch event that can then trigger a Lambda Function that will instruct the publisher to shutdown gracefully. Once that happens, the termination hook is released and termination occurs normally.

The Lifecycle Hook Name is important, because in our Lambda Function we will instruct this particular hook to continue termination.

Heartbeat Timeout specifies the time needed to this hook to expire. This means that in the case the termination Lambda did not release the hook in the meantime, the hook will be automatically released once this timeout expires.



Comments

Popular posts from this blog

Running sp_updatestats on AWS RDS database

Part of the maintenance tasks that I perform on a MSSQL Content Manager database is to run stored procedure sp_updatestats . exec sp_updatestats However, that is not supported on an AWS RDS instance. The error message below indicates that only the sa  account can perform this: Msg 15247 , Level 16 , State 1 , Procedure sp_updatestats, Line 15 [Batch Start Line 0 ] User does not have permission to perform this action. Instead there are several posts that suggest using UPDATE STATISTICS instead: https://dba.stackexchange.com/questions/145982/sp-updatestats-vs-update-statistics I stumbled upon the following post from 2008 (!!!), https://social.msdn.microsoft.com/Forums/sqlserver/en-US/186e3db0-fe37-4c31-b017-8e7c24d19697/spupdatestats-fails-to-run-with-permission-error-under-dbopriveleged-user , which describes a way to wrap the call to sp_updatestats and execute it under a different user: create procedure dbo.sp_updstats with execute as 'dbo' as

Scaling Policies

This post is part of a bigger topic Autoscaling Publishers in AWS . In a previous post we talked about the Auto Scaling Groups , but we didn't go into details on the Scaling Policies. This is the purpose of this blog post. As defined earlier, the Scaling Policies define the rules according to which the group size is increased or decreased. These rules are based on instance metrics (e.g. CPU), CloudWatch custom metrics, or even CloudWatch alarms and their states and values. We defined a Scaling Policy with Steps, called 'increase_group_size', which is triggered first by the CloudWatch Alarm 'Publish_Alarm' defined earlier. Also depending on the size of the monitored CloudWatch custom metric 'Waiting for Publish', the Scaling Policy with Steps can add a difference number of instances to the group. The scaling policy sets the number of instances in group to 1 if there are between 1000 and 2000 items Waiting for Publish in the queue. It also sets the

Toolkit - Dynamic Content Queries

This post if part of a series about the  File System Toolkit  - a custom content delivery API for SDL Tridion. This post presents the Dynamic Content Query capability. The requirements for the Toolkit API are that it should be able to provide CustomMeta queries, pagination, and sorting -- all on the file system, without the use third party tools (database, search engines, indexers, etc). Therefore I had to implement a simple database engine and indexer -- which is described in more detail in post Writing My Own Database Engine . The querying logic does not make use of cache. This means the query logic is executed every time. When models are requested, the models are however retrieved using the ModelFactory and those are cached. Query Class This is the main class for dynamic content queries. It is the entry point into the execution logic of a query. The class takes as parameter a Criterion (presented below) which triggers the execution of query in all sub-criteria of a Criterio