Creating Chained Grid Workers
Table of Contents
In the case of grid chaining, the RightScale Grid framework provides the ability to implement independent scaling events for each of the automated workflows.
Simple Chaining of Grid Computing Processes
As shown in the diagram above, the worker instances associated with “Worker code 1” can autoscale independently of the worker instances running "Worker code 2." This can be very useful in situations in which specific processes in multiple workflows require additional compute cycles and thus take longer to complete. To prevent jobs from backing up in one queue while a second input queue sits idle, different scaling metrics can be associated with different queues. This allows additional instances to be utilized for the more time-consuming jobs, thus keeping the output flowing at a rate reasonable with respect to the input of the next workflow in the chain.
- © Copyright 2015 RightScale Technical Support