Spotinst raises $15M Series A Led By Intel Capital and Vertex Ventures Read The Official Press Release

Everything you should know about EC2 Spot Instances from this re:invent 2017

re:Invent 2017 brought a lot of new features to the Amazon EC2 Spot Instances

Amiram Shachar
Spotinst, Founder and CEO

“Today, we launched a new pricing model and simplified access to Amazon EC2 Spot Instances. With these changes, you can launch Spot instances the same way launch On-Demand instances, and customers can count on low, predictable prices.

Spotinst has been helping AWS customers to leverage Spot instances for many years. By supporting these new features, Spotinst’s service enables customers to move additional workloads to Spot instances with less-effort and greater confidence.”

Joshua Burgin, General Manager, EC2, Amazon Web Services.

As usual, re:Invent brought many changes. Amongst the major changes was an increased focus on EC2 Spot Instances, as AWS continues to sell its spare EC2 capacity. In this article, we’ll dive into the different changes and explain how it affects you – whether you’re running on Spot Instances today or just interested in starting to leverage Spot with the new updates after re:invent.

Before going into the specifics of the changes, let’s start with a high-level explanation of the changes and how it affects you.

Well, if you’ve never used Spot Instances, this is a great time to get started. Getting started with Spot Instances has never been this easy. If you are an existing Spot user, you’ll enjoy longer uptime and availability and a more standard API call to launch Spot Instances.

  • It’s way easier to get started with Spot Instances. By removing the need to determine a bid price, there’s little learning to be done before diving into the world of Spot Instances. They basically work like On-Demand Instances now, only way cheaper.
  • Not as many price adjustments. While the Spot prices still may change, adjusting gradually based on long-term supply and demand means that you can rest a bit easier while running on Spot. No longer you will see noisy Spot price graphs and no longer you will be kicked-out by another Spot customer. You will only be interrupted if EC2 needs that capacity for another On-Demand customer or when Spot price rises above your Maximum price for instance hour.
  • Hibernation! By using this new feature, you won’t lose all your data when your Spot Instance goes down. This makes running things like High-performance computing jobs on Spot a lot easier.

The New EC2 Spot pricing system lowers the bar for new customers to get started with Spot Instances, using a simple and more confident approach to enjoy AWS’ spare capacity for transient workloads like stateless and dev environments. However, if you are thinking of migrating production workloads today to Spot, there are several factors you should consider.

All the changes made to EC2 Spot Instances during re:invent 2017

So what are the actual changes? Let’s go through each of them one-by-one.

1. Spot price changes are less frequent

Before re:invent, Spot prices were adjusting based on real-time supply and demand, sometimes spiking up and dropping suddenly every single second.

Post re:Invent, Spot prices adjust gradually based on long-term supply and demand for spare EC2 Capacity. This means that you don’t need to watch price changes as carefully and can rely on Spot Instances to be a bit steadier.
Still, AWS can terminate your EC2 Spot Capacity based on supply and demand but without reflecting it on the Spot price history. The main benefit here is that you won’t see those multiple spikes happen every second. This allows you to use Spot for transient apps and dev environments with more confidence.

2. Bidding for Spot Instances becomes Optional

Before re:invent, customers have been required to set a maximum bid for Spot Instances. Whenever this maximum bid was exceeded by the Spot Market price, this would trigger an interruption of your Spot Instance within two minutes.

Post re:invent, this bidding process is optional. Customers can access and launch Spot Instances just like they would have an On-Demand Instance. Getting rid of this additional complexity removes a lot of the friction that has kept many customers from diving into the world of Spot Instances.

This optional parameter SpotPrice (bid price) will now determine the maximum price you would be willing to pay for a Spot instance hour, and by default, is set at the On-Demand price.
As before, you continue to pay the Spot instance price, not your maximum price, at the time your instance was running, charged in per-second increments.

You should now be asking yourself – “wait, so when does my Spot Instance get interrupted if I don’t submit a bid price?”

The answer is simple but a bit tricky to monitor. AWS will interrupt your Spot instance for two possible reasons, with the primary one Your Spot Instance will be interrupted when AWS runs out of spare capacity for that Instance type and secondarily if Spot price rises above your bid price.
The flip side here is that interruptions will be harder to predict, as you will have less visibility into the trajectory of the Spot price.

3. New feature: Hibernate for Spot

This is a really nifty new feature that could make your life way easier.

Whenever your Spot Instance is interrupted, rather than being terminated, it will instead hibernate. All your data will be saved into an EBS volume and your Instance will reboot once there is spare capacity of your requested Instance type.

You can use hibernation when your instance(s) need to retain instance state across shutdown-startup cycles, i.e. when your applications running on Spot depend on contextual, business, or session data stored in RAM.

Hibernation is best suitable for the toughest HPC workloads. It may take longer to run your workloads, but they’ll be completed eventually and you won’t lose the data or the state of your memory.

4. Launch Spot instances via RunInstances API

You can request Spot instances from the same API you use for On Demand and Reserved instances by simply specifying Spot for InstanceMarketOption option.

5. T2 Instances are now available as Spot Instances

Great news for EC2 customers, Burstable EC2 Instances (T2) are now also available for purchase in Spot pricing model. That brings AWS to support all of its EC2 capacity for purchase as Spot.

AWS’ General Manager of EC2 has commented on the recent changes:

“Today, we launched a new pricing model and simplified access to Amazon EC2 Spot Instances. With these changes, you can launch Spot instances the same way launch On-Demand instances, and customers can count on low, predictable prices.

Spotinst has been helping AWS customers to leverage Spot instances for many years. By supporting these new features, Spotinst’s service enables customers to move additional workloads to Spot instances with less-effort and greater confidence.”

Joshua Burgin, General Manager, EC2, Amazon Web Services.

To sum up – these changes bring a new spirit to EC2 Spot, immediately opening the door for innovation as to which workloads a DevOps team can run on EC2 Spot with confidence. This is the dawn of a new era of Spot, one where the relevant workloads for Spot Instances is limited only by your imagination.

Amiram Shachar
Spotinst, Founder and CEO

Stay current

Sign up for our newsletter, and we'll send you the latest updates on Spotinst, tips, tutorials and more cool stuff!