Release Management Authors: Liz McMillan, Jnan Dash, Lori MacVittie, Gilad Parann-Nissany, Carmen Gonzalez

Related Topics: @CloudExpo, Microservices Expo, Agile Computing, Release Management

@CloudExpo: Article

Avoiding Unexpected Cloud Economics Pitfalls

There's more to the utility computing benefit of the Cloud than turning a faucet

Anybody who is considering a move to the Cloud knows that the greatest economic motivation for Cloud Computing is the pay-as-you-go, pay-for-what-you-need utility computing benefit, right? Deal with spikes in demand much more cost-effectively, the public Cloud service providers gush, since we can spread the load over many customers and pass the savings from our economies of scale on to you. The utility benefit is also a central premise of Private Clouds. Build a Private Cloud for your enterprise, the vendors promise, and you can achieve the same economies of scale as Public Clouds without all that risk.

Unfortunately, what sounds too good to be true usually is. There are a number of gotchas on both the Public and Private Cloud provider sides that limit—or even prevent—organizations from obtaining a full measure of the utility benefit. Let’s go back to economics class and take a closer look.

Clouds Like Water?
Turn on the faucet, only instead of water, you get Cloud. Sounds good, but we use water very differently than we do IT resources. With water, we generally use all we need without worrying about price. We may try to economize, and perhaps we’ll go through the trouble of digging a well if we need to fill our pool, but generally we don’t think about the cost of each flush or load of laundry.

The Cloud is just the opposite. The techies might not be thinking in terms of cost, but the bean counters definitely are. For a CIO or purchasing manager comfortable with entering resource costs into annual budget spreadsheets, the unknown nature of the Cloud bill strikes fear into their hearts—and their wallets. Instead of focusing on lowered costs, their worry is increased costs, since Cloud usage is inherently unpredictable. After all, that’s why landlords don’t like including heating costs in the rent. If the tenants aren’t responsible for keeping costs down then pay-as-you-go inevitably translates into pay more—and just how much more is a mystery until the bill arrives.

Enterprise Cloud customers in particular are beginning to push back, and as a result, Public Cloud providers must change their pricing model accordingly. Unfortunately, there aren’t many alternatives to simple pay-as-you go. One increasingly popular alternative that might ease Cloud purchasers’ minds is for providers to offer a tiered pricing system, with a fixed price for any consumption up to a pre-defined threshold, and pay-as-you-go above that. However, tiered pricing is not a panacea. While such a pricing model is straightforward and gives organizations an increased measure of predictability, it still doesn’t solve the problem of cost spikes.

If tiered pricing sounds more like paying for your mobile phone service than for utilities like water or electricity, you’re right. Not only does this approach reduce perceived risks for Cloud purchasers, it’s also a familiar model for the telcos, all of whom are looking to enter the Cloud market, or at the least, grow their existing Cloud offerings. As a result, ZapThink expects tiered pricing to become the norm for Public Cloud services over time, in spite of its drawbacks.

The irony with tiered Cloud pricing is that the more you require elasticity, the greater the risk that you’ll use up your allotted consumption for the month—but elasticity is the most important benefit of the Cloud. Sure, if you have steady, predictable consumption then tiered pricing is low risk, but if all you want is steady, predictable availability, then chances are keeping your resources on-premise or in a traditional hosted facility will be more cost-effective than moving to the Cloud in the first place, since you’re not particularly worried about spikes in demand.

To make matters worse, not everyone likes tiered pricing, of course. Anyone who’s used up their minutes or texts for the month only to be surprised by an excessive phone bill knows what I’m talking about. It seems the mobile phone providers love to play games with their pricing plans for the sole purpose of squeezing every penny out of their hapless customers. I’m sure we don’t want our Cloud providers to play the same dirty tricks.

The Subtleties of Cloud Churn
While it’s a common water cooler pastime to demonize mobile phone companies for their underhanded pricing policies, there is a downside for the providers as well: the dreaded customer churn. Since it’s relatively easy for customers to change phone providers, especially now that number portability is a reality, shifty behavior on the part of providers simply chases away customers.

Cloud churn is a very real problem for Public Cloud providers as well, as the ease of deprovisioning Cloud resources naturally eases the deprovisioning of customers. But there is an extra complication with Cloud churn that doesn’t have a parallel in the mobile phone world: Cloud resources that are no longer being used but still remain allocated to customers. Depending on the provider’s pricing model, the cost to the customer to maintain such resources may be minimal, but it’s not always clear whether those minimal amounts sufficiently cover the providers’ costs.

For example, I get monthly charges on my credit card from Amazon Web Services (AWS) for a few cents each month. I can’t remember how I signed up for AWS, but the amounts are so minimal, it’s not worth my time or trouble to cancel the service. Do those few cents per month cover Amazon’s costs, assuming there are potentially millions of such customers? Perhaps in Amazon’s case—but for less experienced providers with wafer thin margins, the economics might work to their disadvantage.

Furthermore, the proliferation of such idle instances may be a more significant issue for Private Cloud providers, since they typically have constrained budgets for data center buildouts. Amazon may be building new data centers as fast as they can, but your Private Cloud likely has a maximum practical size given your budget for the effort. The last thing you want is to fill it up with idle resources that various people in your organization can’t be bothered to fully deprovision.

The Demotivation Paradox
For the Public Cloud provider, the obvious solution to the problem of idle resources left over from Cloud churn is to charge enough for those resources. Either the cost will motivate people to fully deprovision them, so the argument goes, or at the very least, they generate enough money so that keeping them around is worthwhile for the providers.

But what if we’re talking about Private Clouds here? The way to charge internal customers for using Cloud resources is via chargebacks. And everybody hates chargebacks. Not only are they a bookkeeping hassle, but they also demotivate the consumption of shared resources. We went through this problem when we dealt with shared Services and SOA, and now we’re sharing Cloud resources, but the problem remains: the whole point to the Private Cloud is to achieve economies of scale across the enterprise, but the only way to make such economies work is if most or all divisions participate. Chargebacks, however, discourage that participation.

As it was with shared Services, the way to compensate for chargebacks is through effective governance: establish and enforce Cloud consumption policies that counteract the demotivational effects of chargebacks, and come up with a way to motivate people to follow such policies. While you’re at it, formulate policies governing the deprovisioning of instances that no one needs any more. But in the Cloud, such governance is especially challenging because of the diversity of resources and their corresponding consumption scenarios: policies for provisioning virtual machines as part of IaaS is quite different from, say, provisioning development tools on PaaS. It will take organizations with Private Clouds a good bit of trial and error to get the balance right.

The ZapThink Take
Another downside to the idle-resource-masquerading-as-paying-customer problem is that it makes it very difficult for financial analysts to gauge the health of a Public Cloud provider. This obfuscation can skew traditional metrics like number of customers or revenue per customer, and the distortion may be different from one provider to another. Combine the resulting confusion with the lean profit margins in today’s Cloud space, as providers push their prices ever lower to encourage growth, and you have a recipe for disaster. An ostensibly healthy Cloud provider might suddenly collapse due to a foundation of underperforming customers and idle resources.

Private Clouds face a corresponding problem, as executives review the financials for the Cloud effort. ZapThink predicts a backlash against Private Clouds in the next year or two, as vendors underdeliver on their Cloud promises—not necessarily through any fault of their technology, but rather because the reality of achieving cost advantages with Private Clouds is far more difficult than the vendors’ and analysts’ spreadsheets might have you believe.

If you’d like to learn more about the subtleties of Cloud economics, I’d be happy to have a deeper discussion at Cloud Expo in New York or The Business of Cloud Computing in Dallas, or any of the other conferences I’ll be presenting at. Please drop me a line if you’re interested. I’m curious as to whether issues of Cloud churn or Private Cloud demotivation are concerns in your organization.

Image source: Vegan Feast Catering

More Stories By Jason Bloomberg

Jason Bloomberg is the leading expert on architecting agility for the enterprise. As president of Intellyx, Mr. Bloomberg brings his years of thought leadership in the areas of Cloud Computing, Enterprise Architecture, and Service-Oriented Architecture to a global clientele of business executives, architects, software vendors, and Cloud service providers looking to achieve technology-enabled business agility across their organizations and for their customers. His latest book, The Agile Architecture Revolution (John Wiley & Sons, 2013), sets the stage for Mr. Bloomberg’s groundbreaking Agile Architecture vision.

Mr. Bloomberg is perhaps best known for his twelve years at ZapThink, where he created and delivered the Licensed ZapThink Architect (LZA) SOA course and associated credential, certifying over 1,700 professionals worldwide. He is one of the original Managing Partners of ZapThink LLC, the leading SOA advisory and analysis firm, which was acquired by Dovel Technologies in 2011. He now runs the successor to the LZA program, the Bloomberg Agile Architecture Course, around the world.

Mr. Bloomberg is a frequent conference speaker and prolific writer. He has published over 500 articles, spoken at over 300 conferences, Webinars, and other events, and has been quoted in the press over 1,400 times as the leading expert on agile approaches to architecture in the enterprise.

Mr. Bloomberg’s previous book, Service Orient or Be Doomed! How Service Orientation Will Change Your Business (John Wiley & Sons, 2006, coauthored with Ron Schmelzer), is recognized as the leading business book on Service Orientation. He also co-authored the books XML and Web Services Unleashed (SAMS Publishing, 2002), and Web Page Scripting Techniques (Hayden Books, 1996).

Prior to ZapThink, Mr. Bloomberg built a diverse background in eBusiness technology management and industry analysis, including serving as a senior analyst in IDC’s eBusiness Advisory group, as well as holding eBusiness management positions at USWeb/CKS (later marchFIRST) and WaveBend Solutions (now Hitachi Consulting).

@ThingsExpo Stories
SYS-CON Events announced today that Streamlyzer will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Streamlyzer is a powerful analytics for video streaming service that enables video streaming providers to monitor and analyze QoE (Quality-of-Experience) from end-user devices in real time.
You have great SaaS business app ideas. You want to turn your idea quickly into a functional and engaging proof of concept. You need to be able to modify it to meet customers' needs, and you need to deliver a complete and secure SaaS application. How could you achieve all the above and yet avoid unforeseen IT requirements that add unnecessary cost and complexity? You also want your app to be responsive in any device at any time. In his session at 19th Cloud Expo, Mark Allen, General Manager of...
Cloud based infrastructure deployment is becoming more and more appealing to customers, from Fortune 500 companies to SMEs due to its pay-as-you-go model. Enterprise storage vendors are able to reach out to these customers by integrating in cloud based deployments; this needs adaptability and interoperability of the products confirming to cloud standards such as OpenStack, CloudStack, or Azure. As compared to off the shelf commodity storage, enterprise storages by its reliability, high-availabil...
The IoT industry is now at a crossroads, between the fast-paced innovation of technologies and the pending mass adoption by global enterprises. The complexity of combining rapidly evolving technologies and the need to establish practices for market acceleration pose a strong challenge to global enterprises as well as IoT vendors. In his session at @ThingsExpo, Clark Smith, senior product manager for Numerex, will discuss how Numerex, as an experienced, established IoT provider, has embraced a ...
The Internet of Things (IoT), in all its myriad manifestations, has great potential. Much of that potential comes from the evolving data management and analytic (DMA) technologies and processes that allow us to gain insight from all of the IoT data that can be generated and gathered. This potential may never be met as those data sets are tied to specific industry verticals and single markets, with no clear way to use IoT data and sensor analytics to fulfill the hype being given the IoT today.
Donna Yasay, President of HomeGrid Forum, today discussed with a panel of technology peers how certification programs are at the forefront of interoperability, and the answer for vendors looking to keep up with today's growing industry for smart home innovation. "To ensure multi-vendor interoperability, accredited industry certification programs should be used for every product to provide credibility and quality assurance for retail and carrier based customers looking to add ever increasing num...
In the next forty months – just over three years – businesses will undergo extraordinary changes. The exponential growth of digitization and machine learning will see a step function change in how businesses create value, satisfy customers, and outperform their competition. In the next forty months companies will take the actions that will see them get to the next level of the game called Capitalism. Or they won’t – game over. The winners of today and tomorrow think differently, follow different...
“Media Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. CloudBerry Backup is a leading cross-platform cloud backup and disaster recovery solution integrated with major public cloud services, such as Amazon Web Services, Microsoft Azure and Google Cloud Platform.
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, will discuss how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team a...
The security needs of IoT environments require a strong, proven approach to maintain security, trust and privacy in their ecosystem. Assurance and protection of device identity, secure data encryption and authentication are the key security challenges organizations are trying to address when integrating IoT devices. This holds true for IoT applications in a wide range of industries, for example, healthcare, consumer devices, and manufacturing. In his session at @ThingsExpo, Lancen LaChance, vic...
What are the successful IoT innovations from emerging markets? What are the unique challenges and opportunities from these markets? How did the constraints in connectivity among others lead to groundbreaking insights? In her session at @ThingsExpo, Carmen Feliciano, a Principal at AMDG, will answer all these questions and share how you can apply IoT best practices and frameworks from the emerging markets to your own business.
Big Data has been changing the world. IoT fuels the further transformation recently. How are Big Data and IoT related? In his session at @BigDataExpo, Tony Shan, a renowned visionary and thought leader, will explore the interplay of Big Data and IoT. He will anatomize Big Data and IoT separately in terms of what, which, why, where, when, who, how and how much. He will then analyze the relationship between IoT and Big Data, specifically the drilldown of how the 4Vs of Big Data (Volume, Variety,...
SYS-CON Events announced today that SoftNet Solutions will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. SoftNet Solutions specializes in Enterprise Solutions for Hadoop and Big Data. It offers customers the most open, robust, and value-conscious portfolio of solutions, services, and tools for the shortest route to success with Big Data. The unique differentiator is the ability to architect and ...
For basic one-to-one voice or video calling solutions, WebRTC has proven to be a very powerful technology. Although WebRTC’s core functionality is to provide secure, real-time p2p media streaming, leveraging native platform features and server-side components brings up new communication capabilities for web and native mobile applications, allowing for advanced multi-user use cases such as video broadcasting, conferencing, and media recording.
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform and how we integrate our thinking to solve complicated problems. In his session at 19th Cloud Expo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm ...
DevOps is being widely accepted (if not fully adopted) as essential in enterprise IT. But as Enterprise DevOps gains maturity, expands scope, and increases velocity, the need for data-driven decisions across teams becomes more acute. DevOps teams in any modern business must wrangle the ‘digital exhaust’ from the delivery toolchain, "pervasive" and "cognitive" computing, APIs and services, mobile devices and applications, the Internet of Things, and now even blockchain. In this power panel at @...
A completely new computing platform is on the horizon. They’re called Microservers by some, ARM Servers by others, and sometimes even ARM-based Servers. No matter what you call them, Microservers will have a huge impact on the data center and on server computing in general. Although few people are familiar with Microservers today, their impact will be felt very soon. This is a new category of computing platform that is available today and is predicted to have triple-digit growth rates for some ...
Almost everyone sees the potential of Internet of Things but how can businesses truly unlock that potential. The key will be in the ability to discover business insight in the midst of an ocean of Big Data generated from billions of embedded devices via Systems of Discover. Businesses will also need to ensure that they can sustain that insight by leveraging the cloud for global reach, scale and elasticity.
In past @ThingsExpo presentations, Joseph di Paolantonio has explored how various Internet of Things (IoT) and data management and analytics (DMA) solution spaces will come together as sensor analytics ecosystems. This year, in his session at @ThingsExpo, Joseph di Paolantonio from DataArchon, will be adding the numerous Transportation areas, from autonomous vehicles to “Uber for containers.” While IoT data in any one area of Transportation will have a huge impact in that area, combining sensor...
SYS-CON Media announced today that @WebRTCSummit Blog, the largest WebRTC resource in the world, has been launched. @WebRTCSummit Blog offers top articles, news stories, and blog posts from the world's well-known experts and guarantees better exposure for its authors than any other publication. @WebRTCSummit Blog can be bookmarked ▸ Here @WebRTCSummit conference site can be bookmarked ▸ Here