Datadog integrates with AWS Lambda, enables support for serverless architectures

News Analysis
Aug 10, 20163 mins

Datadog’s AWS Lambda integration gives users insight into their serverless application's performance

I’m a big fan of so-called serverless architectures. The idea of these products is that developers don’t have to think about spinning up servers to do some processing—rather a construct that goes something along the lines of “when trigger A happens, set off process B, and when process B is complete, your job is done” can be enabled.

Amazon Web Services (AWS) was the first of the public cloud vendors to launch a serverless offering, AWS Lambda. Since then, it is an approach other players have followed.

But while serverless offerings add massive value in terms of simplicity and economics, they provide challenges. The servers that run the actual code to process these events are not exposed to developers. As such, developers have zero visibility into how those servers are working and what they’re up to.

+ Also on Network World: Serverless computing: Mapping out the possibilities

Traditional approaches towards server monitoring—by way of agents and the like—cannot apply to serverless architectures. Lambda functions can be triggered via an application program interface (API), through in-app actions or by AWS events, such as a new object being added to an Amazon Simple Storage Service (Amazon S3) bucket. Since launching, Lambda adoption has grown quickly, with large enterprise companies such as Netflix leading the way.

So, it is interesting to see an announcement from cloud monitoring vendor Datadog today that they are rolling out an integration with AWS Lambda. What this means is developers can emit custom metrics specific to their Lambda functions, right from the functions, on top of monitoring the metrics provided via Amazon CloudWatch. Once collected, these metrics can be used to create visualizations and alerts alongside operational data from the rest of the infrastructure environment for actionable insight.

“Serverless architecture is ushering in a paradigm shift in cloud computing. Developers no longer have to provision or manage servers to execute their applications, and companies only pay when code is executed,” said Daniel Langer, product manager at Datadog. “With Datadog’s AWS Lambda integration, users can gain insight into their serverless application’s performance that was previously inaccessible.”

My POV

This is an interesting piece of news for a couple of reasons. First, it is an indication of just how seriously customers regard these serverless approaches. It is only a couple of years since Lambda was introduced, but it has quickly moved on from being a very cool, but difficult to understand science project and is now fairly widely understood and adopted. 

The second indicator is one relating to Datadog: This is still a very young company but one that has absolutely grown like the weeds. From very modest beginnings only a few short years ago, Datadog has grown to be seen as one of the more established cloud monitoring platforms. Indeed the list of AWS products it integrates with pretty much spans the entire AWS continuum.

Of course, that is necessary given that AWS offers its own monitoring solution, CloudWatch. But it is the added value on top of the basic metrics that Datadog is looking for, and it will be interesting to see what they do with the addition of Lambda information.

benkepes

Ben Kepes is a technology evangelist, an investor, a commentator and a business adviser. His business interests include a diverse range of industries from manufacturing to property to technology. As a technology commentator he has a broad presence both in the traditional media and extensively online. Ben covers the convergence of technology, mobile, ubiquity and agility, all enabled by the cloud. His areas of interest extend to aviation technology, enterprise software, software integration, financial/accounting software, platforms and infrastructure as well as articulating technology simply for everyday users.

He is a globally recognized subject matter expert with an extensive following across multiple channels. His commentary has been published on Forbes, ReadWriteWeb, GigaOm, The Guardian and a wide variety of publications – both print and online. Often included in lists of the most influential technology thinkers globally, Ben is also an active member of the Clouderati, a global group of cloud thought leaders and is in demand as a speaker at conferences and events all around the world.

As organizations react to the demands for more flexible working environments, the impacts of the economic downturn and the existence of multiple form-factor devices and ubiquitous connectivity, Cloud computing stands alone as the technology paradigm that enables the convergence of those trends -- Ben’s insight into these factors has helped organizations large and small, buy-side and sell-side, to navigate a challenging path from the old paradigm to the new one.

Ben is passionate about technology as an enabler and enjoys exploring that theme in various settings.

The opinions expressed in this blog are those of Ben Kepes and do not necessarily represent those of IDG Communications, Inc., its parent, subsidiary or affiliated companies.

More from this author