Serverless computing could unleash a new startup ecosystem

While serverless computing isn’t new, it has reached an interesting place in its development. As developers begin to see the value of serverless architecture, a whole new startup ecosystem could begin to develop around it.

Serverless isn’t exactly serverless at all, but it does enable a developer to set event triggers and leave the infrastructure requirements completely to the cloud provider. The vendor delivers exactly the right amount of compute, storage and memory and the developer doesn’t even have to think about it (or code for it).

That sounds ideal on its face, but as with every new technology, for each solution there is a set of new problems and those issues tend to represent openings for enterprising entrepreneurs. That could mean big opportunities in the coming years for companies building security, tooling, libraries, APIs, monitoring and a whole host of tools serverless will likely require as it evolves.

Building layers of abstraction

In the beginning we had physical servers, but there was lots of wasted capacity. That led to the development of virtual machines, which enabled IT to take a single physical server and divide it into multiple virtual ones. While that was a huge breakthrough for its time, helped launch successful companies like VMware and paved the way for cloud computing, it was the only beginning.

Then came containers, which really began to take off with the development of Docker and Kubernetes, two open source platforms. Containers enable the developer to break down a large monolithic program into discrete pieces, which helps it run more efficiently. More recently, we’ve seen the rise of serverless or event-driven computing. In this case, the whole idea of infrastructure itself is being abstracted away.

Photo: shutterjack/Getty Images

While it’s not truly serverless, since you need underlying compute, storage and memory to run a program, it is removing the need for developers to worry about servers. Today, so much coding goes into connecting the program’s components to run on whatever hardware (virtual or otherwise) you have designated. With serverless, the cloud vendor handles all of that for the developer.

All of the major vendors have launched serverless products with AWS Lambda, Google Cloud Functions and Microsoft Azure Functions all offering a similar approach. But it has the potential to be more than just another way to code. It could eventually shift the way we think about programming and its relation to the underlying infrastructure altogether.

It’s important to understand that we aren’t quite there yet, and a lot of work still needs to happen for serverless to really take hold, but it has enormous potential to be a startup feeder system in coming years and it’s certainly caught the attention of investors looking for the next big thing.

Removing another barrier to entry

Tim Wagner, general manager for AWS Lambda, says the primary advantage of serverless computing is that it allows developers to strip away all of the challenges associated with managing servers. “So there is no provisioning, deploying patching or monitoring — all those details at the the server and operating system level go away,” he explained.

He says this allows developers to reduce the entire coding process to the function level. The programmer defines the event or function and the cloud provider figures out the exact amount of underlying infrastructure required to run it. Mind you, this can be as little as a single line of code.

Blocks of servers in cloud data center.

Colin Anderson/Getty Images

Sarah Guo, a partner at Greylock Partners, who invests in early stage companies sees serverless computing as offering a way for developers to concentrate on just the code by leaving the infrastructure management to the provider. “If you look at one of the amazing things cloud computing platforms have done, it has just taken a lot of the expertise and cost that you need to build a scalable service and shifted it to [the cloud provider],” she said. Serverless takes that concept and shifts it even further by allowing developers to concentrate solely on the user’s needs without having to worry about what it takes to actually run the program.

Survey says…

Cloud computing company Digital Ocean recently surveyed over 4800 IT pros, of which 55 percent identified themselves as developers. When asked about serverless, nearly half of respondents reported they didn’t fully understand the serverless concept. On the other hand, they certainly recognized the importance of learning more about it with 81 percent reporting that they plan to do further research this year.

When asked if they had deployed a serverless application in the last year, not surprisingly about two-thirds reported they hadn’t. This was consistent across regions with India reporting a slightly higher rate of serverless adoption.

Graph: Digital Ocean

Of those using serverless, Digital Ocean found that AWS was by far the most popular service with 58 percent of respondents reporting Lambda was their chosen tool, followed by Google Cloud Functions with 23 percent and Microsoft Azure Functions further back at 10 percent.

Interestingly enough, one of the reasons that respondents reported a reluctance to begin adopting serverless was a lack of tooling. “One of the biggest challenges developers report when it comes to serverless is monitoring and debugging,” the report stated. That lack of visibility, however could also represent an opening for startups.

Creating ecosystems

The thing about abstraction is that it simplifies operations on one level, but it also creates a new set of requirements, some expected and some that might surprise as a new way of programming scales. This lack of tooling could potentially hinder the development, but more often than not when necessity calls, it can stimulate the development of a new set of instrumentation.

This is certainly something that Guo recognizes as an investor. “I think there is a lot of promise as we improve a bunch of things around making it easier for developers to access serverless, while expanding the use cases, and concentrating on issues like visibility and security, which are all [issues] when you give more and more control of [the infrastructure] to someone else,” she said.

Photo: shylendrahoode/Getty Images

Ping Li, general partner at Accel also sees an opportunity here for investors. “I think the reality is that anytime there’s a kind of shift from a developer application perspective, there’s an opportunity to create a new set of tools or products that help you enable those platforms,” he said.

Li says the promise is there, but it won’t happen right away because there needs to be a critical mass of developers using serverless methodologies first. “I would say that we are definitely interested in serverless in that we believe it’s going to be a big part of how applications will be built in the future, but it’s still in its early stages,” Ping said.

S. Somasgear, managing director at Madrona Ventures says that even as serverless removes complexity, it creates a new set of issues, which in turn creates openings for startups. “It is complicated because we are trying to create this abstraction layer over the underlying infrastructure and telling the developers that you don’t need to worry about it. But that means, there are a lot of tools that have to exist in place — whether it is development tools, deployment tools, debugging tools or monitoring tools — that enable the developer to know certain things are happening when you’re operating in a serverless environment.

Beyond tooling

Having that visibility in a serverless world is a real challenge, but it is not the only opening here. There are also opportunities for trigger or function libraries or companies akin to Twilio or Stripe, which offer easy API access to a set of functionality without having a particular expertise like communications or payment gateways There could be similar analogous needs in the serverless world.

Companies are beginning to take advantage of serverless computing to find new ways of solving problems. Over time, we should begin to see more developer momentum toward this approach and more tools develop.

While it is early days, as Guo says, it’s not as though developers love running infrastructure. It’s just been a necessity. “I think will be very interesting. I just think we’re still very early in the ecosystem,” she said. Yet certainly the potential is there if the pieces fall into place and programmer momentum builds around this way of developing applications for it to really take off and for a startup ecosystem to follow.

Rookout releases serverless debugging tool for AWS Lambda

The beauty of serverless computing services like AWS Lambda is that they abstract away the server itself. That enables developers to create applications without worrying about the underlying infrastructure, but it also creates a set of new problems. Without a static server, how do you debug a program that’s running? It’s a challenge that Israeli startup Rookout has solved in its latest release.

The company has achieved this by providing a way to mark the serverless code with “breakpoints.” Rookout can then collect developer-defined information about the serverless code, allowing them to track issues even while the application is live running in a serverless environment.

This ability to run a trace, which is common in traditional applications, is much more difficult in a serverless one because there is no permanent underlying machine on which the application is running, says Rookout CEO Or Weis.

Rookout running serverless debugger. The information at the bottom of the screen gives developers insight to debug code running on AWS Lambda. Photo: Rookout

“Specifically with serverless, it is extremely hard to predict how your software will behave in that new environment [because] it’s extremely hard to know where software is running and [it has been] almost impossible to see how it’s behaving in production,” Weis explained.
.
He said the only way to solve that to this point has been writing more code in the form of log lines and SDK calls, which creates a whole administrative layer that Rookout wanted to eliminate from the process. By providing an interface to see what’s happening inside the code, the company is giving developers a way to debug live code running in a serverless environment in the same fashion they have debugged more traditional applications.

They can share this information with a myriad of popular adjacent tools including application performance management (APM) like New Relic, log management like Splunk or alerting like PagerDuty. They can also use it to simply go back in and fix the code issue if that’s what’s required.

While serverless computing isn’t truly serverless, there isn’t a dedicated server running the application. Instead, the vendor provides the required amount of server resources based on a particular event trigger. When that event happens, the code runs and the customer gets charged. This is in stark contrast to traditional development where you allocated a server to run the application and you pay for it, regardless of whether you use it or not.

__

Rookout Lambda debugging demo:

Stackery lands $5.5 million for serverless platform

When Stackery’s founders were still at New Relic in 2014, they recognized there was an opportunity to provide instrumentation for the emerging serverless tech market. They left the company after New Relic’s IPO and founded Stackery with the goal of providing a governance and management layer for serverless architecture.

The company had a couple of big announcements today starting with their $5.5 million round, which they are calling a “seed plus” — and a new tool for tracking serverless performance called the Health Metrics Dashboard.

Let’s start with the funding round. Why the Seed Plus designation? Company co-founder and CEO Nathan Taggart says they could have done an A round, but the designation was a reflection of the reality of where their potential market is today. “From our perspective, there was an appetite for an A, but the Seed Plus represents the current stage of the market,” he said. That stage is still emerging as companies begin to see the benefits of the serverless approach.

HWVP led the round. Voyager Capital, Pipeline Capital Partners, and Founders’ Co-op also participated. Today’s investment brings the total raised to $7.3 million since the company was founded in 2016.

Serverless computing like AWS Lambda or Azure Functions is a bit of a misnomer. There is a server underlying the program, but instead of maintaining a dedicated server for your particular application, you only pay when there is a trigger event. Like cloud computing that came before, developers love it because it saves them a ton of time configuring (or begging) for resources for their applications.

But as with traditional cloud computing — serverless is actually a cloud service — developers can easily access it. If you think back to the Consumerization of IT phenomenon that began around 2011, it was this ability to procure cloud services so easily that resulted in a loss of control inside organizations.

As back then, companies want the advantages of serverless technology, but they also want to know how much they are paying, who’s using it and that it’s secure and in compliance with all the rules of the organization. That’s where Stackery comes in.

As for the new Health Metrics Dashboard, that’s an extension of this vision, one that fits in quite well with the monitoring roots of the founders. Serverless often involves containers, which can encompass many functions. When something goes wrong it’s hard to trace what the root cause was.

Stackery Health Metrics Dashboard. Photo: Stackery

“We are are showing architecture-wide throughput and performance at each resource point and [developers] can figure out where there are bottlenecks, performance problems or failure.

The company launched in 2016. It is based in Portland, Oregon and currently has 9 employees, of which five are engineers. They plan to bring on three more by the end of the year.