SeBS v1.1

Contributions

Many thanks to Paweł Żuk of the University of Warsaw for contributing OpenWhisk support!

We would like to also thank Laurin Brandner of ETH Zurich for bug fixes and for helping with testing the new release.

What changed?

• New system of handling non-root containers that do not require rebuilding Docker images.
• Deprecate Python 3.6 on all platforms.
• Update documentation and tutorials.
• Update benchmark codes and dependencies
• Many bug fixes.

OpenWhisk

• Support for the open-source FaaS platform OpenWhisk.
• OpenWhisk uses the new feature of deploying benchmarks as Docker images.
• We support Python 3.7 and 3.9, Node.js 10, and 12 functions.

AWS

• AWS Lambda functions now support Python 3.9 and Node.js 14. Python 3.6 and Node.js 8 are no longer supported.
• Docker build images for AWS now use official AWS images.
• Support for function states on AWS.

Other platforms

• Azure Functions support now Python 3.8 and Python 3.9, and Node.js 12 and 14. Python 3.6, Node.js 8, and 10 are no longer supported.
• Google Cloud Functions support now Node 12 and 14. Node 6 and 8 are no longer supported.

v1.0

The first release comes with full support for AWS Lambda, Azure Functions, and Google Cloud Functions.

Features

• Automatic build and deployment of serverless benchmarks to the cloud.
• Interface for automatic invocations with HTTP and library triggers.
• Experiments for evaluation of performance, cost, and invocation overheads.
• Python and NodeJS nchmarks are configurable with inputs of different sizes.

See our README for details on how to use SeBS.