Skip to content

Implementation of an automated benchmarking environment for dynamic scaling solutions for Apache Spark

License

Notifications You must be signed in to change notification settings

jnsrnhld/automated-benchmarking-env

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Prototypical implementation towards automated benchmarking environment for batch processing. See the related master thesis for detailed background information.

Setup

Follow this guide to set up the software stack.

Benchmarks

To run benchmarks, adjust the benchmark definition and run the hibench playbook.

Generic Spark listener

The prototypical implementation for the generic Spark listener can be found in the listenerdirectory or in this repository.

About

Implementation of an automated benchmarking environment for dynamic scaling solutions for Apache Spark

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 87.4%
  • Shell 10.2%
  • Scala 1.5%
  • Other 0.9%