Archived

This repository has been archived on 2024-04-10. You can view files and clone it, but you cannot make any changes to it's state, such as pushing and creating new issues, pull requests or comments.

Pradyumna Kaushik f4850a7e1d Fixed section and subsection sizes.

2018-10-03 21:41:49 -04:00

3.3 KiB

Raw Blame History

Elektron: A Pluggable Mesos framework with power-aware capabilities

Elektron is a Mesos framework that behaves as a playground for developers to experiment with different scheduling policies to schedule ad-hoc jobs in docker containers. It is designed as a lightweight, configurable framework, which can be used in conjunction with built-in power-capping policies to reduce the peak power and/or energy usage of co-scheduled tasks.

However, in addition to being a scheduler, Elektron also takes advantage of tools such as Performance Co-Pilot and RAPL to help contain the power envelope within defined thresholds, reduce peak power consumption, and also reduce total energy consumption. Elektron is able to leverage the Mesos-provided resource abstraction to allow different algorithms to decide how to consume resource offers made by a Mesos Master.

Architecture

Usage

Logging

Please go through the logging library doc to understand how the logging library has been setup. There are also instructions on how one can add additional loggers.

Data

Cluster Resource Consumption
Schedule Trace
Degree of Collocation
When scheduling policy switching enabled.

Software Requirements

Requires Performance Co-Pilot tool pmdumptext to be installed on the machine on which electron is launched for logging to work and PCP collector agents installed on the Mesos Agents

Compatible with the following versions:

Mesos 1.5.0
Go 1.9.7

Build and Run

Compile the source code using the go build tool as shown below.

go build -o elektron

How to run (Use the --help option to get information about other command-line options):

./elektron -workload <workload json>

To run electron with Scheduling Policy Switching Enabled, run the following command,

./electron -workload <workload json> -ssp -spConfig <schedPolicy config file>

Workload schema:

[
   {
      "name": "minife",
      "cpu": 3.0,
      "ram": 4096,
      "watts": 63.141,
      "class_to_watts": {
        "A": 93.062,
        "B": 65.552,
        "C": 57.897,
        "D": 60.729
      },
      "image": "rdelvalle/minife:electron1",
      "cmd": "cd src && mpirun -np 3 miniFE.x -nx 100 -ny 100 -nz 100",
      "inst": 10
   },
   {
      "name": "dgemm",
      "cpu": 3.0,
      "ram": 32,
      "watts": 85.903,
      "class_to_watts": {
        "A": 114.789,
        "B": 89.133,
        "C": 82.672,
        "D": 81.944
      },
      "image": "rdelvalle/dgemm:electron1",
      "cmd": "/./mt-dgemm 1024",
      "inst": 10
   }
]

3.3 KiB Raw Blame History