Archived

Elektron is a lightweight, power-aware, pluggable Mesos framework that behaves as a playground to experiment with different scheduling policies to schedule ad-hoc jobs in docker containers.

This repository has been archived on 2024-04-10. You can view files and clone it, but you cannot make any changes to it's state, such as pushing and creating new issues, pull requests or comments.

Find a file

Abhishek Jain abc718b554 Performed a git fmt		2017-03-24 16:34:17 -04:00
constants	Removed the hardcoded nodes and their powerclasses from the PowerClasses map as now it will populated dynamically	2017-03-24 16:25:24 -04:00
def	Changed the loop as now we are looping over a map and not a slice.	2017-03-23 22:13:29 -04:00
pcp	Changed the loop as now we are looping over a map and not a slice.	2017-03-23 22:13:29 -04:00
powerCapping	Changed the loop as the Hosts is now a map and not a list and now looping over the keys is required.	2017-03-23 22:03:03 -04:00
rapl	changed the type of percentage in rapl.Cap(...) from int to float64. Retrofitted power-capping strategies to cap using a float64 value instead of an int. Moved common functions in loganddynamiccap.go and logAndProgressiveExtrema.go into pcp/utils.go. New power-capping strategy that builds on top of extrema, where it caps the victims at different until it can't cap further, in which case it starts uncapping them in the reverse order of capping.	2017-02-15 19:22:56 -05:00
schedulers	Performed a git fmt	2017-03-24 16:34:17 -04:00
utilities	Performed a git fmt	2017-03-24 16:34:17 -04:00
config	basic configuration for pcp	2016-12-22 22:58:58 -05:00
README.md	Updated a TODO from the list of TODOs, changed the usage of running electron with Watts as a resource and updated the workload schema	2017-03-23 22:25:35 -04:00
scheduler.go	Fixed messages for commandline arguments.	2017-02-20 23:49:27 -05:00
workload_sample.json	Adding node class mapping for Watts as a resource in binpack	2016-12-23 21:04:15 -05:00

README.md

Electron: A power budget manager

To Do:

Create metrics for each task launched [Time to schedule, run time, power used]
Have calibration phase?
Add ability to use constraints
Running average calculations https://en.wikipedia.org/wiki/Moving_average#Exponential_moving_average
Make parameters corresponding to each scheduler configurable (possible to have a config template for each scheduler?)
TODO : Adding type of scheduler to be used, to be picked from a config file, along with it's configurable parameters.
Write test code for each scheduler (This should be after the design change)
Populate constants.PowerClasses dynamically. Possible to setup the constants at runtime based on the environment?
Log fix for declining offer -- different reason when insufficient resources as compared to when there are no longer any tasks to schedule.
Have a centralised logFile that can be filtered by identifier. All electron logs should go into this file.
Make def.Task an interface for further modularization and flexibility.
Convert def#WattsToConsider(...) to be a receiver of def.Task and change the name of it to Watts(...).
Have a generic sorter for task resources instead of having one for each kind of resource.

Requires Performance Co-Pilot tool pmdumptext to be installed on the machine on which electron is launched for logging to work and PCP collector agents installed on the Mesos Agents

How to run (Use the --help option to get information about other command-line options):

./electron -workload <workload json>

To run electron with Watts as Resource, run the following command,

./electron -workload <workload json> -wattsAsAResource

Workload schema:

[
   {
      "name": "minife",
      "cpu": 3.0,
      "ram": 4096,
      "watts": 63.141,
      "class_to_watts": {
        "A": 93.062,
        "B": 65.552,
        "C": 57.897,
        "D": 60.729
      },
      "image": "rdelvalle/minife:electron1",
      "cmd": "cd src && mpirun -np 3 miniFE.x -nx 100 -ny 100 -nz 100",
      "inst": 10
   },
   {
      "name": "dgemm",
      "cpu": 3.0,
      "ram": 32,
      "watts": 85.903,
      "class_to_watts": {
        "A": 114.789,
        "B": 89.133,
        "C": 82.672,
        "D": 81.944
      },
      "image": "rdelvalle/dgemm:electron1",
      "cmd": "/./mt-dgemm 1024",
      "inst": 10
   }
]