spdf/elektron
Archived
1
0
Fork 0
Code Issues 4 Pull requests 1 Projects Releases Packages Wiki Activity
527 commits 4 branches 0 tags 2.4 MiB
Commit graph

527 commits

This branch
This branch
All branches
Author SHA1 Message Date
Pradyumna Kaushik
505ccc0471 reclassified nodes in the cluster into 4 power classes instead of the original 3. Retrofitted the hybrid schedulers TopHeavy and BottomHeavy to comply with the change classification of nodes" 2017-03-10 17:03:54 -05:00
Pradyumna Kaushik
41206dd82e refactored name of CapThreshold to LowerCapLimit. Added comment to mention that floating point operations can lead to precision loss. 2017-03-09 19:20:13 -05:00
Pradyumna Kaushik
87bd8d7cf0 Added logging when there is no victim left to cap. 2017-03-09 19:17:06 -05:00
Pradyumna Kaushik
1897678452 Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into kmeansTaskClassification 2017-02-28 15:28:49 -05:00
Pradyumna Kaushik
9eab5db2ea Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into progressiveExtrema 2017-02-28 15:28:06 -05:00
Pradyumna Kaushik
3ea500461d Merged in fixAggregateResourceCheckForBinPacking (pull request #13) 
Fixed aggregate check for BinPacking. This had been broken due to a previous merge.

Approved-by: Renan DelValle
Approved-by: Pradyumna Kaushik
 2017-02-28 00:04:53 +00:00
Pradyumna Kaushik
c18dd0fa70 formatted 2017-02-27 19:03:36 -05:00
Pradyumna Kaushik
ef8a315e90 fixed aggregate check for BinPacking. This had been broken due to a previous merge. 2017-02-27 18:37:53 -05:00
Pradyumna Kaushik
74eb616a72 the observation that is to be considered for the classification of a task can now be given as a function that takes the task and returns the observations as a slice of float64. Retrofitted the other functions in taskUtils to make use of this feature. 2017-02-25 19:57:01 -05:00
Pradyumna Kaushik
e54697b0dc Added a task utility to be able to cluster tasks into N clusters based on their watts resource requirements. Electron now compatible with Go1.8 and no longer with 1.7. Added TODOs. 2017-02-25 15:43:32 -05:00
Pradyumna Kaushik
9dddc38cad created a utility for tasks that allows for KMeans clustering based on watts resource requirement 2017-02-24 20:52:59 -05:00
Pradyumna Kaushik
2939943afd Made sure that the victim that is capped the most is the one picked to be uncapped. This is to reduce the chances of benchmark starvation. Refined comments and logging. 2017-02-22 20:09:04 -05:00
Pradyumna Kaushik
64de61ac4e added function to initial list of Pairs from a map[string]float64. Removed unnecessary import. 2017-02-22 20:07:48 -05:00
Pradyumna Kaushik
de4e4c0141 removed unnecessary function. 2017-02-21 22:27:08 -05:00
Pradyumna Kaushik
373ba63933 fixed bugs. Made sure that we don't cap a victim below the threshold. Made sure the victims the can be capped and uncapped are maintained in both cappedVictims and orderCappedVictims. 2017-02-21 21:05:47 -05:00
Pradyumna Kaushik
531c1a120b Fixed messages for commandline arguments. 2017-02-20 23:49:27 -05:00
Pradyumna Kaushik
7d93215a7c added TODO for a generic task sorter that sorts based on any kind of resource, instead of having a sorter for each kind of resource. 2017-02-20 22:55:56 -05:00
Pradyumna Kaushik
ef6f74cd81 removed TODO for consolidating common scheduler struct members into base.go. 2017-02-20 22:42:07 -05:00
Pradyumna Kaushik
726c0555ed Fixed corner cases in progressive extrema -- When a node is capped and the new cap value is above a threshold then that node can be capped or uncapped in the next cycle. If the new cap value is equal to the threshold then the node cannot be capped further and can only be uncapped. When the node is uncapped and the newUncapValue is below 100 then the node can be capped or uncapped in the next cycle. If the newUncapValue is 100 then the node can only be capped. 2017-02-20 20:55:06 -05:00
Pradyumna Kaushik
d42b7a3a3b changed the type of percentage in rapl.Cap(...) from int to float64. Retrofitted power-capping strategies to cap using a float64 value instead of an int. Moved common functions in loganddynamiccap.go and logAndProgressiveExtrema.go into pcp/utils.go. New power-capping strategy that builds on top of extrema, where it caps the victims at different until it can't cap further, in which case it starts uncapping them in the reverse order of capping. 2017-02-15 19:22:56 -05:00
Pradyumna Kaushik
d5d3c87ff2 added a constant called CapThreshold that defines the lower limit below which we shouldn't cap a node. 2017-02-15 19:15:18 -05:00
Pradyumna Kaushik
ccbe7a14b7 Merged in schedulerAttributesConsolidation (pull request #11) 
SchedulerAttributesConsolidation

Approved-by: Renan DelValle
Approved-by: ajain13
 2017-02-14 19:42:22 +00:00
Pradyumna Kaushik
d4b1a85f79 resolved merge conflict with master. Formatted file. 2017-02-11 14:27:33 -05:00
Pradyumna Kaushik
02fede7184 resolved merge conflict with master. Also, changed the name of the constructor for BPSWMaxMin from NewBPMaxMinWatts to NewBPSWMaxMinWatts 2017-02-11 14:26:27 -05:00
Pradyumna Kaushik
bff0fd2b1e Merged in classMapWattsCommandLine (pull request #10) 
Adding classMapWatts as a command-line argument to make it possible to enable/disable watts to power class mapping

Approved-by: Renan DelValle
Approved-by: ajain13
 2017-02-11 16:57:00 +00:00
Pradyumna Kaushik
ceff625d32 fixed formatting of function arguments for CheckFit(...) 2017-02-11 01:23:07 -05:00
Pradyumna Kaushik
6ac1b38883 Added comment to explain the classification of nodes in the cluster into power-classes. 2017-02-11 01:14:02 -05:00
Pradyumna Kaushik
13479e03a4 formatted files 2017-02-11 00:05:42 -05:00
Pradyumna Kaushik
ec78480067 renamed constants.CapMargin to constants.Tolerance for better semantics 2017-02-10 20:53:18 -05:00
Pradyumna Kaushik
ad925dfc8f Added TODO for making WattsToConsider(...) a receiver of def.Task and changing its name to Watts(...) 2017-02-10 20:28:06 -05:00
Pradyumna Kaushik
ae55790c76 removed TODO for adding the possibility of enabling and disabling classMapWatts from command-line 2017-02-10 18:11:52 -05:00
Pradyumna Kaushik
05f92bcfd2 resolved merge conflict 2017-02-10 18:02:06 -05:00
Pradyumna Kaushik
f5ddc56f27 changed the name of takeOffer(...) to takeOfferBinPack(...) and then created another function called takeOfferFirstFit(...). Made sure that these functions are called instead of inlining code. 2017-02-10 16:39:13 -05:00
Pradyumna Kaushik
1dcf416849 Resolved merge conflicts with master 2017-02-10 16:23:09 -05:00
Pradyumna Kaushik
814d16b54d added hostmismatch function to be called by all schedulers 2017-02-10 15:46:20 -05:00
Pradyumna Kaushik
a0a3e78041 Merged in hybridSchedulerAndSortedOffers (pull request #8) 
Hybrid Scheduler -- TopHeavy, BottomHeavy, FirstFit and BinPacked schedulers with sortedOffers.
 2017-02-10 20:21:04 +00:00
Pradyumna Kaushik
07ee19b3f8 fixed comment 2017-02-09 23:36:07 -05:00
Pradyumna Kaushik
d2f754e23b fixed comment 2017-02-09 23:35:26 -05:00
Pradyumna Kaushik
6c62b5326f Added a HostMismatch(...) in offerUtils that checks whether a task's host requirement matches the host corresponding to the offer. Made sure all schedulers call takeOffer(...) that is defined in each scheduler, to maintain consistency. 2017-02-09 22:48:34 -05:00
Pradyumna Kaushik
aabdd716dd Added TODO to clean up constants.go and use Mesos attributes instead. 2017-02-09 20:41:54 -05:00
Pradyumna Kaushik
9dc5bdada2 Moved all the common scheduler attributes into base.go 2017-02-09 20:27:18 -05:00
Pradyumna Kaushik
57512ac2dd Changed ignoreWatts to wattsAsAResource. This resulted in flipping of the condition checks that use these variablees 2017-02-09 18:41:40 -05:00
Pradyumna Kaushik
fdcb401447 Made classMapWatts a commandLine option where one can enable and disable mapping of watts to powerclasses when accepting offers from Mesos. Removed the schedulers that were created solely for the classMapWatts feature. Retrofitted all schedulers to use the powerClass mapped watts attribute for a task, if classMapWatts has been enabled. Removed unnecessary functions and variables from constants.go. Removed unnecessary functions from utilities/utils.go. Fixed operator precendence issue with takeOffer(...) in some of the schedulers. Added TODO to decouple capping strategies from the schedulers completely. Added TODO to move all the common struct attributes in the schedulers into base.go. 2017-02-09 18:05:38 -05:00
Pradyumna Kaushik
a2b50dd313 Added TODO for making def.Task an interface where we can define different types of Task configuration. This increases Electron's flexivility on the workload format 2017-02-08 14:58:57 -05:00
Pradyumna Kaushik
faad66f78c Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into classMapWattsCommandLine 2017-02-05 15:05:17 -05:00
Pradyumna Kaushik
0d79079bf6 changed scheduler to binPacked 2017-02-05 14:59:34 -05:00
Pradyumna Kaushik
77de99fd95 Merged in dram-extrema (pull request #9) 
Adding DRAM monitoring to Extrema.

Approved-by: Pradyumna Kaushik
 2017-02-05 19:58:36 +00:00
Renan DelValle
12efaedaa9 Style and naming fixes. 2017-02-05 14:54:15 -05:00
Pradyumna Kaushik
b838c53c6d added CPUSorter to task to be able to sort tasks based on CPU requirement. 2017-02-05 14:49:07 -05:00
Pradyumna Kaushik
395917a97e changed pcplogger to pcplog and extrema 2017-02-05 01:08:48 -05:00