Commit graph

539 commits

Author SHA1 Message Date
Abhishek Jain
aed4fd1073 Retrofitted all schedulers to now pick the hostname from the offer and add it to constants.Hosts 2017-03-23 22:16:05 -04:00
Abhishek Jain
f85ed944f4 Changed the loop as now we are looping over a map and not a slice. 2017-03-23 22:13:29 -04:00
Abhishek Jain
710447cb0d Changed the Hosts from being a slice to a map with the key as hostname and value as a struct which would be an empty struct in order to mimic a set 2017-03-23 22:11:38 -04:00
Abhishek Jain
26c49d4098 Restoring offerUtils. Had deleted this by mistake. 2017-03-23 22:09:51 -04:00
Abhishek Jain
b311ee81f5 Changed the loop as the Hosts is now a map and not a list and now looping over the keys is required. 2017-03-23 22:03:03 -04:00
Abhishek Jain
9365c2e51d Changed the Hosts from list to a set of hosts using a map with key as hostname and value as an empty struct 2017-03-23 22:01:29 -04:00
Pradyumna Kaushik
8b7a57519b Merged in progressiveExtrema (pull request #12)
ProgressiveExtrema

Approved-by: Renan DelValle <rdelval1@binghamton.edu>
Approved-by: ajain13 <ajain13@binghamton.edu>
2017-03-18 23:56:05 +00:00
Pradyumna Kaushik
dd3019735d Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into progressiveExtrema 2017-03-18 19:54:37 -04:00
Pradyumna Kaushik
e608ce4644 Merged in newPowerClasses (pull request #14)
reclassified nodes in the cluster into 4 power classes instead of the original 3. Retrofitted the hybrid schedulers TopHeavy and BottomHeavy to comply with the change classification of nodes"

Approved-by: Renan DelValle
2017-03-14 02:09:31 +00:00
Pradyumna Kaushik
190b395bc3 fixed bug to return []float64{...} as observations rather than one value. 2017-03-13 16:44:52 -04:00
Pradyumna Kaushik
34ab753491 Used the KMeans classification to classify the tasks. 2017-03-13 16:38:53 -04:00
Pradyumna Kaushik
668ae586fe Merge branch 'newPowerClasses' of https://bitbucket.org/sunybingcloud/electron into kmeansTaskClassification 2017-03-10 17:26:39 -05:00
Pradyumna Kaushik
505ccc0471 reclassified nodes in the cluster into 4 power classes instead of the original 3. Retrofitted the hybrid schedulers TopHeavy and BottomHeavy to comply with the change classification of nodes" 2017-03-10 17:03:54 -05:00
Pradyumna Kaushik
41206dd82e refactored name of CapThreshold to LowerCapLimit. Added comment to mention that floating point operations can lead to precision loss. 2017-03-09 19:20:13 -05:00
Pradyumna Kaushik
87bd8d7cf0 Added logging when there is no victim left to cap. 2017-03-09 19:17:06 -05:00
Pradyumna Kaushik
1897678452 Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into kmeansTaskClassification 2017-02-28 15:28:49 -05:00
Pradyumna Kaushik
9eab5db2ea Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into progressiveExtrema 2017-02-28 15:28:06 -05:00
Pradyumna Kaushik
3ea500461d Merged in fixAggregateResourceCheckForBinPacking (pull request #13)
Fixed aggregate check for BinPacking. This had been broken due to a previous merge.

Approved-by: Renan DelValle
Approved-by: Pradyumna Kaushik
2017-02-28 00:04:53 +00:00
Pradyumna Kaushik
c18dd0fa70 formatted 2017-02-27 19:03:36 -05:00
Pradyumna Kaushik
ef8a315e90 fixed aggregate check for BinPacking. This had been broken due to a previous merge. 2017-02-27 18:37:53 -05:00
Pradyumna Kaushik
74eb616a72 the observation that is to be considered for the classification of a task can now be given as a function that takes the task and returns the observations as a slice of float64. Retrofitted the other functions in taskUtils to make use of this feature. 2017-02-25 19:57:01 -05:00
Pradyumna Kaushik
e54697b0dc Added a task utility to be able to cluster tasks into N clusters based on their watts resource requirements. Electron now compatible with Go1.8 and no longer with 1.7. Added TODOs. 2017-02-25 15:43:32 -05:00
Pradyumna Kaushik
9dddc38cad created a utility for tasks that allows for KMeans clustering based on watts resource requirement 2017-02-24 20:52:59 -05:00
Pradyumna Kaushik
2939943afd Made sure that the victim that is capped the most is the one picked to be uncapped. This is to reduce the chances of benchmark starvation. Refined comments and logging. 2017-02-22 20:09:04 -05:00
Pradyumna Kaushik
64de61ac4e added function to initial list of Pairs from a map[string]float64. Removed unnecessary import. 2017-02-22 20:07:48 -05:00
Pradyumna Kaushik
de4e4c0141 removed unnecessary function. 2017-02-21 22:27:08 -05:00
Pradyumna Kaushik
373ba63933 fixed bugs. Made sure that we don't cap a victim below the threshold. Made sure the victims the can be capped and uncapped are maintained in both cappedVictims and orderCappedVictims. 2017-02-21 21:05:47 -05:00
Pradyumna Kaushik
531c1a120b Fixed messages for commandline arguments. 2017-02-20 23:49:27 -05:00
Pradyumna Kaushik
7d93215a7c added TODO for a generic task sorter that sorts based on any kind of resource, instead of having a sorter for each kind of resource. 2017-02-20 22:55:56 -05:00
Pradyumna Kaushik
ef6f74cd81 removed TODO for consolidating common scheduler struct members into base.go. 2017-02-20 22:42:07 -05:00
Pradyumna Kaushik
726c0555ed Fixed corner cases in progressive extrema -- When a node is capped and the new cap value is above a threshold then that node can be capped or uncapped in the next cycle. If the new cap value is equal to the threshold then the node cannot be capped further and can only be uncapped. When the node is uncapped and the newUncapValue is below 100 then the node can be capped or uncapped in the next cycle. If the newUncapValue is 100 then the node can only be capped. 2017-02-20 20:55:06 -05:00
Pradyumna Kaushik
d42b7a3a3b changed the type of percentage in rapl.Cap(...) from int to float64. Retrofitted power-capping strategies to cap using a float64 value instead of an int. Moved common functions in loganddynamiccap.go and logAndProgressiveExtrema.go into pcp/utils.go. New power-capping strategy that builds on top of extrema, where it caps the victims at different until it can't cap further, in which case it starts uncapping them in the reverse order of capping. 2017-02-15 19:22:56 -05:00
Pradyumna Kaushik
d5d3c87ff2 added a constant called CapThreshold that defines the lower limit below which we shouldn't cap a node. 2017-02-15 19:15:18 -05:00
Pradyumna Kaushik
ccbe7a14b7 Merged in schedulerAttributesConsolidation (pull request #11)
SchedulerAttributesConsolidation

Approved-by: Renan DelValle
Approved-by: ajain13
2017-02-14 19:42:22 +00:00
Pradyumna Kaushik
d4b1a85f79 resolved merge conflict with master. Formatted file. 2017-02-11 14:27:33 -05:00
Pradyumna Kaushik
02fede7184 resolved merge conflict with master. Also, changed the name of the constructor for BPSWMaxMin from NewBPMaxMinWatts to NewBPSWMaxMinWatts 2017-02-11 14:26:27 -05:00
Pradyumna Kaushik
bff0fd2b1e Merged in classMapWattsCommandLine (pull request #10)
Adding classMapWatts as a command-line argument to make it possible to enable/disable watts to power class mapping

Approved-by: Renan DelValle
Approved-by: ajain13
2017-02-11 16:57:00 +00:00
Pradyumna Kaushik
ceff625d32 fixed formatting of function arguments for CheckFit(...) 2017-02-11 01:23:07 -05:00
Pradyumna Kaushik
6ac1b38883 Added comment to explain the classification of nodes in the cluster into power-classes. 2017-02-11 01:14:02 -05:00
Pradyumna Kaushik
13479e03a4 formatted files 2017-02-11 00:05:42 -05:00
Pradyumna Kaushik
ec78480067 renamed constants.CapMargin to constants.Tolerance for better semantics 2017-02-10 20:53:18 -05:00
Pradyumna Kaushik
ad925dfc8f Added TODO for making WattsToConsider(...) a receiver of def.Task and changing its name to Watts(...) 2017-02-10 20:28:06 -05:00
Pradyumna Kaushik
ae55790c76 removed TODO for adding the possibility of enabling and disabling classMapWatts from command-line 2017-02-10 18:11:52 -05:00
Pradyumna Kaushik
05f92bcfd2 resolved merge conflict 2017-02-10 18:02:06 -05:00
Pradyumna Kaushik
f5ddc56f27 changed the name of takeOffer(...) to takeOfferBinPack(...) and then created another function called takeOfferFirstFit(...). Made sure that these functions are called instead of inlining code. 2017-02-10 16:39:13 -05:00
Pradyumna Kaushik
1dcf416849 Resolved merge conflicts with master 2017-02-10 16:23:09 -05:00
Pradyumna Kaushik
814d16b54d added hostmismatch function to be called by all schedulers 2017-02-10 15:46:20 -05:00
Pradyumna Kaushik
a0a3e78041 Merged in hybridSchedulerAndSortedOffers (pull request #8)
Hybrid Scheduler -- TopHeavy, BottomHeavy, FirstFit and BinPacked schedulers with sortedOffers.
2017-02-10 20:21:04 +00:00
Pradyumna Kaushik
07ee19b3f8 fixed comment 2017-02-09 23:36:07 -05:00
Pradyumna Kaushik
d2f754e23b fixed comment 2017-02-09 23:35:26 -05:00