Pradyumna Kaushik
dd3019735d
Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into progressiveExtrema
2017-03-18 19:54:37 -04:00
Pradyumna Kaushik
e608ce4644
Merged in newPowerClasses (pull request #14 )
...
reclassified nodes in the cluster into 4 power classes instead of the original 3. Retrofitted the hybrid schedulers TopHeavy and BottomHeavy to comply with the change classification of nodes"
Approved-by: Renan DelValle
2017-03-14 02:09:31 +00:00
Pradyumna Kaushik
190b395bc3
fixed bug to return []float64{...} as observations rather than one value.
2017-03-13 16:44:52 -04:00
Pradyumna Kaushik
34ab753491
Used the KMeans classification to classify the tasks.
2017-03-13 16:38:53 -04:00
Pradyumna Kaushik
668ae586fe
Merge branch 'newPowerClasses' of https://bitbucket.org/sunybingcloud/electron into kmeansTaskClassification
2017-03-10 17:26:39 -05:00
Pradyumna Kaushik
505ccc0471
reclassified nodes in the cluster into 4 power classes instead of the original 3. Retrofitted the hybrid schedulers TopHeavy and BottomHeavy to comply with the change classification of nodes"
2017-03-10 17:03:54 -05:00
Pradyumna Kaushik
41206dd82e
refactored name of CapThreshold to LowerCapLimit. Added comment to mention that floating point operations can lead to precision loss.
2017-03-09 19:20:13 -05:00
Pradyumna Kaushik
87bd8d7cf0
Added logging when there is no victim left to cap.
2017-03-09 19:17:06 -05:00
Pradyumna Kaushik
1897678452
Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into kmeansTaskClassification
2017-02-28 15:28:49 -05:00
Pradyumna Kaushik
9eab5db2ea
Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into progressiveExtrema
2017-02-28 15:28:06 -05:00
Pradyumna Kaushik
3ea500461d
Merged in fixAggregateResourceCheckForBinPacking (pull request #13 )
...
Fixed aggregate check for BinPacking. This had been broken due to a previous merge.
Approved-by: Renan DelValle
Approved-by: Pradyumna Kaushik
2017-02-28 00:04:53 +00:00
Pradyumna Kaushik
c18dd0fa70
formatted
2017-02-27 19:03:36 -05:00
Pradyumna Kaushik
ef8a315e90
fixed aggregate check for BinPacking. This had been broken due to a previous merge.
2017-02-27 18:37:53 -05:00
Pradyumna Kaushik
74eb616a72
the observation that is to be considered for the classification of a task can now be given as a function that takes the task and returns the observations as a slice of float64. Retrofitted the other functions in taskUtils to make use of this feature.
2017-02-25 19:57:01 -05:00
Pradyumna Kaushik
e54697b0dc
Added a task utility to be able to cluster tasks into N clusters based on their watts resource requirements. Electron now compatible with Go1.8 and no longer with 1.7. Added TODOs.
2017-02-25 15:43:32 -05:00
Pradyumna Kaushik
9dddc38cad
created a utility for tasks that allows for KMeans clustering based on watts resource requirement
2017-02-24 20:52:59 -05:00
Pradyumna Kaushik
2939943afd
Made sure that the victim that is capped the most is the one picked to be uncapped. This is to reduce the chances of benchmark starvation. Refined comments and logging.
2017-02-22 20:09:04 -05:00
Pradyumna Kaushik
64de61ac4e
added function to initial list of Pairs from a map[string]float64. Removed unnecessary import.
2017-02-22 20:07:48 -05:00
Pradyumna Kaushik
de4e4c0141
removed unnecessary function.
2017-02-21 22:27:08 -05:00
Pradyumna Kaushik
373ba63933
fixed bugs. Made sure that we don't cap a victim below the threshold. Made sure the victims the can be capped and uncapped are maintained in both cappedVictims and orderCappedVictims.
2017-02-21 21:05:47 -05:00
Pradyumna Kaushik
531c1a120b
Fixed messages for commandline arguments.
2017-02-20 23:49:27 -05:00
Pradyumna Kaushik
7d93215a7c
added TODO for a generic task sorter that sorts based on any kind of resource, instead of having a sorter for each kind of resource.
2017-02-20 22:55:56 -05:00
Pradyumna Kaushik
ef6f74cd81
removed TODO for consolidating common scheduler struct members into base.go.
2017-02-20 22:42:07 -05:00
Pradyumna Kaushik
726c0555ed
Fixed corner cases in progressive extrema -- When a node is capped and the new cap value is above a threshold then that node can be capped or uncapped in the next cycle. If the new cap value is equal to the threshold then the node cannot be capped further and can only be uncapped. When the node is uncapped and the newUncapValue is below 100 then the node can be capped or uncapped in the next cycle. If the newUncapValue is 100 then the node can only be capped.
2017-02-20 20:55:06 -05:00
Pradyumna Kaushik
d42b7a3a3b
changed the type of percentage in rapl.Cap(...) from int to float64. Retrofitted power-capping strategies to cap using a float64 value instead of an int. Moved common functions in loganddynamiccap.go and logAndProgressiveExtrema.go into pcp/utils.go. New power-capping strategy that builds on top of extrema, where it caps the victims at different until it can't cap further, in which case it starts uncapping them in the reverse order of capping.
2017-02-15 19:22:56 -05:00
Pradyumna Kaushik
d5d3c87ff2
added a constant called CapThreshold that defines the lower limit below which we shouldn't cap a node.
2017-02-15 19:15:18 -05:00
Pradyumna Kaushik
ccbe7a14b7
Merged in schedulerAttributesConsolidation (pull request #11 )
...
SchedulerAttributesConsolidation
Approved-by: Renan DelValle
Approved-by: ajain13
2017-02-14 19:42:22 +00:00
Pradyumna Kaushik
d4b1a85f79
resolved merge conflict with master. Formatted file.
2017-02-11 14:27:33 -05:00
Pradyumna Kaushik
02fede7184
resolved merge conflict with master. Also, changed the name of the constructor for BPSWMaxMin from NewBPMaxMinWatts to NewBPSWMaxMinWatts
2017-02-11 14:26:27 -05:00
Pradyumna Kaushik
bff0fd2b1e
Merged in classMapWattsCommandLine (pull request #10 )
...
Adding classMapWatts as a command-line argument to make it possible to enable/disable watts to power class mapping
Approved-by: Renan DelValle
Approved-by: ajain13
2017-02-11 16:57:00 +00:00
Pradyumna Kaushik
ceff625d32
fixed formatting of function arguments for CheckFit(...)
2017-02-11 01:23:07 -05:00
Pradyumna Kaushik
6ac1b38883
Added comment to explain the classification of nodes in the cluster into power-classes.
2017-02-11 01:14:02 -05:00
Pradyumna Kaushik
13479e03a4
formatted files
2017-02-11 00:05:42 -05:00
Pradyumna Kaushik
ec78480067
renamed constants.CapMargin to constants.Tolerance for better semantics
2017-02-10 20:53:18 -05:00
Pradyumna Kaushik
ad925dfc8f
Added TODO for making WattsToConsider(...) a receiver of def.Task and changing its name to Watts(...)
2017-02-10 20:28:06 -05:00
Pradyumna Kaushik
ae55790c76
removed TODO for adding the possibility of enabling and disabling classMapWatts from command-line
2017-02-10 18:11:52 -05:00
Pradyumna Kaushik
05f92bcfd2
resolved merge conflict
2017-02-10 18:02:06 -05:00
Pradyumna Kaushik
f5ddc56f27
changed the name of takeOffer(...) to takeOfferBinPack(...) and then created another function called takeOfferFirstFit(...). Made sure that these functions are called instead of inlining code.
2017-02-10 16:39:13 -05:00
Pradyumna Kaushik
1dcf416849
Resolved merge conflicts with master
2017-02-10 16:23:09 -05:00
Pradyumna Kaushik
814d16b54d
added hostmismatch function to be called by all schedulers
2017-02-10 15:46:20 -05:00
Pradyumna Kaushik
a0a3e78041
Merged in hybridSchedulerAndSortedOffers (pull request #8 )
...
Hybrid Scheduler -- TopHeavy, BottomHeavy, FirstFit and BinPacked schedulers with sortedOffers.
2017-02-10 20:21:04 +00:00
Pradyumna Kaushik
07ee19b3f8
fixed comment
2017-02-09 23:36:07 -05:00
Pradyumna Kaushik
d2f754e23b
fixed comment
2017-02-09 23:35:26 -05:00
Pradyumna Kaushik
6c62b5326f
Added a HostMismatch(...) in offerUtils that checks whether a task's host requirement matches the host corresponding to the offer. Made sure all schedulers call takeOffer(...) that is defined in each scheduler, to maintain consistency.
2017-02-09 22:48:34 -05:00
Pradyumna Kaushik
aabdd716dd
Added TODO to clean up constants.go and use Mesos attributes instead.
2017-02-09 20:41:54 -05:00
Pradyumna Kaushik
9dc5bdada2
Moved all the common scheduler attributes into base.go
2017-02-09 20:27:18 -05:00
Pradyumna Kaushik
57512ac2dd
Changed ignoreWatts to wattsAsAResource. This resulted in flipping of the condition checks that use these variablees
2017-02-09 18:41:40 -05:00
Pradyumna Kaushik
fdcb401447
Made classMapWatts a commandLine option where one can enable and disable mapping of watts to powerclasses when accepting offers from Mesos. Removed the schedulers that were created solely for the classMapWatts feature. Retrofitted all schedulers to use the powerClass mapped watts attribute for a task, if classMapWatts has been enabled. Removed unnecessary functions and variables from constants.go. Removed unnecessary functions from utilities/utils.go. Fixed operator precendence issue with takeOffer(...) in some of the schedulers. Added TODO to decouple capping strategies from the schedulers completely. Added TODO to move all the common struct attributes in the schedulers into base.go.
2017-02-09 18:05:38 -05:00
Pradyumna Kaushik
a2b50dd313
Added TODO for making def.Task an interface where we can define different types of Task configuration. This increases Electron's flexivility on the workload format
2017-02-08 14:58:57 -05:00
Pradyumna Kaushik
faad66f78c
Merge branch 'master' of https://bitbucket.org/sunybingcloud/electron into classMapWattsCommandLine
2017-02-05 15:05:17 -05:00
