Commit graph

  • 7666167d87 More documentation Renan DelValle 2016-09-26 19:32:25 -04:00
  • 1b821735ed fixed bug in Remove() where the currentSum and numberOfTasksInWindow weren't getting updated. Pradyumna Kaushik 2016-12-20 13:53:28 -05:00
  • 3b3e64ec47 Adding documentation for ignoreWatts Renan DelValle 2016-09-26 19:31:16 -04:00
  • 0503e2ab56 Added option to run without taking watts Renan DelValle 2016-09-26 19:29:30 -04:00
  • cd430eede0 PCP is now controlled by main scheduler. It will start recording upon the acceptance of the very first offer. pcp is now it's own package. README has been updated with instructions on how to create workloads and running instructions. Renan DelValle 2016-09-26 19:14:51 -04:00
  • 3801fbd7d6 Detection of co-scheduled benchmarks is complete Renan DelValle 2016-09-22 20:20:22 -04:00
  • 4e2a1d99fd Tied metric columns to values, next step will be determining how to store them and retrieve them Renan DelValle 2016-09-22 19:54:06 -04:00
  • 58c6bfe7a8 PCP code is now able to deal with receiving information asynchronously from pmdumptext Renan DelValle 2016-09-22 18:34:05 -04:00
  • 992455048a Fixed deadlock issue while running a large number of benchmarks. Changed names of tasks to indicate what they are running. Added name to task schema to append it to the name more easily. Renan DelValle 2016-09-19 20:25:10 -04:00
  • 512e0e7b5c Bug fix for running multiple different benchmarks. Loop did not exit upon being able to take an offer. Renan DelValle 2016-09-19 17:51:32 -04:00
  • 6e2a627038 Electron now launches a series of benchmarks and then shuts down when everything has been sucessfully scheduled Renan DelValle 2016-09-17 18:55:35 -04:00
  • 6de14f2e23 Merge branch 'master' of bitbucket.org:bingcloud/electron Renan DelValle 2016-09-16 19:07:12 -04:00
  • bc5e959ade Scheduler now has a first fit algorithm based on memory, cpu, and watts. Watts need to be set by the user but should be calculated through heuristics. Framework now also works by having a set of tasks and launching them. Renan DelValle 2016-09-16 19:06:53 -04:00
  • 8034222d1e making filenames more dynamic Gourav 2016-09-16 21:37:23 +00:00
  • 6b76e45d6d Changing tagline Renan DelValle 2016-09-16 16:18:59 -04:00
  • 34a0b0aef9 README.md edited online with Bitbucket Renan DelValle 2016-09-16 20:17:46 +00:00
  • 08de958da2 README.md edited online with Bitbucket Renan DelValle 2016-09-16 20:17:08 +00:00
  • 54b69f35e3 Adding formatting to README Renan DelValle 2016-09-16 16:16:33 -04:00
  • 150b1fa350 Adding todo to README Renan DelValle 2016-09-16 16:14:41 -04:00
  • 9097564b0b basic configuration for pcp Gourav 2016-09-16 20:04:26 +00:00
  • 2db3ecbf0b initial pcp logging script Gourav 2016-09-16 20:03:36 +00:00
  • 66fcf8fd8e Removed sleeps that were causing framework to hang. Renan DelValle 2016-09-15 16:31:23 -04:00
  • 9af4e60189 Moving states into scheduler Renan DelValle 2016-09-15 16:13:31 -04:00
  • ddf1d86da1 Framework is now able to sucessfully launch a docker task Renan DelValle 2016-09-15 15:53:56 -04:00
  • 0e7832e55a Removing uncessary xml file Renan DelValle 2016-09-10 18:41:53 -04:00
  • 62961d27d3 Adding helper functions from RENDLER Renan DelValle 2016-09-10 18:40:56 -04:00
  • 120a13432c Initial transformation from RENDLER to electron Renan DelValle 2016-09-08 02:06:24 -04:00
  • 2e4e52df79 First commit Renan DelValle 2016-09-05 01:20:33 -04:00
  • e0a16da97a Added functionality to be able to remove elements from the window by providing a unique ID. Also, added another function to the interface that needs to be implemented by all the structs implementing this interface. This function should return a unique ID identifying the object so as to be able to distinguish between multiple instances of the same type. Pradyumna Kaushik 2016-12-19 20:43:25 -05:00
  • bd3802ddfd Made change to TODO Pradyumna Kaushik 2016-12-19 16:46:52 -05:00
  • 7aea52991b TODO to add another functionality to the runAvg interface to be able to remove element from the window based on a criteria. Pradyumna Kaushik 2016-12-19 16:46:02 -05:00
  • 822ef0067c Removed TODO for creating generic running average calculator. Added TODO to use the generic running average calculator in proactiveclusterwidecappers.go Pradyumna Kaushik 2016-12-19 16:31:55 -05:00
  • 59b8303aaf Generic running average calculator. Pradyumna Kaushik 2016-12-19 16:30:03 -05:00
  • 1321010d6f Changed comment. The utility can be used to sort any map[string]float64 by value, and not just availablePower. Pradyumna Kaushik 2016-12-18 14:31:37 -05:00
  • 63a7f0acb5 Moved the check for fitting tasks into a different function. Pradyumna Kaushik 2016-12-18 14:30:29 -05:00
  • 2e0ec0cc99 Added Piston Capper to the list of schedulers Pradyumna Kaushik 2016-12-18 14:30:04 -05:00
  • c493bd066e used sort interface instead of the quickSort algorithm to sort tasks in ascending order of watts. Pradyumna Kaushik 2016-12-16 15:52:47 -05:00
  • d69c5006ed removed quickSort algorithm to sort tasks. We can do this using the sort interface Pradyumna Kaushik 2016-12-16 15:52:14 -05:00
  • 6ae5cd0cdd removed unnecessary import Pradyumna Kaushik 2016-12-16 15:51:34 -05:00
  • bfcb254f23 formatted the code Pradyumna Kaushik 2016-12-16 15:49:30 -05:00
  • 16e25cea0f removed the explanation of ignoreWatts Pradyumna Kaushik 2016-12-15 15:40:23 -05:00
  • aeabaa7ce0 formatted Pradyumna Kaushik 2016-12-15 15:38:51 -05:00
  • 7c488d451b formatted Pradyumna Kaushik 2016-12-15 15:38:07 -05:00
  • b5566c6719 Added a note to the command to run without ignoreWatts, to mention that Watts becomes a hard limit when not ignored. Pradyumna Kaushik 2016-12-15 15:37:31 -05:00
  • a07806f570 Checked for task fitting watts requirement considering watts to be a hard limit. Pradyumna Kaushik 2016-12-15 15:33:47 -05:00
  • 236be222cd Logging of capping happens only when there is no error with rapl.Cap. Pradyumna Kaushik 2016-12-15 14:39:06 -05:00
  • d9357f59e7 New scheduler. BinPacking with capping each node to different values (piston capping). Pradyumna Kaushik 2016-12-15 14:32:34 -05:00
  • a6dcda04c8 Panic when few tasks are present and hence added a TODO to test each scheduler for corner cases Pradyumna Kaushik 2016-12-15 14:31:35 -05:00
  • de4df8ba7b switched scheduler to now be an instance of PistonCapper. Pradyumna Kaushik 2016-12-15 14:30:43 -05:00
  • 54a55ec523 Nit: Changed variable name 'runningAverageToTotalPowerPercentage' to 'ratios' Pradyumna Kaushik 2016-12-07 18:47:37 -05:00
  • b0140a8b93 Using ranked proactive cluster wide capper with clever recapping Pradyumna Kaushik 2016-12-07 01:11:30 -05:00
  • ef839c530d Fixed corner case bug with sorting of tasks. Not sorting if there are no more tasks to schedule. Pradyumna Kaushik 2016-12-01 18:31:49 -05:00
  • 3e1fe71459 Updated readme to include run command with and without ignoreWatts Pradyumna Kaushik 2016-11-30 22:05:42 -05:00
  • 7f59bc4b68 Fixed the -p option. Changed the README for the same. Pradyumna Kaushik 2016-11-30 21:51:55 -05:00
  • 6c29f2c5a4 synchronized operations on tasksRunning and hence, prevented previously occuring race condition. Pradyumna Kaushik 2016-11-29 23:00:03 -05:00
  • 395e8e3e3d synchronized operations on tasksRunning and hence prevented the previously occuring race condition. Pradyumna Kaushik 2016-11-29 22:26:55 -05:00
  • b8c33b25b4 Added TODO to fix the -p option. Pradyumna Kaushik 2016-11-29 15:22:01 -05:00
  • 8eda0c68b1 Removed TODO comment in ResourceOffers(...), that wasn't necessary anymore. Pradyumna Kaushik 2016-11-28 22:38:02 -05:00
  • 7f5d9c58a3 Added to TODO (generic running average computation). Pradyumna Kaushik 2016-11-28 22:29:13 -05:00
  • 979b0ab9a9 Added to TODO (config template per scheduler). Pradyumna Kaushik 2016-11-28 22:28:44 -05:00
  • e4bf4d3727 Prevented the use of reflect and instead compared the TaskIDs of the tasks. Pradyumna Kaushik 2016-11-28 20:02:03 -05:00
  • f99fce77cb Updated comments Pradyumna Kaushik 2016-11-28 20:01:25 -05:00
  • 785de5bafb Added explanation for StarvationThreshold. Removed TotalPower as it was embedded inside the schedulers. Pradyumna Kaushik 2016-11-28 20:00:12 -05:00
  • 6aa849bbe7 fixed naming convensions to be camel cased. Reformatted the code. Pradyumna Kaushik 2016-11-28 17:18:33 -05:00
  • 978d51135b Removed a commented line. Pradyumna Kaushik 2016-11-28 16:29:12 -05:00
  • 262b13e6b7 Revert "Removed a comment" Pradyumna Kaushik 2016-11-25 20:21:01 -05:00
  • 7ef10e6310 Removed a comment Pradyumna Kaushik 2016-11-25 19:32:50 -05:00
  • f606610232 Added the proactive cluster wide capping with ranked tasks scheduler to the list of schedulers. Pradyumna Kaushik 2016-11-25 18:02:21 -05:00
  • f67773dcde Added proactive cluster wide capping with ranked tasks as another scheduler. Pradyumna Kaushik 2016-11-25 18:00:55 -05:00
  • 892d9b86dc formatted the code Pradyumna Kaushik 2016-11-25 17:42:08 -05:00
  • 948e00bfeb changed the keys in taskMonitor from offer.SlaveId() to offer.Hostname. Pradyumna Kaushik 2016-11-25 16:19:45 -05:00
  • 7bea56206b fixed bug in cleverRecap(...). Now we switch from the primitive recap to the clever recap as the cap determined by the later would be lesser when the cluster is relatively idle. Pradyumna Kaushik 2016-11-25 16:05:55 -05:00
  • 43c173c60b changed the hosts from stratos-00x to stratos-00x.cs.binghamton.edu Pradyumna Kaushik 2016-11-25 16:04:11 -05:00
  • 44d355523b Markdown fix in README Pradyumna Kaushik 2016-11-23 19:24:27 -05:00
  • 5f32074c4c Fixed an error in markdown Pradyumna Kaushik 2016-11-23 19:20:22 -05:00
  • abdfef2044 README to list the different scheduling algorithms defined Pradyumna Kaushik 2016-11-23 19:18:56 -05:00
  • cceedad1f0 Made a mention to use --help option to get more information about the other command line options Pradyumna Kaushik 2016-11-23 19:18:19 -05:00
  • e8db162820 changed the window size and capmargin to create differernt configurations. No chnage made to the code. Pradyumna Kaushik 2016-11-22 17:08:27 -05:00
  • d7a5b10057 Praoctive cluster wide capping after ranking the tasks based on the requested watts Pradyumna Kaushik 2016-11-22 17:07:08 -05:00
  • 6c858c4e88 Added another line that needs to be uncommented to choose cleverRecap. Pradyumna Kaushik 2016-11-22 17:04:30 -05:00
  • a158f4a341 removed rankedDetermineCap(...) as it was not needed. This algorithm has been integrated into proactiveclusterwidecappingranked.go Pradyumna Kaushik 2016-11-22 17:02:58 -05:00
  • 3f90ccfe74 Sycnrhonized operations that change the value of the cluster wide cap. Added cleverRecap(...) that determines the recap value of the cluster at a much finer level, taking into account the average load on each node in the cluster. Bug fix in cap.go -- closed the session once capping had been done. This prevented from running out of file descriptors. Pradyumna Kaushik 2016-11-17 21:51:02 -05:00
  • e562df0f5c Formatted the code Pradyumna Kaushik 2016-11-15 15:11:00 -05:00
  • 7522cf9879 formatted the code Pradyumna Kaushik 2016-11-14 22:53:06 -05:00
  • 4cc1dd8e63 Kept track of totalPower per node. The watts resource for the first offer corresponds to the total power per node. Removed tasks, that had all their instances scheduled, from the list of tasks to schedule. Also, calling recap(...) every time a task completes to determine the new cluster wide cap." Pradyumna Kaushik 2016-11-14 22:46:38 -05:00
  • 7a69aff8d7 The computation of the cluster wide cap now considers total power per node rather than the available power per node. Also, added function recap(...) that is called to compute the cluster wide cap once a task completes. This value is used to change the cluster wide cap once a task completes." Pradyumna Kaushik 2016-11-14 22:43:05 -05:00
  • a1c8319b81 changed extrema to non-extrema. This was done so that proactive cluster wide capping scheme doesn't conflict with the extrema capping scheme. Pradyumna Kaushik 2016-11-14 22:42:22 -05:00
  • 79a5dca76b Added another log message to log the name of the file to which the pcplogs are getting written to. Pradyumna Kaushik 2016-11-14 22:40:31 -05:00
  • a9f7ca5c91 Made a check to see whether cluster wide capping has started and if not then starting the go routine that performs the cluster wide capping at regular intervals. Pradyumna Kaushik 2016-11-10 21:18:05 -05:00
  • 8a6ad00e21 fixed an error Pradyumna Kaushik 2016-11-10 21:16:57 -05:00
  • c44088f48b fixed a an error. Pradyumna Kaushik 2016-11-10 21:16:39 -05:00
  • 2382b66e29 commented out the constant Clusterwide_cap_interval and its setter function. Instead hardcoding this in proactiveclusterwidecappingfcfs.go Pradyumna Kaushik 2016-11-10 21:16:06 -05:00
  • 04864ca174 No change made. Pradyumna Kaushik 2016-11-10 20:07:04 -05:00
  • 46afab1be0 Removed these files and integrated them with electron Pradyumna Kaushik 2016-11-10 20:05:48 -05:00
  • 0d6b714e1d Utility data structures and functions. Pradyumna Kaushik 2016-11-10 20:01:22 -05:00
  • 8d032f9547 Proactive cluster wide first come first server scheduler. This schedules tasks based on the fcfs cluster wide capping policy defined in proactiveclusterwidecappers.go Pradyumna Kaushik 2016-11-10 19:59:20 -05:00
  • d8710385be Proactive cluster wide capper that defines two types of schedulers. First fit scheduling, that uses running average of task.Watts to calculate the cluster wide cap, and Ranked based cluster wide capper that ranks the tasks (sorts) based on the watts required and then performs fcfs in the sorted order. Pradyumna Kaushik 2016-11-10 19:57:36 -05:00
  • 10824a8520 Defined constants that help in scheduling of tasks. Pradyumna Kaushik 2016-11-10 19:55:28 -05:00
  • c578f9904d changed bingcloud to sunybingcloud in the import statements. Pradyumna Kaushik 2016-11-10 19:50:53 -05:00
  • 6c3f48e324 changed bingcloud to sunybingcloud in the import statements. Pradyumna Kaushik 2016-11-10 19:50:40 -05:00