Commit graph

  • 86d91b3b5b changed the CapMargin to 70 and Window to 20 as they are the optimal ones. Pradyumna Kaushik 2017-01-06 15:56:49 -08:00
  • 3acdfd9975 Merged in maxMinAndTrace (pull request #4) Renan DelValle 2017-01-06 18:53:57 -05:00
  • 841c5e0392 Minor comments and style changes Renan DelValle 2017-01-06 18:53:03 -05:00
  • 270b5a7ee1 Fixed bug. Now watts is taken from task.ClassMapWatts[nodeClass] and not task.Watts. Changed the function signature of newTask(...) to take in another parameter called newTaskClass that corresponds to the nodeClass. Pradyumna Kaushik 2017-01-06 15:41:13 -08:00
  • 0135ee69e4 Added TODO to make the newTask(...) variadic Pradyumna Kaushik 2017-01-06 15:39:12 -08:00
  • 776bffb100 Finished bin packed max min. Renan DelValle 2017-01-04 20:25:54 -05:00
  • 2678032c2c Go fmt on the entire project Renan DelValle 2017-01-03 20:57:25 -05:00
  • b636ff490c Using anonymous and type promotion to code share more efficiently Renan DelValle 2017-01-03 20:56:55 -05:00
  • b73c30a8bf Implemented a scheduling tracer. Logs time date and host:task-ID. Made log prefix more global since it needs to be constant for all log files generated. Renan DelValle 2017-01-03 20:30:21 -05:00
  • ab9fda5513 Merged in electron_with_class (pull request #3) Renan DelValle 2017-01-03 18:13:58 -05:00
  • 3f04e4cc4c Minor fixes. Updated the README. Renan DelValle 2017-01-03 18:10:05 -05:00
  • 312728a2f6 Adding node class mapping for Watts as a resource in binpack Renan DelValle 2016-12-23 21:04:15 -05:00
  • 147bbc8b5a Fixing commit history Renan DelValle 2016-12-22 23:27:18 -05:00
  • 99dfb20efb Merged in pkDev (pull request #2) Renan DelValle 2016-12-22 15:00:31 -05:00
  • b25158336d Used the capping strategy 'proactiveclusterwidecappers' from pcp/ instead of from the same package as it was moved. Pradyumna Kaushik 2016-12-22 13:51:08 -05:00
  • 7d0a902773 Used the capping strategy 'proactiveclusterwidecappers' from pcp/ instead of from the same package as it was moved Pradyumna Kaushik 2016-12-22 13:50:37 -05:00
  • f829cfea66 Moved it to pcp/ as it is not a scheduler and is a capping strategy Pradyumna Kaushik 2016-12-22 13:49:43 -05:00
  • 71c889982f resolved merge conflicts Renan DelValle 2016-12-22 23:17:01 -05:00
  • 620c81466c Merged in pk_dev (pull request #1) Renan DelValle 2016-12-22 23:08:10 -05:00
  • 2d3b484151 Using ranked proactive cluster wide capper with clever recapping Pradyumna Kaushik 2016-12-07 01:11:30 -05:00
  • f55169c91c Fixed corner case bug with sorting of tasks. Not sorting if there are no more tasks to schedule. Pradyumna Kaushik 2016-12-01 18:31:49 -05:00
  • 57b2756fc6 Updated readme to include run command with and without ignoreWatts Pradyumna Kaushik 2016-11-30 22:05:42 -05:00
  • f548f06f2d Fixed the -p option. Changed the README for the same. Pradyumna Kaushik 2016-11-30 21:51:55 -05:00
  • 7bd562cacb synchronized operations on tasksRunning and hence, prevented previously occuring race condition. Pradyumna Kaushik 2016-11-29 23:00:03 -05:00
  • 24d2b89aa0 synchronized operations on tasksRunning and hence prevented the previously occuring race condition. Pradyumna Kaushik 2016-11-29 22:26:55 -05:00
  • 8767cc61da Added TODO to fix the -p option. Pradyumna Kaushik 2016-11-29 15:22:01 -05:00
  • 89a294b365 Removed TODO comment in ResourceOffers(...), that wasn't necessary anymore. Pradyumna Kaushik 2016-11-28 22:38:02 -05:00
  • fae3a35403 Added to TODO (generic running average computation). Pradyumna Kaushik 2016-11-28 22:29:13 -05:00
  • 795daf68a4 Added to TODO (config template per scheduler). Pradyumna Kaushik 2016-11-28 22:28:44 -05:00
  • 6289b8954d Prevented the use of reflect and instead compared the TaskIDs of the tasks. Pradyumna Kaushik 2016-11-28 20:02:03 -05:00
  • 1c8265b87b Updated comments Pradyumna Kaushik 2016-11-28 20:01:25 -05:00
  • 512918e1e8 Added explanation for StarvationThreshold. Removed TotalPower as it was embedded inside the schedulers. Pradyumna Kaushik 2016-11-28 20:00:12 -05:00
  • 50d1d79051 fixed naming convensions to be camel cased. Reformatted the code. Pradyumna Kaushik 2016-11-28 17:18:33 -05:00
  • 55ea017a9a Removed a commented line. Pradyumna Kaushik 2016-11-28 16:29:12 -05:00
  • 6ae59d4be5 Revert "Removed a comment" Pradyumna Kaushik 2016-11-25 20:21:01 -05:00
  • 2a9c0eb81a Removed a comment Pradyumna Kaushik 2016-11-25 19:32:50 -05:00
  • 6b32c9eeda Added the proactive cluster wide capping with ranked tasks scheduler to the list of schedulers. Pradyumna Kaushik 2016-11-25 18:02:21 -05:00
  • 72bd54374c Added proactive cluster wide capping with ranked tasks as another scheduler. Pradyumna Kaushik 2016-11-25 18:00:55 -05:00
  • 81d795f197 formatted the code Pradyumna Kaushik 2016-11-25 17:42:08 -05:00
  • f6ec974182 changed the keys in taskMonitor from offer.SlaveId() to offer.Hostname. Pradyumna Kaushik 2016-11-25 16:19:45 -05:00
  • a255351952 fixed bug in cleverRecap(...). Now we switch from the primitive recap to the clever recap as the cap determined by the later would be lesser when the cluster is relatively idle. Pradyumna Kaushik 2016-11-25 16:05:55 -05:00
  • 42e28d69e1 changed the hosts from stratos-00x to stratos-00x.cs.binghamton.edu Pradyumna Kaushik 2016-11-25 16:04:11 -05:00
  • 8bbecf9d5f Markdown fix in README Pradyumna Kaushik 2016-11-23 19:24:27 -05:00
  • 5329fce402 Fixed an error in markdown Pradyumna Kaushik 2016-11-23 19:20:22 -05:00
  • e5aaf2dbe9 README to list the different scheduling algorithms defined Pradyumna Kaushik 2016-11-23 19:18:56 -05:00
  • d555c37924 Made a mention to use --help option to get more information about the other command line options Pradyumna Kaushik 2016-11-23 19:18:19 -05:00
  • 1184016f8c changed the window size and capmargin to create differernt configurations. No chnage made to the code. Pradyumna Kaushik 2016-11-22 17:08:27 -05:00
  • 87e2c802dd Praoctive cluster wide capping after ranking the tasks based on the requested watts Pradyumna Kaushik 2016-11-22 17:07:08 -05:00
  • 4bc81707e0 Added another line that needs to be uncommented to choose cleverRecap. Pradyumna Kaushik 2016-11-22 17:04:30 -05:00
  • ec4f4e0f03 removed rankedDetermineCap(...) as it was not needed. This algorithm has been integrated into proactiveclusterwidecappingranked.go Pradyumna Kaushik 2016-11-22 17:02:58 -05:00
  • c1eaa453a2 Sycnrhonized operations that change the value of the cluster wide cap. Added cleverRecap(...) that determines the recap value of the cluster at a much finer level, taking into account the average load on each node in the cluster. Bug fix in cap.go -- closed the session once capping had been done. This prevented from running out of file descriptors. Pradyumna Kaushik 2016-11-17 21:51:02 -05:00
  • cd644bbf69 Formatted the code Pradyumna Kaushik 2016-11-15 15:11:00 -05:00
  • b7394b8762 formatted the code Pradyumna Kaushik 2016-11-14 22:53:06 -05:00
  • 4d13c432c4 Kept track of totalPower per node. The watts resource for the first offer corresponds to the total power per node. Removed tasks, that had all their instances scheduled, from the list of tasks to schedule. Also, calling recap(...) every time a task completes to determine the new cluster wide cap." Pradyumna Kaushik 2016-11-14 22:46:38 -05:00
  • 3551de20da The computation of the cluster wide cap now considers total power per node rather than the available power per node. Also, added function recap(...) that is called to compute the cluster wide cap once a task completes. This value is used to change the cluster wide cap once a task completes." Pradyumna Kaushik 2016-11-14 22:43:05 -05:00
  • 5dc3baab55 changed extrema to non-extrema. This was done so that proactive cluster wide capping scheme doesn't conflict with the extrema capping scheme. Pradyumna Kaushik 2016-11-14 22:42:22 -05:00
  • bbb83f4197 Added another log message to log the name of the file to which the pcplogs are getting written to. Pradyumna Kaushik 2016-11-14 22:40:31 -05:00
  • ed25adcc6c Made a check to see whether cluster wide capping has started and if not then starting the go routine that performs the cluster wide capping at regular intervals. Pradyumna Kaushik 2016-11-10 21:18:05 -05:00
  • 7b19cfb4fc fixed an error Pradyumna Kaushik 2016-11-10 21:16:57 -05:00
  • 0f8a2d3f0c fixed a an error. Pradyumna Kaushik 2016-11-10 21:16:39 -05:00
  • 58289ed90f commented out the constant Clusterwide_cap_interval and its setter function. Instead hardcoding this in proactiveclusterwidecappingfcfs.go Pradyumna Kaushik 2016-11-10 21:16:06 -05:00
  • c16e33d99d No change made. Pradyumna Kaushik 2016-11-10 20:07:04 -05:00
  • 37b918d494 Removed these files and integrated them with electron Pradyumna Kaushik 2016-11-10 20:05:48 -05:00
  • 04d6d4b631 Utility data structures and functions. Pradyumna Kaushik 2016-11-10 20:01:22 -05:00
  • 8e0ed6a014 Proactive cluster wide first come first server scheduler. This schedules tasks based on the fcfs cluster wide capping policy defined in proactiveclusterwidecappers.go Pradyumna Kaushik 2016-11-10 19:59:20 -05:00
  • c728b1f733 Proactive cluster wide capper that defines two types of schedulers. First fit scheduling, that uses running average of task.Watts to calculate the cluster wide cap, and Ranked based cluster wide capper that ranks the tasks (sorts) based on the watts required and then performs fcfs in the sorted order. Pradyumna Kaushik 2016-11-10 19:57:36 -05:00
  • d3e4914f58 Defined constants that help in scheduling of tasks. Pradyumna Kaushik 2016-11-10 19:55:28 -05:00
  • 31bbacf149 changed bingcloud to sunybingcloud in the import statements. Pradyumna Kaushik 2016-11-10 19:50:53 -05:00
  • c1fa0b1a6e changed bingcloud to sunybingcloud in the import statements. Pradyumna Kaushik 2016-11-10 19:50:40 -05:00
  • d0e37811d6 changed bingcloud to sunybingcloud in the import statements. Pradyumna Kaushik 2016-11-10 19:50:21 -05:00
  • bfbca705c8 changed bingcloud to sunybingcloud in the import statements. Pradyumna Kaushik 2016-11-10 19:50:00 -05:00
  • 6d0a3f8a90 scheduler is now an instance of ProactiveClusterwideCapFCFS Pradyumna Kaushik 2016-11-10 19:49:39 -05:00
  • 522b606165 changed bingcloud to sunybingcloud in the import statements. Pradyumna Kaushik 2016-11-10 19:48:41 -05:00
  • 0c53bb386f Added TaskID as a field. Added a function UpdateHost() to update the host on which the task runs. Added a setter for TaskID. Added a comparator called Compare() that compares to instances of Task Pradyumna Kaushik 2016-11-10 19:47:03 -05:00
  • e27912f99e fixed an error in the readme file Pradyumna Kaushik 2016-10-31 21:43:18 -04:00
  • fb2580bcad Modified readme to include commands to build and run the program and also added documentation to mention what main.go contains Pradyumna Kaushik 2016-10-31 21:41:59 -04:00
  • 353439464e Added proactive dynamic capping (FCFS and Rank based). Also added a primitive readme file. Pradyumna Kaushik 2016-10-31 21:38:40 -04:00
  • 86790133e1 Go FMT run on entire project Renan DelValle 2016-10-18 17:42:09 -04:00
  • 7c7d80b557 Minor renaming of receivers in some schedulers Renan DelValle 2016-10-18 17:39:44 -04:00
  • cf3d83e712 Finished integrating dynamic capping policy that uses a high and a low threshold to start capping and uncapping node via an ssh commands that triggers a python script. Commit has sensitive data, scrub before releasing to public. Renan DelValle 2016-10-18 17:38:49 -04:00
  • 1386049d30 rapl capping via ssh command in rapl package Renan DelValle 2016-10-18 14:56:07 -04:00
  • 254528f4f1 Initial version of command which will cap system Renan DelValle 2016-10-17 22:12:59 -04:00
  • e568dcc508 Averages are calculated correctly, PCP is able to determine a victim to be capped Renan DelValle 2016-10-17 21:31:10 -04:00
  • 39aa3cacc4 Binpacking algorithm based on 3 dimensions using a list of tasks sorted by watts Renan DelValle 2016-10-16 14:48:31 -04:00
  • 617fb8ac0f Sorting based on watts value added. bin packing based on watts is almost complete. Renan DelValle 2016-10-15 21:24:14 -04:00
  • 97002ea353 Adding First Fit Watts Only Renan DelValle 2016-10-13 17:50:54 -04:00
  • c2e2b7e554 Moved schedulers from the main programs to schedulers package. Can now choose different scheduelrs to use. Work on code sharing between schedulers remains to be done. Renan DelValle 2016-10-13 17:15:09 -04:00
  • 407c350d3c Adding some fields Renan DelValle 2016-10-07 21:05:57 -04:00
  • 5e9db05d4c Temporary blank struct for metrics Renan DelValle 2016-10-07 21:04:58 -04:00
  • 45d84f9485 formatted code Pradyumna Kaushik 2016-12-20 16:28:03 -05:00
  • 8f9b29cbcb SIGINT is now captured. Linux/MacOS shutdown for pcpdumptext child processes added to clean up after we finish running. Made all tasks run on bridged network mode so that benchmarks that heavily utilize network are protected from eachother. I.e: Tradebeans, tradesoap Renan DelValle 2016-10-07 20:47:59 -04:00
  • 373a437bae Added TODO to setup the constants at runtime. Pradyumna Kaushik 2016-12-20 16:27:44 -05:00
  • 5dd64f1e16 Added Error state. Fixed bug with tasks returning error because 0.0 watts was requested as a resource. Changed name to be more readable by eliminating electron. PCP logs can now have a prefix. Renan DelValle 2016-10-07 19:29:36 -04:00
  • 4ef038f22f updated comment Pradyumna Kaushik 2016-12-20 15:07:31 -05:00
  • 52d012a7ee Added the ability to prefix a pcplog Renan DelValle 2016-09-27 20:22:07 -04:00
  • 9b5ac0bfa8 removed unnecessary variable 'numberOfElementsInWindow' and just used window.Len() instead Pradyumna Kaushik 2016-12-20 15:03:43 -05:00
  • 23d7014cfe Adding shorthands Renan DelValle 2016-09-27 19:15:32 -04:00
  • bf6c5eded9 used the generic running average calculator Pradyumna Kaushik 2016-12-20 14:56:07 -05:00
  • c4ea0321c1 Added ability to tie benchmark to single node. Uses offer hostname for this, maybe a better soluition would be to look at offer attributes. Added shorthand for workloads flag -w Renan DelValle 2016-09-27 18:12:50 -04:00
  • f304cd295a Completed couple of TODOs and added two more. Pradyumna Kaushik 2016-12-20 14:55:46 -05:00