forked from jbarber/maui-admin-guide
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy path15.1userfeedbackloops.html
53 lines (37 loc) · 4.76 KB
/
15.1userfeedbackloops.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta name="generator" content="HTML Tidy for Linux (vers 25 March 2009), see www.w3.org">
<title></title>
</head>
<body>
<div class="sright">
<div class="sub-content-head">
Maui Scheduler
</div>
<div id="sub-content-rpt" class="sub-content-rpt">
<div class="tab-container docs" id="tab-container">
<div class="topNav">
<div class="docsSearch"></div>
<div class="navIcons topIcons">
<a href="index.html"><img src="home.png" title="Home" alt="Home" border="0"></a> <a href="15.0improvingusereffectiveness.html"><img src="upArrow.png" title="Up" alt="Up" border="0"></a> <a href="15.0improvingusereffectiveness.html"><img src="prevArrow.png" title="Previous" alt="Previous" border="0"></a> <a href="15.2userlevelstatistics.html"><img src="nextArrow.png" title="Next" alt="Next" border="0"></a>
</div>
<h1>15.1 User Feedback Loops</h1>
<p>In evaluating a given system, it is interesting to note that almost invariably, real world systems outperform simulated systems. Even when all policies, reservations, workload, and resource distributions are fully captured and emulated. What is it about real world usage that is not emulated via a simulation? The answer is the 'user feedback' loop, the impact of users making decisions to optimize their level of service based on real time information.</p>
<p>A user feedback loop is created any time information is provided to a user which modifies his job submission or job management behavior. As in a market economy, the cumulative effect of many users taking steps to improve their individual scheduling performance results in better job packing, lower queue time, and better system utilization overall. Because this behavior is beneficial to the system at large, system admins and management should encourage this behavior and provide the best possible information to them.</p>
<p>There are two primary types of information which help users make improved decisions. Cluster wide resource availability information and per job resource utilization information.</p>
<h2>15.1.1 Improving Job Size/Duration Requests</h2>
<p>Maui provides a number of informational commands which help users make improved job management decisions based on real-time cluster wide resource availability information. These commands include <a href="commands/showbf.html">showbf</a>, <a href="commands/showgrid.html">showgrid</a>, and <a href="commands/showq.html">showq</a>. Using these commands, a user can determine what resources are available, and what job configurations statistically receive the best scheduling performance.</p>
<h3>15.1.2 Improving Resource Requirement Specification</h3>
<p>A job's resource requirement specification tells the scheduler what type of compute nodes are required to run the job. These requirements may state that a certain amount of memory is required per node or that a node have a minimum processor speed. At many sites, users will determine the resource requirements needed to run an initial job. Then, for the next several years, they will use the same basic batch command file to run all of their remaining jobs even though the resource requirements of their subsequent jobs may be very different from their initial run. Users often do not update their batch command files even though these constraints may be unnecessarily limiting the resources available to their jobs for two reasons: 1) users do not know how much their performance will improve if better information were provided. 2) users do not no exactly what resources their jobs are utilizing and are afraid to lower their job's resource requirements since doing so might cause their job to fail.</p>
<p>To help with determining accurate per job resource utilization information, Maui provides the <a href="a.fparameters.html#feedbackprogram">FEEDBACKPROGRAM</a> facility. This tool allows sites to send detailed resource utilization information back to users via email, to store it in a centralized database for report preparation, or use it in other ways to help users refine their batch jobs.</p>
<div class="navIcons bottomIcons">
<a href="index.html"><img src="home.png" title="Home" alt="Home" border="0"></a> <a href="15.0improvingusereffectiveness.html"><img src="upArrow.png" title="Up" alt="Up" border="0"></a> <a href="15.0improvingusereffectiveness.html"><img src="prevArrow.png" title="Previous" alt="Previous" border="0"></a> <a href="15.2userlevelstatistics.html"><img src="nextArrow.png" title="Next" alt="Next" border="0"></a>
</div>
</div>
</div>
</div>
<div class="sub-content-btm"></div>
</div>
</body>
</html>