Child pages
  • Cluster Statistics Plugin
Skip to end of metadata
Go to start of metadata

Every now and then your Jenkins cluster will get slow for the users. Usually this happens because of the increase in utilization due to added projects, team members or added supported platforms. Then starts whining. Cluster is slow, not enough executors, long builds etc. From higher up it is difficult to assess if we need more computing power or less whining. Hence, Jenkins Cluster Statistics Plugin was conceived.

Plugin Information

View Cluster Statistics on the plugin site for more information.

The plugin will measure the time in queue, time in build and show these statistics per node. Hopefully this will give you an indication if you need to invest in more Jenkins nodes. Want more statistics? Download the data in CSV format and run your own analysis in Excel.

How to get started

Once you install the plugin and at least one of your jobs have run you will statistics under Manage Jenkins » Cluster Statistics. See the screenshot for more details.

2 Comments

  1. What exactly is the definition of timeInQueue for the CSV file?  (As a side note, why use semi-colon for a comma separated value file?)

    I have a job that is often waiting for itself . . . and the timeInQueue seems to accumulate and never reset so that after 46 hours, this job in the file will show a timeInQueue of 15 Hours, even though it just finished running 1 hour ago.

    The following is for the slave rfsw08 only . . . the timeInQueue makes not sense to me for the job rfa_rf-MPSS.DI.1.0: how can a job that just ran an hour ago have a timeInQueue of 15 Hours?

    <duration>

    <nodeName>

    <projectName>

    <started>

    <timeInQueue>

    Hours

    4133

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Wed May 01 14:59:22 PDT 2013

    0

    0.00

    2044

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Wed May 01 16:08:15 PDT 2013

    2551

    0.71

    4236

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Wed May 01 17:29:57 PDT 2013

    5953

    1.65

    2140

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Wed May 01 18:40:34 PDT 2013

    9889

    2.75

    2799

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Wed May 01 19:54:32 PDT 2013

    14028

    3.90

    2073

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Wed May 01 20:41:12 PDT 2013

    14728

    4.09

    2065

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Wed May 01 22:01:17 PDT 2013

    17732

    4.93

    2334

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Wed May 01 22:55:28 PDT 2013

    20383

    5.66

    4707

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Wed May 01 23:35:44 PDT 2013

    20999

    5.83

    4778

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 01:07:02 PDT 2013

    26177

    7.27

    1919

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 07:49:09 PDT 2013

    48504

    13.47

    1054

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 09:20:44 PDT 2013

    53699

    14.92

    1934

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 09:50:44 PDT 2013

    52199

    14.50

    2459

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 11:19:51 PDT 2013

    56646

    15.74

    5104

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 12:05:07 PDT 2013

    57263

    15.91

    953

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 13:30:13 PDT 2013

    55769

    15.49

    3262

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 13:46:06 PDT 2013

    54022

    15.01

    2884

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 14:40:29 PDT 2013

    54285

    15.08

    2093

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 15:28:34 PDT 2013

    55067

    15.30

    2168

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 16:03:27 PDT 2013

    55663

    15.46

    2054

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 16:39:36 PDT 2013

    31827

    8.84

    2891

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 17:50:55 PDT 2013

    30611

    8.50

    2307

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 18:39:06 PDT 2013

    31702

    8.81

    1149

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 19:17:34 PDT 2013

    30710

    8.53

    905

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 19:36:43 PDT 2013

    31559

    8.77

    1912

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Thu May 02 23:32:50 PDT 2013

    44826

    12.45

    5285

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Fri May 03 00:04:42 PDT 2013

    46438

    12.90

    2175

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Fri May 03 01:32:48 PDT 2013

    50523

    14.03

    2812

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Fri May 03 08:19:12 PDT 2013

    74608

    20.72

    1150

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Fri May 03 09:06:04 PDT 2013

    76520

    21.26

    849

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Fri May 03 09:25:15 PDT 2013

    77070

    21.41

    888

    rfsw08

    rfa_rf-MPSS.DI.1.0

    Fri May 03 09:45:44 PDT 2013

    77400

    21.50

    1. Sorry for the late reply. I don't get notifications about these comments. There are problems with certain queue items and the stats can be off for in queue times. Reasoning is here http://jenkins-ci.361315.n4.nabble.com/trying-to-measure-the-time-in-queue-td4659079.html#a4659350 I have not been able to get feedback to my problem but I know KK will be at one conference next week that I'm also attending. Hopefully I can find a solution there. I'll let you know.