Project

General

Profile

Analysing performance issues

Carl Hasselskog
Added almost 5 years ago

Hi,

We are currently having some performance issues with our Tigase installation. At least that is what I think it is. The only thing I know for sure that our clients (running Smack) sometimes gets an empty list of roster entries even if the client has roster entries stored. This leads me to believe that some packets are being dropped.

We haven't done any performance analysis of the installation before so I'm guessing that this is caused by some low hanging fruit that is relatively easy to fix once it has been identified. Unfortunately I don't exactly how to parse the stats provided by the server (see below). I noticed a couple of things that struck me as suspicious:

sess-man/OUT_QUEUE IQ error = 8118

sess-man/Authentication timouts = 174641

How do I go from here? What do you think is wrong?

<iq from="stats@REMOVED" type="result" id="ab78a" to="admin@REMOVED/pc3">
<command xmlns="http://jabber.org/protocol/commands" status="executing" node="stats">
<x xmlns="jabber:x:data" type="form">
<field var="vhost-man/Number of VHosts">
<value>2</value>
</field>
<field var="vhost-man/Checks: is local domain">
<value>161712754</value>
</field>
<field var="vhost-man/Checks: is anonymous domain">
<value>0</value>
</field>
<field var="vhost-man/Get components for local domain">
<value>24431806</value>
</field>
<field var="vhost-man/Get components for non-local domain">
<value>0</value>
</field>
<field var="message-router/Last second packets">
<value>599</value>
</field>
<field var="message-router/Last minute packets">
<value>13612</value>
</field>
<field var="message-router/Last hour packets">
<value>464183</value>
</field>
<field var="message-router/Processing threads">
<value>8</value>
</field>
<field var="message-router/Packets received">
<value>72623789</value>
</field>
<field var="message-router/Packets sent">
<value>129</value>
</field>
<field var="message-router/In queue: SYSTEM">
<value>0</value>
</field>
<field var="message-router/In queue: CLUSTER">
<value>0</value>
</field>
<field var="message-router/In queue: HIGH">
<value>0</value>
</field>
<field var="message-router/In queue: NORMAL">
<value>0</value>
</field>
<field var="message-router/In queue: LOW">
<value>0</value>
</field>
<field var="message-router/In queue: PRESENCE">
<value>0</value>
</field>
<field var="message-router/In queue: LOWEST">
<value>0</value>
</field>
<field var="message-router/Out queue: SYSTEM">
<value>0</value>
</field>
<field var="message-router/Out queue: CLUSTER">
<value>0</value>
</field>
<field var="message-router/Out queue: HIGH">
<value>0</value>
</field>
<field var="message-router/Out queue: NORMAL">
<value>0</value>
</field>
<field var="message-router/Out queue: LOW">
<value>0</value>
</field>
<field var="message-router/Out queue: PRESENCE">
<value>0</value>
</field>
<field var="message-router/Out queue: LOWEST">
<value>0</value>
</field>
<field var="message-router/Total In queues wait">
<value>0</value>
</field>
<field var="message-router/Total Out queues wait">
<value>0</value>
</field>
<field var="message-router/Total queues wait">
<value>0</value>
</field>
<field var="message-router/Max queue size">
<value>321232</value>
</field>
<field var="message-router/IN Queue overflow">
<value>0</value>
</field>
<field var="message-router/OUT Queue overflow">
<value>0</value>
</field>
<field var="message-router/Total queues overflow">
<value>0</value>
</field>
<field var="message-router/Average processing time on last 100 runs [ms]">
<value>0</value>
</field>
<field var="message-router/IN_QUEUE messages">
<value>1545266</value>
</field>
<field var="message-router/IN_QUEUE presences">
<value>27839249</value>
</field>
<field var="message-router/IN_QUEUE cluster">
<value>0</value>
</field>
<field var="message-router/IN_QUEUE other">
<value>43242024</value>
</field>
<field var="message-router/IN_QUEUE IQ no XMLNS">
<value>10806428</value>
</field>
<field var="message-router/IN_QUEUE IQ jingle">
<value>1904278</value>
</field>
<field var="message-router/IN_QUEUE IQ bind">
<value>2536</value>
</field>
<field var="message-router/IN_QUEUE IQ session">
<value>1268</value>
</field>
<field var="message-router/IN_QUEUE IQ jabber:iq:roster">
<value>1734760</value>
</field>
<field var="message-router/IN_QUEUE IQ command">
<value>13962717</value>
</field>
<field var="message-router/IN_QUEUE IQ vCard">
<value>10</value>
</field>
<field var="message-router/IN_QUEUE IQ http://jabber.org/protocol/disco#info">
<value>353</value>
</field>
<field var="message-router/IN_QUEUE IQ http://jabber.org/protocol/disco#items">
<value>63</value>
</field>
<field var="message-router/IN_QUEUE IQ ping">
<value>10082931</value>
</field>
<field var="message-router/IN_QUEUE IQ jabber:iq:register">
<value>3186</value>
</field>
<field var="message-router/IN_QUEUE IQ degoo-roster-notifications">
<value>4444974</value>
</field>
<field var="message-router/IN_QUEUE IQ jabber:iq:private">
<value>10</value>
</field>
<field var="message-router/IN_QUEUE IQ error">
<value>8126</value>
</field>
<field var="message-router/IN_QUEUE IQ jabber:iq:auth">
<value>288025</value>
</field>
<field var="message-router/IN_QUEUE IQ">
<value>43239665</value>
</field>
<field var="message-router/OUT_QUEUE messages">
<value>0</value>
</field>
<field var="message-router/OUT_QUEUE presences">
<value>0</value>
</field>
<field var="message-router/OUT_QUEUE cluster">
<value>0</value>
</field>
<field var="message-router/OUT_QUEUE other">
<value>129</value>
</field>
<field var="message-router/OUT_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="message-router/OUT_QUEUE IQ command">
<value>31</value>
</field>
<field var="message-router/OUT_QUEUE IQ http://jabber.org/protocol/disco#info">
<value>83</value>
</field>
<field var="message-router/OUT_QUEUE IQ http://jabber.org/protocol/disco#items">
<value>15</value>
</field>
<field var="message-router/OUT_QUEUE IQ">
<value>129</value>
</field>
<field var="message-router/Processed packets in_0-message-router">
<value>7725739</value>
</field>
<field var="message-router/Processed packets in_1-message-router">
<value>9087063</value>
</field>
<field var="message-router/Processed packets in_2-message-router">
<value>7369618</value>
</field>
<field var="message-router/Processed packets in_3-message-router">
<value>13169098</value>
</field>
<field var="message-router/Processed packets in_4-message-router">
<value>7637868</value>
</field>
<field var="message-router/Processed packets in_5-message-router">
<value>7298366</value>
</field>
<field var="message-router/Processed packets in_6-message-router">
<value>12840462</value>
</field>
<field var="message-router/Processed packets in_7-message-router">
<value>7499971</value>
</field>
<field var="message-router/Processed packets out_0-message-router">
<value>129</value>
</field>
<field var="message-router/Local hostname">
<value>REMOVED</value>
</field>
<field var="message-router/Uptime">
<value>40 days, 1 hour</value>
</field>
<field var="message-router/Load average">
<value>0.51</value>
</field>
<field var="message-router/CPUs no">
<value>2</value>
</field>
<field var="message-router/Threads count">
<value>262</value>
</field>
<field var="message-router/CPU usage [%]">
<value>18.753874</value>
</field>
<field var="message-router/HEAP usage [%]">
<value>13.389919</value>
</field>
<field var="message-router/NONHEAP usage [%]">
<value>24.07515</value>
</field>
<field var="message-router/CPU usage">
<value>18.8%</value>
</field>
<field var="message-router/Max Heap mem">
<value>6,274,432 KB</value>
</field>
<field var="message-router/Used Heap">
<value>868,544 KB</value>
</field>
<field var="message-router/Free Heap">
<value>5,405,887 KB</value>
</field>
<field var="message-router/Max NonHeap mem">
<value>311,296 KB</value>
</field>
<field var="message-router/Used NonHeap">
<value>74,944 KB</value>
</field>
<field var="message-router/Free NonHeap">
<value>236,351 KB</value>
</field>
<field var="StorageContractMaintenance/Last second packets">
<value>78</value>
</field>
<field var="StorageContractMaintenance/Last minute packets">
<value>1331</value>
</field>
<field var="StorageContractMaintenance/Last hour packets">
<value>57837</value>
</field>
<field var="StorageContractMaintenance/Processing threads">
<value>1</value>
</field>
<field var="StorageContractMaintenance/Packets received">
<value>4444974</value>
</field>
<field var="StorageContractMaintenance/Packets sent">
<value>0</value>
</field>
<field var="StorageContractMaintenance/In queue: SYSTEM">
<value>0</value>
</field>
<field var="StorageContractMaintenance/In queue: CLUSTER">
<value>0</value>
</field>
<field var="StorageContractMaintenance/In queue: HIGH">
<value>0</value>
</field>
<field var="StorageContractMaintenance/In queue: NORMAL">
<value>0</value>
</field>
<field var="StorageContractMaintenance/In queue: LOW">
<value>0</value>
</field>
<field var="StorageContractMaintenance/In queue: PRESENCE">
<value>0</value>
</field>
<field var="StorageContractMaintenance/In queue: LOWEST">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Out queue: SYSTEM">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Out queue: CLUSTER">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Out queue: HIGH">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Out queue: NORMAL">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Out queue: LOW">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Out queue: PRESENCE">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Out queue: LOWEST">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Total In queues wait">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Total Out queues wait">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Total queues wait">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Max queue size">
<value>32124</value>
</field>
<field var="StorageContractMaintenance/IN Queue overflow">
<value>0</value>
</field>
<field var="StorageContractMaintenance/OUT Queue overflow">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Total queues overflow">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Average processing time on last 100 runs [ms]">
<value>1</value>
</field>
<field var="StorageContractMaintenance/IN_QUEUE messages">
<value>0</value>
</field>
<field var="StorageContractMaintenance/IN_QUEUE presences">
<value>0</value>
</field>
<field var="StorageContractMaintenance/IN_QUEUE cluster">
<value>0</value>
</field>
<field var="StorageContractMaintenance/IN_QUEUE other">
<value>4444974</value>
</field>
<field var="StorageContractMaintenance/IN_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="StorageContractMaintenance/IN_QUEUE IQ degoo-roster-notifications">
<value>4444974</value>
</field>
<field var="StorageContractMaintenance/IN_QUEUE IQ">
<value>4444974</value>
</field>
<field var="StorageContractMaintenance/OUT_QUEUE messages">
<value>0</value>
</field>
<field var="StorageContractMaintenance/OUT_QUEUE presences">
<value>0</value>
</field>
<field var="StorageContractMaintenance/OUT_QUEUE cluster">
<value>0</value>
</field>
<field var="StorageContractMaintenance/OUT_QUEUE other">
<value>0</value>
</field>
<field var="StorageContractMaintenance/OUT_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="StorageContractMaintenance/OUT_QUEUE IQ">
<value>0</value>
</field>
<field var="StorageContractMaintenance/Processed packets in_0-StorageContractMaintenance">
<value>4444974</value>
</field>
<field var="StorageContractMaintenance/Processed packets out_0-StorageContractMaintenance">
<value>0</value>
</field>
<field var="amp/Last second packets">
<value>0</value>
</field>
<field var="amp/Last minute packets">
<value>0</value>
</field>
<field var="amp/Last hour packets">
<value>0</value>
</field>
<field var="amp/Processing threads">
<value>1</value>
</field>
<field var="amp/Packets received">
<value>0</value>
</field>
<field var="amp/Packets sent">
<value>0</value>
</field>
<field var="amp/In queue: SYSTEM">
<value>0</value>
</field>
<field var="amp/In queue: CLUSTER">
<value>0</value>
</field>
<field var="amp/In queue: HIGH">
<value>0</value>
</field>
<field var="amp/In queue: NORMAL">
<value>0</value>
</field>
<field var="amp/In queue: LOW">
<value>0</value>
</field>
<field var="amp/In queue: PRESENCE">
<value>0</value>
</field>
<field var="amp/In queue: LOWEST">
<value>0</value>
</field>
<field var="amp/Out queue: SYSTEM">
<value>0</value>
</field>
<field var="amp/Out queue: CLUSTER">
<value>0</value>
</field>
<field var="amp/Out queue: HIGH">
<value>0</value>
</field>
<field var="amp/Out queue: NORMAL">
<value>0</value>
</field>
<field var="amp/Out queue: LOW">
<value>0</value>
</field>
<field var="amp/Out queue: PRESENCE">
<value>0</value>
</field>
<field var="amp/Out queue: LOWEST">
<value>0</value>
</field>
<field var="amp/Total In queues wait">
<value>0</value>
</field>
<field var="amp/Total Out queues wait">
<value>0</value>
</field>
<field var="amp/Total queues wait">
<value>0</value>
</field>
<field var="amp/Max queue size">
<value>32124</value>
</field>
<field var="amp/IN Queue overflow">
<value>0</value>
</field>
<field var="amp/OUT Queue overflow">
<value>0</value>
</field>
<field var="amp/Total queues overflow">
<value>0</value>
</field>
<field var="amp/Average processing time on last 100 runs [ms]">
<value>0</value>
</field>
<field var="amp/IN_QUEUE messages">
<value>0</value>
</field>
<field var="amp/IN_QUEUE presences">
<value>0</value>
</field>
<field var="amp/IN_QUEUE cluster">
<value>0</value>
</field>
<field var="amp/IN_QUEUE other">
<value>0</value>
</field>
<field var="amp/IN_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="amp/IN_QUEUE IQ">
<value>0</value>
</field>
<field var="amp/OUT_QUEUE messages">
<value>0</value>
</field>
<field var="amp/OUT_QUEUE presences">
<value>0</value>
</field>
<field var="amp/OUT_QUEUE cluster">
<value>0</value>
</field>
<field var="amp/OUT_QUEUE other">
<value>0</value>
</field>
<field var="amp/OUT_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="amp/OUT_QUEUE IQ">
<value>0</value>
</field>
<field var="amp/Processed packets in_0-amp">
<value>0</value>
</field>
<field var="amp/Processed packets out_0-amp">
<value>0</value>
</field>
<field var="bosh/Last second packets">
<value>0</value>
</field>
<field var="bosh/Last minute packets">
<value>0</value>
</field>
<field var="bosh/Last hour packets">
<value>0</value>
</field>
<field var="bosh/Processing threads">
<value>8</value>
</field>
<field var="bosh/Packets received">
<value>0</value>
</field>
<field var="bosh/Packets sent">
<value>0</value>
</field>
<field var="bosh/In queue: SYSTEM">
<value>0</value>
</field>
<field var="bosh/In queue: CLUSTER">
<value>0</value>
</field>
<field var="bosh/In queue: HIGH">
<value>0</value>
</field>
<field var="bosh/In queue: NORMAL">
<value>0</value>
</field>
<field var="bosh/In queue: LOW">
<value>0</value>
</field>
<field var="bosh/In queue: PRESENCE">
<value>0</value>
</field>
<field var="bosh/In queue: LOWEST">
<value>0</value>
</field>
<field var="bosh/Out queue: SYSTEM">
<value>0</value>
</field>
<field var="bosh/Out queue: CLUSTER">
<value>0</value>
</field>
<field var="bosh/Out queue: HIGH">
<value>0</value>
</field>
<field var="bosh/Out queue: NORMAL">
<value>0</value>
</field>
<field var="bosh/Out queue: LOW">
<value>0</value>
</field>
<field var="bosh/Out queue: PRESENCE">
<value>0</value>
</field>
<field var="bosh/Out queue: LOWEST">
<value>0</value>
</field>
<field var="bosh/Total In queues wait">
<value>0</value>
</field>
<field var="bosh/Total Out queues wait">
<value>0</value>
</field>
<field var="bosh/Total queues wait">
<value>0</value>
</field>
<field var="bosh/Max queue size">
<value>321232</value>
</field>
<field var="bosh/IN Queue overflow">
<value>0</value>
</field>
<field var="bosh/OUT Queue overflow">
<value>0</value>
</field>
<field var="bosh/Total queues overflow">
<value>0</value>
</field>
<field var="bosh/Average processing time on last 100 runs [ms]">
<value>0</value>
</field>
<field var="bosh/IN_QUEUE messages">
<value>0</value>
</field>
<field var="bosh/IN_QUEUE presences">
<value>0</value>
</field>
<field var="bosh/IN_QUEUE cluster">
<value>0</value>
</field>
<field var="bosh/IN_QUEUE other">
<value>0</value>
</field>
<field var="bosh/IN_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="bosh/IN_QUEUE IQ">
<value>0</value>
</field>
<field var="bosh/OUT_QUEUE messages">
<value>0</value>
</field>
<field var="bosh/OUT_QUEUE presences">
<value>0</value>
</field>
<field var="bosh/OUT_QUEUE cluster">
<value>0</value>
</field>
<field var="bosh/OUT_QUEUE other">
<value>0</value>
</field>
<field var="bosh/OUT_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="bosh/OUT_QUEUE IQ">
<value>0</value>
</field>
<field var="bosh/Processed packets in_0-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets in_1-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets in_2-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets in_3-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets in_4-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets in_5-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets in_6-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets in_7-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets out_0-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets out_1-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets out_2-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets out_3-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets out_4-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets out_5-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets out_6-bosh">
<value>0</value>
</field>
<field var="bosh/Processed packets out_7-bosh">
<value>0</value>
</field>
<field var="bosh/Open connections">
<value>0</value>
</field>
<field var="bosh/Waiting to send">
<value>0</value>
</field>
<field var="bosh/Bytes sent">
<value>0</value>
</field>
<field var="bosh/Bytes received">
<value>1348</value>
</field>
<field var="bosh/Socket overflow">
<value>0</value>
</field>
<field var="bosh/Watchdog runs">
<value>5769</value>
</field>
<field var="bosh/Watchdog tests">
<value>0</value>
</field>
<field var="bosh/Watchdog stopped">
<value>0</value>
</field>
<field var="bosh/Bosh sessions">
<value>0</value>
</field>
<field var="c2s/Last second packets">
<value>116</value>
</field>
<field var="c2s/Last minute packets">
<value>3424</value>
</field>
<field var="c2s/Last hour packets">
<value>129363</value>
</field>
<field var="c2s/Processing threads">
<value>8</value>
</field>
<field var="c2s/Packets received">
<value>22497796</value>
</field>
<field var="c2s/Packets sent">
<value>15605976</value>
</field>
<field var="c2s/In queue: SYSTEM">
<value>0</value>
</field>
<field var="c2s/In queue: CLUSTER">
<value>0</value>
</field>
<field var="c2s/In queue: HIGH">
<value>0</value>
</field>
<field var="c2s/In queue: NORMAL">
<value>0</value>
</field>
<field var="c2s/In queue: LOW">
<value>0</value>
</field>
<field var="c2s/In queue: PRESENCE">
<value>0</value>
</field>
<field var="c2s/In queue: LOWEST">
<value>0</value>
</field>
<field var="c2s/Out queue: SYSTEM">
<value>0</value>
</field>
<field var="c2s/Out queue: CLUSTER">
<value>0</value>
</field>
<field var="c2s/Out queue: HIGH">
<value>0</value>
</field>
<field var="c2s/Out queue: NORMAL">
<value>0</value>
</field>
<field var="c2s/Out queue: LOW">
<value>0</value>
</field>
<field var="c2s/Out queue: PRESENCE">
<value>0</value>
</field>
<field var="c2s/Out queue: LOWEST">
<value>0</value>
</field>
<field var="c2s/Total In queues wait">
<value>0</value>
</field>
<field var="c2s/Total Out queues wait">
<value>0</value>
</field>
<field var="c2s/Total queues wait">
<value>0</value>
</field>
<field var="c2s/Max queue size">
<value>321232</value>
</field>
<field var="c2s/IN Queue overflow">
<value>0</value>
</field>
<field var="c2s/OUT Queue overflow">
<value>0</value>
</field>
<field var="c2s/Total queues overflow">
<value>0</value>
</field>
<field var="c2s/Average processing time on last 100 runs [ms]">
<value>0</value>
</field>
<field var="c2s/IN_QUEUE messages">
<value>106172</value>
</field>
<field var="c2s/IN_QUEUE presences">
<value>4595535</value>
</field>
<field var="c2s/IN_QUEUE cluster">
<value>0</value>
</field>
<field var="c2s/IN_QUEUE other">
<value>17246993</value>
</field>
<field var="c2s/IN_QUEUE IQ no XMLNS">
<value>10182782</value>
</field>
<field var="c2s/IN_QUEUE IQ jingle">
<value>634762</value>
</field>
<field var="c2s/IN_QUEUE IQ bind">
<value>1268</value>
</field>
<field var="c2s/IN_QUEUE IQ jabber:iq:roster">
<value>1639607</value>
</field>
<field var="c2s/IN_QUEUE IQ command">
<value>4681711</value>
</field>
<field var="c2s/IN_QUEUE IQ vCard">
<value>5</value>
</field>
<field var="c2s/IN_QUEUE IQ http://jabber.org/protocol/disco#info">
<value>85</value>
</field>
<field var="c2s/IN_QUEUE IQ http://jabber.org/protocol/disco#items">
<value>15</value>
</field>
<field var="c2s/IN_QUEUE IQ ping">
<value>12</value>
</field>
<field var="c2s/IN_QUEUE IQ jabber:iq:register">
<value>1074</value>
</field>
<field var="c2s/IN_QUEUE IQ jabber:iq:private">
<value>5</value>
</field>
<field var="c2s/IN_QUEUE IQ error">
<value>8113</value>
</field>
<field var="c2s/IN_QUEUE IQ jabber:iq:auth">
<value>96241</value>
</field>
<field var="c2s/IN_QUEUE IQ">
<value>17245680</value>
</field>
<field var="c2s/OUT_QUEUE messages">
<value>719563</value>
</field>
<field var="c2s/OUT_QUEUE presences">
<value>157190</value>
</field>
<field var="c2s/OUT_QUEUE cluster">
<value>0</value>
</field>
<field var="c2s/OUT_QUEUE other">
<value>14729316</value>
</field>
<field var="c2s/OUT_QUEUE IQ no XMLNS">
<value>74468</value>
</field>
<field var="c2s/OUT_QUEUE IQ jingle">
<value>634762</value>
</field>
<field var="c2s/OUT_QUEUE IQ bind">
<value>1268</value>
</field>
<field var="c2s/OUT_QUEUE IQ session">
<value>1268</value>
</field>
<field var="c2s/OUT_QUEUE IQ jabber:iq:roster">
<value>95153</value>
</field>
<field var="c2s/OUT_QUEUE IQ command">
<value>3644117</value>
</field>
<field var="c2s/OUT_QUEUE IQ vCard">
<value>5</value>
</field>
<field var="c2s/OUT_QUEUE IQ http://jabber.org/protocol/disco#info">
<value>90</value>
</field>
<field var="c2s/OUT_QUEUE IQ http://jabber.org/protocol/disco#items">
<value>16</value>
</field>
<field var="c2s/OUT_QUEUE IQ ping">
<value>10082919</value>
</field>
<field var="c2s/OUT_QUEUE IQ jabber:iq:register">
<value>2112</value>
</field>
<field var="c2s/OUT_QUEUE IQ jabber:iq:private">
<value>5</value>
</field>
<field var="c2s/OUT_QUEUE IQ error">
<value>8</value>
</field>
<field var="c2s/OUT_QUEUE IQ jabber:iq:auth">
<value>191784</value>
</field>
<field var="c2s/OUT_QUEUE IQ">
<value>14727975</value>
</field>
<field var="c2s/Processed packets in_0-c2s">
<value>2680564</value>
</field>
<field var="c2s/Processed packets in_1-c2s">
<value>3027274</value>
</field>
<field var="c2s/Processed packets in_2-c2s">
<value>2723855</value>
</field>
<field var="c2s/Processed packets in_3-c2s">
<value>2795752</value>
</field>
<field var="c2s/Processed packets in_4-c2s">
<value>2754487</value>
</field>
<field var="c2s/Processed packets in_5-c2s">
<value>2858414</value>
</field>
<field var="c2s/Processed packets in_6-c2s">
<value>2790854</value>
</field>
<field var="c2s/Processed packets in_7-c2s">
<value>2866741</value>
</field>
<field var="c2s/Processed packets out_0-c2s">
<value>1776264</value>
</field>
<field var="c2s/Processed packets out_1-c2s">
<value>2726255</value>
</field>
<field var="c2s/Processed packets out_2-c2s">
<value>1822549</value>
</field>
<field var="c2s/Processed packets out_3-c2s">
<value>1833014</value>
</field>
<field var="c2s/Processed packets out_4-c2s">
<value>1817178</value>
</field>
<field var="c2s/Processed packets out_5-c2s">
<value>1896538</value>
</field>
<field var="c2s/Processed packets out_6-c2s">
<value>1852554</value>
</field>
<field var="c2s/Processed packets out_7-c2s">
<value>1881738</value>
</field>
<field var="c2s/Open connections">
<value>219</value>
</field>
<field var="c2s/Waiting to send">
<value>0</value>
</field>
<field var="c2s/Bytes sent">
<value>30789583594</value>
</field>
<field var="c2s/Bytes received">
<value>5865967690</value>
</field>
<field var="c2s/Socket overflow">
<value>8944</value>
</field>
<field var="c2s/Watchdog runs">
<value>5768</value>
</field>
<field var="c2s/Watchdog tests">
<value>11295</value>
</field>
<field var="c2s/Watchdog stopped">
<value>0</value>
</field>
<field var="cl-comp/Last second packets">
<value>0</value>
</field>
<field var="cl-comp/Last minute packets">
<value>0</value>
</field>
<field var="cl-comp/Last hour packets">
<value>0</value>
</field>
<field var="cl-comp/Processing threads">
<value>16</value>
</field>
<field var="cl-comp/Packets received">
<value>0</value>
</field>
<field var="cl-comp/Packets sent">
<value>0</value>
</field>
<field var="cl-comp/In queue: SYSTEM">
<value>0</value>
</field>
<field var="cl-comp/In queue: CLUSTER">
<value>0</value>
</field>
<field var="cl-comp/In queue: HIGH">
<value>0</value>
</field>
<field var="cl-comp/In queue: NORMAL">
<value>0</value>
</field>
<field var="cl-comp/In queue: LOW">
<value>0</value>
</field>
<field var="cl-comp/In queue: PRESENCE">
<value>0</value>
</field>
<field var="cl-comp/In queue: LOWEST">
<value>0</value>
</field>
<field var="cl-comp/Out queue: SYSTEM">
<value>0</value>
</field>
<field var="cl-comp/Out queue: CLUSTER">
<value>0</value>
</field>
<field var="cl-comp/Out queue: HIGH">
<value>0</value>
</field>
<field var="cl-comp/Out queue: NORMAL">
<value>0</value>
</field>
<field var="cl-comp/Out queue: LOW">
<value>0</value>
</field>
<field var="cl-comp/Out queue: PRESENCE">
<value>0</value>
</field>
<field var="cl-comp/Out queue: LOWEST">
<value>0</value>
</field>
<field var="cl-comp/Total In queues wait">
<value>0</value>
</field>
<field var="cl-comp/Total Out queues wait">
<value>0</value>
</field>
<field var="cl-comp/Total queues wait">
<value>0</value>
</field>
<field var="cl-comp/Max queue size">
<value>321216</value>
</field>
<field var="cl-comp/IN Queue overflow">
<value>0</value>
</field>
<field var="cl-comp/OUT Queue overflow">
<value>0</value>
</field>
<field var="cl-comp/Total queues overflow">
<value>0</value>
</field>
<field var="cl-comp/Average processing time on last 100 runs [ms]">
<value>0</value>
</field>
<field var="cl-comp/IN_QUEUE messages">
<value>0</value>
</field>
<field var="cl-comp/IN_QUEUE presences">
<value>0</value>
</field>
<field var="cl-comp/IN_QUEUE cluster">
<value>0</value>
</field>
<field var="cl-comp/IN_QUEUE other">
<value>0</value>
</field>
<field var="cl-comp/IN_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="cl-comp/IN_QUEUE IQ">
<value>0</value>
</field>
<field var="cl-comp/OUT_QUEUE messages">
<value>0</value>
</field>
<field var="cl-comp/OUT_QUEUE presences">
<value>0</value>
</field>
<field var="cl-comp/OUT_QUEUE cluster">
<value>0</value>
</field>
<field var="cl-comp/OUT_QUEUE other">
<value>0</value>
</field>
<field var="cl-comp/OUT_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="cl-comp/OUT_QUEUE IQ">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_0-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_1-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_2-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_3-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_4-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_5-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_6-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_7-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_8-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_9-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_10-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_11-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_12-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_13-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_14-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets in_15-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_0-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_1-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_2-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_3-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_4-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_5-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_6-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_7-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_8-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_9-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_10-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_11-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_12-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_13-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_14-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Processed packets out_15-cl-comp">
<value>0</value>
</field>
<field var="cl-comp/Open connections">
<value>0</value>
</field>
<field var="cl-comp/Waiting to send">
<value>0</value>
</field>
<field var="cl-comp/Bytes sent">
<value>0</value>
</field>
<field var="cl-comp/Bytes received">
<value>0</value>
</field>
<field var="cl-comp/Socket overflow">
<value>0</value>
</field>
<field var="cl-comp/Watchdog runs">
<value>5769</value>
</field>
<field var="cl-comp/Watchdog tests">
<value>0</value>
</field>
<field var="cl-comp/Watchdog stopped">
<value>0</value>
</field>
<field var="cl-comp/Total disconnects">
<value>0</value>
</field>
<field var="cl-comp/Service connected time-outs">
<value>0</value>
</field>
<field var="cl-comp/Last day disconnects">
<value>[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]</value>
</field>
<field var="cl-comp/Last hour disconnects">
<value>[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0]</value>
</field>
<field var="cl-comp/Average compression ratio">
<value>NaN</value>
</field>
<field var="cl-comp/Average decompression ratio">
<value>NaN</value>
</field>
<field var="monitor/Last second packets">
<value>0</value>
</field>
<field var="monitor/Last minute packets">
<value>0</value>
</field>
<field var="monitor/Last hour packets">
<value>0</value>
</field>
<field var="monitor/Processing threads">
<value>2</value>
</field>
<field var="monitor/Packets received">
<value>0</value>
</field>
<field var="monitor/Packets sent">
<value>0</value>
</field>
<field var="monitor/In queue: SYSTEM">
<value>0</value>
</field>
<field var="monitor/In queue: CLUSTER">
<value>0</value>
</field>
<field var="monitor/In queue: HIGH">
<value>0</value>
</field>
<field var="monitor/In queue: NORMAL">
<value>0</value>
</field>
<field var="monitor/In queue: LOW">
<value>0</value>
</field>
<field var="monitor/In queue: PRESENCE">
<value>0</value>
</field>
<field var="monitor/In queue: LOWEST">
<value>0</value>
</field>
<field var="monitor/Out queue: SYSTEM">
<value>0</value>
</field>
<field var="monitor/Out queue: CLUSTER">
<value>0</value>
</field>
<field var="monitor/Out queue: HIGH">
<value>0</value>
</field>
<field var="monitor/Out queue: NORMAL">
<value>0</value>
</field>
<field var="monitor/Out queue: LOW">
<value>0</value>
</field>
<field var="monitor/Out queue: PRESENCE">
<value>0</value>
</field>
<field var="monitor/Out queue: LOWEST">
<value>0</value>
</field>
<field var="monitor/Total In queues wait">
<value>0</value>
</field>
<field var="monitor/Total Out queues wait">
<value>0</value>
</field>
<field var="monitor/Total queues wait">
<value>0</value>
</field>
<field var="monitor/Max queue size">
<value>32124</value>
</field>
<field var="monitor/IN Queue overflow">
<value>0</value>
</field>
<field var="monitor/OUT Queue overflow">
<value>0</value>
</field>
<field var="monitor/Total queues overflow">
<value>0</value>
</field>
<field var="monitor/Average processing time on last 100 runs [ms]">
<value>0</value>
</field>
<field var="monitor/IN_QUEUE messages">
<value>0</value>
</field>
<field var="monitor/IN_QUEUE presences">
<value>0</value>
</field>
<field var="monitor/IN_QUEUE cluster">
<value>0</value>
</field>
<field var="monitor/IN_QUEUE other">
<value>0</value>
</field>
<field var="monitor/IN_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="monitor/IN_QUEUE IQ">
<value>0</value>
</field>
<field var="monitor/OUT_QUEUE messages">
<value>0</value>
</field>
<field var="monitor/OUT_QUEUE presences">
<value>0</value>
</field>
<field var="monitor/OUT_QUEUE cluster">
<value>0</value>
</field>
<field var="monitor/OUT_QUEUE other">
<value>0</value>
</field>
<field var="monitor/OUT_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="monitor/OUT_QUEUE IQ">
<value>0</value>
</field>
<field var="monitor/Processed packets in_0-monitor">
<value>0</value>
</field>
<field var="monitor/Processed packets in_1-monitor">
<value>0</value>
</field>
<field var="monitor/Processed packets out_0-monitor">
<value>0</value>
</field>
<field var="monitor/Processed packets out_1-monitor">
<value>0</value>
</field>
<field var="s2s/Last second packets">
<value>0</value>
</field>
<field var="s2s/Last minute packets">
<value>0</value>
</field>
<field var="s2s/Last hour packets">
<value>0</value>
</field>
<field var="s2s/Processing threads">
<value>8</value>
</field>
<field var="s2s/Packets received">
<value>0</value>
</field>
<field var="s2s/Packets sent">
<value>0</value>
</field>
<field var="s2s/In queue: SYSTEM">
<value>0</value>
</field>
<field var="s2s/In queue: CLUSTER">
<value>0</value>
</field>
<field var="s2s/In queue: HIGH">
<value>0</value>
</field>
<field var="s2s/In queue: NORMAL">
<value>0</value>
</field>
<field var="s2s/In queue: LOW">
<value>0</value>
</field>
<field var="s2s/In queue: PRESENCE">
<value>0</value>
</field>
<field var="s2s/In queue: LOWEST">
<value>0</value>
</field>
<field var="s2s/Out queue: SYSTEM">
<value>0</value>
</field>
<field var="s2s/Out queue: CLUSTER">
<value>0</value>
</field>
<field var="s2s/Out queue: HIGH">
<value>0</value>
</field>
<field var="s2s/Out queue: NORMAL">
<value>0</value>
</field>
<field var="s2s/Out queue: LOW">
<value>0</value>
</field>
<field var="s2s/Out queue: PRESENCE">
<value>0</value>
</field>
<field var="s2s/Out queue: LOWEST">
<value>0</value>
</field>
<field var="s2s/Total In queues wait">
<value>0</value>
</field>
<field var="s2s/Total Out queues wait">
<value>0</value>
</field>
<field var="s2s/Total queues wait">
<value>0</value>
</field>
<field var="s2s/Max queue size">
<value>32112</value>
</field>
<field var="s2s/IN Queue overflow">
<value>0</value>
</field>
<field var="s2s/OUT Queue overflow">
<value>0</value>
</field>
<field var="s2s/Total queues overflow">
<value>0</value>
</field>
<field var="s2s/Average processing time on last 100 runs [ms]">
<value>0</value>
</field>
<field var="s2s/IN_QUEUE messages">
<value>0</value>
</field>
<field var="s2s/IN_QUEUE presences">
<value>0</value>
</field>
<field var="s2s/IN_QUEUE cluster">
<value>0</value>
</field>
<field var="s2s/IN_QUEUE other">
<value>0</value>
</field>
<field var="s2s/IN_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="s2s/IN_QUEUE IQ">
<value>0</value>
</field>
<field var="s2s/OUT_QUEUE messages">
<value>0</value>
</field>
<field var="s2s/OUT_QUEUE presences">
<value>0</value>
</field>
<field var="s2s/OUT_QUEUE cluster">
<value>0</value>
</field>
<field var="s2s/OUT_QUEUE other">
<value>0</value>
</field>
<field var="s2s/OUT_QUEUE IQ no XMLNS">
<value>0</value>
</field>
<field var="s2s/OUT_QUEUE IQ">
<value>0</value>
</field>
<field var="s2s/Processed packets in_0-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets in_1-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets in_2-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets in_3-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets in_4-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets in_5-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets in_6-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets in_7-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets out_0-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets out_1-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets out_2-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets out_3-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets out_4-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets out_5-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets out_6-s2s">
<value>0</value>
</field>
<field var="s2s/Processed packets out_7-s2s">
<value>0</value>
</field>
<field var="s2s/Open connections">
<value>0</value>
</field>
<field var="s2s/Waiting to send">
<value>0</value>
</field>
<field var="s2s/Bytes sent">
<value>0</value>
</field>
<field var="s2s/Bytes received">
<value>1348</value>
</field>
<field var="s2s/Socket overflow">
<value>0</value>
</field>
<field var="s2s/Watchdog runs">
<value>5769</value>
</field>
<field var="s2s/Watchdog tests">
<value>0</value>
</field>
<field var="s2s/Watchdog stopped">
<value>0</value>
</field>
<field var="s2s/CIDs number">
<value>0</value>
</field>
<field var="s2s/Total outgoing">
<value>0</value>
</field>
<field var="s2s/Total outgoing TLS">
<value>0</value>
</field>
<field var="s2s/Total outgoing handshaking">
<value>0</value>
</field>
<field var="s2s/Total incoming">
<value>0</value>
</field>
<field var="s2s/Total incoming TLS">
<value>0</value>
</field>
<field var="s2s/Total DB keys">
<value>0</value>
</field>
<field var="s2s/Total waiting">
<value>0</value>
</field>
<field var="s2s/Total control waiting">
<value>0</value>
</field>
<field var="sess-man/Last second packets">
<value>401</value>
</field>
<field var="sess-man/Last minute packets">
<value>7847</value>
</field>
<field var="sess-man/Last hour packets">
<value>276873</value>
</field>
<field var="sess-man/Processing threads">
<value>16</value>
</field>
<field var="sess-man/Packets received">
<value>45682915</value>
</field>
<field var="sess-man/Packets sent">
<value>57020768</value>
</field>
<field var="sess-man/In queue: SYSTEM">
<value>0</value>
</field>
<field var="sess-man/In queue: CLUSTER">
<value>0</value>
</field>
<field var="sess-man/In queue: HIGH">
<value>0</value>
</field>
<field var="sess-man/In queue: NORMAL">
<value>7</value>
</field>
<field var="sess-man/In queue: LOW">
<value>0</value>
</field>
<field var="sess-man/In queue: PRESENCE">
<value>344</value>
</field>
<field var="sess-man/In queue: LOWEST">
<value>0</value>
</field>
<field var="sess-man/Out queue: SYSTEM">
<value>0</value>
</field>
<field var="sess-man/Out queue: CLUSTER">
<value>0</value>
</field>
<field var="sess-man/Out queue: HIGH">
<value>0</value>
</field>
<field var="sess-man/Out queue: NORMAL">
<value>0</value>
</field>
<field var="sess-man/Out queue: LOW">
<value>0</value>
</field>
<field var="sess-man/Out queue: PRESENCE">
<value>0</value>
</field>
<field var="sess-man/Out queue: LOWEST">
<value>0</value>
</field>
<field var="sess-man/Total In queues wait">
<value>351</value>
</field>
<field var="sess-man/Total Out queues wait">
<value>0</value>
</field>
<field var="sess-man/Total queues wait">
<value>351</value>
</field>
<field var="sess-man/Max queue size">
<value>321216</value>
</field>
<field var="sess-man/IN Queue overflow">
<value>0</value>
</field>
<field var="sess-man/OUT Queue overflow">
<value>0</value>
</field>
<field var="sess-man/Total queues overflow">
<value>0</value>
</field>
<field var="sess-man/Average processing time on last 100 runs [ms]">
<value>9</value>
</field>
<field var="sess-man/IN_QUEUE messages">
<value>1439093</value>
</field>
<field var="sess-man/IN_QUEUE presences">
<value>23242140</value>
</field>
<field var="sess-man/IN_QUEUE cluster">
<value>0</value>
</field>
<field var="sess-man/IN_QUEUE other">
<value>18108167</value>
</field>
<field var="sess-man/IN_QUEUE IQ no XMLNS">
<value>2</value>
</field>
<field var="sess-man/IN_QUEUE IQ jingle">
<value>1269516</value>
</field>
<field var="sess-man/IN_QUEUE IQ bind">
<value>1268</value>
</field>
<field var="sess-man/IN_QUEUE IQ session">
<value>1268</value>
</field>
<field var="sess-man/IN_QUEUE IQ jabber:iq:roster">
<value>95153</value>
</field>
<field var="sess-man/IN_QUEUE IQ command">
<value>6462555</value>
</field>
<field var="sess-man/IN_QUEUE IQ vCard">
<value>5</value>
</field>
<field var="sess-man/IN_QUEUE IQ http://jabber.org/protocol/disco#info">
<value>180</value>
</field>
<field var="sess-man/IN_QUEUE IQ http://jabber.org/protocol/disco#items">
<value>32</value>
</field>
<field var="sess-man/IN_QUEUE IQ ping">
<value>10082919</value>
</field>
<field var="sess-man/IN_QUEUE IQ jabber:iq:register">
<value>2112</value>
</field>
<field var="sess-man/IN_QUEUE IQ jabber:iq:private">
<value>5</value>
</field>
<field var="sess-man/IN_QUEUE IQ error">
<value>10</value>
</field>
<field var="sess-man/IN_QUEUE IQ jabber:iq:auth">
<value>191784</value>
</field>
<field var="sess-man/IN_QUEUE IQ">
<value>18106809</value>
</field>
<field var="sess-man/OUT_QUEUE messages">
<value>825652</value>
</field>
<field var="sess-man/OUT_QUEUE presences">
<value>27667877</value>
</field>
<field var="sess-man/OUT_QUEUE cluster">
<value>0</value>
</field>
<field var="sess-man/OUT_QUEUE other">
<value>28511823</value>
</field>
<field var="sess-man/OUT_QUEUE IQ no XMLNS">
<value>10731960</value>
</field>
<field var="sess-man/OUT_QUEUE IQ jingle">
<value>1269516</value>
</field>
<field var="sess-man/OUT_QUEUE IQ bind">
<value>1268</value>
</field>
<field var="sess-man/OUT_QUEUE IQ jabber:iq:roster">
<value>1639607</value>
</field>
<field var="sess-man/OUT_QUEUE IQ command">
<value>10318569</value>
</field>
<field var="sess-man/OUT_QUEUE IQ vCard">
<value>5</value>
</field>
<field var="sess-man/OUT_QUEUE IQ http://jabber.org/protocol/disco#info">
<value>180</value>
</field>
<field var="sess-man/OUT_QUEUE IQ http://jabber.org/protocol/disco#items">
<value>32</value>
</field>
<field var="sess-man/OUT_QUEUE IQ ping">
<value>12</value>
</field>
<field var="sess-man/OUT_QUEUE IQ jabber:iq:register">
<value>1074</value>
</field>
<field var="sess-man/OUT_QUEUE IQ degoo-roster-notifications">
<value>4444974</value>
</field>
<field var="sess-man/OUT_QUEUE IQ jabber:iq:private">
<value>5</value>
</field>
<field var="sess-man/OUT_QUEUE IQ error">
<value>8118</value>
</field>
<field var="sess-man/OUT_QUEUE IQ jabber:iq:auth">
<value>96241</value>
</field>
<field var="sess-man/OUT_QUEUE IQ">
<value>28511561</value>
</field>
<field var="sess-man/Processed packets in_0-sess-man">
<value>2878418</value>
</field>
<field var="sess-man/Processed packets in_1-sess-man">
<value>2850583</value>
</field>
<field var="sess-man/Processed packets in_2-sess-man">
<value>2510257</value>
</field>
<field var="sess-man/Processed packets in_3-sess-man">
<value>8044084</value>
</field>
<field var="sess-man/Processed packets in_4-sess-man">
<value>2598890</value>
</field>
<field var="sess-man/Processed packets in_5-sess-man">
<value>2338042</value>
</field>
<field var="sess-man/Processed packets in_6-sess-man">
<value>2354456</value>
</field>
<field var="sess-man/Processed packets in_7-sess-man">
<value>2114919</value>
</field>
<field var="sess-man/Processed packets in_8-sess-man">
<value>2204454</value>
</field>
<field var="sess-man/Processed packets in_9-sess-man">
<value>3247798</value>
</field>
<field var="sess-man/Processed packets in_10-sess-man">
<value>2174131</value>
</field>
<field var="sess-man/Processed packets in_11-sess-man">
<value>2366814</value>
</field>
<field var="sess-man/Processed packets in_12-sess-man">
<value>2322389</value>
</field>
<field var="sess-man/Processed packets in_13-sess-man">
<value>2139689</value>
</field>
<field var="sess-man/Processed packets in_14-sess-man">
<value>2984547</value>
</field>
<field var="sess-man/Processed packets in_15-sess-man">
<value>2555312</value>
</field>
<field var="sess-man/Processed packets out_0-sess-man">
<value>3299149</value>
</field>
<field var="sess-man/Processed packets out_1-sess-man">
<value>3311272</value>
</field>
<field var="sess-man/Processed packets out_2-sess-man">
<value>2945922</value>
</field>
<field var="sess-man/Processed packets out_3-sess-man">
<value>8526130</value>
</field>
<field var="sess-man/Processed packets out_4-sess-man">
<value>3019736</value>
</field>
<field var="sess-man/Processed packets out_5-sess-man">
<value>2773568</value>
</field>
<field var="sess-man/Processed packets out_6-sess-man">
<value>7285347</value>
</field>
<field var="sess-man/Processed packets out_7-sess-man">
<value>2638599</value>
</field>
<field var="sess-man/Processed packets out_8-sess-man">
<value>2650318</value>
</field>
<field var="sess-man/Processed packets out_9-sess-man">
<value>3049536</value>
</field>
<field var="sess-man/Processed packets out_10-sess-man">
<value>2601147</value>
</field>
<field var="sess-man/Processed packets out_11-sess-man">
<value>2809837</value>
</field>
<field var="sess-man/Processed packets out_12-sess-man">
<value>2800954</value>
</field>
<field var="sess-man/Processed packets out_13-sess-man">
<value>2628260</value>
</field>
<field var="sess-man/Processed packets out_14-sess-man">
<value>3702557</value>
</field>
<field var="sess-man/Processed packets out_15-sess-man">
<value>2979634</value>
</field>
<field var="sess-man/Registered accounts">
<value>904</value>
</field>
<field var="sess-man/Open user connections">
<value>216</value>
</field>
<field var="sess-man/Maximum user connections">
<value>276</value>
</field>
<field var="sess-man/Total user connections">
<value>274697</value>
</field>
<field var="sess-man/Closed user connections">
<value>46683</value>
</field>
<field var="sess-man/Open user sessions">
<value>194</value>
</field>
<field var="sess-man/Maximum user sessions">
<value>211</value>
</field>
<field var="sess-man/Total user sessions">
<value>34315</value>
</field>
<field var="sess-man/Authentication timouts">
<value>174641</value>
</field>
<field var="sess-man/Processor: session-open">
<value>, Queue: 0, AvTime: 1, Runs: 274697, Lost: 0</value>
</field>
<field var="sess-man/Processor: http://jabber.org/protocol/stats">
<value>, Queue: 0, AvTime: 1, Runs: 5636886, Lost: 0</value>
</field>
<field var="sess-man/Processor: http://jabber.org/protocol/commands">
<value>, Queue: 0, AvTime: 1, Runs: 5636886, Lost: 0</value>
</field>
<field var="sess-man/Processor: jabber:iq:version">
<value>, Queue: 0, AvTime: 0, Runs: 0, Lost: 0</value>
</field>
<field var="sess-man/Processor: jabber:iq:roster">
<value>, Queue: 0, AvTime: 8, Runs: 1379429, Lost: 0</value>
</field>
<field var="sess-man/Processor: vcard-temp">
<value>, Queue: 0, AvTime: 9, Runs: 5, Lost: 0</value>
</field>
<field var="sess-man/Processor: starttls">
<value>, Queue: 0, AvTime: 0, Runs: 5, Lost: 0</value>
</field>
<field var="sess-man/Processor: presence">
<value>, Queue: 0, AvTime: 1, Runs: 23239511, Lost: 0</value>
</field>
<field var="sess-man/Processor: default-handler">
<value>, Queue: 0, AvTime: 1, Runs: 1267869, Lost: 0</value>
</field>
<field var="sess-man/Processor: urn:ietf:params:xml:ns:xmpp-sasl">
<value>, Queue: 0, AvTime: 1452, Runs: 1357, Lost: 0</value>
</field>
<field var="sess-man/Processor: urn:xmpp:ping">
<value>, Queue: 0, AvTime: 1, Runs: 10082907, Lost: 0</value>
</field>
<field var="sess-man/Processor: urn:ietf:params:xml:ns:xmpp-session">
<value>, Queue: 0, AvTime: 0, Runs: 1268, Lost: 0</value>
</field>
<field var="sess-man/Processor: pep">
<value>, Queue: 0, AvTime: 0, Runs: 0, Lost: 0</value>
</field>
<field var="sess-man/Processor: jabber:iq:register">
<value>, Queue: 0, AvTime: 20, Runs: 2112, Lost: 0</value>
</field>
<field var="sess-man/Processor: degoo-roster-notifications">
<value>, Queue: 0, AvTime: 2, Runs: 23239511, Lost: 0</value>
</field>
<field var="sess-man/Processor: session-close">
<value>, Queue: 0, AvTime: 1624, Runs: 274486, Lost: 0</value>
</field>
<field var="sess-man/Processor: amp">
<value>, Queue: 0, AvTime: 1, Runs: 24678616, Lost: 0</value>
</field>
<field var="sess-man/Processor: disco">
<value>, Queue: 0, AvTime: 0, Runs: 212, Lost: 0</value>
</field>
<field var="sess-man/Processor: jabber:iq:privacy">
<value>, Queue: 0, AvTime: 0, Runs: 0, Lost: 0</value>
</field>
<field var="sess-man/Processor: urn:ietf:params:xml:ns:xmpp-bind">
<value>, Queue: 0, AvTime: 1, Runs: 1268, Lost: 0</value>
</field>
<field var="sess-man/Processor: jabber:iq:private">
<value>, Queue: 0, AvTime: 5, Runs: 5, Lost: 0</value>
</field>
<field var="sess-man/Processor: jabber:iq:auth">
<value>, Queue: 0, AvTime: 140, Runs: 191784, Lost: 0</value>
</field>
<field var="sess-man/Average amp on last 100 runs [ms]">
<value>0</value>
</field>
<field var="sess-man/Cluster sync IN traffic">
<value>0</value>
</field>
<field var="sess-man/Cluster sync OUT traffic">
<value>124047</value>
</field>
<field var="degoo-roster-notifications/NotificationsSent">
<value>4444927</value>
</field>
<field var="presence/Users status changes">
<value>152062</value>
</field>
<field var="cl-caching-strat/Connected nodes">
<value>0</value>
</field>
<field var="total/Total queues wait">
<value>351</value>
</field>
<field var="total/Total queues overflow">
<value>0</value>
</field>
<field type="list-single" label="Stats level" var="Stats level">
<value>FINEST</value>
<option label="INFO">
<value>INFO</value>
</option>
<option label="FINE">
<value>FINE</value>
</option>
<option label="FINER">
<value>FINER</value>
</option>
<option label="FINEST">
<value>FINEST</value>
</option>
</field>
</x>
<actions execute="complete">
<complete/>
</actions>
</command>
</iq>

Replies (4)

Avatar?id=6023&size=32x32

Added by Artur Hefczyc TigaseTeam almost 5 years ago

Thank you for providing all the statistics. It gives a good overview of your system. It does not look overloaded. On a contrary usage is very low.

However, database seems very slow responding, average DB query for jabber:iq:auth is 140ms. This is slow but at this level of use should not cause any problems. Average time of 140ms means there are some calls which possibly take much longer. If your SQL query timeout is set to 2secs then it may cause query fails and login/authentication errors - timeouts.

However, for SASL auth average DB query takes 1452ms. Is is extremely slow. But again, at your usage level it should not cause you problems unless you have SQL query timeout exceeded in which case login fails. However, it looks like very few of your clients actually use SASL.

Session close processing also takes very long time - 1.6sec on average.

Roster call, on the other hand, takes 8ms on average which is pretty good for a roster processing.

In general the only problem I can see with your system is very slow DB. I do not remember your system well enough to say for certain but there is one possibility that you may get empty rosters in the case described in your post. If the roster is loaded from DB during authentication request, hence the long DB calls and because of the long DB calls you get SQL timeout, you may get an empty data set from DB due to the timeout....

Added by Carl Hasselskog almost 5 years ago

Thanks for your quick response! I will take a lock at our DB-server. None of our clients should use SASL (we control all the clients) so the few connection attempt are probably just some bot probing the Internet.

Avatar?id=6023&size=32x32

Added by Artur Hefczyc TigaseTeam almost 5 years ago

Maybe these SASL auth, it's you, I mean admin, connecting using a standard (Psi) client?

Added by Carl Hasselskog almost 5 years ago

Yeah, that sounds reasonable.

    (1-4/4)