GemFire Statistics List

This section describes the primary statistics gathered by GemFire when statistics are enabled.

All statistics gathering requires the gemfire.properties statistic-sampling-enabled in the gemfire.properties file to be true. Statistics that use time require the gemfire.properties enable-time-statistics to be true.

System Performance Statistics

Performance statistics are collected for each Java application or cache server that connects to a distributed system.
Note: For pure Java applications, operating system statistics are not available for collection. Operating system statistics are categorized as process statistics and system statistics.

CacheClientNotifierStatistics

Statistics regarding cache server operations sent to clients.

Statistic Description
events Number of events (operations) processed by the cache client notifier.
eventProcessingTime Total time, in nanoseconds, spent by the cache client notifier processing events.
clientRegistrations Number of clients (operations) that have registered for updates.
clientRegistrationTime Total time, in nanoseconds, spent doing client registrations.
clientHealthMonitorRegister Number of clients that register.
clientHealthMonitorUnRegister Number of clients that unregister.
durableReconnectionCount Number of times the same durable client connects to the server.
queueDroppedCount Number of times the client subscription queue for a particular durable client is dropped.
eventsEnqueuedWhileClientAwayCount Number of events enqueued for a durable client.
cqProcessingTime Total time, in nanoseconds, spent by the cache client notifier processing CQs.

CacheClientProxyStatistics

Statistics regarding cache server operations and cache server client notifications sent to a single client.

Statistic Description
messagesReceived Number of client operations messages received.
messagesQueued Number of client operations messages added to the subscription queue.
messagesFailedQueued Number of client operations messages attempted but failed to be added to the subscription queue.
messagesNotQueuedOriginator Number of client operations messages received but not added to the subscription queue, because the receiving proxy represents the client originating the message.
messagesNotQueuedNotInterested Number of client operations messages received but not added to the subscription queue because the client represented by the receiving proxy was not interested in the message's key.
messagesNotQueuedConflated Number of client operations messages received but not added to the subscription queue because the queue already contains a message with the message's key.
messageQueueSize Size of the operations subscription queue.
messagesProcessed Number of client operations messages removed from the subscription queue and sent.
messageProcessingTime Total time, in nanoseconds, spent sending messages to clients.
cqCount Number of CQs operations on the client.

CacheClientUpdaterStats

Statistics in a client that pertain to server-to-client data pushed from the server over a queue to the client (they are the client side of the server’s CacheClientNotifierStatistics). :

Statistic Description
receivedBytes Total number of bytes received from the server.
messagesBeingReceived Current number of message being received off the network or being processed after reception.
messageBytesBeingReceived Current number of bytes consumed by messages being received or processed.

CachePerfStats

Statistics on the GemFire cache. These can be used to determine the type and number of cache operations being performed and how much time they consume. The primary statistics are:

Statistic Description
conflatedEvents The number of events that were conflated, and not delivered to event listeners or gateway senders on this member. Events are typically conflated because a later event was already applied to the cache, or because a concurrent event was ignored to ensure cache consistency. Note that some members may discard an update while other members apply the update, depending on the order in which each member receives the update. For this reason, the conflatedEvents statistic will differ for each GemFire member. See How Consistency Checking Works for Replicated Regions.
loadsInProgress Current number of threads in this cache doing a cache load.
loadsCompleted Total number of times a load on this cache has completed as a result of either a local get() or a remote netload.
loadTime Total time spent invoking loaders on this cache.
netloadsInProgress Current number of threads doing a network load initiated by a get() in this cache.
netloadsCompleted Total number of times a network load initiated on this cache has completed.
netloadTime Total time spent doing network loads on this cache.
netsearchesInProgress Current number of threads doing a network search initiated by a get() in this cache.
netsearchesCompleted Total number of times network searches initiated by this cache have completed.
netsearchTimeDesc Total time spent doing network searches for cache values.
cacheWriterCallsInProgress Current number of threads doing a cache writer call.
cacheWriterCallsCompleted Total number of times a cache writer call has completed.
cacheWriterCallTime Total time spent doing cache writer calls.
cacheListenerCallsInProgress Current number of threads doing a cache listener call.
cacheListenerCallsCompleted Total number of times a cache listener call has completed.
cacheListenerCallTime Total time spent doing cache listener calls.
getInitialImagesInProgressDesc Current number of getInitialImage operations currently in progress.
getInitialImagesCompleted Total number of times getInitialImages initiated by this cache have completed.
getInitialImageTime Total time spent doing getInitialImages for region creation.
getInitialImageKeysReceived Total number of keys received while doing getInitialImage operations.
regions The current number of regions in the cache.
partitionedRegions The current number of partitioned regions in the cache.
destroys The total number of times a cache object entry has been destroyed in this cache.
updates The total number of updates originating remotely that have been applied to this cache.
updateTime Total time spent performing an update.
invalidates The total number of times an existing cache object entry value in this cache has been invalidated.
getsDesc The total number of times a successful get has been done on this cache.
creates The total number of times an entry is added to this cache.
puts The total number of times an entry is added or replaced in this cache as a result of a local operation (put(), create(), or get() which results in load, netsearch, or netloading a value). Note, this only counts puts done explicitly on this cache; it does not count updates pushed from other caches.
putTime Total time spent adding or replacing an entry in this cache as a result of a local operation. This includes synchronizing on the map, invoking cache callbacks, sending messages to other caches, and waiting for responses (if required).
putAlls The total number of times a map is added or replaced in this cache as a result of a local operation. Note, this only counts putAlls done explicitly on this cache; it does not count updates pushed from other caches.
putallTime Total time spent replacing a map in this cache as a result of a local operation. This includes synchronizing on the map, invoking cache callbacks, sending messages to other caches and waiting for responses (if required).
getTime Total time spent doing get operations from this cache (including netsearch and netload).
eventQueueSize The number of cache events waiting to be processed.
eventQueueThrottleTime The total amount of time, in nanoseconds, spent delayed by the event queue throttle.
eventQueueThrottleCount The total number of times a thread was delayed in adding an event to the event queue.
eventThreads The number of threads currently processing events.
misses Total number of times a get on the cache did not find a value already in local memory. The number of hits (that is, gets that did not miss) can be calculated by subtracting misses from gets.
queryExecutions Total number of times some query has been executed.
queryExecutionTime Total time spent executing queries.
reliableQueuedOps Current number of cache operations queued for distribution to required roles.
reliableQueueSize Current size in megabytes of disk used to queue for distribution to required roles.
reliableQueueMax Maximum size in megabytes allotted for disk usage to queue for distribution to required roles.
reliableRegions Current number of regions configured for reliability.
reliableRegionsMissing Current number regions configured for reliability that are missing required roles.
reliableRegionsQueuing Current number regions configured for reliability that are queuing for required roles.
reliableRegionsMissingFullAccess Current number of regions configured for reliability that are missing require roles with full access.
reliableRegionsMissingLimitedAccess Current number of regions configured for reliability that are missing required roles with limited access.
reliableRegionsMissingNoAccess Current number of regions configured for reliability that are missing required roles with no access.
tombstoneCount The total number of tombstone entries created for performing concurrency checks. See How Destroy and Clear Operations Are Resolved.
tombstoneGCCount The total number of tombstone garbage collection cycles that a member has performed. See How Destroy and Clear Operations Are Resolved.
replicatedTombstonesSize The approximate number of bytes that are currently consumed by tombstones in replicated or partitioned regions. See How Destroy and Clear Operations Are Resolved.
nonReplicatedTombstonesSize The approximate number of bytes that are currently consumed by tombstones in non-replicated regions. See How Destroy and Clear Operations Are Resolved.

CacheServerStats

Statistics used for cache servers and for gateway receivers and are recorded in CacheServerStats in a cache server. The primary statistics are:

Statistic Description
getRequests Number of cache client operations get requests.
readGetRequestTime Total time, in nanoseconds, spent in reading get requests.
processGetTime Total time, in nanoseconds, spent in processing a cache client get request, including the time to get an object from the cache.
getResponses Number of getResponses written to the cache client.
writeGetResponseTime Total time, in nanoseconds, spent in writing get responses.
putRequests Number of cache client operations put requests.
readPutRequestTime Total time, in nanoseconds, spent in reading put requests.
processPutTime Total time, in nanoseconds, spent in processing a cache client put request, including the time to put an object into the cache.
putResponses Number of putResponses written to the cache client.
writePutResponseTime Total time, in nanoseconds, spent in writing put responses.
putAllRequests Number of cache client operations putAll requests.
readPutAllRequestTime Total time, in nanoseconds, spent in reading putAll requests.
processPutAllTime Total time, in nanoseconds, spent in processing a cache client putAll request, including the time to put all objects into the cache.
putAllResponses Number of putAllResponses written to the cache client.
writePutAllResponseTime Total time, in nanoseconds, spent in writing putAll responses.
destroyRequests Number of cache client operations destroy requests.
readDestroyRequestTime Total time, in nanoseconds, spent in reading destroy requests.
processDestroyTime Total time, in nanoseconds, spent in processing a cache client destroy request, including the time to destroy an object from the cache.
destroyResponses Number of destroy responses written to the cache client.
writeDestroyResponseTime Total time, in nanoseconds, spent in writing destroy responses.
queryRequests Number of cache client operations query requests.
readQueryRequestTime Total time, in nanoseconds, spent in reading query requests.
processQueryTime Total time, in nanoseconds, spent in processing a cache client query request, including the time to destroy an object from the cache.
queryResponses Number of query responses written to the cache client.
writeQueryResponseTime Total time, in nanoseconds, spent in writing query responses.
destroyRegionRequests Number of cache client operations destroyRegion requests.
readDestroyRegionRequestTime Total time, in nanoseconds, spent in reading destroyRegion requests.
processDestroyRegionTime Total time, in nanoseconds, spent in processing a cache client destroyRegion request, including the time to destroy the region from the cache.
destroyRegionResponses Number of destroyRegion responses written to the cache client.
writeDestroyRegionResponseTime Total time, in nanoseconds, spent in writing destroyRegion responses.
containsKeyRequests Number of cache client operations containsKey requests.
readContainsKeyRequestTime Total time, in nanoseconds, spent reading containsKey requests.
processContainsKeyTime Total time spent, in nanoseconds, processing a containsKey request.
containsKeyResponses Number of containsKey responses written to the cache client.
writeContainsKeyResponseTime Total time, in nanoseconds, spent writing containsKey responses.
processBatchRequests Number of cache client operations processBatch requests.
readProcessBatchRequestTime Total time, in nanoseconds, spent in reading processBatch requests.
processBatchTime Total time, in nanoseconds, spent in processing a cache client processBatch request.
processBatchResponses Number of processBatch responses written to the cache client.
writeProcessBatchResponseTime Total time, in nanoseconds, spent in writing processBatch responses.
batchSize The size (in bytes) of the batches received.
batchSize The size (in bytes) of the batches received.
clearRegionRequests Number of cache client operations clearRegion requests.
readClearRegionRequestTime Total time, in nanoseconds, spent in reading clearRegion requests.
processClearRegionTime Total time, in nanoseconds, spent in processing a cache client clearRegion request, including the time to clear the region from the cache.
clearRegionResponses Number of clearRegion responses written to the cache client.
writeClearRegionResponseTime Total time, in nanoseconds, spent in writing clearRegion responses.
clientNotificationRequests Number of cache client operations notification requests.
readClientNotificationRequestTime Total time, in nanoseconds, spent in reading client notification requests.
processClientNotificationTime Total time, in nanoseconds, spent in processing a cache client notification request.
updateClientNotificationRequests Number of cache client notification update requests.
readUpdateClientNotificationRequestTime Total time, in nanoseconds, spent in reading client notification update requests.
processUpdateClientNotificationTime Total time, in nanoseconds, spent in processing a client notification update request.
clientReadyRequests Number of cache client ready requests.
readClientReadyRequestTime Total time, in nanoseconds, spent in reading cache client ready requests.
processClientReadyTime Total time, in nanoseconds, spent in processing a cache client ready request, including the time to destroy an object from the cache.
clientReadyResponses Number of client ready responses written to the cache client.
writeClientReadyResponseTime Total time, in nanoseconds, spent in writing client ready responses.
closeConnectionRequests Number of cache client close connection operations requests.
readCloseConnectionRequestTime Total time, in nanoseconds, spent in reading close connection requests.
processCloseConnectionTime Total time, in nanoseconds, spent in processing a cache client close connection request.
failedConnectionAttempts Number of failed connection attempts.
currentClientConnections Number of sockets accepted.
currentClients Number of client virtual machines (clients) connected.
outOfOrderGatewayBatchIds Number of Out of Order batch IDs (batches).
abandonedWriteRequests Number of write operations (requests) abandoned by clients
abandonedReadRequests Number of read operations (requests) abandoned by clients
receivedBytes Total number of bytes received from clients.
sentBytes Total number of bytes sent to clients.
messagesBeingReceived Current number of messages being received off the network or being processed after reception.
messageBytesBeingReceived Current number of bytes consumed by messages being received or processed.
connectionsTimedOut Total number of connections that have been timed out by the server because of client inactivity.
threadQueueSize Current number of connections waiting for a thread to start processing their message.
acceptsInProgress Current number of server accepts that are attempting to do the initial handshake with the client.
acceptThreadStarts Total number of threads created (starts) to deal with an accepted socket. Note, this is not the current number of threads.
connectionThreadStarts Total number of threads created (starts) to deal with a client connection. Note, this is not the current number of threads.
connectionThreads Current number of threads dealing with a client connection.
connectionLoad The load from client to server connections as reported by the load probe installed in this server.
loadPerConnection The estimate of how much load i.s added for each new connection as reported by the load probe installed in this server.
queueLoad The load from subscription queues as reported by the load probe installed in this server
loadPerQueue The estimate of how much load would be added for each new subscription connection as reported by the load probe installed in this server

ClientStats

These statistics are in a client and they describe all the messages sent from the client to a specific server. The primary statistics are:

Statistic Description
opsInProgress Current number of ops being executed.
opSendsInProgress Current number of opSends being executed.
opSends Total number of opSends that have completed successfully.
opSendFailures Total number of opSends that have failed.
ops Total number of ops that have completed successfully.
opFailures Total number of op attempts that have failed.
opTimeouts Total number of op attempts that have timed out.
opSendTime Total amount of time, in nanoseconds, spent doing opSends.
opTime Total amount of time, in nanoseconds, spent doing ops.
getsInProgress Current number of gets being executed.
getSendsInProgress Current number of getSends being executed.
getSends Total number of getSends that have completed successfully.
getSendFailures Total number of getSends that have failed.
gets Total number of gets that have completed successfully.
getFailures Total number of get attempts that have failed.
getTimeouts Total number of get attempts that have timed out.
getSendTime Total amount of time, in nanoseconds, spent doing getSends.
getTime Total amount of time, in nanoseconds, spent doing gets.
putsInProgress Current number of puts being executed.
putSendsInProgress Current number of putSends being executed.
putSends Total number of putSends that have completed successfully.
putSendFailures Total number of putSends that have failed.
puts Total number of puts that have completed successfully.
putFailures Total number of put attempts that have failed.
putTimeouts Total number of put attempts that have timed out.
putSendTime Total amount of time, in nanoseconds, spent doing putSends.
putTime Total amount of time, in nanoseconds, spent doing puts.
destroysInProgress Current number of destroys being executed.
destroySendsInProgress Current number of destroySends being executed.
destroySends Total number of destroySends that have completed successfully.
destroySendFailures Total number of destroySends that have failed.
destroys Total number of destroys that have completed successfully.
destroyFailures Total number of destroy attempts that have failed.
destroyTimeouts Total number of destroy attempts that have timed out.
destroySendTime Total amount of time, in nanoseconds, spent doing destroySends.
destroyTime Total amount of time, in nanoseconds, spent doing destroys.
destroyRegionsInProgress Current number of destroyRegions being executed.
destroyRegionSendsInProgress Current number of destroyRegionSends being executed.
destroyRegionSends Total number of destroyRegionSends that have completed successfully.
destroyRegionSendFailures Total number of destroyRegionSends that have failed.
destroyRegions Total number of destroyRegions that have completed successfully.
destroyRegionFailures Total number of destroyRegion attempts that have failed.
destroyRegionTimeouts Total number of destroyRegion attempts that have timed out.
destroyRegionSendTime Total amount of time, in nanoseconds, spent doing destroyRegionSends.
destroyRegionTime Total amount of time, in nanoseconds, spent doing destroyRegions.
clearsInProgress Current number of clears being executed.
clearSendsInProgress Current number of clearSends being executed.
clearSends Total number of clearSends that have completed successfully.
clearSendFailures Total number of clearSends that have failed.
clears Total number of clears completed successfully.
clearFailures Total number of clear attempts that have failed.
clearTimeouts Total number of clear attempts that have timed out.
clearSendTime Total amount of time, in nanoseconds, spent doing clearSends.
clearTime Total amount of time, in nanoseconds, spent doing clears.
containsKeysInProgress Current number of containsKeys being executed.
containsKeySendsInProgress Current number of containsKeySends being executed.
containsKeySends Total number of containsKeySends that have completed successfully.
containsKeySendFailures Total number of containsKeySends that have failed.
containsKeys Total number of containsKeys that completed successfully.
containsKeyFailures Total number of containsKey attempts that have failed.
containsKeyTimeouts Total number of containsKey attempts that have timed out.
containsKeySendTime Total amount of time, in nanoseconds, spent doing containsKeyends.
containsKeyTime Total amount of time, in nanoseconds, spent doing containsKeys.
keySetsInProgress Current number of keySets being executed.
keySetSendsInProgress Current number of keySetSends being executed.
keySetSends Total number of keySetSends that have completed successfully.
keySetSendFailures Total number of keySetSends that have failed.
keySets Total number of keySets that have completed successfully.
keySetFailures Total number of keySet attempts that have failed.
keySetTimeouts Total number of keySet attempts that have timed out.
keySetSendTime Total amount of time, in nanoseconds, spent doing keySetSends.
keySetTime Total amount of time, in nanoseconds, spent doing keySets.
registerInterestsInProgress Current number of registerInterests being executed.
registerInterestSendsInProgress Current number of registerInterestSends being executed.
registerInterestSends Total number of registerInterestSends that have completed successfully.
registerInterestSendFailures Total number of registerInterestSends that have failed.
registerInterests Total number of registerInterests that have completed successfully.
registerInterestFailures Total number of registerInterest attempts that have failed.
registerInterestTimeouts Total number of registerInterest attempts that have timed out.
registerInterestSendTime Total amount of time, in nanoseconds, spent doing registerInterestSends.
registerInterestTime Total amount of time, in nanoseconds, spent doing registerInterests.
unregisterInterestsInProgress Current number of unregisterInterests being executed.
unregisterInterestSendsInProgress Current number of unregisterInterestSends being executed.
unregisterInterestSends Total number of unregisterInterestSends that have completed successfully.
unregisterInterestSendFailures Total number of unregisterInterestSends that have failed.
unregisterInterests Total number of unregisterInterests that have completed successfully
unregisterInterestFailures Total number of unregisterInterest attempts that have failed.
unregisterInterestTimeouts Total number of unregisterInterest attempts that have timed out.
unregisterInterestSendTime Total amount of time, in nanoseconds, spent doing unregisterInterestSends.
unregisterInterestTime Total amount of time, in nanoseconds, spent doing unregisterInterests.
querysInProgress Current number of querys being executed.
querySendsInProgress Current number of querySends being executed.
querySends Total number of querySends that have completed successfully.
querySendFailures Total number of querySends that have failed.
querys Total number of querys completed successfully.
queryFailures Total number of query attempts that have failed.
queryTimeouts Total number of query attempts that have timed out.
querySendTime Total amount of time, in nanoseconds, spent doing querySends.
queryTime Total amount of time, in nanoseconds. spent doing querys.
createCQsInProgress Current number of createCQs being executed.
createCQSendsInProgress Current number of createCQSends being executed.
createCQSends Total number of createCQSends that have completed successfully.
createCQSendFailures Total number of createCQSends that have failed.
createCQs Total number of createCQs that have completed successfully.
createCQFailures Total number of createCQ attempts that have failed.
createCQTimeouts Total number of createCQ attempts that have timed out.
createCQSendTime Total amount of time, in nanoseconds, spent doing createCQSends.
createCQTime Total amount of time, in nanoseconds, spent doing createCQs.
stopCQsInProgress Current number of stopCQs being executed.
stopCQSendsInProgress Current number of stopCQSends being executed.
stopCQSends Total number of stopCQSends that have completed successfully.
stopCQSendFailures Total number of stopCQSends that have failed.
stopCQs Total number of stopCQs that have completed successfully.
stopCQFailures Total number of stopCQ attempts that have failed.
stopCQTimeouts Total number of stopCQ attempts that have timed out.
stopCQSendTime Total amount of time, in nanoseconds, spent doing stopCQSends.
stopCQTime Total amount of time, in nanoseconds, spent doing stopCQs.
closeCQsInProgress Current number of closeCQs being executed.
closeCQSendsInProgress Current number of closeCQSends being executed.
closeCQSends Total number of closeCQSends that have completed successfully.
closeCQSendFailures Total number of closeCQSends that have failed.
closeCQs Total number of closeCQs that have completed successfully.
closeCQFailures Total number of closeCQ attempts that have failed.
closeCQTimeouts Total number of closeCQ attempts that have timed out.
closeCQSendTime Total amount of time, in nanoseconds, spent doing closeCQSends.
closeCQTime Total amount of time, in nanoseconds, spent doing closeCQs.
gatewayBatchsInProgress Current number of gatewayBatchs being executed.
gatewayBatchSendsInProgress Current number of gatewayBatchSends being executed.
gatewayBatchSends Total number of gatewayBatchSends that have completed successfully.
gatewayBatchSendFailures Total number of gatewayBatchSends that have failed.
gatewayBatchs Total number of gatewayBatchs completed successfully.
gatewayBatchFailures Total number of gatewayBatch attempts that have failed.
gatewayBatchTimeouts Total number of gatewayBatch attempts that have timed out.
gatewayBatchSendTime Total amount of time, in nanoseconds, spent doing gatewayBatchSends.
gatewayBatchTime Total amount of time, in nanoseconds, spent doing gatewayBatchs.
readyForEventsInProgress Current number of readyForEventss being executed
readyForEventsSendsInProgress Current number of readyForEventsSends being executed.
readyForEventsSends Total number of readyForEventsSends that have completed successfully.
readyForEventsSendFailures Total number of readyForEventsSends that have failed.
readyForEvents Total number of readyForEventss that have completed successfully.
readyForEventsFailures Total number of readyForEvents attempts that have failed.
readyForEventsTimeouts Total number of readyForEvents attempts that have timed out.
readyForEventsSendTime Total amount of time, in nanoseconds, spent doing readyForEventsSends.
readyForEventsTime Total amount of time, in nanoseconds, spent doing readyForEvents.
makePrimarysInProgress Current number of makePrimarys being executed.
makePrimarySendsInProgress Current number of makePrimarySends being executed.
makePrimarySends Total number of makePrimarySends that have completed successfully.
makePrimarySendFailures Total number of makePrimarySends that have failed.
makePrimarys Total number of makePrimarys that have completed successfully.
makePrimaryFailures Total number of makePrimary attempts that have failed.
makePrimaryTimeouts Total number of makePrimary attempts that have timed out.
makePrimarySendTime Total amount of time, in nanoseconds, spent doing makePrimarySends.
makePrimaryTime Total amount of time, in nanoseconds, spent doing makePrimarys.
closeConsInProgress Current number of closeCons being executed.
closeConSendsInProgress Current number of closeConSends being executed.
closeConSends Total number of closeConSends that have completed successfully.
closeConSendFailures Total number of closeConSends that have failed.
closeCons Total number of closeCons that have completed successfully.
closeConFailures Total number of closeCon attempts that have failed.
closeConTimeouts Total number of closeCon attempts that have timed out.
closeConSendTime Total amount of time, in nanoseconds, spent doing closeConSends.
closeConTime Total amount of time, in nanoseconds, spent doing closeCons.
primaryAcksInProgress Current number of primaryAcks being executed.
primaryAckSends Total number of primaryAckSends that have completed successfully.
primaryAckSendFailures Total number of primaryAckSends that have failed.
primaryAcks Total number of primaryAcks that have completed successfully.
primaryAckFailures Total number of primaryAck attempts that have failed.
primaryAckTimeouts Total number of primaryAck attempts that have timed out.
primaryAckSendTime Total amount of time, in nanoseconds, spent doing primaryAckSends.
primaryAckTime Total amount of time, in nanoseconds, spent doing primaryAcks.
pingsInProgress Current number of pings being executed.
pingSendsInProgress Current number of pingSends being executed.
pingSends Total number of pingSends that have completed successfully.
pingSendFailures Total number of pingSends that have failed.
pings Total number of pings that have completed successfully.
pingFailures Total number of ping attempts that have failed.
pingTimeouts Total number of ping attempts that have timed out.
pingSendTime Total amount of time, in nanoseconds, spent doing pingSends.
pingTime Total amount of time, in nanoseconds, spent doing pings.
registerInstantiatorssInProgress Current number of registerInstantiators being executed
registerInstantiatorsSendsInProgress Current number of registerInstantiators sends being executed
registerInstantiatorsSends Total number of registerInstantiators sends that have completed successfully
registerInstantiatorsSendFailures Total number of registerInstantiators sends that have failed
registerInstantiators Total number of registerInstantiators completed successfully
registerInstantiatorsFailures Total number of registerInstantiators attempts that have failed.
registerInstantiatorsTimeouts Total number of registerInstantiators attempts that have timed out.
registerInstantiatorsSendTime Total amount of time, in nanoseconds, spent doing registerInstantiatorsSends.
registerInstantiatorsTime Total amount of time, in nanoseconds, spent doing registerInstantiators.
connections Current number of connections.
connects Total number of times a connection has been created.
disconnects Total number of times a connection has been destroyed.
putAllsInProgress Current number of putAlls being executed.
putAllSendsInProgress Current number of putAllSends being executed.
putAllSends Total number of putAllSends that have completed successfully.
putAllSendFailures Total number of putAllSends that have failed.
putAlls Total number of putAlls that have completed successfully.
putAllFailures Total number of putAll attempts that have failed.
putAllTimeouts Total number of putAll attempts that have timed out.
putAllSendTime Total amount of time, in nanoseconds, spent doing putAllSends.
putAllTime Total amount of time, in nanoseconds, spent doing putAlls.
getAllsInProgress Current number of getAlls being executed.
getAllSendsInProgress Current number of getAllSends being executed.
getAllSends Total number of getAllSends that have completed successfully.
getAllSendFailures Total number of getAllSends that have failed.
getAlls Total number of getAlls that have completed successfully.
getAllFailures Total number of getAll attempts that have failed.
getAllTimeouts Total number of getAll attempts that have timed out.
getAllSendTime Total amount of time, in nanoseconds, spent doing getAllSends.
getAllTime Total amount of time, in nanoseconds, spent doing getAlls.
receivedBytes Total number of bytes received from the server.
sentBytes Total number of bytes sent to the server.
messagesBeingReceived Current number of messages being received off the network or being processed after reception.
messageBytesBeingReceived Current number of bytes consumed by messages being received or processed.

ClientSubscriptionStats

Collected in the server, these statistics track event messages queued on the server to be sent to the client. The statistics are gathered for each client subscription queue and are incremental for the lifetime of the queue. The event messages are referred to as events in these statistics. The primary statistics are:

Statistic Description
eventsQueued Number of events placed in the subscription queue.
eventsConflated Number of events conflated. If this is high, the server.s dispatcher may be running slowly. This could be caused by one or more slow client.s causing blocking in their subscription queues.
eventsRemoved Number of events removed from the subscription queue.
eventsTaken Number of events taken from the subscription queue.
eventsExpired Number of events that have expired while in the subscription queue. If this is high on a secondary server, it might be that the MessageSyncInterval on the primary is set too high, causing the secondary to fall behind in event cleanup.
eventsRemovedByQrm Number of events removed based on a message sent from the primary. Only incremented while the subscription queue is in a secondary server.
numVoidRemovals Number of events which were supposed to be destroyed from the subscription queue through remove but were removed by some other operation like conflation or expiration.
numSequenceViolated Number of events that had sequence ID less than or equal to the last sequence ID. The system assumes these events are duplicates and does not add them to the subscription queue. A non-zero value may indicate message loss.
threadIdentifiers Number of ThreadIdentifier objects (units) in the subscription queue.

CQStatistics

These statistics are for continuous querying information for a single CQ and for the query service’s management of CQs as a whole. The primary statistics are:

Statistic Description
CQS_CREATED Number of CQ operations created.
CQS_ACTIVE Number of CQ operations actively executing.
CQS_STOPPED Number of CQ operations stopped.
CQS_CLOSED Number of CQ operations closed.
CQS_ON_CLIENT Number of CQ operations on the client.
CLIENTS_WITH_CQS Number of Clients with CQ operations.
CQ_QUERY_EXECUTION_TIME Time taken, in nanoseconds, for CQ query execution.
CQ_QUERY_EXECUTIONS_COMPLETED Number of CQ query executions operations.
CQ_QUERY_EXECUTION_IN_PROGRESS CQ Query execution operations in progress.
UNIQUE_CQ_QUERY Number of unique CQ queries.

DeltaPropagationStatistics

These statistics are for delta propagation between members. The primary statistics are:

Statistic Description
processedDeltaMessages The number of distribution messages containing delta that this GemFire system has processed.
processedDeltaMessagesTime The amount of time this distribution manager has spent in applying delta on its existing value.
preparedDeltaMessages The number of distribution messages containing delta that this GemFire system has prepared for distribution.
preparedDeltaMessagesTime The total amount of time this distribution manager has spent preparing delta parts of messages.
deltaMessageFailures The number of distribution messages containing delta that could not be processed at receiving side.
fullValueDeltaMessagesSent The number of distribution messages sent in response to full value requests by a remote GemFire System as a result of failure in applying delta.
fullValueDeltaMessagesRequested The number of distribution messages containing full value requested by this GemFire system after failing to apply received delta.
partitionMessagesWithDeltaSent Number of PartitionMessages containing delta sent.
partitionMessagesWithDeltaSentTime Total time spent extractng deltas.
partitionMessagesWithDeltaProcessed Number of PartitionMessages containing delta processed.
partitionMessagesWithDeltaProcessedTime Total time spent applying deltas.
partitionMessagesWithDeltaFailures Number of failures while processing PartitionMessages containing delta.
partitionMessagesWithFullValueDeltaSent Number of PartitionMessages containing full delta value sent.
partitionMessagesWithFullValueDeltaRequested Number of requests for PartitionMessages containing full delta value as a result of failure in applying delta.
processedDeltaPuts Number of cache client put requests containing delta received from a client and processed successfuly.
processedDeltaPutsTime Total time spent in applying delta received from a client on existing value in this server's region.
deltaPutFailures Number of failures encountered while processing delta received from a client on this server.
fullDeltaRequests Number of full value requests made by this server to the sender client after failing to apply delta.
deltaFullValueRequests Number of full value requests received from a client after failing to apply delta and processed successfully by this server.
deltaPuts Total number of puts containing delta.
deltaPutsTime Total amount of time, in nanoseconds, spent constructing delta part of puts.
deltaFullValuePuts Total number of full value puts processed successfully in response to failed delta puts.
processedDeltaMessages Current number of delta messages received off network and processed after reception.
deltaMessageFailures Current number of delta messages received but could not be processed after reception.
processedDeltaMessagesTime Total time spent applying received delta parts on existing messages at clients.
fullDeltaMessages Current number of full value delta messages received off network and processed after reception.
preparedDeltaMessages Number of client messages being prepared for dispatch, which have delta part in them.

DiskDirStatistics

These statistics pertain to the disk usage for a region’s disk directory. The primary statistics are:

Statistic Description
diskSpace The total number of bytes currently being used on disk in this directory.

DiskRegionStatistics

Statistics regarding operations performed on a disk region for persistence/overflow. The primary statistics are:

Statistic Description
commits Total number of commits.
commitTime Total amount of time, in nanoseconds, spent doing commits.
writes Total number of region entries that have been written to disk. A write is done every time an entry is created on disk or every time its value is modified on the disk.
writeTime Total amount of time, in nanoseconds, spent writing to the disk.
writtenBytes Total number of bytes that have been written to the disk.
flushes Total number of times the async write buffer has been flushed.
flushTime Total amount of time, in nanoseconds, spent doing a buffer flush.
flushedBytes Total number of bytes flushed out of the async write buffer to the disk.
reads Total number of region entries that have been read from the disk.
readTime Total amount of time, in nanoseconds, spent reading from the disk.
readBytes Total number of bytes that have been read from the disk.
recoveryTime Total amount of time, in nanoseconds, spent doing a recovery.
recoveredBytes Total number of bytes that have been read from disk during a recovery.
removes Total number of region entries that have been removed from the disk.
removeTime Total amount of time, in nanoseconds, spent removing from the disk.
bufferSize Current number of bytes buffered to be written to the disk.
entriesOnDisk Current number of entries whose value is on the disk and is not in memory. This is true of overflowed entries. It is also true of recovered entries that have not yet been faulted in.
entriesInVM Current number of entries whose value resides in the member. The value may also have been written to the disk.

DistributionStats

Statistics on the GemFire distribution layer. These can be used to tell how much message traffic there is between this member and other distributed system members.

The primary statistics are:
Statistic Description
sentMessagesDesc The number of distribution messages that the GemFire system has sent, which includes broadcastMessages.
sentCommitMessagesDesc The number of transaction commit messages that the GemFire system has created to be sent. Note, it is possible for a commit to only create one message even though it will end up being sent to multiple recipients.
commitWaitsDesc The number of transaction commits that had to wait for a response before they could complete.
sentMessagesTimeDesc The total amount of time this distribution manager has spent sending messages, which includes broadcastMessagesTime.
sentMessagesMaxTimeDesc The highest amount of time this distribution manager has spent distributing a single message to the network.
broadcastMessagesDesc The number of distribution messages that the GemFire system has broadcast. A broadcast message is one sent to every other manager in the group.
broadcastMessagesTimeDesc The total amount of time this distribution manager has spent broadcasting messages. A broadcast message is one sent to every other manager in the group.
receivedMessagesDesc The number of distribution messages that the GemFire system has received.
receivedBytesDesc The number of distribution message bytes that the GemFire system has received.
sentBytesDesc The number of distribution message bytes that the GemFire system has sent.
processedMessagesDesc The number of distribution messages that the GemFire system has processed.
processedMessagesTimeDesc The amount of time this distribution manager has spent in message.process().
messageProcessingScheduleTimeDesc The amount of time this distribution manager has spent dispatching a message to processor threads.
overflowQueueSizeDesc The number of normal distribution messages currently waiting to be processed.
waitingQueueSizeDesc The number of distribution messages currently waiting for some other resource before they can be processed.
overflowQueueThrottleTimeDesc The total amount of time, in nanoseconds, spent delayed by the overflow queue throttle.
overflowQueueThrottleCountDesc The total number of times a thread was delayed in adding a normal message to the overflow queue.
highPriorityQueueSizeDesc The number of high priority distribution messages currently waiting to be processed.
highPriorityQueueThrottleTimeDesc The total amount of time, in nanoseconds, spent delayed by the high priority queue throttle.
highPriorityQueueThrottleCounDesc The total number of times a thread was delayed in adding a normal message to the high priority queue.
serialQueueSizeDesc The number of serial distribution messages currently waiting to be processed.
serialQueueBytesDesc The approximate number of bytes consumed by serial distribution messages currently waiting to be processed.
serialPooledThreadDesc The number of threads created in the SerialQueuedExecutorPool.
serialQueueThrottleTimeDesc The total amount of time, in nanoseconds, spent delayed by the serial queue throttle.
serialQueueThrottleCountDesc The total number of times a thread was delayed in adding a ordered message to the serial queue.
serialThreadsDesc The number of threads currently processing serial/ordered messages.
processingThreadsDesc The number of threads currently processing normal messages.
highPriorityThreadsDesc The number of threads currently processing high priority messages.
partitionedRegionThreadsDesc The number of threads currently processing partitioned region messages.
waitingThreadsDesc The number of threads currently processing messages that had to wait for a resource.
messageChannelTimeDesc The total amount of time received messages spent in the distribution channel.
replyMessageTimeDesc The amount of time spent processing reply messages;
final String distributeMessageTimeDesc = The amount of time it takes to prepare a message and send it on the network. This includes sentMessagesTime.
nodesDesc The current number of members in this distributed system.
replyWaitsInProgressDesc Current number of threads waiting for a reply.
replyWaitsCompletedDesc Total number of times waits for a reply have completed.
replyWaitTimeDesc Total time spent waiting for a reply to a message.
replyWaitMaxTimeDesc Maximum time spent transmitting and then waiting for a reply to a message. See sentMessagesMaxTime for related information.
replyTimeoutsDesc Total number of message replies that have timed out.
receiverConnectionsDesc Current number of sockets dedicated to receiving messages.
failedAcceptsDesc Total number of times an accept (receiver creation) of a connect from some other member has failed.
failedConnectsDesc Total number of times a connect (sender creation) to some other member has failed.
reconnectAttemptsDesc Total number of times an established connection was lost and a reconnect was attempted.
lostConnectionLeaseDesc Total number of times an unshared sender socket has remained idle long enough that its lease expired.
sharedOrderedSenderConnectionsDesc Current number of shared sockets dedicated to sending ordered messages.
sharedUnorderedSenderConnectionsDesc Current number of shared sockets dedicated to sending unordered messages.
threadOrderedSenderConnectionsDesc Current number of thread sockets dedicated to sending ordered messages.
threadUnorderedSenderConnectionsDesc Current number of thread sockets dedicated to sending unordered messages.
asyncQueuesDesc Current number of queues for asynchronous messaging.
asyncQueueFlushesInProgressDesc Current number of asynchronous queues being flushed.
asyncQueueFlushesCompletedDesc Total number of asynchronous queue flushes completed.
asyncQueueFlushTimeDesc Total time spent flushing asynchronous queues.
asyncQueueTimeoutExceededDesc Total number of asynchronous queues that have timed out by being blocked for more than async-queue-timeout milliseconds.
asyncQueueSizeExceededDesc Total number of asynchronous queues that have exceeded the maximum size.
asyncDistributionTimeoutExceededDesc Total number of times the async-distribution-timeout has been exceeded during a socket write.
asyncQueueSizeDesc Current size in bytes used for asynchronous queues.
asyncQueuedMsgsDesc The total number of queued messages used for asynchronous queues.
asyncDequeuedMsgsDesc The total number of queued messages that have been removed from the queue and successfully sent.
asyncConflatedMsgsDesc The total number of queued conflated messages used for asynchronous queues.
asyncThreadsDesc Total number of asynchronous message queue threads.
asyncThreadInProgressDesc Current iterations of work performed by asynchronous message queue threads.
asyncThreadCompletedDesc Total number of iterations of work performed by asynchronous message queue threads.
asyncThreadTimeDesc Total time spent by asynchronous message queue threads performing iterations.
receiverDirectBufferSizeDesc Current number of bytes allocated from direct memory as buffers for incoming messages.
receiverHeapBufferSizeDesc Current number of bytes allocated from Java heap memory as buffers for incoming messages.S
senderDirectBufferSizeDesc Current number of bytes allocated from direct memory as buffers for outgoing messages.
senderHeapBufferSizeDesc Current number of bytes allocated from Java heap memory as buffers for outgoing messages.
replyHandoffTimeDesc Total number of seconds to switch thread contexts from processing thread to application thread.
partitionedRegionThreadJobsDesc The number of messages currently being processed by partitioned region threads.
viewThreadsDesc The number of threads currently processing view messages.
serialThreadJobsDesc The number of messages currently being processed by serial threads.
viewThreadJobsDesc The number of messages currently being processed by view threads.
serialPooledThreadJobsDesc The number of messages currently being processed by pooled serial processor threads.
processingThreadJobsDesc The number of messages currently being processed by pooled message processor threads.
highPriorityThreadJobsDesc The number of messages currently being processed by high priority processor threads.
waitingThreadJobsDesc The number of messages currently being processed by waiting pooly processor threads.
syncSocketWritesInProgress Current number of synchronous/blocking socket write calls in progress.
syncSocketWriteTime Total amount of time, in nanoseconds, spent in synchronous/blocking socket write calls.
syncSocketWrites Total number of completed synchronous/blocking socket write calls.
syncSocketWriteBytes Total number of bytes sent out in synchronous/blocking mode on sockets.
ucastReads Total number of unicast datagrams received.
ucastReadBytes Total number of bytes received in unicast datagrams.
ucastWriteTime Total amount of time, in nanoseconds, spent in unicast datagram socket write calls.
ucastWrites Total number of unicast datagram socket write calls.
ucastWriteBytes Total number of bytes sent out on unicast datagram sockets.
ucastRetransmits Total number of unicast datagram socket retransmissions.
mcastReads Total number of multicast datagrams received.
mcastReadBytes Total number of bytes received in multicast datagrams.
mcastWriteTime Total amount of time, in nanoseconds, spent in multicast datagram socket write calls.
mcastWrites Total number of multicast datagram socket write calls.
mcastWriteBytes Total number of bytes sent out on multicast datagram sockets.
mcastRetransmits Total number of multicast datagram socket retransmissions.
mcastRetransmitRequests Total number of multicast datagram socket retransmission requests sent to other processes.
serializationTime Total amount of time, in nanoseconds, spent serializing objects.
serializations Total number of object serialization calls.
serializedBytes Total number of bytes produced by object serialization.
deserializationTime Total amount of time, in nanoseconds, spent deserializing objects.
deserializations Total number of object deserialization calls.
deserializedBytes Total number of bytes consumed by object deserialization.
msgSerializationTime Total amount of time, in nanoseconds, spent serializing messages.
msgDeserializationTime Total amount of time, in nanoseconds, spent deserializing messages.
batchSendTime Total amount of time, in nanoseconds, spent queueing and flushing message batches.
batchWaitTime Reserved for future use
batchCopyTime Total amount of time, in nanoseconds, spent copying messages for batched transmission.
batchFlushTime Total amount of time, in nanoseconds, spent flushing batched messages to the network.
ucastFlushes Total number of flushes of the unicast datagram protocol, prior to sending a multicast message.
ucastFlushTime Total amount of time, in nanoseconds, spent waiting for acknowledgements for outstanding unicast datagram messages.
flowControlRequests Total number of flow control credit requests sent to other processes.
flowControlResponses Total number of flow control credit responses sent to a requestor.
flowControlWaitsInProgress Number of threads blocked waiting for flow-control recharges from other processes.
flowControlWaitTime Total amount of time, in nanoseconds, spent waiting for other processes to recharge the flow of the control meter.
flowControlThrottleWaitsInProgress Number of threads blocked waiting due to flow-control throttle requests from other members.
jgNAKACKreceivedMessages Number of received messages awaiting stability in NAKACK.
jgNAKACKsentMessages Number of sent messages awaiting stability in NAKACK.
jgUNICASTreceivedMessages Number of received messages awaiting receipt of prior messages.
jgUNICASTsentMessages Number of un-acked normal priority messages.
jgUNICASTsentHighPriorityMessages Number of un-acked high priority messages
jgUNICASTdataReceivedTime Amount of time spent in JGroups UNICAST send.
jgSTABLEsuspendTime Amount of time JGroups STABLE is suspended.
jgSTABLEmessages Number of STABLE messages received by JGroups.
jgSTABLEmessagesSent Number of STABLE messages sent by JGroups.
jgSTABILITYmessages Number of STABILITY messages received by JGroups.
jgUDPupTime Time, in nanosecnds, spent in JGroups UDP processing up events.
jgUDPdownTime Time, in nanoseconds, spent in JGroups UDP processing down events.
jgNAKACKupTime Time, in nanoseconds, spent in JGroups NAKACK processing up events.
jgNAKACKdownTime Time, in nanoseconds, spent in JGroups NAKACK processing down events.
jgUNICASTupTime Time, in nanoseconds, spent in JGroups UNICAST processing up events.
jgUNICASTdownTime Time, in nanoseconds, spent in JGroups UNICAST processing down events.
jgSTABLEupTime Time, in nanoseconds, spent in JGroups STABLE processing up events.
jgSTABLEdownTime Time, in nanoseconds, spent in JGroups STABLE processing down events.
jgFRAG2upTime Time, in nanoseconds, spent in JGroups FRAG2 processing up events.
jgFRAG2downTime Time, in nanoseconds, spent in JGroups FRAG2 processing down events.
jgGMSupTime Time, in nanoseconds, spent in JGroups GMS processing up events.
jgGMSdownTime Time, in nanoseconds, spent in JGroups GMS processing down events.
jgFCupTime Time, in nanoseconds, spent in JGroups FC processing up events.
jgFCdownTime Time, in nanoseconds, spent in JGroups FC processing down events.
jgDirAckupTime Time, in nanoseconds, spent in JGroups DirAck processing up events.
jgDirAckdownTime Time, in nanoseconds, spent in JGroups DirAck processing down events.
jgVIEWSYNCdownTime Time, in nanoseconds, spent in JGroups VIEWSYNC processing down events.
jgVIEWSYNCupTime Time, in nanoseconds, spent in JGroups VIEWSYNC processing up events.
jgFDdownTime Time, in nanoseconds, spent in JGroups FD processing down events.
jgFDupTime Time, in nanoseconds, spent in JGroups FD processing up events.
jgTCPGOSSIPdownTime Time, in nanoseconds, spent in JGroups TCPGOSSIP processing down events.
jgTCPGOSSIPupTime Time, in nanoseconds, spent in JGroups TCPGOSSIP processing up events.
jgDISCOVERYdownTime Time, in nanoseconds, spent in JGroups DISCOVERY processing down events.
jgDISCOVERYupTime Time, in nanoseconds, spent in JGroups DISCOVERY processing up events.
jgDownTime Down Time spent in JGroups stacks.
jgUpTime Up Time spent in JGroups stacks.
jChannelUpTime Up Time spent in JChannel including jgroup stack.
jgFCsendBlocks Number of times JGroups FC halted send events due to backpressure.
jgFCautoRequests Number of times JGroups FC automatically sent replenishment requests.
jgFCreplenish Number of times JGroups FC received replenishments messages from receivers.
jgFCresumes Number of times JGroups FC resumed sends events due to backpressure.
jgFCsentCredits Number of times JGroups FC sent credits events to a sender.
jgFCsentThrottleRequests Number of times JGroups FC sent throttle events requests to a sender.
asyncSocketWritesInProgress Current number of non-blocking socket write calls in progress.
asyncSocketWrites Total number of non-blocking socket write calls completed.
asyncSocketWriteRetries Total number of retries needed to write a single block of data using non-blocking socket write calls.
asyncSocketWriteTime Total amount of time, in nanoseconds, spent in non-blocking socket write calls.
asyncSocketWriteBytes Total number of bytes sent out on non-blocking sockets.
asyncQueueAddTime Total amount of time, in nanoseconds, spent in adding messages to async queue.
asyncQueueRemoveTime Total amount of time, in nanoseconds, spent in removing messages from async queue.
jgDirAcksReceived Number of DirAck acks received.
jgFragmentationsPerformed Number of message fragmentation operations performed.
jgFragmentsCreated Number of message fragments created.
socketLocks Total number of times a socket has been locked.
socketLockTime Total amount of time, in nanoseconds, spent locking a socket.
bufferAcquiresInProgress Current number of threads waiting to acquire a buffer.
bufferAcquires Total number of times a buffer has been acquired.
bufferAcquireTime Total amount of time, in nanoseconds, spent acquiring a socket.
messagesBeingReceived Current number of messages being received off the network or being processed after reception.
messageBytesBeingReceived Current number of bytes consumed by messages being received or processed.
serialThreadStarts Total number of times a thread has been created for the serial message executor.
viewThreadStarts Total number of times a thread has been created for the view message executor.
processingThreadStarts Total number of times a thread has been created for the pool processing normal messages.
highPriorityThreadStarts Total number of times a thread has been created for the pool handling high priority messages.
waitingThreadStarts Total number of times a thread has been created for the waiting pool.
partitionedRegionThreadStarts Total number of times a thread has been created for the pool handling partitioned region messages.
serialPooledThreadStarts Total number of times a thread has been created for the serial pool(s).
TOSentMsgs Total number of messages sent on thread owned senders.
pdxSerializations Total number of PDX serializations.
pdxSerializedBytes Total number of bytes produced by PDX serialization.
pdxDeserializations Total number of PDX deserializations.
pdxDeserializedBytes Total number of bytes read by PDX deserialization.
pdxInstanceDeserializations Total number of times getObject has been called on a PdxInstance.
pdxInstanceDeserializationTime Total amount of time, in nanoseconds, spent deserializing PdxInstances by calling getObject.
pdxInstanceCreations Total number of times a PdxInstance has been created by deserialization.

DistributionStats Related to Slow Receivers

The distribution statistics provide statistics pertaining to slow receivers. The primary statistics are:

Statistic Description
asyncSocketWrite* Used anytime a producer is distributing to one or more consumers with a non-zero distribution timeout. These statistics also reflect the writes done by the threads that service asynchronous queues.
asyncQueue* Provide information about queues the producer is managing for its consumers. There are no statistics maintained for individual consumers. The following are the primary statistics of this type.
asyncQueues Indicates the number of queues currently in the producer.
asyncQueueTimeoutExceeded Incremented every time a queue flushing has exceeded async-queue-timeout and the receiver has been sent a disconnect message.
asyncQueueSizeExceeded Incremented every time a queue has exceeded
async-max-queue-size and the receiver has been sent a disconnect message.
asyncDistributionTimeoutExceeded Incremented every time an asyncSocketWrite has exceeded async-distribution-timeout and an async queue has been created.

DLockStats

These statistics are for distributed lock services. The primary statistics are:

Statistic Description
grantorsDesc The current number of lock grantors hosted by this system member.
servicesDesc The current number of lock services used by this system member.
tokensDesc The current number of lock tokens used by this system member.
requestQueuesDesc The current number of lock request queues used by this system member.
serialQueueSizeDesc The number of serial distribution messages currently waiting to be processed.
serialThreadsDesc The number of threads currently processing serial/ordered messages.
waitingQueueSizeDesc The number of distribution messages currently waiting for some other resource before they can be processed.
waitingThreadsDesc The number of threads currently processing messages that had to wait for a resource.
lockWaitsInProgressDesc Current number of threads waiting for a distributed lock.
lockWaitsCompletedDesc Total number of times distributed lock wait has completed by successfully obtaining the lock.
lockWaitTimeDesc Total time spent waiting for a distributed lock that was obtained.
lockWaitsFailedDesc Total time spent waiting for a distributed lock that failed to be obtained.
lockWaitFailedTimeDesc Total number of times distributed lock wait has completed by failing to obtain the lock.
grantWaitsInProgressDesc Current number of distributed lock requests being granted.
grantWaitsCompletedDesc Total number of times granting of a lock request has completed by successfully granting the lock.
grantWaitTimeDesc Total time spent attempting to grant a distributed lock.
grantWaitsNotGrantorDesc Total number of times granting of lock request failed because not grantor.
grantWaitNotGrantorTimeDesc Total time spent granting of lock requests that failed because not grantor.
grantWaitsTimeoutDesc Total number of times granting of lock request failed because of a timeout.
grantWaitTimeoutTimeDesc Total time spent granting of lock requests that failed because of a timeout.
grantWaitsNotHolderDesc Total number of times granting of lock request failed because reentrant was not holder.
grantWaitNotHolderTimeDesc Total time spent granting of lock requests that failed because reentrant was not holder.
grantWaitsFailedDesc Total number of times granting of lock request failed because try locks failed.
grantWaitFailedTimeDesc Total time spent granting of lock requests that failed because try locks failed.
grantWaitsSuspendedDesc Total number of times granting of lock request failed because lock service was suspended.
grantWaitSuspendedTimeDesc Total time spent granting of lock requests that failed because lock service was suspended.
grantWaitsDestroyedDesc Total number of times granting of lock request failed because lock service was destroyed.
grantWaitDestroyedTimeDesc Total time spent granting of lock requests that failed because lock service was destroyed.
createGrantorsInProgressDesc Current number of initial grantors being created in this process.
createGrantorsCompletedDesc Total number of initial grantors created in this process.
String createGrantorTimeDesc Total time spent waiting create the initial grantor for lock services.
serviceCreatesInProgressDesc Current number of lock services being created in this process.
serviceCreatesCompletedDesc Total number of lock services created in this process.
serviceCreateLatchTimeDesc Total time spent creating lock services before releasing create latches.
serviceInitLatchTimeDesc Total time spent creating lock services before releasing init latches.
grantorWaitsInProgressDesc Current number of threads waiting for grantor latch to open.
grantorWaitsCompletedDesc Total number of times waiting threads completed waiting for the grantor latch to open.
grantorWaitTimeDesc Total time spent waiting for the grantor latch which resulted in success.
grantorWaitsFailedDesc Total number of times waiting threads failed to finish waiting for the grantor latch to open.
grantorWaitFailedTimeDesc Total time spent waiting for the grantor latch which resulted in failure.
grantorThreadsInProgressDesc Current iterations of work performed by grantor thread.
grantorThreadsCompletedDesc Total number of iterations of work performed by grantor thread(s).
grantorThreadExpireAndGrantLocksTimeDesc Total time spent by grantor thread(s) performing expireAndGrantLocks tasks.
grantorThreadHandleRequestTimeoutsTimeDesc Total time spent by grantor thread(s) performing handleRequestTimeouts tasks.";
grantorThreadRemoveUnusedTokensTimeDesc Total time spent by grantor thread(s) performing removeUnusedTokens tasks.
grantorThreadTimeDesc Total time spent by grantor thread(s) performing all grantor tasks.
pendingRequestsDesc The current number of pending lock requests queued by grantors in this process.
destroyReadWaitsInProgressDesc Current number of threads waiting for a DLockService destroy read lock.
destroyReadWaitsCompletedDesc Total number of times a DLockService destroy read lock wait has completed successfully.
destroyReadWaitTimeDesc Total time spent waiting for a DLockService destroy read lock that was obtained.
destroyReadWaitsFailedDesc Total number of times a DLockService destroy read lock wait has completed unsuccessfully.
destroyReadWaitFailedTimeDesc Total time spent waiting for a DLockService destroy read lock that was not obtained.
destroyWriteWaitsInProgressDesc Current number of writes waiting for a DLockService destroy write lock.
destroyWriteWaitsCompletedDesc Total number of times a DLockService destroy write lock wait has completed successfully.
destroyWriteWaitTimeDesc Total time spent waiting for a DLockService destroy write lock that was obtained.
destroyWriteWaitsFailedDesc Total number of times a DLockService destroy write lock wait has completed unsuccessfully.
destroyWriteWaitFailedTimeDesc Total time spent waiting for a DLockService destroy write lock that was not obtained.
destroyReadsDesc The current number of DLockService destroy read locks held by this process.
destroyWritesDesc The current number of DLockService destroy write locks held by this process.
lockReleasesInProgressDesc Current number of threads releasing a distributed lock.
lockReleasesCompletedDesc Total number of times distributed lock release has completed.
lockReleaseTimeDesc Total time spent releasing a distributed lock.
becomeGrantorRequestsDesc Total number of times this member has explicitly requested to become lock grantor.

FunctionServiceStatistics

These statistics are the aggregate statistics for all function executions. The primary statistics are:

Statistic Description
functionExecutionsCompleted Total number of completed function.execute() calls.
functionExecutionsCompletedProcessingTime Total time consumed for all completed function invocations.
functionExecutionsRunning Number of function invocations that are currently running.
resultsSentToResultCollector Total number of results sent to the ResultCollector.
resultsReceived Total number of results received and passed to the ResultCollector.
functionExecutionsHasResultCompletedProcessingTime Total time consumed for all completed execute() calls where hasResult() returns true.
functionExecutionsHasResultRunning A gauge indicating the number of currently active execute() calls for functions where hasResult() returns true.
functionExecutionsExceptions Total number of Exceptions Occured while executing functions.

FunctionStatistics

These are the statistics for each execution of the function. The primary statistics are:

Statistic Description
functionExecutionsCompleted Total number of completed function.execute() calls for given function.
functionExecutionsCompletedProcessingTime Total time consumed for all completed invocations of the given function.
functionExecutionsRunning number of currently running invocations of the given function.
resultsSentToResultCollector Total number of results sent to the ResultCollector.
functionExecutionCalls Total number of FunctionService.execute() calls for given function.
functionExecutionsHasResultCompletedProcessingTime Total time consumed for all completed given function.execute() calls where hasResult() returns true.
functionExecutionsHasResultRunning A gauge indicating the number of currently active execute() calls for functions where hasResult() returns true.
resultsReceived Total number of results received and passed to the ResultCollector.
functionExecutionsExceptions Total number of Exceptions Occurred while executing function.

GatewayStatistics

These statistics are for an outgoing gateway queue and connection. The primary statistics are:

Statistic Description
eventsQueued Number of events operations added to the event queue.
eventsNotQueuedConflated Number of events operations received but not added to the event queue because the queue already contains an event with the event's key.
eventQueueTime Total time, in nanoseconds, spent queueing events.
eventQueueSize Size of the event operations queue.
eventsDistributed Number of events operations removed from the event queue and sent.
batchDistributionTime Total time, in nanoseconds, spent distributing batches of events to other gateways.
batchesDistributed Number of batches of events operations removed from the event queue and sent.
batchesRedistributed Number of batches of events operations removed from the event queue and resent.
unprocessedTokensAddedByPrimary Number of tokens added through a listener to the secondary's unprocessed token map by the primary.
unprocessedEventsAddedBySecondary Number of events added to the secondary's unprocessed event map by the secondary.
unprocessedEventsRemovedByPrimary Number of events removed through a listener from the secondary's unprocessed event map by the primary.
unprocessedTokensRemovedBySecondary Number of tokens removed from the secondary's unprocessed token map by the secondary.
unprocessedEventsRemovedByTimeout Number of events removed from the secondary's unprocessed event map by a timeout.
unprocessedTokensRemovedByTimeout Number of tokens removed from the secondary's unprocessed token map by a timeout.
unprocessedEventMapSize Current number of events entries in the secondary's unprocessed event map.
unprocessedTokenMapSize Current number of tokens entries in the secondary's unprocessed token map.

GatewayHubStatistics

These statistics are for the WAN gateway hub. The primary statistics are:

Statistic Description
eventsReceived Number of events operations received by this hub.
eventsQueued Number of events operations added to the event queue by this hub.
eventQueueTime Total time, in nanoseconds, spent queueing events
eventQueueSize Size of the event operations queue.
eventsProcessed Number of events operations removed from the event queue and processed by this hub.
numberOfGateways Number of gateways operations known to this hub.

LocatorStatistics

These statistics are on the GemFire locator. The primary statistics are:

Statistic Description
KNOWN_LOCATORS Number of locators known to this locator.
REQUESTS_TO_LOCATOR Number of requests this locator has received from clients.
RESPONSES_FROM_LOCATOR Number of responses this locator has sent to clients.
ENDPOINTS_KNOWN Number of servers this locator knows about.
REQUESTS_IN_PROGRESS The number of location requests currently being processed by the thread pool.
REQUEST_TIME Time, measured in nanoseconds, spent processing server location requests.
RESPONSE_TIME Time, measured in nanoseconds, spent sending location responses to clients.
SERVER_LOAD_UPDATES Total number of times a server load update has been received.

LRUStatistics – Count-based

The entry-count least recently used (LRU) eviction mechanism records these LRUStatistics. The primary statistics are:

Statistic Description
entriesAllowed Number of entries allowed in this region.
entryCount Number of entries in this region.
lruEvictions Number of total entry evictions triggered by an LRU.
lruDestroys Number of entry destroys triggered by an LRU.
lruDestroysLimit Maximum number of entry destroys triggered by an LRU before a scan occurs.
lruEvaluations Number of entries evaluated during LRU operations
lruGreedyReturns Number of non-LRU entries evicted during LRU operations.

LRUStatistics – Size-based

The least recently used (LRU) mechanism that keeps the size of a region under a given set point records these MemLRUStatistics. The primary statistics are:

Statistic Description
bytesAllowed Total number of bytes allowed in this region.
byteCount Number of bytes in region
lruEvictions Total number of entry evictions triggered by LRU.
lruDestroys Number of entry destroys triggered by LRU.
lruDestroysLimit Maximum number of entry destroys triggered by LRU before a scan occurs.
lruEvaluations Number of entries evaluated during LRU operations.
lruGreedyReturns Number of non-LRU entries evicted during LRU operations.

PartitionedRegion<partitioned_region_name>Statistics

Partitioned Region Statistics on Region Operations

These statistics track the standard region operations executed in the member. Operations can originate locally or in a request from a remote member.
Note: Unsuccessful operations are not counted in these statistics.
The primary statistics are:
Statistic Description
containsKeyCompleted Number of successful containsKey operations in this member.
containsKeyOpsRetried Number of containsKey or containsValueForKey operations retried due to failures. This stat counts each retried operation only once, even if it requires multiple retries.
containsKeyRetries Total number of times containsKey or containsValueForKey operations were retried. If multiple retries are required on a single operation, this stat counts them all.
containsKeyTime Total time, in nanoseconds, the member spent doing containsKey operations in this member.
containsValueForKeyCompleted Number of successful containsValueForKey operations in this member.
containsValueForKeyTime Total time, in nanoseconds, the member spent doing containsValueForKey operations in this member.
createOpsRetried Number of create operations retried due to failures. This stat counts each retried operation only once, even if it requires multiple retries.
createRetries Total number of times create operations were retried. If multiple retries are required on a single operation, this stat counts them all.
createsCompleted Number of successful create operations in this member.
createTime Total time, in nanoseconds, the member spent doing create operations in this member.
destroyOpsRetried Number of destroy operations retried due to failures. This stat counts each retried operation only once, even if it requires multiple retries.
destroyRetries Total number of times destroy operations were retried. If multiple retries are required on a single operation, this stat counts them all.
destroysCompleted Number of successful destroy operations in this member.
destroyTime Total time, in nanoseconds, the member spent doing destroy operations in this member.
getOpsRetried Number of get operations retried due to failures. This stat counts each retried operation only once, even if it requires multiple retries.
getEntriesCompleted Number of get entry operations completed.
getEntriesTime Total time, in nanoseconds, spent performing get entry operations.
getRetries Total number of times get operations were retried. If multiple retries are required on a single operation, this stat counts them all.
getsCompleted Number of successful get operations in this member.
getTime Total time, in nanoseconds, the member spent doing get operations in this member.
sentMessageMaxTime Longest amount of time, in milliseconds, taken to write a message to the network before a forced disconnect occurs. This stat is always active regardless of the setting of the enable-time-statistics gemfire.properties setting.
replyWaitMaxTime Longest amount of time, in milliseconds, taken to write a message and receive a reply before a forced disconnect occurs. This stat is always active regardless of the setting of the enable-time-statistics gemfire.properties setting.
invalidatesCompleted Number of successful invalidate operations in this member.
invalidateOpsRetried Number of invalidate operations retried due to failures. This stat counts each retried operation only once, even if it requires multiple retries.
invalidateRetries Total number of times invalidate operations were retried. If multiple retries are required on a single operation, this stat counts them all.
invalidateTime Total time, in nanoseconds, the member spent doing invalidate operations in this member.
putOpsRetried Number of put operations retried due to failures. This stat counts each retried operation only once, even if it requires multiple retries.
putRetries Total number of times put operations were retried. If multiple retries are required on a single operation, this stat counts them all.
putsCompleted Number of successful put operations in this member.
putTime Total time, in nanoseconds, the member spent doing put operations in this member.

Partitioned Region Statistics on Partition Messages

Note: Unsuccessful operations and local operations—those that originated in this member—are not counted in these statistics.
The primary statistics are:
Statistic Description
partitionMessagesProcessed Number of region operations executed in this member at the request of other data stores for the region.
partitionMessagesProcessingTime Total time, in nanoseconds, the member spent executing region operations in this member at the request of remote members.
partitionMessagesReceived Number of remote requests this member received for any region operation in this member.
partitionMessagesSent Number of requests this member sent for any region operation on a remote member.
prMetaDataSentCount Number of times meta data refresh sent on client's request. Used with pr-single-hop functionality.

Partitioned Region Statistics on Data Entry Caching

These statistics track the pattern of data entry distribution among the buckets in this member. The primary statistics are:

Statistic Description
avgBucketSize Average number of entries for each of the primary buckets in this member.
bucketCount Total number of buckets in this member.
bucketCreationsCompleted Number of logical bucket creation operations requests completed after which the bucket was created.
bucketCreationsTime Total time, in nanoseconds, spent waiting for bucket creation requests to complete after which the bucket was created.
bucketCreationsDiscoveryCompleted Number of bucket creation operations requests completed after which it was discovered that the bucket was created by another member.
bucketCreationsDiscoveryTime Total time, in nanoseconds, spent waiting for bucket creation requests to complete after which it was discovered that the bucket was created by another member.
dataStoreBytesInUse The number of bytes stored in this cache for the named partitioned region.
dataStoreEntryCount Total number of entries in all the buckets in this member.
maxBucketSize Largest number of entries in the primary buckets in this member.
minBucketSize Smallest number of entries in the primary buckets in this member.
totalBucketSize Total number of entries in the primary buckets.

Partitioned Region Statistics on Redundancy

These statistics track status on partitioned region data copies. The primary statistics are:

Statistic Description
configuredRedundantCopies This is equivalent to the PartitionAttributes.getRedundantCopies configuration that was used to create this partitioned region. This value remains unchanged for a given partitioned region.
actualRedundantCopies The least current redundant number of copies for any data in this partitioned region (there may be some data that is fully redundant, but some data will have only this number of copies). This value may drop when a data store is lost or rise when a data store is added. This value may drop temporarily during partitioned region creation or destruction and then rise again.
Note: If this value remains low, then partitioned region data is at risk and may be lost if another data store is lost.
A healthy partitioned region will maintain a value equal to configuredRedundantCopies. The user should add one or more data stores if the value remains low. High-availability may result in a brief fluctuation, but it should return to a value equal to configuredRedundantCopies if there are sufficient data stores present (that is, killing one data store will cause its data to fail over to another data store).
lowRedundancyBucketCount The number of buckets in this partitioned region that currently have fewer copies than the configuredRedundantCopies. This value may rise above zero when a data store is lost and return to zero when one or more data stores are added. This value may rise temporarily during partitioned region creation or destruction and then return to zero.
Note: If this value remains above zero, then partitioned region data is at risk and may be lost if another data store is lost.
This value will be above zero whenever actualRedundantCopies is less than configuredRedundantCopies. A healthy partitioned region will maintain a value of zero. The user should add one or more datstores if this value remains above zero. High-availability may result in a brief fluctuation, but it should return to zero if there are sufficient data stores present (that is, killing one data store will cause its data to fail over to another data store).

PoolStats

These statistics are in a client and they describe one of the client’s connection pools. The primary statistics are:

Statistic Description
INITIAL_CONTACTS Number of contacts initially made the user.
KNOWN_LOCATORS Current number of locators discovered.
ENDPOINTS_KNOWN Current number of servers discovered.
QUEUE_SERVERS Number of servers hosting this client.s subscription queue.
REQUESTS_TO_LOCATOR Number of requests from this connection pool to a locator.
RESPONSES_FROM_LOCATOR Number of responses from the locator to this connection pool.
connections Current number of connections.
connects Total number of times a connection has been created.
disconnects Total number of times a connection has been destroyed.
minPoolSizeConnects Total number of connects done to maintain minimum pool size.
lifetimeConnects Total number of connects done due to lifetime expiration.
idleDisconnects Total number of disconnects done due to idle expiration.
lifetimeDisconnects Total number of disconnects done due to lifetime expiration.
idleChecks Total number of checks done for idle expiration.
lifetimeChecks Total number of checks done for lifetime expiration.
lifetimeExtensions Total number of times a connection's lifetime has been extended because the servers are still balanced.
connectionWaitsInProgress Current number of threads waiting for a connection.
connectionWaits Total number of times a thread completed waiting for a connection (either by timing out or by getting a connection).
connectionWaitTime Total time, in nanoseconds, spent waiting for a connection.

LinuxProcessStats

Operating system statistics on the member’s process. These can be used to determine the member’s CPU, memory, and disk usage. Operating system statistics are not available in pure Java mode, where GemFire runs without the use of the GemFire native library. These are the equivalent of SolarisProcessStats when we're running on Linux. The primary statistics are:

Statistic Description
imageSize Size, in megabytes, of the process's image.
rssSIze Size, in megabytes, of the process's resident size.

SolarisProcessStats

Operating system statistics on the member process. These can be used to determine the member’s CPU, memory, and disk usage. Operating system statistics are not available in pure Java mode, where GemFire runs without the use of the GemFire native library. For the Solaris operating system, when not using pure-java mode, these statistics are gathered for every process. The primary statistics are:

Statistic Description
allOtherSleepTime The number of milliseconds the process has been sleeping for some reason not tracked by any other stat. Note, all lightweight processes (lwps) contribute to this stat's value, so check lwpCurCount to understand large values.
characterIo The number of characters read and written.
dataFaultSleepTime The number of milliseconds the process has been faulting in data pages.
heapSize The size, in megabytes, of the process's heap.
imageSize The size, in megabytes, of the process's image.
involContextSwitches The number of times the process operation was forced to do a context switch.
kernelFaultSleepTime The number of milliseconds the process has been faulting in kernel pages.
lockWaitSleepTime The number of milliseconds the process has been waiting for a user lock. Note, all lwp's contribute to this stat's value, so check lwpCurCount to understand large values.
lwpCurCount The current number of lightweight process threads that exist in the process.
lwpTotalCount The total number of lightweight process threads that have ever contributed to the process's statistics.
majorFaults The number of times the process operation has had a page fault that needed disk access.
messagesRecv The number of messages received by the process.
messagesSent The number of messages sent by the process.
minorFaults The number of times the process operation has had a page fault that did not need disk access.
rssSize The size, in megabytes of the process's resident set size.
signalsReceived The total number of operating system signals this process has received.
systemCalls The total number system call operations done by this process.
stackSize The size, in megabytes, of the process's stack.
stoppedTime The amount of time, in milliseconds, the process has been stopped.
systemTime The amount it time, in milliseconds, the process has been using the CPU to execute system calls.
textFaultSleepTime The amount of time, in milliseconds, the process has been faulting in text pages.
trapTime The amount of time, in milliseconds, the process has been in system traps.
userTime The amount of time, in milliseconds, the process has been using the CPU to execute user code.
volContextSwitches The number of voluntary context switch operations done by the process.
waitCpuTime The amount of time, in milliseconds, the process has been waiting for a CPU due to latency.
activeTime The amount of time, in milliseconds, the process has been using the CPU to execute user or system code.
cpuUsed The percentage of recent CPU time used by the process.
memoryUsed The percentage of real memory used by the process.

WindowsProcessStats

Operating system statistics on the member process. These can be used to determine the member’s CPU, memory, and disk usage. Operating system statistics are not available in pure Java mode, where GemFire runs without the use of the GemFire native library. These are the equivalent of SolarisProcessStats when running on Windows. The primary statistics are:

Statistic Description
handles The total number of handle items currently open by this process. This number is the sum of the handles currently open by each thread in this process.
priorityBase The current base priority of the process. Threads within a process can raise and lower their own base priority relative to the process's base priority.
threads Number of threads currently active in this process. An instruction is the basic unit of execution in a processor, and a thread is the object that executes instructions. Every running process has at least one thread.
activeTime The elapsed time, in milliseconds, that all of the threads of this process used the processor to execute instructions. An instruction is the basic unit of execution in a computer, a thread is the object that executes instructions, and a process is the object created when a program is run. Code executed to handle some hardware interrupts and trap conditions are included in this count.
pageFaults The total number of page fault operations by the threads executing in this process. A page fault occurs when a thread refers to a virtual memory page that is not in its working set in main memory. This will not cause the page to be fetched from disk if it is on the standby list and hence already in main memory, or if it is in use by another process with whom the page is shared.
pageFileSize The current number of bytes this process has used in the paging file(s). Paging files are used to store pages of memory used by the process that are not contained in other files. Paging files are shared by all processes, and lack of space in paging files can prevent other processes from allocating memory.
pageFileSizePeak The maximum number of bytes this process has used in the paging file(s). Paging files are used to store pages of memory used by the process that are not contained in other files. Paging files are shared by all processes, and lack of space in paging files can prevent other processes from allocating memory.
privateSize The current number of bytes this process has allocated that cannot be shared with other processes.
systemTime The elapsed time, in milliseconds, that the threads of the process have spent executing code in privileged mode. When a Windows system service is called, the service will often run in Privileged Mode to gain access to system-private data. Such data is protected from access by threads executing in user mode. Calls to the system can be explicit or implicit, such as page faults or interrupts. Unlike some early operating systems, Windows uses process boundaries for subsystem protection in addition to the traditional protection of user and privileged modes. These subsystem processes provide additional protection. Therefore, some work done by Windows on behalf of your application might appear in other subsystem processes in addition to the privileged time in your process.
userTime The elapsed time, in milliseconds, that this process's threads have spent executing code in user mode. Applications, environment subsystems, and integral subsystems execute in user mode. Code executing in User Mode cannot damage the integrity of the Windows Executive, Kernel, and device drivers. Unlike some early operating systems, Windows uses process boundaries for subsystem protection in addition to the traditional protection of user and privileged modes. These subsystem processes provide additional protection. Therefore, some work done by Windows on behalf of your application might appear in other subsystem processes in addition to the privileged time in your process.
virtualSize Virtual Bytes is the current size in bytes of the virtual address space the process is using. Use of virtual address space does not necessarily imply corresponding use of either disk or main memory pages. Virtual space is finite, and by using too much, the process can limit its ability to load libraries.
virtualSizePeak The maximum number of bytes of virtual address space the process has used at any one time. Use of virtual address space does not necessarily imply corresponding use of either disk or main memory pages. Virtual space is however finite, and by using too much, the process might limit its ability to load libraries.
workingSetSize The current number of bytes in the Working Set of this process. The Working Set is the set of memory pages touched recently by the threads in the process. If free memory in the computer is above a threshold, pages are left in the Working Set of a process even if they are not in use. When free memory falls below a threshold, pages are trimmed from Working Sets. If they are needed they will then be soft-faulted back into the Working Set before they are paged out to disk.
workingSetSizePeak The maximum number of bytes in the Working Set of this process at any point in time. The Working Set is the set of memory pages touched recently by the threads in the process. If free memory in the computer is above a threshold, pages are left in the Working Set of a process even if they are not in use. When free memory falls below a threshold, pages are trimmed from Working Sets. If they are needed they will then be soft-faulted back into the Working Set before they leave main memory.

ResourceManagerStats

Statistics related to the GemFire resource manager. Use these to help analyze and tune your JVM memory settings and the GemFire resource-manager settings. The primary statistics are:

Statistic Description
criticalThreshold The cache resource-manager setting critical-heap-percentage..
heapCriticalEvents Number of times incoming cache activities were blocked due to heap use going over the critical threshold.
heapSafeEvents Number of times incoming cache activities were unblocked due to heap use going under the critical threshold.
evictionThreshold The cache resource-manager setting eviction-heap-percentage..
evictionStartEvents Number of times eviction activities were started due to the heap use going over the eviction threshold.
evictionStopEvents Number of times eviction activities were stopped due to the heap use going below the eviction threshold.
tenuredHeapUsed Percentage of tenured heap currently in use.

StatSampler

These statistics show how much time is spent collecting statistics. The primary statistics are:

Statistic Description
sampleCount Total number of samples taken by this sampler.
sampleTime Total amount of time spent taking samples.

LinuxSystemStats

Operating system statistics on the member’s machine. These can be used to determine total cpu, memory, and disk usage on the machine. Operating system statistics are not available in pure Java mode. These are the equivalent of SolarisSystemStats when running on Linux. The primary statistics are:

Statistic Description
allocatedSwap Number of megabytes of swap space that have actually been written to. Swap space must be reserved before it can be allocated.
bufferMemory Number of megabytes of memory allocated to buffers.
contextSwitches Total number of context switches from one thread to another on the computer. Thread switches can occur either inside of a single process or across processes. A thread switch may be caused either by one thread asking another for information, or by a thread being preempted by another, higher priority thread becoming ready to run.
cpuActive Percentage of the total available time that has been used in a non-idle state.
cpuIdle Percentage of the total available time that has been spent sleeping.
cpuNice Percentage of the total available time that has been used to execute user code in processes with low priority.
cpuSystem Percentage of the total available time that has been used to execute system (that is, kernel) code.
cpuUser Percentage of the total available time that has been used to execute user code.
cpus Number of online CPUs (items) on the local machine.
freeMemory Number of megabytes of unused memory on the machine.
pagesPagedIn Total number of pages that have been brought into memory from disk by the operating system's memory manager.
pagesPagedOut Total number of pages that have been flushed from memory to disk by the operating system's memory manager.
pagesSwappedIn Total number of swap pages that have been read in from disk by the operating system's memory manager.
pagesSwappedOut Total number of swap pages that have been written out to disk by the operating system's memory manager.
physicalMemory Actual amount of total physical memory on the machine.
processCreates The total number of times a process (operation) has been created.
processes Number of processes in the computer at the time of data collection. Notice that this is an instantaneous count, not an average over the time interval. Each process represents the running of a program.
sharedMemory Number of megabytes of shared memory on the machine.
unallocatedSwap Number of megabytes of swap space that have not been allocated.
loopbackPackets Number of network packets sent (or received) on the loopback interface.
loopbackBytes Number of network bytes sent (or received) on the loopback interface.
recvPackets Total number of network packets received (excluding loopback).
recvBytes Total number of network bytes received (excluding loopback).
recvErrors Total number of network receive errors.
recvDrops Total number network receives (packets) dropped.
xmitPackets Total number of network packets transmitted (excluding loopback.
xmitBytes Total number of network bytes transmitted (excluding loopback).
xmitErrors Total number of network transmit errors.
xmitDrops Total number of network transmits (packets) dropped.
xmitCollisions Total number of network transmit collisions.
loadAverage1 Average number of threads in the run queue or waiting for disk I/O over the last minute.
loadAverage15 Average number of threads in the run queue or waiting for disk I/O over the last fifteen minutes.
loadAverage5 Average number of threads in the run queue or waiting for disk I/O over the last five minutes.

SolarisSystemStats

Operating system statistics on the member’s machine. These can be used to determine total cpu, memory, and disk usage on the machine. Operating system statistics are not available in pure Java mode. These statistics are recorded for the machine on which the program is running when not using pure Java and running on Solaris. The primary statistics are:

Statistic Description
allocatedSwap The number of megabytes of swap space that have actually been written to. Swap space must be reserved before it can be allocated.
cpuActive The percentage of the total available time that has been used to execute user or system code.
cpuIdle The percentage of the total available time that has been spent sleeping.
cpuIoWait The percentage of the total available time that has been spent waiting for disk IO to complete.
cpuSwapWait The percentage of the total available time that has been spent waiting for paging and swapping to complete.
cpuSystem The percentage of the total available time that has been used to execute system (that is, kernel) code.
cpuUser The percentage of the total available time that has been used to execute user code.
cpuWaiting The percentage of the total available time that has been spent waiting for IO, paging, or swapping.
cpus The number of online CPUs on the local machine.
freeMemory The number of megabytes of unused memory on the machine.
physicalMemory The actual amount of total physical memory on the machine.
processes The number of processes in the computer at the time of data collection. Notice, this is an instantaneous count, not an average over the time interval. Each process represents the running of a program
reservedSwap The number of megabytes of swap space reserved for allocation by a particular process.
schedulerRunCount The total number of times the system scheduler has put a thread in its run queue.
schedulerSwapCount The total number of times the system scheduler has swapped out an idle process.
schedulerWaitCount The total number of times the system scheduler has removed a thread from the run queue because it was waiting for a resource.
unreservedSwap The number of megabytes of swap space that are free. If this value goes to zero new processes can no longer be created.
unallocatedSwap The number of megabytes of swap space that have not been allocated.
anonymousPagesFreed The total number pages that contain heap, stack, or other changeable data that have been removed from memory and added to the free list.
anonymousPagesPagedIn The total number pages that contain heap, stack, or other changeable data that have been allocated in memory and possibly copied from disk.
anonymousPagesPagedOut The total number pages that contain heap, stack, or other changeable data that have been removed from memory and copied to disk.
contextSwitches The total number of context switches from one thread to another on the computer. Thread switches can occur either inside of a single process or across processes. A thread switch may be caused either by one thread asking another for information, or by a thread being preempted by another, higher priority thread becoming ready to run.
execPagesFreed The total number read only pages that contain code or data that have been removed from memory and returned to the free list.
execPagesPagedIn The total number read only pages that contain code or data that have been copied from disk to memory.
execPagesPagedOut The total number read only pages that contain code or data that have been removed from memory and will need to be paged in when used again.
failedMutexEnters The total number of times a thread entering a mutex had to wait for the mutex to be unlocked.
failedReaderLocks The total number of times readers failed to obtain a readers/writer locks on their first try. When this happens the reader must wait for the current writer to release the lock.
failedWriterLocks The total number of times writers failed to obtain a readers/writer locks on their first try. When this happens the writer must wait for all the current readers or the single writer to release the lock.
fileSystemPagesFreed The total number of pages, that contained the contents of a file due to the file being read from a file system, that have been removed from memory and put on the free list.
fileSystemPagesPagedIn The total number of pages that contain the contents of a file due to the file being read from a file system.
fileSystemPagesPagedOut The total number of pages, that contained the contents of a file due to the file being read from a file system, that have been removed from memory and copied to disk.
hatMinorFaults The total number of hat faults. You only get these on systems with software memory management units.
interrupts The total number of interrupts that have occurred on the computer.
involContextSwitches The total number of times a thread was forced to give up the CPU even though it was still ready to run.
majorPageFaults The total number of times a page fault required disk IO to get the page.
messageCount The total number of msgrcv and msgsnd system calls.
pageDaemonCycles The total number of revolutions of the page daemon's scan "clock hand".
pageIns The total number of times pages have been brought into memory from disk by the operating system's memory manager.
pageOuts The total number of times pages have been flushed from memory to disk by the operating system's memory manager.
pagerRuns The total number of times the pager daemon has been scheduled to run.
pagesPagedIn The total number of pages that have been brought into memory from disk by the operating system's memory manager.
pagesPagedOut The total number of pages that have been flushed from memory to disk by the operating system's memory manager.
pagesScanned The total number pages examined by the pageout daemon. When the amount of free memory gets below a certain size, the daemon starts to look for inactive memory pages to steal from processes. A high scan rate is a good indication of needing more memory.
procsInIoWait The number of processes waiting for block I/O at this instant in time.
protectionFaults The total number of times memory has been accessed in a way that was not allowed. This results in a segmentation violation and in most cases a core dump.
semphoreOps The total number of semaphore operations.
softwareLockFaults The total number of fault operations caused by software locks held on memory pages.
systemCalls The total number of fault operations caused by software locks held on memory pages.
systemMinorFaults The total number of minor page fault operations in kernel code. Minor page faults do not require disk access.
threadCreates The total number of times a thread operation has been created.
traps The total number of trap operations that have occurred on the computer.
userMinorFaults The total number of minor page fault operations in non-kernel code. Minor page faults do not require disk access.
loopbackInputPackets The total number of input packets received over the loopback network adaptor.
loopbackOutputPackets The total number of output packets sent over the loopback network adaptor.
inputPackets Packets received.
inputErrors Input errors.
outputPackets Solaris out packets.
outputErrors Output errors.
collisions Solaris collisions.
inputBytes Octets received.
outputBytes Octats transmitted.
multicastInputPackets Multicast packets received.
multicastOutputPackets Multicast packets requested to be sent.
broadcastInputPackets Broadcast packets received.
broadcastOutputPackets Broadcast packets requested to be sent.
inputPacketsDiscarded Number of received packets discarded.
outputPacketsDiscarded Packets that could not be sent up because the queue was flow controlled.
loadAverage1 The average number of threads ready to run over the last minute.
loadAverage15 The average number of threads ready to run over the last 15 minutes.
loadAverage5 The average number of threads ready to run over the last five minute.

VMStats

Show the JVM’s Java usage and can be used to detect possible problems with memory consumption. These statistics are recorded from java.lang.Runtime under VMStats. The primary statistics are:

Statistic Description
cpus Number of CPUs available to the member on its machine.
daemonThreads Current number of live daemon threads in this JVM.
fdLimit Maximum number of file descriptors.
fdsOpen Current number of open file descriptors.
freeMemory An approximation for the total amount of memory, measured in bytes, currently available for future allocated objects.
loadedClasses Total number of classes loaded since the JVM started.
maxMemory The maximum amount of memory, measured in bytes, that the JVM will attempt to use.
peakThreads High water mark of live threads in this JVM.
pendingFinalization Number of objects that are pending finalization in the JVM.
processCpuTime CPU time, measured in nanoseconds, used by the process.
threads Current number of live threads (both daemon and non-daemon) in this JVM.
threadStarts Total number of times a thread has been started since this JVM started.
totalMemory The total amount of memory, measure in bytes, currently available for current and future objects.
unloadedClasses Total number of classes unloaded since the JVM started.

VMGCStats

These statistics show how much time used by different JVM garbage collection and are available on JDK 1.5 and later JVMs. The primary statistics are:

Statistic Description
collections Total number of collections this garbage collector has done.
collectionTime Approximate elapsed time spent doing collections by this garbage collector.

VMMemoryPoolStats

These statistics describe memory usage in difference garbage collector memory pools. The primary statistics are:

Statistic Description
collectionUsageExceeded Total number of times the garbage collector detected that memory usage in this pool exceeded the collectionUsageThreshold.
collectionUsageThreshold The collection usage threshold, measured in bytes, for this pool.
collectionUsedMemory The estimated amount of used memory, measured in bytes, after that last garbage collection of this pool.
currentCommittedMemory The amount of committed memory, measured in bytes, for this pool.
currentInitMemory Initial memory the JVM requested from the operating system for this pool.
currentMaxMemory The maximum amount of memory, measured in bytes, this pool can have.
currentUsedMemory The estimated amount of used memory, measured in bytes, currently in use for this pool.
usageExceeded Total number of times that memory usage in this pool exceeded the usageThreshold.
usageThreshold The usage threshold, measured in bytes, for this pool.

VMMemoryUsageStats

Show details on how the Java heap memory is being used. This statistic is available on JDK 1.5 and later JVMs. The primary statistics are:

Statistic Description
committedMemory The amount of committed memory, measured in bytes, for this area.
initMemory Initial memory the JVM requested from the operating system for this area.
maxMemory The maximum amount of memory, measured in bytes, this area can have.
usedMemory The amount of used memory, measured in bytes, for this area.

Cache Performance Statistics Related to Transactions

During the operation of GemFire cache transactions, if enabled, the following statistics are compiled and stored as properties in the CachePerfStats statistic resource. Because the transaction’s data scope is the cache, these statistics are collected on a per-cache basis. The primary statistics are:

Statistic Description
txCommits Total number of times a transaction commit has succeeded.
txFailures Total number of times a transaction commit has failed.
txRollbacks Total number of times a transaction has been explicitly rolled back.
txSuccessLifeTime The total amount of time, in nanoseconds, spent in a transaction before a successful commit. The time measured starts at transaction begin and ends when commit is called.
txFailedLifeTime The total amount of time, in nanoseconds, spent in a transaction before a failed commit. The time measured starts at transaction begin and ends when commit is called.
txRollbackLifeTime The total amount of time, in nanoseconds, spent in a transaction before an explicit rollback. The time measured starts at transaction begin and ends when rollback is called.
txCommitTime The total amount of time, in nanoseconds, spent doing successful transaction commits.
txFailureTime The total amount of time, in nanoseconds, spent doing failed transaction commits.
txRollbackTime The total amount of time, in nanoseconds, spent doing explicit transaction rollbacks.
txCommitChanges Total number of changes made by committed transactions.
txFailureChanges Total number of changes lost by failed transactions.
txRollbackChanges Total number of changes lost by explicit transaction rollbacks.
txConflictCheckTime The total amount of time, in nanoseconds, spent doing conflict checks during transaction commit.

IndexStats - Query Independent Index Statistics

Statistic Description
numKeys Number of keys currently stored in the Index.
numValues Number of values currently stored in the Index.
numUpdates Number of updates applied and completed on the Index while inserting, modifying , or deleting corresponding data in GemFire.
updateTime Total time taken in applying and completing updates on the Index.
updatesInProgress Current number of updates in progress on the Index. Concurrent updates on an index are allowed.

IndexStats - Query Dependent Index Statistics

Statistic Description
numUses Number of times the Index has been used for querying.
useTime Total time during the use of the Index for querying.
usesInProgress Current number of uses of the index in progress or current number of concurrent threads accessing the index for querying. Concurrent use of an index is allowed for different queries.