Generic Data Integration queue exceeded allowed size

Problem

ERROR – Generic Data Integration queue exceeded allowed size 500* olest samples were discarded

*this value may vary, 500 is the default value.

Cause

This message occurs when remote system which should consume data from Sitescope over “generic data integration” channel is down or can not process messages from SiteScope.

The value of _dataSamplesQueueMaxSize is the upper limit of the data integration sample’s queue. If this limit is reached, old samples are discarded. If this value is limiting the data queue, then we need to increase that number.

Fix
For further debbuging the below appenders can be added in either the log4j.properties or bac_integration.properties; these files are located on the directory: \SiteScope\conf\core\Tools\log4j\PlainJava
###################################################################################
# Generic Event Integration
###################################################################################
log4j.category.genericEventIntegration=DEBUG, generic.event.integration.appender
log4j.additivity.genericEventIntegration=false
log4j.appender.generic.event.integration.appender=org.apache.log4j.RollingFileAppender
log4j.appender.generic.event.integration.appender.File=../${log.file.path}/generic_event_integration.log
log4j.appender.generic.event.integration.appender.MaxFileSize=${def.file.max.size}
log4j.appender.generic.event.integration.appender.MaxBackupIndex=${def.files.backup.count}
log4j.appender.generic.event.integration.appender.layout=org.apache.log4j.PatternLayout
log4j.appender.generic.event.integration.appender.layout.ConversionPattern=%d [%t] (%F:%L) %-5p – %m%n
log4j.appender.generic.event.integration.encoding=${general.encoding}
###################################################################################
# Generic Data Integration
###################################################################################
log4j.category.genericDataIntegration=DEBUG, generic.data.integration.appender
log4j.additivity.genericDataIntegration=false
log4j.appender.generic.data.integration.appender=org.apache.log4j.RollingFileAppender
log4j.appender.generic.data.integration.appender.File=../${log.file.path}/generic_data_integration.log
log4j.appender.generic.data.integration.appender.MaxFileSize=${def.file.max.size}
log4j.appender.generic.data.integration.appender.MaxBackupIndex=${def.files.backup.count}
log4j.appender.generic.data.integration.appender.layout=org.apache.log4j.PatternLayout
log4j.appender.generic.data.integration.appender.layout.ConversionPattern=%d [%t] (%F:%L) %-5p – %m%n
log4j.appender.generic.data.integration.encoding=${general.encoding}
To solve this problem proceed with below steps:
1. stop SiteScope service
2. increase the queue sizes in “master.config” to below values:
     _dataSamplesQueueMaxSize=2000
     _dataSamplesQueueDiscardSamples=1000
3. restart sitescope after changing these parameters.
After the change, run the problematic monitor(s) and confirm SiteScope data is arriving successfully.
Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s