iHateZombies
19th March 2009, 04:07
Hello all,
I am running Centreon 2.0.1 on a RHEL 5.2 machine. I noticed that I was sporadically beginning to see gaps in my graphs. At any given point in time, some graphs would have data and others would not. After verifying that all of the services were running and performance data from them was being saved to my perf data file I stumbled on quite a bit of segfaults coming from centstorage.
Each run I see this message outputed to dmesg and /var/log/message:
centstorage[8893]: segfault at 00002b47f9d15c50 rip 000000342d42b653 rsp 00007fffb56c3ab0 error 6
centstorage[16150]: segfault at 00002b47f9d15c50 rip 000000342d42b653 rsp 00007fffb56c3ab0 error 6
Looking at the censtorage log I am seeing quite a few of the following:
1237430764 - ERROR while updating /usr/local/centreon/centstorage_rrds/status/151.rrd at 1237430744 -> 100 : reading the cookie off /usr/loc
al/centreon/centstorage_rrds/status/151.rrd failed
1237430764 - ERROR while updating /usr/local/centreon/centstorage_rrds/status/3.rrd at 1237430744 -> 100 : reading the cookie off /usr/local
/centreon/centstorage_rrds/status/3.rrd failed
1237430764 - ERROR while updating /usr/local/centreon/centstorage_rrds/status/14.rrd at 1237430746 -> 100 : reading the cookie off /usr/loca
l/centreon/centstorage_rrds/status/14.rrd failed
I also tried to rebuild some of the graphs with the missing data only to find that they ended up looking the same. And querying my centstorage.data_bin table I was able to verify that there were indeed gaps which has me thinking that the process is bailing out before storing the service's metrics.
I currently have the following rrd packages installed:
rrdtool-1.2.30-1.el5.rf
perl-rrdtool-1.2.30-1.el5.rf
And my centreon configuration does have 1.2.30 as its version number (if that makes a difference).
Does anyone have any ideas on what this could be or on how to further troubleshoot what is happening?
I am running Centreon 2.0.1 on a RHEL 5.2 machine. I noticed that I was sporadically beginning to see gaps in my graphs. At any given point in time, some graphs would have data and others would not. After verifying that all of the services were running and performance data from them was being saved to my perf data file I stumbled on quite a bit of segfaults coming from centstorage.
Each run I see this message outputed to dmesg and /var/log/message:
centstorage[8893]: segfault at 00002b47f9d15c50 rip 000000342d42b653 rsp 00007fffb56c3ab0 error 6
centstorage[16150]: segfault at 00002b47f9d15c50 rip 000000342d42b653 rsp 00007fffb56c3ab0 error 6
Looking at the censtorage log I am seeing quite a few of the following:
1237430764 - ERROR while updating /usr/local/centreon/centstorage_rrds/status/151.rrd at 1237430744 -> 100 : reading the cookie off /usr/loc
al/centreon/centstorage_rrds/status/151.rrd failed
1237430764 - ERROR while updating /usr/local/centreon/centstorage_rrds/status/3.rrd at 1237430744 -> 100 : reading the cookie off /usr/local
/centreon/centstorage_rrds/status/3.rrd failed
1237430764 - ERROR while updating /usr/local/centreon/centstorage_rrds/status/14.rrd at 1237430746 -> 100 : reading the cookie off /usr/loca
l/centreon/centstorage_rrds/status/14.rrd failed
I also tried to rebuild some of the graphs with the missing data only to find that they ended up looking the same. And querying my centstorage.data_bin table I was able to verify that there were indeed gaps which has me thinking that the process is bailing out before storing the service's metrics.
I currently have the following rrd packages installed:
rrdtool-1.2.30-1.el5.rf
perl-rrdtool-1.2.30-1.el5.rf
And my centreon configuration does have 1.2.30 as its version number (if that makes a difference).
Does anyone have any ideas on what this could be or on how to further troubleshoot what is happening?