1、安装ganglia参考之前的一篇博客(以下示例使用ganglia组播方式,单播方式大家自己尝试)

2、安装jmxtrans

3、安装storm

4、修改storm配置文件storm..yaml

###nimbus config nimbus.childopts: "-verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=12345 -Xmx1024m"###supervisor config supervisor.childopts: "-verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=12346 -Xmx256m"

5、为jmxtrans增加两个json文件

分别获取nimbus和supervisor节点的jvm信息,以下文件仅列举了部分参数,如果有需要可以增加queries中的数据,以监控更多的参数,具体的MBean的参数,可以通过jconsole来查看

nimbus.json

{    "servers": [        {        		"host": "master",            "port": "12345",            "queries": [                {                    "outputWriters": [                        {                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",                            "settings": {                                "groupName": "nimbus",                                "host": "239.2.11.71",                                "port": "8649"                            }                        }                    ],                    "obj": "java.lang:type=Memory",                    "resultAlias": "nimbus.heap",                    "attr": [                        "ObjectPendingFinalizationCount"                    ]                },                {                    "outputWriters": [                        {                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",                            "settings": {                                "groupName": "nimbus",                                "host": "239.2.11.71",                                "port": "8649"                            }                        }                    ],                    "obj": "java.lang:name=Copy,type=GarbageCollector",                    "resultAlias": "nimbus.gc",                    "attr": [                        "CollectionCount",                        "CollectionTime"                    ]                },                {                    "outputWriters": [                        {                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",                            "settings": {                                "groupName": "nimbus",                                "host": "239.2.11.71",                                "port": "8649"                            }                        }                    ],                    "obj": "java.lang:name=Code Cache,type=MemoryPool",                    "resultAlias": "nimbus.threads",                    "attr": [                        "CollectionUsageThreshold",                        "CollectionUsageThresholdCount",                        "UsageThreshold",                        "UsageThresholdCount"                    ]                },                {                    "outputWriters": [                        {                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",                            "settings": {                                "groupName": "nimbus",                                "host": "239.2.11.71",                                "port": "8649"                            }                        }                    ],                    "obj": "java.lang:type=Runtime",                    "resultAlias": "nimbus.runtime",                    "attr": [                        "StartTime",                        "Uptime"                    ]                }            ],            "numQueryThreads": 2        }    ]}

supervisor.json

{    "servers": [        {        		"host": "node1",            "port": "12346",            "queries": [                {                    "outputWriters": [                        {                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",                            "settings": {                                "groupName": "supervisor",                                "host": "239.2.11.71",                                "port": "8649"                            }                        }                    ],                    "obj": "java.lang:type=Memory",                    "resultAlias": "supervisor.heap",                    "attr": [                        "ObjectPendingFinalizationCount"                    ]                },                {                    "outputWriters": [                        {                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",                            "settings": {                                "groupName": "supervisor",                                "host": "239.2.11.71",                                "port": "8649"                            }                        }                    ],                    "obj": "java.lang:name=Copy,type=GarbageCollector",                    "resultAlias": "supervisor.gc",                    "attr": [                        "CollectionCount",                        "CollectionTime"                    ]                },                {                    "outputWriters": [                        {                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",                            "settings": {                                "groupName": "supervisor",                                "host": "239.2.11.71",                                "port": "8649"                            }                        }                    ],                    "obj": "java.lang:name=Code Cache,type=MemoryPool",                    "resultAlias": "supervisor.threads",                    "attr": [                        "CollectionUsageThreshold",                        "CollectionUsageThresholdCount",                        "UsageThreshold",                        "UsageThresholdCount"                    ]                },                {                    "outputWriters": [                        {                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",                            "settings": {                                "groupName": "supervisor",                                "host": "239.2.11.71",                                "port": "8649"                            }                        }                    ],                    "obj": "java.lang:type=Runtime",                    "resultAlias": "supervisor.runtime",                    "attr": [                        "StartTime",                        "Uptime"                    ]                }            ],            "numQueryThreads": 2        }    ]}

两个json文件一定要注意host是主机名,如果写ip的话,在ganglia里同一个节点会有两个显示,看着有点别扭,大家都统一使用hostname就好.ganglia的gmnod和gmetad不需要重启,用自动收集。

说明:

    修改json文件需要重新启动jmxtrans,查看jmxtrans日志/var/log/jmxtrans/jmxtrans.log.

    service jmxtrans restart

下面来张ganglia的主界面,监控两个节点

上图显示不出来监控指标,就放下面来了,可以看到supervisor的监控数据已经收集到ganglia里了。

下图搞了master节点的页面,可以看到nimbus group的监控数据已经显示,node1节点的supervisor group懒得上图了,大家可以明白了,不明白的去面壁去