User Tools

Site Tools


gpfs_performance_monitoring

This is an old revision of the document!


Performance Monitoring

La performance monitoring tool colecciona métricas de GPFS y provee información de performance del sistema. Está habilitada por default e incluye Collectors, Sensors y Proxies.

Collector

Un collector soporta hasta 150 sensor nodes. Con un collector debería ser suficiente para nuestro sistema. Se pueden armar esquemas con más de un collector (multi-collector federation) por razones de escala y de tolerancia a fallas.

Podemos utilizar mmgt01 como Node Collector en el cluster de storage y vlmgt02 en el cluster cliente, ya que es buena práctica mantener servicios extra (como monitoreo) fuera de los quorum nodes.

Sensors

El componente que recopila datos de performance de un nodo

Proxy

Se corre un proxy por cada protocolo para recopilar métricas de ese protocolo.

IBM Storage Scale bridge for Grafana

Queremos incorporar IBM Storage Scale bridge for Grafana para poder ver métricas de performance de GPFS en Grafana.

Para eso necesitamos configurar la performance monitoring tool de GPFS.

Configurar performance monitoring tool

Necesitamos los paquetes gpfs.gss.pmsensors gpfs.gss.pmscollectors

Los encontramos únicamente en el storage node.

[root@sdmgt01 ~]# dnf search gpfs.gss.pmcollector

=========================== Name Exactly Matched: gpfs.gss.pmcollector =====================
gpfs.gss.pmcollector.x86_64 : ZIMonCollector - an in-memory database for collecting and storing performance metrics.

Descargamos los rpm con dnf.

[root@sdmgt01 ~]# dnf download gpfs.gss.pmcollector gpfs.gss.pmsensors
Updating Subscription Management repositories.
Unable to read consumer identity

This system is not registered with an entitlement server. You can use "rhc" or "subscription-manager" to register.

Last metadata expiration check: 17:29:09 ago on Thu 30 Jul 2026 06:16:49 PM -03.
(1/2): gpfs.gss.pmcollector-5.2.3-3.el9.x86_64.rpm                                                                              58 MB/s | 7.7 MB     00:00
(2/2): gpfs.gss.pmsensors-5.2.3-3.el9.x86_64.rpm                                                                                55 MB/s | 8.1 MB     00:00

Instalamos los paquetes en vlmgt02

[root@vlmgt02 gpfs_perf_testing]# dnf localinstall /data/admin/gpfs_perf_testing/gpfs.gss.pmcollector-5.2.3-3.el9.x86_64.rpm /data/admin/gpfs_perf_testing/gpfs.gss.pmsensors-5.2.3-3.el9.x86_64.rpm --disablerepo=Lenovo-Lenovo-OpenHPC-local,lenovo-hpc,lico-dep-local-library,lico-dep-local-standalone,lico-release
Updating Subscription Management repositories.
Unable to read consumer identity

This system is not registered with an entitlement server. You can use "rhc" or "subscription-manager" to register.

Local install repository for AppStream                                                                                          76 kB/s | 3.2 kB     00:00
Local install repository for BaseOS                                                                                             54 kB/s | 2.7 kB     00:00
nvidia-driver-local-rhel9-590.48.01                                                                                            3.4 MB/s | 3.5 kB     00:00
Dependencies resolved.
===============================================================================================================================================================
 Package                                      Architecture                   Version                                Repository                            Size
===============================================================================================================================================================
Installing:
 gpfs.gss.pmcollector                         x86_64                         5.2.3-3.el9                            @commandline                         7.7 M
 gpfs.gss.pmsensors                           x86_64                         5.2.3-3.el9                            @commandline                         8.1 M

Transaction Summary
===============================================================================================================================================================
Install  2 Packages

Total size: 16 M
Installed size: 65 M
Is this ok [y/N]: y
Downloading Packages:
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Running scriptlet: gpfs.gss.pmsensors-5.2.3-3.el9.x86_64                                                                                                 1/1
  Running scriptlet: gpfs.gss.pmcollector-5.2.3-3.el9.x86_64                                                                                               1/1
  Preparing        :                                                                                                                                       1/1
  Running scriptlet: gpfs.gss.pmsensors-5.2.3-3.el9.x86_64                                                                                                 1/2
  Installing       : gpfs.gss.pmsensors-5.2.3-3.el9.x86_64                                                                                                 1/2
  Running scriptlet: gpfs.gss.pmsensors-5.2.3-3.el9.x86_64                                                                                                 1/2
Created symlink /etc/systemd/system/multi-user.target.wants/pmsensors.service → /usr/lib/systemd/system/pmsensors.service.

  Running scriptlet: gpfs.gss.pmcollector-5.2.3-3.el9.x86_64                                                                                               2/2
  Installing       : gpfs.gss.pmcollector-5.2.3-3.el9.x86_64                                                                                               2/2
  Running scriptlet: gpfs.gss.pmcollector-5.2.3-3.el9.x86_64                                                                                               2/2
Created symlink /etc/systemd/system/multi-user.target.wants/pmcollector.service → /usr/lib/systemd/system/pmcollector.service.

  Running scriptlet: gpfs.gss.pmsensors-5.2.3-3.el9.x86_64                                                                                                 2/2
  Running scriptlet: gpfs.gss.pmcollector-5.2.3-3.el9.x86_64                                                                                               2/2
/usr/lib/tmpfiles.d/pmcollector.conf:1: Line references path below legacy directory /var/run/, updating /var/run/perfmon → /run/perfmon; please update the tmpfiles.d/ drop-in file accordingly.
/usr/lib/tmpfiles.d/pmsensors.conf:1: Line references path below legacy directory /var/run/, updating /var/run/perfmon → /run/perfmon; please update the tmpfiles.d/ drop-in file accordingly.

  Verifying        : gpfs.gss.pmcollector-5.2.3-3.el9.x86_64                                                                                               1/2
  Verifying        : gpfs.gss.pmsensors-5.2.3-3.el9.x86_64                                                                                                 2/2
Installed products updated.

Installed:
  gpfs.gss.pmcollector-5.2.3-3.el9.x86_64                                         gpfs.gss.pmsensors-5.2.3-3.el9.x86_64

Complete!

Definimos la config de la perf monitoring tool y designamos vlmgt02 como collector

[root@vlmgt02 gpfs_perf_testing]# /usr/lpp/mmfs/bin/mmperfmon config generate --collectors vlmgt02-ib0
mmperfmon: Node vlmgt02-ib0 is not a perfmon node.
mmperfmon: Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.
[root@vlmgt02 gpfs_perf_testing]# /usr/lpp/mmfs/bin/mmchnode --perfmon -N vlmgt02-ib0
Fri Jul 31 01:54:56 PM -03 2026: mmchnode: Processing node vlmgt02-ib0
mmchnode: Propagating the cluster configuration data to all
  affected nodes.  This is an asynchronous process.
  

Habilitamos los servicios.

systemctl enable --now pmcollector pmsensors
systemctl status pmcollector
systemctl status pmsensors

CherryPy

En el nodo collector tiene que estar instalado el paquete de python CherryPy.

[root@vlmgt02 gpfs_perf_testing]# python -m venv env
[root@vlmgt02 gpfs_perf_testing]# source env/bin/activate
(env) [root@vlmgt02 gpfs_perf_testing]# pip install cherrypy
gpfs_performance_monitoring.1785518318.txt.gz · Last modified: by bbruzzo