mirror of
https://github.com/ClusterCockpit/cc-metric-collector.git
synced 2024-12-26 23:29:06 +01:00
7840de7b82
* Add cpu_used (all-cpu_idle) to CpustatCollector * Update cc-metric-collector.init * Allow selection of timestamp precision in HttpSink * Add comment about precision requirement for cc-metric-store * Fix for API changes in gofish@v0.15.0 * Update requirements to latest version * Read sensors through redfish * Update golang toolchain to 1.21 * Remove stray error check * Update main config in configuration.md * Update Release action to use golang 1.22 stable release, no golang RPMs anymore * Update runonce action to use golang 1.22 stable release, no golang RPMs anymore * Update README.md Use right JSON type in configuration * Update sink's README * Test whether ipmitool or ipmi-sensors can be executed without errors * Little fixes to the prometheus sink (#115) * Add uint64 to float64 cast option * Add prometheus sink to the list of available sinks * Add aggregated counters by gpu for nvlink errors --------- Co-authored-by: Michael Schwarz <schwarz@uni-paderborn.de> * Ccmessage migration (#119) * Add cpu_used (all-cpu_idle) to CpustatCollector * Update cc-metric-collector.init * Allow selection of timestamp precision in HttpSink * Add comment about precision requirement for cc-metric-store * Fix for API changes in gofish@v0.15.0 * Update requirements to latest version * Read sensors through redfish * Update golang toolchain to 1.21 * Remove stray error check * Update main config in configuration.md * Update Release action to use golang 1.22 stable release, no golang RPMs anymore * Update runonce action to use golang 1.22 stable release, no golang RPMs anymore * Switch to CCMessage for all files. --------- Co-authored-by: Holger Obermaier <Holger.Obermaier@kit.edu> Co-authored-by: Holger Obermaier <40787752+ho-ob@users.noreply.github.com> * Switch to ccmessage also for latest additions in nvidiaMetric * New Message processor (#118) * Add cpu_used (all-cpu_idle) to CpustatCollector * Update cc-metric-collector.init * Allow selection of timestamp precision in HttpSink * Add comment about precision requirement for cc-metric-store * Fix for API changes in gofish@v0.15.0 * Update requirements to latest version * Read sensors through redfish * Update golang toolchain to 1.21 * Remove stray error check * Update main config in configuration.md * Update Release action to use golang 1.22 stable release, no golang RPMs anymore * Update runonce action to use golang 1.22 stable release, no golang RPMs anymore * New message processor to check whether a message should be dropped or manipulate it in flight * Create a copy of message before manipulation --------- Co-authored-by: Holger Obermaier <Holger.Obermaier@kit.edu> Co-authored-by: Holger Obermaier <40787752+ho-ob@users.noreply.github.com> * Update collector's Makefile and go.mod/sum files * Use message processor in router, all sinks and all receivers * Add support for credential file (NKEY) to NATS sink and receiver * Fix JSON keys in message processor configuration * Update docs for message processor, router and the default router config file * Add link to expr syntax and fix regex matching docs * Update sample collectors * Minor style change in collector manager * Some helpers for ccTopology * LIKWID collector: write log owner change only once * Fix for metrics without units and reduce debugging messages for messageProcessor * Use shorted hostname for hostname added by router * Define default port for NATS * CPUstat collector: only add unit for applicable metrics * Add precision option to all sinks using Influx's encoder * Add message processor to all sink documentation * Add units to documentation of cpustat collector --------- Co-authored-by: Holger Obermaier <Holger.Obermaier@kit.edu> Co-authored-by: Holger Obermaier <40787752+ho-ob@users.noreply.github.com> Co-authored-by: oscarminus <me@oscarminus.de> Co-authored-by: Michael Schwarz <schwarz@uni-paderborn.de>
174 lines
5.1 KiB
YAML
174 lines
5.1 KiB
YAML
# See: https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions
|
|
|
|
# Workflow name
|
|
name: Run Test
|
|
|
|
# Run on event push
|
|
on:
|
|
push:
|
|
workflow_dispatch:
|
|
|
|
jobs:
|
|
|
|
#
|
|
# Job build-1-21
|
|
# Build on latest Ubuntu using golang version 1.21
|
|
#
|
|
build-1-21:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
# See: https://github.com/marketplace/actions/checkout
|
|
# Checkout git repository and submodules
|
|
- name: Checkout
|
|
uses: actions/checkout@v4
|
|
with:
|
|
submodules: recursive
|
|
|
|
# See: https://github.com/marketplace/actions/setup-go-environment
|
|
- name: Setup Golang
|
|
uses: actions/setup-go@v4
|
|
with:
|
|
go-version: '1.21'
|
|
|
|
- name: Build MetricCollector
|
|
run: make
|
|
|
|
- name: Run MetricCollector once
|
|
run: ./cc-metric-collector --once --config .github/ci-config.json
|
|
|
|
#
|
|
# Job build-1-22
|
|
# Build on latest Ubuntu using golang version 1.22
|
|
#
|
|
build-1-22:
|
|
runs-on: ubuntu-latest
|
|
steps:
|
|
# See: https://github.com/marketplace/actions/checkout
|
|
# Checkout git repository and submodules
|
|
- name: Checkout
|
|
uses: actions/checkout@v4
|
|
with:
|
|
submodules: recursive
|
|
|
|
# See: https://github.com/marketplace/actions/setup-go-environment
|
|
- name: Setup Golang
|
|
uses: actions/setup-go@v4
|
|
with:
|
|
go-version: '1.22'
|
|
|
|
- name: Build MetricCollector
|
|
run: make
|
|
|
|
- name: Run MetricCollector once
|
|
run: ./cc-metric-collector --once --config .github/ci-config.json
|
|
|
|
#
|
|
# Build on AlmaLinux 8 using go-toolset
|
|
#
|
|
AlmaLinux-RPM-build:
|
|
runs-on: ubuntu-latest
|
|
# See: https://hub.docker.com/_/almalinux
|
|
container: almalinux:8
|
|
# The job outputs link to the outputs of the 'rpmrename' step
|
|
# Only job outputs can be used in child jobs
|
|
steps:
|
|
|
|
# Use dnf to install development packages
|
|
- name: Install development packages
|
|
run: |
|
|
dnf --assumeyes group install "Development Tools" "RPM Development Tools"
|
|
dnf --assumeyes install wget openssl-devel diffutils delve which
|
|
|
|
# Checkout git repository and submodules
|
|
# fetch-depth must be 0 to use git describe
|
|
# See: https://github.com/marketplace/actions/checkout
|
|
- name: Checkout
|
|
uses: actions/checkout@v4
|
|
with:
|
|
submodules: recursive
|
|
fetch-depth: 0
|
|
|
|
# See: https://github.com/marketplace/actions/setup-go-environment
|
|
- name: Setup Golang
|
|
uses: actions/setup-go@v4
|
|
with:
|
|
go-version: '1.21'
|
|
|
|
- name: RPM build MetricCollector
|
|
id: rpmbuild
|
|
run: |
|
|
git config --global --add safe.directory /__w/cc-metric-collector/cc-metric-collector
|
|
export PATH=/usr/local/go/bin:/usr/local/go/pkg/tool/linux_amd64:$PATH
|
|
make RPM
|
|
|
|
#
|
|
# Build on UBI 8 using go-toolset
|
|
#
|
|
UBI-8-RPM-build:
|
|
runs-on: ubuntu-latest
|
|
# See: https://catalog.redhat.com/software/containers/ubi8/ubi/5c359854d70cc534b3a3784e?container-tabs=gti
|
|
container: registry.access.redhat.com/ubi8/ubi:8.8-1032.1692772289
|
|
# The job outputs link to the outputs of the 'rpmbuild' step
|
|
steps:
|
|
|
|
# Use dnf to install development packages
|
|
- name: Install development packages
|
|
run: dnf --assumeyes --disableplugin=subscription-manager install rpm-build go-srpm-macros rpm-build-libs rpm-libs gcc make python38 git wget openssl-devel diffutils delve which
|
|
|
|
# Checkout git repository and submodules
|
|
# fetch-depth must be 0 to use git describe
|
|
# See: https://github.com/marketplace/actions/checkout
|
|
- name: Checkout
|
|
uses: actions/checkout@v4
|
|
with:
|
|
submodules: recursive
|
|
fetch-depth: 0
|
|
|
|
# See: https://github.com/marketplace/actions/setup-go-environment
|
|
- name: Setup Golang
|
|
uses: actions/setup-go@v4
|
|
with:
|
|
go-version: '1.21'
|
|
|
|
- name: RPM build MetricCollector
|
|
id: rpmbuild
|
|
run: |
|
|
git config --global --add safe.directory /__w/cc-metric-collector/cc-metric-collector
|
|
export PATH=/usr/local/go/bin:/usr/local/go/pkg/tool/linux_amd64:$PATH
|
|
make RPM
|
|
|
|
#
|
|
# Build on Ubuntu 22.04 using official go package
|
|
#
|
|
Ubuntu-jammy-build:
|
|
runs-on: ubuntu-latest
|
|
container: ubuntu:22.04
|
|
|
|
steps:
|
|
# Use apt to install development packages
|
|
- name: Install development packages
|
|
run: |
|
|
apt update && apt --assume-yes upgrade
|
|
apt --assume-yes install build-essential sed git wget bash
|
|
# Checkout git repository and submodules
|
|
# fetch-depth must be 0 to use git describe
|
|
# See: https://github.com/marketplace/actions/checkout
|
|
- name: Checkout
|
|
uses: actions/checkout@v4
|
|
with:
|
|
submodules: recursive
|
|
fetch-depth: 0
|
|
# Use official golang package
|
|
# See: https://github.com/marketplace/actions/setup-go-environment
|
|
- name: Setup Golang
|
|
uses: actions/setup-go@v4
|
|
with:
|
|
go-version: '1.21'
|
|
|
|
- name: DEB build MetricCollector
|
|
id: dpkg-build
|
|
run: |
|
|
export PATH=/usr/local/go/bin:/usr/local/go/pkg/tool/linux_amd64:$PATH
|
|
git config --global --add safe.directory /__w/cc-metric-collector/cc-metric-collector
|
|
make DEB
|