cc-metric-collector

ClusterCockpit/cc-metric-collector

Fork 0

mirror of https://github.com/ClusterCockpit/cc-metric-collector.git synced 2025-04-05 21:25:55 +02:00

Commit Graph

Select branches

Hide Pull Requests

amqp_sink

app_metric_collector

cc_lib_switch

check_file_perm_and_user

develop

http_stats

httpsink_with_batchsize

likwidMetric-cycleclock

likwid_collector_lock_file

likwidenergy

lustre_jobstats_collector

main

mqtt_sink

nats_nkey_support

nfsio_remount_fix

nvidia_running_average

perf_collectors

rapl_collector_limits

slurm_cgroup_collector

smartmon_collector

snmp_receiver

sqlite3_sink

syslog_sink

#1

#101

#102

#104

#106

#107

#108

#109

#110

#111

#112

#113

#114

#115

#116

#117

#118

#119

#120

#121

#123

#124

#125

#126

#127

#129

#130

#131

#132

#133

#134

#135

#135

#136

#137

#137

#139

#139

#14

#15

#16

#17

#18

#19

#2

#20

#21

#22

#23

#24

#25

#26

#27

#28

#29

#3

#30

#31

#32

#34

#35

#36

#37

#38

#39

#4

#40

#41

#42

#43

#44

#45

#46

#47

#48

#49

#5

#50

#51

#52

#53

#54

#55

#56

#57

#58

#59

#6

#60

#61

#62

#63

#64

#65

#66

#67

#68

#69

#7

#72

#72

#74

#75

#76

#77

#78

#79

#8

#80

#81

#82

#82

#83

#84

#85

#86

#86

#87

#88

#89

#9

#91

#92

#93

#95

#96

#97

#98

#99

v0.1

v0.2

v0.3

v0.4

v0.5

v0.5.1

v0.6.0

v0.6.1

v0.6.2

v0.6.3

v0.6.4

v0.6.5

v0.6.6

v0.6.7

v0.7.0

f2bdf37751 Fix import path Thomas Roehl 2022-05-23 16:07:04 +02:00
503f218583 Add collector for AMD ROCm SMI metrics Thomas Roehl 2022-05-20 17:16:58 +02:00
7ddc889f06 MetricRouter: Fix JSON in README Thomas Roehl 2022-05-20 16:06:54 +02:00
500685672b Option to use MIG slice name as subtype-id in NvidiaCollector Thomas Roehl 2022-05-13 15:26:47 +02:00
d4c89a4206 Option to use MIG UUID as subtype-id in NvidiaCollector Thomas Roehl 2022-05-13 14:34:32 +02:00
826f364772

CC topology module update (#76) Thomas Gruber 2022-05-13 14:28:07 +02:00
5df550b208

Update NvidiaCollector with new metrics, MIG and NvLink support (#75) Thomas Gruber 2022-05-13 14:11:55 +02:00
5c34805918

Collectors in parallel (#74) Thomas Gruber 2022-05-13 14:10:39 +02:00
1db5f3b29a

Rename cpu type to hwthread (#69) Thomas Gruber 2022-05-13 14:09:45 +02:00
7087edd5af Fix for --once option Thomas Roehl 2022-05-13 14:07:58 +02:00
1ed4e70fb9 Fix for CI sink config Thomas Roehl 2022-05-13 14:04:13 +02:00
0623691bab Fix for --once option Thomas Roehl 2022-05-13 13:50:19 +02:00
9886f14d14 Check readability of sensor files in TempCollector Thomas Roehl 2022-05-13 13:32:54 +02:00
857903be2b Skip disks in DiskstatCollector that have size=0 Thomas Roehl 2022-05-13 13:31:22 +02:00
80d92d6d28

Units with cc-units (#64) Thomas Gruber 2022-05-13 13:30:02 +02:00
43d7b35b16

Merge branch 'develop' into rename_cpu_type Thomas Gruber 2022-05-13 13:25:45 +02:00
8068e59818 Update handling of LIKWID headers. Download only if not already present in the system. Fixes #73 Thomas Roehl 2022-05-13 13:14:47 +02:00
8abedac0fe Use Golang duration parser for 'interval' and 'duration' in main config Thomas Roehl 2022-05-13 12:33:33 +02:00
6266edad53 Remove remaining debugging print Thomas Roehl 2022-05-13 12:23:47 +02:00
1d1315c08b Split serial and parallel collectors. Read in parallel first Thomas Roehl 2022-05-13 12:23:34 +02:00
7b804ad7a2 Provide info to CollectorManager whether the collector can be executed in parallel with others Thomas Roehl 2022-05-13 12:20:23 +02:00
0f7c4712fa Update NvidiaCollector with new metrics, MIG and NvLink support Thomas Roehl 2022-05-12 14:30:08 +02:00
ee4bd558f1 Cleanup: Remove unused code Holger Obermaier 2022-05-06 11:44:57 +02:00
4706876323 Merge branch 'units_in_router' of github.com:ClusterCockpit/cc-metric-collector into units_in_router Thomas Roehl 2022-05-04 14:33:43 +02:00
463d554b8b Use second add_tags/del_tags only if metric gets renamed Thomas Roehl 2022-05-04 14:32:34 +02:00
9bd0705875 Add order of operations in router to README Thomas Roehl 2022-05-04 14:32:07 +02:00
feb8f16af8 Add batch_size option to httpSink httpsink_with_batchsize Thomas Roehl 2022-05-04 13:05:10 +02:00
186a62a86b Fix: influx sink ignores config batch_size. Feature: Add Redfish receiver Holger Obermaier 2022-05-04 13:00:56 +02:00
e098c33179 Add some golang debug options Holger Obermaier 2022-05-04 12:48:46 +02:00
618327aad2

Merge branch 'develop' into units_in_router Thomas Gruber 2022-05-04 12:25:30 +02:00
478fb0787f Add to MetricRouter README Thomas Roehl 2022-05-04 12:24:40 +02:00
3e029d0eb0 Add option to change unit prefix in the router Thomas Roehl 2022-05-04 12:24:27 +02:00
38d4e0a730 Merge branch 'develop' of github.com:ClusterCockpit/cc-metric-collector into develop Thomas Roehl 2022-05-04 11:54:55 +02:00
54d14519ca Skip mount points in DiskstatCollector if statfs() call does not work (bind mounts, ...) Thomas Roehl 2022-05-04 11:54:34 +02:00
c35ac9dba8 Flush if batch size is reached Holger Obermaier 2022-05-04 11:28:06 +02:00
c019f8e7ad Reuse tags and meta data tags Holger Obermaier 2022-05-03 17:55:33 +02:00
fb6f6a4daa Fix GPFS collector last state handling Holger Obermaier 2022-05-02 16:57:19 +02:00
9d6d0dbd93 Delete empty tags and meta data tags Holger Obermaier 2022-04-20 14:39:26 +02:00
c2d4272fdf Clear workerInput channel after done event Holger Obermaier 2022-04-20 12:36:45 +02:00
8c73095548 Allow to shutdown redfish receiver during metric read Holger Obermaier 2022-04-20 09:58:02 +02:00
31c5c89a5a Fix: Close done channel Holger Obermaier 2022-04-19 14:01:23 +02:00
bf9c7e1830 Update requirements Holger Obermaier 2022-04-19 12:15:51 +02:00
48d34bf564 Adopt sinks.json for new meta_as_tags usage Holger Obermaier 2022-04-19 12:06:53 +02:00
a1d85fa886 Add redfish receiver Holger Obermaier 2022-04-19 12:05:03 +02:00
96ee16398e Removed unused done channel and wg wait group Holger Obermaier 2022-04-19 11:53:11 +02:00
e7b8088c41 Extended go routine use case in sample receiver Holger Obermaier 2022-04-19 11:42:46 +02:00
017cd58247 Updating page for LikwidCollector Thomas Roehl 2022-04-05 10:57:09 +02:00
36dd440864 Merge branch 'develop' into main v0.5.1 Thomas Roehl 2022-04-04 15:16:33 +02:00
7b098e0b1b Fix for missing metrics in LikwidCollector is hwthread is inactive Thomas Roehl 2022-04-04 15:16:11 +02:00
229a57b16a Merge branch 'develop' into main Thomas Roehl 2022-04-04 11:49:33 +02:00
70a9530aba Set WriteFailedCallback to get some error message Thomas Roehl 2022-04-04 11:48:54 +02:00
2f0b6057ca Merge branch 'develop' into main Thomas Roehl 2022-04-04 02:59:42 +02:00
69f7c19659 InfluxAsyncSink: Add custom flush mechanism Thomas Roehl 2022-04-04 02:56:23 +02:00
ecdb4c1bcf Add debug message when updating interval_timestep Thomas Roehl 2022-04-04 02:55:44 +02:00
4d5b1adbc8 Fix for interval_timestamp option Thomas Roehl 2022-04-04 02:26:04 +02:00
a428bb5bdf

Merge 9dd6ff1a76ac8ddbc98d979b9bf20dc6315770dd into 28348bd1086a9659aa0a0abf713e5dd1903dad26 Thomas Gruber 2022-04-02 21:41:55 +00:00
9dd6ff1a76 Add StatsAPI to README http_stats Thomas Roehl 2022-04-02 16:07:13 +02:00
257b4a64b5 Add missing main API file Thomas Roehl 2022-04-02 16:06:51 +02:00
5eeb097136 Add stats counters to sinks Thomas Roehl 2022-04-02 16:06:03 +02:00
4a4992877c Add stats counters to collectors Thomas Roehl 2022-04-02 16:05:52 +02:00
9447685a69 Add StatsApi. Started if a configuration file is set in global config.json Thomas Roehl 2022-04-02 16:05:27 +02:00
28348bd108 InfluxSink: Use batch&flush logic from HttpSink Thomas Roehl 2022-04-01 18:37:45 +02:00
a3b9d8a90b HttpSink: Use sink name in error outputs Thomas Roehl 2022-04-01 18:36:54 +02:00
7e43e9171e Use default options. Overwrite if anything is configured differently. Use seconds as precision Thomas Roehl 2022-04-01 17:26:56 +02:00
5d25a7bf12 Add units to InfiniBandCollector Thomas Roehl 2022-04-01 17:14:26 +02:00
83b4343310 Likwid receives signal at first Read, check when re-initializing Thomas Roehl 2022-04-01 17:10:31 +02:00
f1d3cabdc6 Merge branch 'develop' of github.com:ClusterCockpit/cc-metric-collector into develop Thomas Roehl 2022-04-01 12:45:25 +02:00
4763733d8d Merge branch 'develop' into main v0.5 Thomas Röhl 2022-03-31 11:57:19 +02:00
2a014b6fba

Read unit of values from /proc/meminfo (#68) Thomas Gruber 2022-03-31 11:56:31 +02:00
16e898ecca Merge branch 'develop' into main Thomas Röhl 2022-03-31 11:47:02 +02:00
50479f9325 Move all LIKWID related stuff to late initialization routine Thomas Roehl 2022-03-24 18:12:23 +01:00
e0e91844bc Use late initialization of LIKWID and catch access daemon death. Fixes #70 and fixes #71. Thomas Roehl 2022-03-24 17:56:51 +01:00
296225f3a8 Always export all metrics in NfsCollectors Thomas Roehl 2022-03-24 13:50:35 +01:00
43bcce6fb5 Merge branch 'develop' of github.com:ClusterCockpit/cc-metric-collector into develop Thomas Roehl 2022-03-22 18:05:38 +01:00
85ff515992 Remove CpuList and SocketList function from metricCollector. Available in ccTopology Thomas Roehl 2022-03-22 16:55:45 +01:00
05806d3e97 Do renaming in other parts Thomas Roehl 2022-03-22 16:52:36 +01:00
d8b2dc2455 Rename CPU to hardware thread, write some comments Thomas Roehl 2022-03-22 16:52:13 +01:00
622e94ae0e Fix DieList() if system does not support dies. Explicitly set entries in CpuData list Thomas Roehl 2022-03-22 15:58:10 +01:00
07fe17c2d1 Rename 'cpu' type to 'hwthread' to avoid naming clashes with MetricStore and CC-Webfrontend Thomas Roehl 2022-03-18 13:41:54 +01:00
c506114480 Add processing order to MetricRouter README and add missing options Thomas Roehl 2022-03-18 12:29:00 +01:00
657543dded Ensure max_forward is at least 1 Thomas Roehl 2022-03-18 12:28:52 +01:00
28764f2c7e Add unit conversion to router Thomas Roehl 2022-03-17 18:38:15 +01:00
7dce6be099 Read unit of values from /proc/meminfo Thomas Roehl 2022-03-17 14:29:02 +01:00
4851382ad7 Merge branch 'develop' into main v0.4 Thomas Roehl 2022-03-16 19:08:13 +01:00
b66fdd1436 Add missing socket->thread_id map for LikwidCollector Thomas Roehl 2022-03-16 19:04:39 +01:00
3f76947f54

Merge latest developments into main (#67) Thomas Gruber 2022-03-15 16:41:11 +01:00
c182d295f4

Fix staticcheck warnings (#66) Thomas Gruber 2022-03-15 16:38:20 +01:00
beebcd7145 Merge branch 'develop' of github.com:ClusterCockpit/cc-metric-collector into develop Thomas Roehl 2022-03-15 16:16:39 +01:00
57629a2e0a

Meta to tags list and map for sinks (#63) Thomas Gruber 2022-03-15 16:16:26 +01:00
082eea525a Merge branch 'develop' of github.com:ClusterCockpit/cc-metric-collector into develop Thomas Roehl 2022-03-15 16:10:41 +01:00
aa1afd745e

Derived metrics (#65) Thomas Gruber 2022-03-15 16:09:47 +01:00
e1f4b0e12c

Merge branch 'develop' into derived_metrics Thomas Gruber 2022-03-15 16:07:52 +01:00
3b962cd0d6 Add option to normalize units with cc-unit Thomas Roehl 2022-03-15 16:00:28 +01:00
2b8266d1d2 Merge branch 'develop' of github.com:ClusterCockpit/cc-metric-collector into develop Thomas Roehl 2022-03-15 15:24:29 +01:00
e00b7af5ee Update LustreCollector Thomas Roehl 2022-03-15 14:44:21 +01:00
872a9acb28 Update README Thomas Roehl 2022-03-11 20:10:18 +01:00
cccd264881 Add some more units for testing Thomas Roehl 2022-03-11 20:10:06 +01:00
9728f171c3 Ignore prefixes for percentage Thomas Roehl 2022-03-11 20:09:42 +01:00
f80aee4d0f Use 1 as Base prefix Thomas Roehl 2022-03-11 20:09:16 +01:00
887bf963af Simplify special cases Thomas Roehl 2022-03-11 20:01:18 +01:00