Commit Graph
54 Commits
Author SHA1 Message Date
moebiusbandandClaude Opus 4.8 0724b2dc60 Adopt cc-lib hierarchical JobData/Statistics structs
cc-lib changed JobData, ScopedJobStats and Job.Statistics from flat maps
to structs (a .Metrics map plus array-valued Groups) to represent
filesystem (and future interconnect) metric groups. Migrate all
construction, indexing and iteration to the new API across the archive
backends, metricstore query path, metric dispatcher, archiver, importer,
tagger, taskmanager, repository and API layers.

Semantics: DecodeJobStats now projects JobData.Groups into
ScopedJobStats.Groups, and the archiver derives per-filesystem node-scope
statistics into Job.Statistics.Groups. deepCopy, resampling and the
metric/scope filter are group-aware. The metricstore internal storage
(buffers, selector tree, checkpoint/parquet) is unchanged; all conversion
stays at the LoadData/archive-codec seam.

Note: requires the corresponding cc-lib release; bump the cc-lib
dependency version once tagged (a local go.mod replace was used during
development and is intentionally not committed).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-01 19:14:12 +02:00
moebiusband c267501a1b Reduve noise in tagger logging 2026-03-25 06:53:01 +01:00
moebiusband e70310dcbc fix: Segvault when taggers are enabled but rule directories missing 2026-03-11 11:15:08 +01:00
moebiusband dc7407d0f0 fix: prevent segvault if enable-job-taggers option is tru but tagger config directories are missing
Entire-Checkpoint: 9ec86e3669e1
2026-03-11 07:50:53 +01:00
moebiusband 282197ebef fix: Round floats in tagger message
Entire-Checkpoint: b68850c6fcff
2026-03-10 06:01:31 +01:00
moebiusband 67a17b5306 Reduce noise in info log 2026-03-04 15:14:35 +01:00
moebiusband 3d5a124321 Refine patterns. Do not match commented lines. 2026-03-02 15:01:44 +01:00
moebiusband 998aff2345 Fix bug in taggers. Allow to add multiple tags to one job 2026-02-24 06:44:17 +01:00
moebiusband 8ee6c09e9b Enable to run taggers from within admin web interface 2026-02-22 09:42:53 +01:00
moebiusband 064aa0a238 Add logging for AppTagger 2026-02-20 07:44:00 +01:00
moebiusband 90b52f997d Cleanup and handle error in AppTagger 2026-02-19 08:24:39 +01:00
moebiusband 57536d982c Add log output and fix bugs in AppTagger 2026-02-18 16:00:50 +01:00
moebiusband 9af44779aa Add error handling in tagger initialization 2026-02-17 08:13:50 +01:00
moebiusband 6294f8e263 Review and improve detectApp implementation 2026-02-06 14:53:05 +01:00
moebiusband fa7727c6ca Print job db id instead of its address 2026-02-06 14:06:56 +01:00
moebiusband 1d4c79c821 Unify JSON attribute naming ot use kebab style case. Cleanup configuration. 2026-01-20 09:47:13 +01:00
moebiusband 8f0bb907ff Improve documentation and add more tests 2026-01-15 06:41:23 +01:00
moebiusband 42809e3f75 Remove embedded tagger rules 2026-01-13 07:20:26 +01:00
moebiusband 8576ae458d Switch to cc-lib v2 2025-12-24 09:24:18 +01:00
moebiusband 1cd4a57bd3 Remove support for mysql/mariadb 2025-12-20 11:13:41 +01:00
moebiusband e6286768a7 Refactor variabel naming and update doc comments 2025-12-16 08:56:48 +01:00
moebiusband 8f4ef1e274 Refactor repository
Fix issues
Improve transaction API
Make hardcoded constants configurable
Make error messages consistent and always add context info
2025-11-20 06:58:45 +01:00
moebiusband 39a2157d46 Refactor tagger package
Fix issues
Add documentation
Add unit tests
2025-11-19 16:58:48 +01:00
moebiusband 6efd6334bb Fix unit tests 2025-10-17 07:06:31 +02:00
moebiusband eaca187032 Fix testdata for new schema 2025-09-09 15:04:25 +02:00
Aditya Ujeniya af43901ca3 Trial and Test MetricStore components 2025-09-08 22:54:13 +02:00
moebiusband 86453e7e11 Port to new job structs
Backup commit: Does not build.
2025-08-05 10:23:54 +02:00
moebiusband 639e1b9c6d Port to cc-lib. Extend legal header. 2025-06-30 12:06:35 +02:00
moebiusband 7531ba4b5c Refine app detection
Switch to regexp
2025-06-27 14:11:10 +02:00
moebiusband 983aa592d8 refine highload rule 2025-06-27 12:16:17 +02:00
moebiusband 8378784231 Enclose terms by spaces in app detection 2025-06-27 12:16:06 +02:00
moebiusband c0a4724f57 Add matlab app type and fix tests 2025-06-27 11:31:43 +02:00
moebiusband 6c06450701 Add more tagger rules 2025-06-24 06:52:21 +02:00
moebiusband 0373010497 Refactor and fix tagger test 2025-06-06 16:41:48 +02:00
moebiusband 3d6dca9386 Add more apps for tagger 2025-06-06 16:04:37 +02:00
moebiusband 3efee22536 Remove jobMeta and use job struct everywhere 2025-05-28 15:59:21 +02:00
moebiusband eef48ac3a3 Small fix in highload rule 2025-05-28 14:33:52 +02:00
moebiusband 4a5fd96b32 Adapt job class rules 2025-05-28 14:32:49 +02:00
moebiusband cdfe722457 Include metric thresholds in rule environment
Not yet tested
2025-05-27 13:02:13 +02:00
moebiusband 0aecea6de2 Refactor. Add Subcluster get metric list helper routine. 2025-05-27 09:23:28 +02:00
moebiusband 5a88c77171 Remove debug output 2025-05-26 14:42:41 +02:00
moebiusband 8003217092 Add string to gromacs app file 2025-05-26 14:41:02 +02:00
moebiusband 0261c263f9 Add hint message only if rule matches 2025-05-26 13:36:23 +02:00
moebiusband f14bdb3068 Fix bugs in job classifier and tagger infrastructure 2025-05-26 13:08:03 +02:00
moebiusband 3c66840f95 Add tagger config option and command line switch to run taggers on all jobs 2025-05-23 10:13:59 +02:00
moebiusband 733e3ea9d5 Revert interface from jobMeta to job type. Extend job classifier tagger. Cleanup test rules. 2025-05-23 07:48:27 +02:00
moebiusband ca634bb707 Refactor taggers. Refine Job Hooks. Start job classifier 2025-05-22 07:10:41 +02:00
moebiusband 9abc206d1a Read in tagger config on startup. Safeguard watcher shutdown 2025-05-20 07:10:15 +02:00
moebiusband 85f17c0fd8 Refactor Tagger package. Add fsNotify Service 2025-05-19 16:08:43 +02:00
moebiusband 14bad81b9f Extend Job Hooks and add unit tests
Add job tagger control
2025-05-19 13:25:39 +02:00