Commit Graph
28 Commits
Author SHA1 Message Date
moebiusbandandClaude Opus 4.8 0724b2dc60 Adopt cc-lib hierarchical JobData/Statistics structs
cc-lib changed JobData, ScopedJobStats and Job.Statistics from flat maps
to structs (a .Metrics map plus array-valued Groups) to represent
filesystem (and future interconnect) metric groups. Migrate all
construction, indexing and iteration to the new API across the archive
backends, metricstore query path, metric dispatcher, archiver, importer,
tagger, taskmanager, repository and API layers.

Semantics: DecodeJobStats now projects JobData.Groups into
ScopedJobStats.Groups, and the archiver derives per-filesystem node-scope
statistics into Job.Statistics.Groups. deepCopy, resampling and the
metric/scope filter are group-aware. The metricstore internal storage
(buffers, selector tree, checkpoint/parquet) is unchanged; all conversion
stays at the LoadData/archive-codec seam.

Note: requires the corresponding cc-lib release; bump the cc-lib
dependency version once tagged (a local go.mod replace was used during
development and is intentionally not committed).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-01 19:14:12 +02:00
moebiusband 7d8b305cd9 Add format conversion to archive manager 2026-02-13 13:54:10 +01:00
moebiusband 1d4c79c821 Unify JSON attribute naming ot use kebab style case. Cleanup configuration. 2026-01-20 09:47:13 +01:00
moebiusband 5281f3bb60 Remove obsolete config option disable-archive 2026-01-19 16:42:30 +01:00
moebiusband 754f7e16f6 Reformat with gofumpt 2026-01-13 09:52:31 +01:00
moebiusband 4cec933349 Remove obsolete cluster config section 2026-01-13 06:28:33 +01:00
moebiusband 8576ae458d Switch to cc-lib v2 2025-12-24 09:24:18 +01:00
moebiusband e707fd0893 Provide fallback in archive manager in case fd is not available 2025-12-18 11:26:05 +01:00
moebiusband 79a2ca8ae8 Adapt unit test to new API 2025-12-17 08:44:37 +01:00
moebiusband 88dc5036b3 Make import function interuptible and replace countJobs with external call to fd 2025-12-17 06:32:53 +01:00
moebiusband 72b2560ecf Add progress bar for import function 2025-12-16 09:11:26 +01:00
moebiusband ab70acd582 Also import ClusterConfigs 2025-12-15 11:20:49 +01:00
moebiusband f13be109c2 Fix: Replace all Printf log messages with appropriate loglevels 2025-12-11 11:20:11 +01:00
moebiusband c76e9bb3fe Fix error in unit test 2025-12-04 06:20:45 +01:00
moebiusband 2333068de7 Add tools for archive manager and archive-migration
Needs testing and review
2025-12-03 14:55:22 +01:00
moebiusband 0754ba5292 Port configuration to ccConfig scheme
Decentralize config validation
Modularize configuration handling
2025-07-07 13:09:12 +02:00
moebiusband 639e1b9c6d Port to cc-lib. Extend legal header. 2025-06-30 12:06:35 +02:00
Christoph Kluge bd0cc69668 Review fatalf log calls and messages 2025-02-27 18:10:04 +01:00
moebiusband fb8bbea99d Remove year in copyright notice 2024-04-11 23:04:30 +02:00
moebiusband 6731b8b1e0 Add clean functionality to archive manager 2023-05-15 15:38:18 +02:00
moebiusband 1ae34c5e10 Extend archive manager 2023-05-15 14:32:23 +02:00
Jan Eitzinger 93f34c7d9e Fix bug in tools related to log init 2023-04-12 12:27:15 +02:00
Jan Eitzinger 129dd13fc8 Fix merge errors 2023-04-11 16:26:09 +02:00
Jan Eitzinger d858868901 Fine tune schema and job archive migration 2023-04-06 18:09:36 +02:00
Jan Eitzinger 559445900d Adapt job iterator
* Add option to also load Job Metric Data
* Validate Job Metric Data
* Allow null values in series array
2023-03-31 15:28:35 +02:00
Jan Eitzinger bfee9d847b Fix copy and paste error 2023-03-31 12:33:14 +02:00
Jan Eitzinger eb2e2cb1d2 Implement tool to validate archive 2023-03-31 11:25:12 +02:00
Jan Eitzinger 465d5c0186 Rename archive tools 2023-03-24 16:24:06 +01:00