Commit Graph
54 Commits
Author SHA1 Message Date
moebiusbandandClaude Opus 4.8 0724b2dc60 Adopt cc-lib hierarchical JobData/Statistics structs
cc-lib changed JobData, ScopedJobStats and Job.Statistics from flat maps
to structs (a .Metrics map plus array-valued Groups) to represent
filesystem (and future interconnect) metric groups. Migrate all
construction, indexing and iteration to the new API across the archive
backends, metricstore query path, metric dispatcher, archiver, importer,
tagger, taskmanager, repository and API layers.

Semantics: DecodeJobStats now projects JobData.Groups into
ScopedJobStats.Groups, and the archiver derives per-filesystem node-scope
statistics into Job.Statistics.Groups. deepCopy, resampling and the
metric/scope filter are group-aware. The metricstore internal storage
(buffers, selector tree, checkpoint/parquet) is unchanged; all conversion
stays at the LoadData/archive-codec seam.

Note: requires the corresponding cc-lib release; bump the cc-lib
dependency version once tagged (a local go.mod replace was used during
development and is intentionally not committed).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-01 19:14:12 +02:00
moebiusband e1c1148160 Fix more bugs related to job_cache ids used in job table 2026-02-20 09:20:18 +01:00
moebiusband 6035b62734 Run go fix 2026-02-17 21:04:17 +01:00
moebiusband fa7727c6ca Print job db id instead of its address 2026-02-06 14:06:56 +01:00
moebiusband 1d4c79c821 Unify JSON attribute naming ot use kebab style case. Cleanup configuration. 2026-01-20 09:47:13 +01:00
moebiusband 5281f3bb60 Remove obsolete config option disable-archive 2026-01-19 16:42:30 +01:00
moebiusband e1efc68476 Update dependencies. Rebuild graphql and swagger 2026-01-15 08:32:06 +01:00
moebiusband c8627a13f4 Remove obsolete slusters config section 2026-01-14 11:17:49 +01:00
moebiusband 4cec933349 Remove obsolete cluster config section 2026-01-13 06:28:33 +01:00
moebiusband 8576ae458d Switch to cc-lib v2 2025-12-24 09:24:18 +01:00
moebiusband 1cd4a57bd3 Remove support for mysql/mariadb 2025-12-20 11:13:41 +01:00
moebiusband b8fdfc30c0 Fix performance bugs in sqlite archive backend 2025-12-17 10:12:49 +01:00
moebiusband f13be109c2 Fix: Replace all Printf log messages with appropriate loglevels 2025-12-11 11:20:11 +01:00
moebiusband 8d44ac90ad Fix: Busywait loop in archiver and slow shutdown
Remove unblocking default in select
Add shutdown handler with context and timeout
2025-12-11 09:29:10 +01:00
moebiusband 6325793902 Add check in initDB importer if jobMeta is nil 2025-12-04 15:38:21 +01:00
moebiusband 7cff8bbfd2 Add documentation for importer 2025-12-04 15:07:09 +01:00
moebiusband f141ca926f Increase archive version. Fix unit tests. 2025-11-20 14:28:06 +01:00
moebiusband 0b38a980d2 Port importer to new transaction api 2025-11-20 07:39:16 +01:00
Jan EitzingerandGitHub df0e8eb228 Merge branch 'dev' into metricstore 2025-09-10 09:14:50 +02:00
Aditya Ujeniya 9b644119ae Fix to testdata database 2025-09-09 18:34:10 +02:00
moebiusband eaca187032 Fix testdata for new schema 2025-09-09 15:04:25 +02:00
Aditya Ujeniya bca176170c Migration SQL fix 2025-09-03 08:22:15 +02:00
Christoph Kluge 2a91ca0cff Merge branch 'dev' into rework_status_view 2025-08-13 14:29:19 +02:00
moebiusband 86453e7e11 Port to new job structs
Backup commit: Does not build.
2025-08-05 10:23:54 +02:00
moebiusband 0754ba5292 Port configuration to ccConfig scheme
Decentralize config validation
Modularize configuration handling
2025-07-07 13:09:12 +02:00
Christoph Kluge 743a89c3a2 Finalize node query backend functions, fix migration issue 2025-07-04 15:14:15 +02:00
moebiusband 639e1b9c6d Port to cc-lib. Extend legal header. 2025-06-30 12:06:35 +02:00
moebiusband 3efee22536 Remove jobMeta and use job struct everywhere 2025-05-28 15:59:21 +02:00
moebiusband 99f8187092 Port tests to new architecture 2025-05-19 09:17:16 +02:00
moebiusband 161f0744aa fix: enforce apiAllowedIPs config option
Fixes #385
2025-04-28 09:54:22 +02:00
Christoph Kluge 2b56b40e6d Review energyFootprint calculation, fix missing numNodes factor, add log 2025-03-06 12:46:25 +01:00
moebiusband 3ab26172c4 Port tests to new job archive version 2024-11-16 07:03:29 +01:00
moebiusband cdd45ce88b Fix importers and add Energy footprint to import 2024-11-16 06:36:55 +01:00
moebiusband 210a7d3136 Debugging initDB archive import
Footprint working
EnergyFootprint still missing
2024-11-14 19:13:07 +01:00
Christoph Kluge d5382aec4f Merge branch 'dev' into 275_add_tag_scope 2024-09-05 16:44:41 +02:00
moebiusband e267481f71 Cleanup transaction api 2024-09-03 15:40:02 +02:00
moebiusband 6568b6d723 Prepare transaction API for general usage 2024-09-03 13:40:11 +02:00
moebiusband c459724114 Resolve build errors 2024-08-30 13:50:49 +02:00
Christoph Kluge 017f9b2140 feat: Add tag scopes to front and backend, initial commit 2024-08-01 18:59:24 +02:00
moebiusband 721b6b2afa Change footprint variabel from bool to string
The footprint variable also indicates the type of statistic used now
2024-07-20 08:59:07 +02:00
Christoph Kluge bf6b87d65c Fix circular import after merge 2024-07-09 09:50:32 +02:00
moebiusband ac9bba8b5b Restructure and simplify job repo 2024-07-04 15:05:24 +02:00
moebiusband 80c46bea7f Fix bugs and failed testcases 2024-07-04 14:14:27 +02:00
moebiusband 130613b717 Fix build errors
Code not yet functional
2024-06-28 17:08:28 +02:00
moebiusband fb8bbea99d Remove year in copyright notice 2024-04-11 23:04:30 +02:00
moebiusband 14c487c9e4 Update test inputs 2023-08-18 09:31:57 +02:00
moebiusband 9137931b74 Add cpu_load and mem_used to Job stats
Fixes #111
2023-06-15 11:07:48 +02:00
moebiusband f6c629c696 Remove obsolete check
Now handeled by DB UNIQUE constraint
2023-05-04 18:14:46 +02:00
moebiusband 066c4553b4 Refactor 2023-05-04 16:27:30 +02:00
moebiusband c5b67d64d2 Add Table flush on init 2023-05-04 16:03:04 +02:00