ClusterCockpit/cc-backend
1
0
Fork 0
mirror of https://github.com/ClusterCockpit/cc-backend synced 2026-07-27 00:37:14 +02:00
Code Issues Packages Releases Activity
2,824 Commits 9 Branches 18 Tags
0724b2dc60ffebbb7198e49ee36de3c964f3f324
Commit Graph
53 Commits
Author SHA1 Message Date
moebiusbandandClaude Opus 4.8 0724b2dc60 Adopt cc-lib hierarchical JobData/Statistics structs 
cc-lib changed JobData, ScopedJobStats and Job.Statistics from flat maps
to structs (a .Metrics map plus array-valued Groups) to represent
filesystem (and future interconnect) metric groups. Migrate all
construction, indexing and iteration to the new API across the archive
backends, metricstore query path, metric dispatcher, archiver, importer,
tagger, taskmanager, repository and API layers.

Semantics: DecodeJobStats now projects JobData.Groups into
ScopedJobStats.Groups, and the archiver derives per-filesystem node-scope
statistics into Job.Statistics.Groups. deepCopy, resampling and the
metric/scope filter are group-aware. The metricstore internal storage
(buffers, selector tree, checkpoint/parquet) is unchanged; all conversion
stays at the LoadData/archive-codec seam.

Note: requires the corresponding cc-lib release; bump the cc-lib
dependency version once tagged (a local go.mod replace was used during
development and is intentionally not committed).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-01 19:14:12 +02:00
moebiusband a418abc7d5 Run go fix 2026-02-27 14:40:26 +01:00
moebiusband 6035b62734 Run go fix 2026-02-17 21:04:17 +01:00
moebiusband 754f7e16f6 Reformat with gofumpt 2026-01-13 09:52:31 +01:00
moebiusband 8576ae458d Switch to cc-lib v2 2025-12-24 09:24:18 +01:00
moebiusband 7fce6fa401 Parallelize the Iter function in all archive backends 2025-12-16 09:11:09 +01:00
moebiusband 0306723307 Introduce transparent compression for importJob function in all archive backends 2025-12-16 08:55:31 +01:00
moebiusband 10aa2bfbd3 Add support for ClusterConfig 2025-12-15 11:24:12 +01:00
moebiusband 48b68d3410 Fix aws endpoint deprecation 2025-12-04 06:20:19 +01:00
moebiusband e1c7583670 Add sqlite and s3 job archive backend 
Add documentation
Extend config
 2025-11-19 17:00:11 +01:00
moebiusband 4fc78bc382 Refactor variable namings and doc comments 2025-09-27 09:27:36 +02:00
moebiusband 0754ba5292 Port configuration to ccConfig scheme 
Decentralize config validation
Modularize configuration handling
 2025-07-07 13:09:12 +02:00
moebiusband 4bd73450b5 Temporary disable archive clean test 2025-06-30 13:00:07 +02:00
moebiusband 639e1b9c6d Port to cc-lib. Extend legal header. 2025-06-30 12:06:35 +02:00
moebiusband 3efee22536 Remove jobMeta and use job struct everywhere 2025-05-28 15:59:21 +02:00
moebiusband ca634bb707 Refactor taggers. Refine Job Hooks. Start job classifier 2025-05-22 07:10:41 +02:00
Christoph Kluge f5f36427a4 split statsTable data from jobMetrics query, initial commit 
- mainly backend changes
- statstable changes only for prototyping
 2025-03-13 17:33:55 +01:00
moebiusband fb8bbea99d Remove year in copyright notice 2024-04-11 23:04:30 +02:00
moebiusband 6d8a3aa256 Fix bug in fsBackend and add tests for file utils 2023-06-28 07:39:39 +02:00
moebiusband eb626db9c2 Debug compression service 2023-06-27 14:29:56 +02:00
moebiusband 93396aa0ea Fix bug in compression service 2023-06-14 07:31:43 +02:00
moebiusband 911dcb6626 Improve Compression Service 
* Add Timing and more feedback
* Introduce persistent last compressed timestamp
 2023-06-10 07:49:02 +02:00
moebiusband 0f9b83e636 Add Move retention policy 
* Currently not testet!
 2023-05-15 16:57:31 +02:00
moebiusband 1ae34c5e10 Extend archive manager 2023-05-15 14:32:23 +02:00
moebiusband 6aea486891 Add util package 2023-05-12 15:09:39 +02:00
moebiusband cfafd5aa08 Add archive test and fix fsBackend test 2023-05-11 16:17:17 +02:00
moebiusband 538427d59b Introduce Retention and compression 2023-05-09 16:33:26 +02:00
Jan Eitzinger 7c2171afda Save state 2023-04-18 07:43:21 +02:00
Jan Eitzinger 10f4e09562 Set all versions and print in version flag 2023-04-12 10:43:46 +02:00
Jan Eitzinger ecd0709851 Fix more merge bugs 2023-04-12 07:30:41 +02:00
Jan Eitzinger 129dd13fc8 Fix merge errors 2023-04-11 16:26:09 +02:00
Jan Eitzinger f8ba79e9e7 Merge branch 'master' into import-data-sanitation 2023-04-07 08:57:42 +02:00
Jan Eitzinger d858868901 Fine tune schema and job archive migration 2023-04-06 18:09:36 +02:00
Jan Eitzinger 559445900d Adapt job iterator 
* Add option to also load Job Metric Data
* Validate Job Metric Data
* Allow null values in series array
 2023-03-31 15:28:35 +02:00
Jan Eitzinger bfee9d847b Fix copy and paste error 2023-03-31 12:33:14 +02:00
Jan Eitzinger eb2e2cb1d2 Implement tool to validate archive 2023-03-31 11:25:12 +02:00
Jan Eitzinger b5b5feb850 Fix tests 2023-03-27 14:41:00 +02:00
moebiusband 8447d011ad Add version to job archive 2023-03-27 13:24:06 +02:00
Jan Eitzinger a4a90074ee Introduce compression in job archive. 2023-03-27 11:11:14 +02:00
Christoph Kluge a885e69125 Adapt loglevel for logs, shorten strings, fix formats, streamline 
- Switched to Warn for most errors, reduces bloat, improves log control
 2023-02-01 11:58:27 +01:00
Christoph Kluge b77bd078e5 Add log messages to error events w/o log message, primaryly error level 
- "log spam" to be controlled via loglevel flag on startup
 2023-01-31 18:28:44 +01:00
Christoph Kluge 79a949b55e Rework pkg/log, add 'loglevel' and 'logdate' flags, streamline 
- removes some previously added manual location strings: now handled by pkg/log depending on loglevel
- kept manual string locations on fmt print functions
- add 'notice' and 'critical' loglevels
- add 'Panic' and 'Panicf' functions to log panics
- adresses issue #26
 2023-01-23 18:48:06 +01:00
Christoph Kluge 24a4244f19 add more information to existing errors logs and panics 
- '$ROOT/$FILE' for better localization in the code
- add text where none was given
- fix unnecessary sprintf nesting in influxv2 and prometheus metricrepo logging
 2023-01-19 16:59:14 +01:00
Jan Eitzinger 5c715b6ec2 Add test for import job handler. Improve error messages. 2022-09-23 15:23:45 +02:00
Jan Eitzinger 777f225e91 Add option for json validation 2022-09-13 15:22:20 +02:00
Jan Eitzinger fd100f28dd Change interface and reintroduce caching 2022-09-13 07:37:48 +02:00
Jan Eitzinger 48c1ba097a Improve error handling and implement tests 2022-09-11 07:09:10 +02:00
Jan Eitzinger 882dc011b9 Fix vet issue 2022-09-07 13:41:33 +02:00
Jan Eitzinger 8856f26fb0 Reformat and Refactor packages. Rebuild GraphQL. 2022-09-07 12:24:45 +02:00
Jan Eitzinger 937e72954d Make api test pass and cleanup 2022-09-06 14:40:14 +02:00