Commit Graph
100 Commits
Author SHA1 Message Date
moebiusband 4ecc050c4c Fix deadlock if NATS is not configured 2025-12-17 07:03:01 +01:00
moebiusband 88dc5036b3 Make import function interuptible and replace countJobs with external call to fd 2025-12-17 06:32:53 +01:00
moebiusband d30c6ef3bf Make NATS API subjects configurable 2025-12-17 06:08:09 +01:00
moebiusband 0419fec810 Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev 2025-12-17 05:46:10 +01:00
moebiusband 43e5fd1131 Add NATS API backend 2025-12-17 05:44:49 +01:00
moebiusband 5e2cbd75fa Review and refactor 2025-12-16 09:45:48 +01:00
moebiusband 14f1192ccb Introduce central nats client 2025-12-16 09:35:33 +01:00
moebiusband 72b2560ecf Add progress bar for import function 2025-12-16 09:11:26 +01:00
moebiusband 7fce6fa401 Parallelize the Iter function in all archive backends 2025-12-16 09:11:09 +01:00
moebiusband e6286768a7 Refactor variabel naming and update doc comments 2025-12-16 08:56:48 +01:00
moebiusband 0306723307 Introduce transparent compression for importJob function in all archive backends 2025-12-16 08:55:31 +01:00
moebiusband 6f49998ad3 Switch to new go tool pattern for external tool deps 2025-12-16 08:49:17 +01:00
moebiusband 457c944ec6 Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev 2025-12-15 21:25:32 +01:00
moebiusband 33c38f9464 Fix start time in tasks 2025-12-15 21:25:30 +01:00
moebiusband 46351389b6 Add ai agent guidelines 2025-12-15 21:25:00 +01:00
moebiusband d567a5312e Add flag omitTagged to DeleteJobsBefore
Fixes #344
2025-12-15 14:38:46 +01:00
moebiusband 97a322354f Refactor 2025-12-15 14:06:33 +01:00
moebiusband 554527445b Merge branch 'master' into dev 2025-12-15 13:56:41 +01:00
moebiusband 987cc40318 Refactor 2025-12-15 13:50:05 +01:00
moebiusband 104fd1576a Refactor 2025-12-15 13:44:50 +01:00
moebiusband 72ce3954b4 feat: Add omitTagged flag for retention services
Fixes #344
2025-12-15 13:44:17 +01:00
moebiusband cfa7461855 Refactor 2025-12-15 13:25:41 +01:00
moebiusband 44cda8a232 Add flag to obmit tagged jobs from TestFindJobsBetween 2025-12-15 13:25:22 +01:00
moebiusband cf119e6843 Also initialize job-archive on init flag
Fixes #378
2025-12-15 12:59:12 +01:00
moebiusband d7d81e352d Update cc-lib to v1.0.0 and fix bug in init 2025-12-15 12:20:42 +01:00
moebiusband 078c608bda Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev 2025-12-15 11:25:44 +01:00
moebiusband f2e57f9edd Update gitignore 2025-12-15 11:25:42 +01:00
moebiusband 5698d5216f Reformat 2025-12-15 11:24:56 +01:00
moebiusband 10aa2bfbd3 Add support for ClusterConfig 2025-12-15 11:24:12 +01:00
moebiusband 6cfed989ff Fix bugs in sqlite backend 2025-12-15 11:23:53 +01:00
moebiusband ab70acd582 Also import ClusterConfigs 2025-12-15 11:20:49 +01:00
moebiusband f13be109c2 Fix: Replace all Printf log messages with appropriate loglevels 2025-12-11 11:20:11 +01:00
moebiusband d24d85b970 Adapt tests to new API 2025-12-11 09:39:38 +01:00
moebiusband 8d44ac90ad Fix: Busywait loop in archiver and slow shutdown
Remove unblocking default in select
Add shutdown handler with context and timeout
2025-12-11 09:29:10 +01:00
moebiusband 6325793902 Add check in initDB importer if jobMeta is nil 2025-12-04 15:38:21 +01:00
moebiusband 03b5272e44 Upgrade to latest cc-lib 2025-12-04 15:08:22 +01:00
moebiusband 7da01975f7 archive-migration: Add check for archive version and rewrite version after migration 2025-12-04 15:08:03 +01:00
moebiusband 7cff8bbfd2 Add documentation for importer 2025-12-04 15:07:09 +01:00
moebiusband f3ea95535b Remove init functionlity from Makefile 2025-12-04 10:24:33 +01:00
moebiusband b9b84b7971 Use --init flag in startDemo script 2025-12-04 07:43:55 +01:00
moebiusband be7340ca30 archive-migration leanup and fix path in README.md 2025-12-04 07:43:26 +01:00
moebiusband 881c4566dd Reformat and remove optional ui-config 2025-12-04 07:42:55 +01:00
moebiusband 7efbb0217f Update config for ccbackend --init 2025-12-04 07:42:26 +01:00
moebiusband 9e2ce39cde Update startDemo script 2025-12-04 07:03:01 +01:00
moebiusband 6aa830adb6 Merge dependabot and upgrade dependencies 2025-12-04 06:34:40 +01:00
moebiusband be6603cbb9 Merge branch 'master' into dev 2025-12-04 06:29:48 +01:00
moebiusband 81fe2c043e Upgrade to latest cc-lib 2025-12-04 06:21:28 +01:00
moebiusband c76e9bb3fe Fix error in unit test 2025-12-04 06:20:45 +01:00
moebiusband 48b68d3410 Fix aws endpoint deprecation 2025-12-04 06:20:19 +01:00
moebiusband 2b64b31393 Merge branch 'ai-review' into dev 2025-12-03 15:01:18 +01:00
moebiusband 2333068de7 Add tools for archive manager and archive-migration
Needs testing and review
2025-12-03 14:55:22 +01:00
moebiusband 78530029ef Reformat 2025-12-03 14:54:48 +01:00
moebiusband 329b6e5640 Review refactored code 2025-12-03 14:54:09 +01:00
moebiusband e00288b160 Cleanup dependencies 2025-11-20 14:28:25 +01:00
moebiusband f141ca926f Increase archive version. Fix unit tests. 2025-11-20 14:28:06 +01:00
moebiusband f7a0954213 Fix init order. Reformat. 2025-11-20 14:26:27 +01:00
moebiusband 6239e7f19b Merge branch 'dev' into ai-review 2025-11-20 08:59:52 +01:00
moebiusband d0e1b7186c Add perl script for CC logfile analysis 2025-11-20 07:51:33 +01:00
moebiusband fea3292f50 Add idea directory to gitignore 2025-11-20 07:50:10 +01:00
moebiusband 9973aa9ffa Refactor api package 2025-11-20 07:48:45 +01:00
moebiusband 0b38a980d2 Port importer to new transaction api 2025-11-20 07:39:16 +01:00
moebiusband 20838b6882 Add documentation to repository package 2025-11-20 07:38:54 +01:00
moebiusband 8f4ef1e274 Refactor repository
Fix issues
Improve transaction API
Make hardcoded constants configurable
Make error messages consistent and always add context info
2025-11-20 06:58:45 +01:00
moebiusband e1c7583670 Add sqlite and s3 job archive backend
Add documentation
Extend config
2025-11-19 17:00:11 +01:00
moebiusband 39a2157d46 Refactor tagger package
Fix issues
Add documentation
Add unit tests
2025-11-19 16:58:48 +01:00
moebiusband dd63e7157a Refactor memorystore
Fix issues
Add unit test
Add documentation
2025-11-19 16:58:02 +01:00
moebiusband 340efd7926 Refactor auth package
Fix security issues
Remove redundant code
Add documentation
Add units tests
2025-11-19 16:54:01 +01:00
moebiusband ecc6194b57 Refactor main package
Fix issues.
Break down main routine.
Add documentation.
Remove globals.
2025-11-19 16:53:04 +01:00
moebiusband cb5d06decd Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev 2025-10-29 09:01:05 +01:00
moebiusband 8555a88202 Upgrade dependencies. Regenerate GraphQL API. 2025-10-29 08:55:06 +01:00
moebiusband ae5d202661 Remove S3Backend stub 2025-10-23 15:14:28 +02:00
moebiusband bc43c844fc Fix memoryStore Init and move MetricConfig init 2025-10-20 10:22:40 +02:00
moebiusband 67be9aa27b Refactor
Port logging to cclog, use loglevels
Separate REST API from pkg API
2025-10-19 09:33:40 +02:00
moebiusband 047b997a22 Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev 2025-10-18 08:30:47 +02:00
moebiusband bac51891b7 Move avro into memorystore. Refactor
Does not compile
2025-10-18 08:30:42 +02:00
moebiusband 6efd6334bb Fix unit tests 2025-10-17 07:06:31 +02:00
moebiusband 91f4475d76 Update test db 2025-10-17 07:05:45 +02:00
moebiusband 440cd59e50 Revert hpc_cluster to cluster. Refactor. 2025-10-16 14:32:06 +02:00
moebiusband eefb6f6265 Cleanup after merge 2025-10-16 13:21:22 +02:00
moebiusband f5e1226837 Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev 2025-10-16 13:01:35 +02:00
moebiusband 151f7e701f Disable userConfig unit test 2025-10-16 12:54:29 +02:00
moebiusband 40398497c2 Update Node table code. Add simple unit test 2025-10-16 12:54:16 +02:00
moebiusband 89055506d6 Revert changes to ui config init 2025-10-15 08:54:16 +02:00
moebiusband 3d38d78845 Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev 2025-10-13 16:13:53 +02:00
moebiusband 600f19ac80 Sync commit
Does not work yet
2025-10-13 16:12:02 +02:00
moebiusband 9485a463b8 Refactor node repository 2025-09-30 10:07:07 +02:00
moebiusband 35c6ab4a08 Ongoing work on node table
Sync commit: Does not compile
2025-09-30 10:06:19 +02:00
moebiusband e58b0fa015 Add ui config tests and fix bugs 2025-09-30 09:01:54 +02:00
moebiusband beb92967e5 Update nodestate API and db adapter 2025-09-28 08:26:44 +02:00
moebiusband 015583f1cd Add incremental configuration 2025-09-28 08:26:18 +02:00
moebiusband d40c54b802 Refactor 2025-09-28 08:24:41 +02:00
moebiusband 647665b6b9 Refactor 2025-09-28 08:24:12 +02:00
moebiusband 4fc78bc382 Refactor variable namings and doc comments 2025-09-27 09:27:36 +02:00
moebiusband 50d000e7e2 Implement UI config handling 2025-09-27 09:26:42 +02:00
moebiusband 9020613a8b Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev 2025-09-10 15:14:40 +02:00
moebiusband be92d5943d Decrease verbosity in jobcache sync task 2025-09-10 15:13:53 +02:00
moebiusband 7948d5f773 Use different demo job-archive for dev branch 2025-09-10 10:34:11 +02:00
moebiusband 79605c8a9e Update test pipeline to go 1.25 2025-09-10 09:08:32 +02:00
moebiusband 55ca892f90 Merge branch 'metricstore' of github.com:ClusterCockpit/cc-backend into metricstore 2025-09-09 15:04:33 +02:00
moebiusband eaca187032 Fix testdata for new schema 2025-09-09 15:04:25 +02:00