Commit Graph

114 Commits

Author SHA1 Message Date
911dcb6626 Improve Compression Service
* Add Timing and more feedback
* Introduce persistent last compressed timestamp
2023-06-10 07:49:02 +02:00
918f1993f2 Add loglevel access. Fix timer labels. 2023-06-09 15:02:22 +02:00
5ba6f0ed3a Refactor and adapt to new API 2023-06-09 09:09:41 +02:00
Christoph Kluge
a6cb833843 Merge branch 'master' into 97_107_mark_and_show_shared
- Solves query.go conflict by splitting QueryJobLinks function aswell
2023-06-01 17:48:43 +02:00
65cebf6fde Add fix for broken ids in job archives 2023-06-01 15:26:53 +02:00
Christoph Kluge
37d5db443f Merge branch 'master' into 97_107_mark_and_show_shared 2023-06-01 15:24:26 +02:00
0a472d2b39 Fix bug in logger 2023-06-01 10:12:45 +02:00
Christoph Kluge
270750a78d Move concurrentJobs as field to main job query 2023-05-16 12:42:06 +02:00
0f9b83e636 Add Move retention policy
* Currently not testet!
2023-05-15 16:57:31 +02:00
1ae34c5e10 Extend archive manager 2023-05-15 14:32:23 +02:00
c64b996742 Finish uncompressed load data benchmark 2023-05-12 15:40:21 +02:00
c6dceb1265 Add LoadData Benchmark 2023-05-12 15:10:04 +02:00
6aea486891 Add util package 2023-05-12 15:09:39 +02:00
cfafd5aa08 Add archive test and fix fsBackend test 2023-05-11 16:17:17 +02:00
19e3ba7290 Improve retention
Add db cleanup
Fixes #103
2023-05-11 09:40:13 +02:00
538427d59b Introduce Retention and compression 2023-05-09 16:33:26 +02:00
72f178a088 Extend config schema 2023-05-09 09:34:03 +02:00
d3107dd2cc Omit redundant init of handlers 2023-05-09 07:48:46 +02:00
07c10d88b9 Initialize log handlers also without init 2023-05-09 07:47:54 +02:00
3d3e8f1d5a Merge branch 'master' into 103-add-retention-support 2023-05-09 07:18:50 +02:00
0a43c4a146 Fix archive test
Add testdata
2023-05-04 18:54:34 +02:00
d9b18d1763 Cleanup
Use external cc-units
Lint code
Fix import tests
2023-05-04 15:34:36 +02:00
dce02ab1e0 Revert optional pointer attributes 2023-05-04 07:00:47 +02:00
5a09277d1c Restructure black box test
Remove string ptr from unit prefix
2023-04-25 09:26:48 +02:00
Jan Eitzinger
500ae29d25 Synchronize DB Schema with json schema
Rework tests
2023-04-21 12:59:27 +02:00
Jan Eitzinger
7c2171afda Save state 2023-04-18 07:43:21 +02:00
Jan Eitzinger
10f4e09562 Set all versions and print in version flag 2023-04-12 10:43:46 +02:00
Jan Eitzinger
ecd0709851 Fix more merge bugs 2023-04-12 07:30:41 +02:00
Jan Eitzinger
129dd13fc8 Fix merge errors 2023-04-11 16:26:09 +02:00
Jan Eitzinger
f8ba79e9e7 Merge branch 'master' into import-data-sanitation 2023-04-07 08:57:42 +02:00
Jan Eitzinger
52a07b51d2 Fix tests 2023-04-07 08:04:40 +02:00
Jan Eitzinger
af51c93601 Merge branch 'import-data-sanitation' of github.com:ClusterCockpit/cc-backend into import-data-sanitation 2023-04-06 18:09:39 +02:00
Jan Eitzinger
d858868901 Fine tune schema and job archive migration 2023-04-06 18:09:36 +02:00
Christoph Kluge
323066cb30 Merge branch 'import-data-sanitation' of https://github.com/ClusterCockpit/cc-backend into import-data-sanitation 2023-04-06 11:38:12 +02:00
Christoph Kluge
f0cbb8c5dc Fix PrintList implementation, add NodeCount method 2023-04-06 11:38:10 +02:00
Jan Eitzinger
6661937fed Adapt schema and fix bugs in migration 2023-04-05 15:55:04 +02:00
Jan Eitzinger
559445900d Adapt job iterator
* Add option to also load Job Metric Data
* Validate Job Metric Data
* Allow null values in series array
2023-03-31 15:28:35 +02:00
Jan Eitzinger
bfee9d847b Fix copy and paste error 2023-03-31 12:33:14 +02:00
Jan Eitzinger
e009caa3d9 Formatting. Fix Typo 2023-03-31 11:30:33 +02:00
Jan Eitzinger
eb2e2cb1d2 Implement tool to validate archive 2023-03-31 11:25:12 +02:00
Christoph Kluge
68a839bf1c Remove comments 2023-03-30 15:23:31 +02:00
Christoph Kluge
0c1b66aad9 Adapt svelte to new schema, add removed metric box
- Moved 'scope' field to parent jobMetric
- Implemented unit { prefix, base } where necessary
- SubCluster Metric Config 'remove' option implemented in Joblists
2023-03-30 15:21:35 +02:00
Christoph Kluge
1bb2827aeb Merge branch 'import-data-sanitation' of https://github.com/ClusterCockpit/cc-backend into import-data-sanitation 2023-03-29 10:39:42 +02:00
Christoph Kluge
fc133f328a Add check to ccms getSubCluster routine
- Fixes nil pointer panic if topology requested from undef'd subcluster
- rest.go: vscode LINT
2023-03-29 10:39:31 +02:00
Jan Eitzinger
5d535edb48 Synchronize go job struct with schema 2023-03-29 06:46:33 +02:00
Jan Eitzinger
b5b5feb850 Fix tests 2023-03-27 14:41:00 +02:00
8447d011ad Add version to job archive 2023-03-27 13:24:06 +02:00
Jan Eitzinger
a4a90074ee Introduce compression in job archive. 2023-03-27 11:11:14 +02:00
Jan Eitzinger
58f589e019 Fix subcluster assigment with wildcard 2023-03-24 15:56:27 +01:00
Jan Eitzinger
3ce8344275 Add default match for one subcluster 2023-03-24 15:21:31 +01:00