Jan Eitzinger
d858868901
Fine tune schema and job archive migration
2023-04-06 18:09:36 +02:00
Jan Eitzinger
6661937fed
Adapt schema and fix bugs in migration
2023-04-05 15:55:04 +02:00
Jan Eitzinger
559445900d
Adapt job iterator
...
* Add option to also load Job Metric Data
* Validate Job Metric Data
* Allow null values in series array
2023-03-31 15:28:35 +02:00
Jan Eitzinger
bfee9d847b
Fix copy and paste error
2023-03-31 12:33:14 +02:00
Jan Eitzinger
869c4d7e5e
Add validate=true in example config.json
2023-03-31 11:34:22 +02:00
Jan Eitzinger
e009caa3d9
Formatting. Fix Typo
2023-03-31 11:30:33 +02:00
Jan Eitzinger
eb2e2cb1d2
Implement tool to validate archive
2023-03-31 11:25:12 +02:00
Jan Eitzinger
6b84e65d88
Disable test
2023-03-29 14:37:42 +02:00
Jan Eitzinger
82120cfb3d
Update generated.go
2023-03-29 10:54:16 +02:00
Jan Eitzinger
d4f3c4d07b
Update job.go
2023-03-29 06:47:19 +02:00
Jan Eitzinger
5d535edb48
Synchronize go job struct with schema
2023-03-29 06:46:33 +02:00
Jan Eitzinger
9aa12c6edc
Update .gitignore
2023-03-27 15:36:57 +02:00
Jan Eitzinger
f16d99ef71
Use filepath.Join instead of Sprintf
2023-03-27 15:34:56 +02:00
Jan Eitzinger
b5b5feb850
Fix tests
2023-03-27 14:41:00 +02:00
Jan Eitzinger
ff8f013b56
Make archive migration threaded
2023-03-27 11:11:28 +02:00
Jan Eitzinger
a4a90074ee
Introduce compression in job archive.
2023-03-27 11:11:14 +02:00
Jan Eitzinger
465d5c0186
Rename archive tools
2023-03-24 16:24:06 +01:00
Jan Eitzinger
72fc4b859c
Remove obsolete numberOfNodes property
2023-03-24 16:13:51 +01:00
Jan Eitzinger
58f589e019
Fix subcluster assigment with wildcard
2023-03-24 15:56:27 +01:00
Jan Eitzinger
3ce8344275
Add default match for one subcluster
2023-03-24 15:21:31 +01:00
Jan Eitzinger
9aff980a38
Add scope to Metric List. Add numberOfNodes.
2023-03-24 15:10:23 +01:00
Jan Eitzinger
4d49698e5a
Add scope to GraphQL Metric Type
2023-03-24 14:43:37 +01:00
Jan Eitzinger
c622967d27
Fix json test data
2023-03-24 13:40:08 +01:00
Jan Eitzinger
05bce53c7f
Adapt test json data to new schema
2023-03-24 13:30:54 +01:00
Jan Eitzinger
cf6c217f76
Allocate reference variables on heap
2023-03-22 19:29:29 +01:00
Jan Eitzinger
1f8c6064e2
Refactor schema
...
* Remove redundant scope
* Change Series Id type to string
* Adopt golang structs to schema
2023-03-22 19:21:11 +01:00
Jan Eitzinger
def35a551a
Only hide binary
2023-03-22 07:18:45 +01:00
Jan Eitzinger
327721bac7
Add validate option. Backport startDemo
2023-03-22 07:15:41 +01:00
Jan Eitzinger
a168efa8c8
Fix unit tests
2023-03-22 07:05:41 +01:00
Jan Eitzinger
d2b97c9e2f
Continue with job-archive migration
2023-03-10 12:14:33 +01:00
Jan Eitzinger
97f391deff
GraphQL remove toplevel thresholds and add Unit
...
Add Unit to metric values in subCluster
2023-03-10 12:13:40 +01:00
Jan Eitzinger
93ee7b534a
Update .gitignore
2022-11-10 13:41:17 +01:00
Jan Eitzinger
8dc9e6ecdd
Fix issues in conversion tool
2022-11-10 13:37:53 +01:00
Jan Eitzinger
70b39730d2
Add skeleton for job archive conversion tool
2022-11-10 07:35:38 +01:00
Jan Eitzinger
740d2a2928
Adapt test input to new unit schema
2022-11-09 19:47:56 +01:00
Jan Eitzinger
d2818d54ff
Remove redundant stopTime property
2022-10-18 07:32:56 +02:00
Jan Eitzinger
954236bd8e
Fix issue for a non gpu system
2022-10-18 07:32:34 +02:00
Jan Eitzinger and GitHub
8227f904f8
Merge pull request #54 from ClusterCockpit/48_improve_status_view
...
48 improve status view
2022-10-17 10:10:49 +02:00
Jan Eitzinger
29d215fcea
Intermediate Save commit
2022-10-04 10:12:35 +02:00
Jan Eitzinger
7251344d4a
Add convenience routines to unit package
2022-09-28 16:25:26 +02:00
Jan Eitzinger and GitHub
5f50a00784
Merge pull request #50 from ClusterCockpit/48_improve_status_view
...
Add build info to footer
2022-09-27 10:17:14 +02:00
Jan Eitzinger and GitHub
9d9690b2ff
Update README.md
2022-09-27 07:46:18 +02:00
Jan Eitzinger and GitHub
4af3b62567
Update README.md
2022-09-27 07:44:35 +02:00
Jan Eitzinger
7eebc0b5b7
Update README.md
2022-09-26 16:39:34 +02:00
Jan Eitzinger
d1fefe16a3
Update README.md
2022-09-26 15:46:38 +02:00
Jan Eitzinger
fe91e0a362
Update config.json
2022-09-26 15:34:21 +02:00
Jan Eitzinger and GitHub
411da118db
Merge pull request #49 from ClusterCockpit/dev-job-archive-module
...
Refactoring and Cleanup
* Add packages for archive
* Extract all data structures into schema package
* Re-Generate GraphQL Code
* Add Swagger UI Frontend and REST Api documentation generated from code comments
* Integrate JSON Schema and add schema validation
* Add more tests
* Add Makefile for build automation
* Integrate binary version and git hash
2022-09-26 15:18:41 +02:00
Jan Eitzinger and GitHub
918a07735d
Merge branch 'master' into dev-job-archive-module
2022-09-26 15:12:46 +02:00
Jan Eitzinger
2753cf5652
Update README.md
2022-09-26 14:19:15 +02:00
Jan Eitzinger
90425021ad
Add info output tp Makefile
2022-09-26 13:51:03 +02:00
Jan Eitzinger
066194121b
Add version and git tag to binary
...
Fixes #47
2022-09-26 13:16:04 +02:00
Jan Eitzinger
b44c6a2e7d
Add Makefile for build automation
2022-09-26 11:22:34 +02:00
Jan Eitzinger
dd5f09c982
Rename api_test to integration_test
2022-09-23 16:17:33 +02:00
Jan Eitzinger
9ae7a813fa
Restructure import job test due to db handle clash
2022-09-23 16:11:35 +02:00
Jan Eitzinger
5c715b6ec2
Add test for import job handler. Improve error messages.
2022-09-23 15:23:45 +02:00
Jan Eitzinger
3a582ee2f5
Update schema
2022-09-21 15:20:26 +02:00
Jan Eitzinger
6ed9f16882
Adapt startDemo script to new flags
2022-09-21 15:10:46 +02:00
Jan Eitzinger
4652f1dae1
Extend unit schema
2022-09-21 15:10:31 +02:00
Jan Eitzinger and GitHub
2b9d01f3a0
Merge pull request #44 from ClusterCockpit/config-component
...
Include config component
2022-09-20 13:21:55 +02:00
Jan Eitzinger
35114aeb2d
Cleanup. Fix failing test
2022-09-20 13:07:46 +02:00
Jan Eitzinger
0c4096eda3
Fix api testcase
2022-09-20 12:21:20 +02:00
Jan Eitzinger
2fdf1c14be
Fix broken schema and add tests
2022-09-20 10:27:23 +02:00
Jan Eitzinger
207254a9e2
Embed schema files for validation
2022-09-20 07:05:01 +02:00
Jan Eitzinger
7e0f2a2e06
Update cluster..json in rest api test
2022-09-19 17:37:32 +02:00
Jan Eitzinger
27d18f00eb
Add docs for deployment
2022-09-19 17:37:04 +02:00
Jan Eitzinger
2a43e0bcf3
Update config README. Add helper script for subClusters
2022-09-19 17:36:45 +02:00
Jan Eitzinger
71d6bf81c2
Add hands-on README in docs
2022-09-19 17:36:00 +02:00
Jan Eitzinger
02732cbbce
Move additional tools to tools directory
2022-09-19 16:16:33 +02:00
Jan Eitzinger
e8d7722c42
Add json schema validation for config file
2022-09-19 16:16:05 +02:00
Jan Eitzinger
24f374ed36
Fix API tag data type
2022-09-16 11:21:27 +02:00
Jan Eitzinger and GitHub
597fe955fa
Update README.md
2022-09-16 07:05:44 +02:00
Jan Eitzinger
ae26c86e3b
Add description on Swagger UI
2022-09-16 06:39:12 +02:00
Jan Eitzinger
6325f02ba2
Merge branch 'dev-job-archive-module' of github.com:ClusterCockpit/cc-backend into dev-job-archive-module
2022-09-16 06:28:07 +02:00
Jan Eitzinger
f1941b5e67
Reconfigure Swagger integration. Regenerate API docs
2022-09-16 06:09:55 +02:00
Jan Eitzinger
8845bba90d
Fix bug
2022-09-13 15:40:32 +02:00
Jan Eitzinger
cab017ea63
Disable validation for api test
2022-09-13 15:32:01 +02:00
Jan Eitzinger
777f225e91
Add option for json validation
2022-09-13 15:22:20 +02:00
Jan Eitzinger
732801548f
Enable caching for job metric data
2022-09-13 15:21:50 +02:00
Jan Eitzinger
520c814e3b
Introduce import job flag
2022-09-13 15:20:07 +02:00
Jan Eitzinger
7cea964271
Update jsonschema package
2022-09-13 15:18:55 +02:00
Jan Eitzinger and GitHub
adc22f6bc1
Merge branch 'master' into config-component
2022-09-13 09:05:07 +02:00
Jan Eitzinger
f6508046ff
Integrate cc-units as units package
2022-09-13 07:38:44 +02:00
Jan Eitzinger
d8aaa26c27
Cleanup and small fixes
2022-09-13 07:38:18 +02:00
Jan Eitzinger
fd100f28dd
Change interface and reintroduce caching
2022-09-13 07:37:48 +02:00
Jan Eitzinger
95f04f8ae9
Update README.md
2022-09-12 16:27:54 +02:00
Jan Eitzinger
00fc5f4774
Remove to set ArrayJobId on DB Init
2022-09-12 14:51:51 +02:00
Jan Eitzinger
cca0722b01
Remove obsolete variable
2022-09-12 14:46:18 +02:00
Jan Eitzinger
56b710db29
Add job archive for tests
2022-09-12 14:36:12 +02:00
Jan Eitzinger
7e8b2eb3a5
Make production flag static
2022-09-12 13:37:16 +02:00
Jan Eitzinger
9a4d279c5a
Inject cluster config in header variable
2022-09-12 13:35:42 +02:00
Jan Eitzinger
10c6b366a5
Refactor UserCfg, add test
2022-09-12 13:34:21 +02:00
Jan Eitzinger
c0daad256f
Regenerate GraphQL Api. Remove FilterRanger
2022-09-12 13:33:01 +02:00
Jan Eitzinger
c64a935750
Cleanup and improve error handling
2022-09-11 07:13:08 +02:00
Jan Eitzinger
eb5d3581d1
Make ArrayJobId int64
2022-09-11 07:11:41 +02:00
Jan Eitzinger
5e002def0a
Cleanup and shift FilterRanges to configuration
2022-09-11 07:11:17 +02:00
Jan Eitzinger
48c1ba097a
Improve error handling and implement tests
2022-09-11 07:09:10 +02:00
Jan Eitzinger
80583323c0
Inverse behavior for server flag
2022-09-11 07:08:28 +02:00
Jan Eitzinger
882dc011b9
Fix vet issue
2022-09-07 13:41:33 +02:00
Jan Eitzinger
8856f26fb0
Reformat and Refactor packages. Rebuild GraphQL.
2022-09-07 12:24:45 +02:00
Jan Eitzinger
b7907d33aa
Move data structures to config package
2022-09-06 15:43:57 +02:00