ClusterCockpit/cc-backend
1
0
Fork 0
mirror of https://github.com/ClusterCockpit/cc-backend synced 2024-11-15 03:07:26 +01:00
Code Issues Packages Releases Activity
1,498 Commits 7 Branches 8 Tags 12 MiB
82e28f26d7
Commit Graph

483 Commits

Author SHA1 Message Date
Jan Eitzinger
83df6f015c
Merge pull request #287 from ClusterCockpit/refactor-archiving 
Refactor archiving
 2024-08-28 10:14:46 +02:00
Jan Eitzinger
e7231b0e13 Finish refactoring 
Add new packages:
- metricDataDispatcher
- archiver
 2024-08-28 10:03:04 +02:00
Christoph Kluge
cff60eb51c increase server timeout limit, improve and add db indices 
- change energy footprint key to string
 2024-08-27 17:43:48 +02:00
Jan Eitzinger
f914a312f5
Introduce metricDataDispatcher 
Does not compile yet
 2024-08-27 16:44:16 +02:00
Jan Eitzinger
56ebb301ca Start to restructure 
Does not compile
 2024-08-27 10:14:33 +02:00
Christoph Kluge
5cc7fc6ccb Merge branch 'sample_resolution_select' of https://github.com/ClusterCockpit/cc-backend into sample_resolution_select 2024-08-26 09:55:36 +02:00
Christoph Kluge
55027cb630 fix: add resolution 60 default to ccms nodeData query 2024-08-26 09:55:33 +02:00
Aditya Ujeniya
036eba68e1 Fix for resampler 2024-08-25 16:13:43 +02:00
Christoph Kluge
31765ce0ef Merge branch 'dev' into 275_add_tag_scope 2024-08-23 14:52:42 +02:00
Christoph Kluge
adc3502b6b cleanup dev logline 2024-08-23 13:37:42 +02:00
Christoph Kluge
d629a58712 Merge branch 'dev' into sample_resolution_select 2024-08-22 17:33:16 +02:00
Aditya Ujeniya
ceb3a095d8 Sampling Feature for archived and fresh data 2024-08-22 14:29:51 +02:00
Jan Eitzinger
a8a27c9b51 Add project index to job table 2024-08-19 12:11:53 +02:00
Christoph Kluge
b1fd07cd30 add single update gql queries to metric wrapper 2024-08-16 14:50:31 +02:00
Jan Eitzinger
5e074dad10
Resolve error in migration 2024-08-15 12:39:14 +02:00
Jan Eitzinger
5c99f5f8bb
Only add footprint columns if not 0 2024-08-15 12:35:11 +02:00
Jan Eitzinger
ba2f406bc0
Extend sqlite db migration 2024-08-15 09:41:54 +02:00
Christoph Kluge
561fd41d5d fix: add accelerator scope to to-be archived scopes 
- if numAcc > 0
- fixes Add accelerator scope to archive requests #282
 2024-08-13 17:49:28 +02:00
Christoph Kluge
9b5c6e3164 fix StartJobTest, add tag_scope to migration 2024-08-05 10:37:42 +02:00
Christoph Kluge
e6ebec8c1e fix TestGetTags test, was missing scope and ctx 2024-08-05 10:19:00 +02:00
Christoph Kluge
e02575aad7 adds comments 2024-08-02 16:42:55 +02:00
Christoph Kluge
ff3502c87a fix: fix tag filter results 
- displayed multiple identical entries before
- job count was incorrect before
 2024-08-02 16:11:47 +02:00
Christoph Kluge
017f9b2140 feat: Add tag scopes to front and backend, initial commit 2024-08-01 18:59:24 +02:00
Christoph Kluge
6a1cb51c2f Refactor svelte frontend 
- Adapt to new metricConfig logic
- Footprint-Metrics generalized for bar card
- Footprint-Metrics in stats filter and sorting
- Frontend always uses GQL, except adminOptions
- Job View will load scopes for all metrics on request
 2024-07-22 15:41:33 +02:00
Jan Eitzinger
c4d93e492b
Remove bugs in main init 2024-07-20 10:03:14 +02:00
Jan Eitzinger
c2f72f72ac
Update go dependencies 2024-07-20 08:59:51 +02:00
Jan Eitzinger
721b6b2afa
Change footprint variabel from bool to string 
The footprint variable also indicates the type of statistic used now
 2024-07-20 08:59:07 +02:00
Jan Eitzinger
b6f011c669
Move footprint update task placeholder to taskmanager 2024-07-16 12:34:27 +02:00
Jan Eitzinger
801607fc16
Refactor main 
Convert components to Singletons
Restructure main package
Reduce dependencies
 2024-07-16 12:08:10 +02:00
Jan Eitzinger
01a4d33514
Refactor: Archive workers and Tasks 
Work in progress
 2024-07-14 11:18:38 +02:00
Jan Eitzinger
e348ec74fd
Fix bugs in stats.go 2024-07-12 14:08:48 +02:00
Jan Eitzinger
0458675608
Convert histogram query to json keys 2024-07-12 13:42:12 +02:00
Jan Eitzinger
c61ffce0e9
Make job query on metric stats generic 2024-07-12 13:21:19 +02:00
Jan Eitzinger
a07d167390
Fix build error with updated prometheus client 2024-07-12 09:17:31 +02:00
Christoph Kluge
a8721dcc69 Regenerate gql after internal merge 2024-07-11 17:37:53 +02:00
Christoph Kluge
68cf952ac6 Merge branch 'Refactor-job-footprint' of https://github.com/ClusterCockpit/cc-backend into Refactor-job-footprint 2024-07-11 17:33:21 +02:00
Christoph Kluge
e14d6a81fe fix: fix db migration to v8, changes key name to cpu_load 2024-07-11 17:24:33 +02:00
Christoph Kluge
a4912893a8 Frontend refactor backend changes 2024-07-11 17:23:59 +02:00
Jan Eitzinger
b64ce1f67f
Add LowerIsBetter Metric boolean. Upgrade dependencies. 2024-07-11 16:58:12 +02:00
Jan Eitzinger
f1427d5272
Add global metric list including graphQL query 2024-07-11 11:09:14 +02:00
Christoph Kluge
bf6b87d65c Fix circular import after merge 2024-07-09 09:50:32 +02:00
Christoph Kluge
0240997257 Merge branch '263_use_median_for_statsseries' into Refactor-job-footprint 2024-07-09 09:28:21 +02:00
Christoph Kluge
f1e341f0b9 Initial commit for frontend refactor 2024-07-09 09:17:50 +02:00
Christoph Kluge
11176da5d8 Merge branch 'Refactor-job-footprint' into 264_user_api_access 2024-07-05 16:11:42 +02:00
Christoph Kluge
0a604336c4 Fix other apitest subtests 2024-07-05 15:42:08 +02:00
Christoph Kluge
be9df7649f fix: setup user in api test config 2024-07-05 15:25:24 +02:00
Christoph Kluge
63fb923995 fix: fix api test router init 2024-07-05 13:16:21 +02:00
Christoph Kluge
3afe40083d rename api userconfig to frontend, return json on api auth error 2024-07-05 11:48:06 +02:00
Jan Eitzinger
ac9bba8b5b
Restructure and simplify job repo 2024-07-04 15:05:24 +02:00
Jan Eitzinger
80c46bea7f
Fix bugs and failed testcases 2024-07-04 14:14:27 +02:00
Christoph Kluge
1072d7b449 Improve auth handling of rest apis used in frontend for compatibility 2024-07-04 11:16:45 +02:00
Christoph Kluge
61eebc9fbd Rework initial commit 
- moved frontend configuration api to new subrouter for compatibility
 2024-07-03 17:24:26 +02:00
Jan Eitzinger
130613b717
Fix build errors 
Code not yet functional
 2024-06-28 17:08:28 +02:00
Jan Eitzinger
b3c1f39a0e
Merge branch 'master' into Refactor-job-footprint 2024-06-28 16:50:04 +02:00
Jan Eitzinger
97c807cd33
Add migration for footprint 2024-06-28 16:49:24 +02:00
Jan Eitzinger
786770f56a
Start to convert to new footprint layout 2024-06-28 16:48:10 +02:00
Jan Eitzinger
5c5484b4d2
Export package runtimeEnv 2024-06-25 07:12:46 +02:00
Christoph Kluge
70e63764ff fix: allow single partial errors on otherwise non-empty returned metric array 2024-06-13 12:38:29 +02:00
Christoph Kluge
320c87a1db fix: add additional 30d fitler to searchbar fallback handling 2024-05-27 11:11:25 +02:00
Christoph Kluge
420bec7c46 fix: fix jobname and arrayjobid timeouts by adding additional 30d filter 
- improve archive worker logs
- add arrayjobid filter to url if used
 2024-05-23 11:53:23 +02:00
Christoph Kluge
684cb5a376 feat: change statistics render of metric plot to min/max/median 
- #263
 2024-05-08 16:17:42 +02:00
Christoph Kluge
597bccc080 fix: add SQL JSON validity check to meta_data query 2024-05-06 13:15:15 +02:00
Christoph Kluge
a22340196f Fix: Improve jobName query by parsing DB field as JSON 
- No DB mirgration required
- SQLite internal EXTRACT function used
 2024-04-22 12:14:40 +02:00
Christoph Kluge
cbaeffde2c fix: improve speed of hasNextPage query for infinite scroll 2024-04-22 11:29:31 +02:00
Jan Eitzinger
b67f5436f8 Merge branch 'hotfix' of github.com:ClusterCockpit/cc-backend into hotfix 2024-04-21 15:04:09 +02:00
Jan Eitzinger
b637ddeb28 Refactor and reformat userConfig 2024-04-21 15:04:00 +02:00
Jan Eitzinger
fb8bbea99d Remove year in copyright notice 2024-04-11 23:04:30 +02:00
Jan Eitzinger
baa51db26c
Merge pull request #252 from ClusterCockpit/20_infinite_scroll 
20 infinite scroll
 2024-03-28 17:43:02 +01:00
Jan Eitzinger
6828c97415 Add central function to persist users on Login 2024-03-28 14:22:23 +01:00
Jan Eitzinger
50401e0030 Fix conditional rendering of OIDC button in login 2024-03-28 13:18:25 +01:00
Jan Eitzinger
642fd5cc91 Merge branch 'master' into 236-user-authentication-using-keycloak-or-any-openid-client-for-using-external-auth-providers-such-as-ldap-github-google 2024-03-28 12:07:58 +01:00
Jan Eitzinger
e8fb5a0030 Add OpenID Connect authentication 
Fixes #236
Template conditional not yet working
Needs more testing
 2024-03-28 12:01:13 +01:00
Christoph Kluge
0dee5073c6 fix: make hasnextpage optional parameter, use only if inf scroll configured 2024-03-26 16:27:04 +01:00
Christoph Kluge
b9b452f043 feat: prototype infinite scroll implementation 2024-03-26 15:56:07 +01:00
Christoph Kluge
1f5723a97e Merge branch 'hotfix' of https://github.com/ClusterCockpit/cc-backend into hotfix 2024-03-22 16:10:35 +01:00
Christoph Kluge
5a177c952d fix: multiple accs with identical label, cloned data for single acc 
- GPU id label in job view statistic table is always the same on multi GPU jobs #239
- Multiple accelerators listed in plot despite using only one #241
 2024-03-22 16:10:30 +01:00
Jan Eitzinger
83c38e74db Refactoring: Reduze bytesize of structs. 2024-03-22 08:59:35 +01:00
Jan Eitzinger
1e5f2944cf Upgrade dependencies. Port to jwt-auth v5. 2024-03-21 22:02:59 +01:00
Jan Eitzinger
c65694b36c Add tags and metadata to job queries. Fix query parameter handling. 
Fixes #248
 2024-03-19 16:18:43 +01:00
Jan Eitzinger
0005469101 Refactor 2024-03-19 16:16:02 +01:00
Jan Eitzinger
81fe492655
Merge pull request #247 from ClusterCockpit/hotfix 
Hotfix
 2024-03-15 09:30:48 +01:00
Christoph Kluge
849b7e038d Fix: make footprint display configurable app-wide 
- note: requires full ui-defaults object in config
 2024-03-14 15:14:19 +01:00
Michael Schwarz
ce792426e6 Disable foreign key check while updating database 2024-03-14 09:15:15 +01:00
Jan Eitzinger
e92e727279 Extend oidc auth provider 2024-03-13 17:09:36 +01:00
Jan Eitzinger
f761900a3e Add initial code for oidc authentication support 2024-03-13 09:37:12 +01:00
Jan Eitzinger
99d55f05f8 feat: Add cluster config endpoint to rest api 2024-03-08 16:35:30 +01:00
Jan Eitzinger
9fd839fad8 Add rest endpoint to get all job data 
Fixes #203
 2024-03-08 15:31:34 +01:00
Jan Eitzinger
06d01962a6 feat: Allow to revert db to previous version 2024-03-08 11:28:26 +01:00
Jan Eitzinger
2c2c1accb5 Allow up and down migration of database 2024-03-08 10:58:45 +01:00
Jan Eitzinger
105b7eabf0 Add migration and introduce dirty flag handling 2024-03-08 10:47:32 +01:00
Jan Eitzinger
de1d83e1a9
Merge branch 'master' into 231-sql-statement-syntax 2024-03-08 09:05:13 +01:00
Jan Eitzinger
e81e56ea1d Add rest endpoint edit_meta including helper routines 
Fixes #219
 2024-03-08 08:51:05 +01:00
Jan Eitzinger
aa6336ea1e Refactor 
Reformat.
Convert to query builder.
Add descriptive error log messages.
 2024-03-06 14:50:08 +01:00
Jan Eitzinger
dd887cbb1f Do all tag queries with query builder 
Fix bug in mysql database initialization.
Fixes #231
 2024-03-06 13:47:52 +01:00
Jan Eitzinger
5a4671b7b1 Always return on metricstore error. 2024-02-23 10:08:41 +01:00
Christoph Kluge
21dde870c6
Merge branch 'master' into 214_user_status_histograms 2024-02-08 12:26:07 +01:00
Christoph Kluge
07073e290a feat: add selectable histograms to status view 2023-12-12 16:46:03 +01:00
Christoph Kluge
119637cb9b Fix using crossjoin arguments not used 2023-12-12 15:07:23 +01:00
Christoph Kluge
ee4097a2dd Add missing filters to crossjoinquery 2023-12-11 13:55:56 +01:00
Christoph Kluge
1185737eaa Add metrics to histoselect, add userfilters 
- edit struct to make only count return required
 2023-12-08 12:03:04 +01:00