Commit Graph

257 Commits

Author SHA1 Message Date
0458675608
Convert histogram query to json keys 2024-07-12 13:42:12 +02:00
c61ffce0e9
Make job query on metric stats generic 2024-07-12 13:21:19 +02:00
Christoph Kluge
e14d6a81fe fix: fix db migration to v8, changes key name to cpu_load 2024-07-11 17:24:33 +02:00
Christoph Kluge
bf6b87d65c Fix circular import after merge 2024-07-09 09:50:32 +02:00
Christoph Kluge
f1e341f0b9 Initial commit for frontend refactor 2024-07-09 09:17:50 +02:00
Christoph Kluge
11176da5d8 Merge branch 'Refactor-job-footprint' into 264_user_api_access 2024-07-05 16:11:42 +02:00
Christoph Kluge
3afe40083d rename api userconfig to frontend, return json on api auth error 2024-07-05 11:48:06 +02:00
ac9bba8b5b
Restructure and simplify job repo 2024-07-04 15:05:24 +02:00
80c46bea7f
Fix bugs and failed testcases 2024-07-04 14:14:27 +02:00
Christoph Kluge
61eebc9fbd Rework initial commit
- moved frontend configuration api to new subrouter for compatibility
2024-07-03 17:24:26 +02:00
97c807cd33
Add migration for footprint 2024-06-28 16:49:24 +02:00
786770f56a
Start to convert to new footprint layout 2024-06-28 16:48:10 +02:00
Christoph Kluge
420bec7c46 fix: fix jobname and arrayjobid timeouts by adding additional 30d filter
- improve archive worker logs
- add arrayjobid filter to url if used
2024-05-23 11:53:23 +02:00
Christoph Kluge
597bccc080 fix: add SQL JSON validity check to meta_data query 2024-05-06 13:15:15 +02:00
Christoph Kluge
a22340196f Fix: Improve jobName query by parsing DB field as JSON
- No DB mirgration required
- SQLite internal EXTRACT function used
2024-04-22 12:14:40 +02:00
b67f5436f8 Merge branch 'hotfix' of github.com:ClusterCockpit/cc-backend into hotfix 2024-04-21 15:04:09 +02:00
b637ddeb28 Refactor and reformat userConfig 2024-04-21 15:04:00 +02:00
fb8bbea99d Remove year in copyright notice 2024-04-11 23:04:30 +02:00
0005469101 Refactor 2024-03-19 16:16:02 +01:00
Michael Schwarz
ce792426e6 Disable foreign key check while updating database 2024-03-14 09:15:15 +01:00
06d01962a6 feat: Allow to revert db to previous version 2024-03-08 11:28:26 +01:00
2c2c1accb5 Allow up and down migration of database 2024-03-08 10:58:45 +01:00
105b7eabf0 Add migration and introduce dirty flag handling 2024-03-08 10:47:32 +01:00
Jan Eitzinger
de1d83e1a9
Merge branch 'master' into 231-sql-statement-syntax 2024-03-08 09:05:13 +01:00
e81e56ea1d Add rest endpoint edit_meta including helper routines
Fixes #219
2024-03-08 08:51:05 +01:00
aa6336ea1e Refactor
Reformat.
Convert to query builder.
Add descriptive error log messages.
2024-03-06 14:50:08 +01:00
dd887cbb1f Do all tag queries with query builder
Fix bug in mysql database initialization.
Fixes #231
2024-03-06 13:47:52 +01:00
Christoph Kluge
21dde870c6
Merge branch 'master' into 214_user_status_histograms 2024-02-08 12:26:07 +01:00
Christoph Kluge
07073e290a feat: add selectable histograms to status view 2023-12-12 16:46:03 +01:00
Christoph Kluge
119637cb9b Fix using crossjoin arguments not used 2023-12-12 15:07:23 +01:00
Christoph Kluge
ee4097a2dd Add missing filters to crossjoinquery 2023-12-11 13:55:56 +01:00
Christoph Kluge
1185737eaa Add metrics to histoselect, add userfilters
- edit struct to make only count return required
2023-12-08 12:03:04 +01:00
Christoph Kluge
ead5c54bcb Prototype completed 2023-12-05 15:30:40 +01:00
Christoph Kluge
b5b355c16c Finished backend sql query and gql resolve 2023-12-05 11:59:01 +01:00
Christoph Kluge
9bc36152d9 intermediate save
- DOES NOT COMPILE
2023-12-01 13:22:01 +01:00
Christoph Kluge
e34623b1ce Add db average stats to gql, use in footprint 2023-11-24 15:11:38 +01:00
Christoph Kluge
69ee19bed0 fix: include running jobs case in statsQueries 2023-09-01 10:23:14 +02:00
Jan Eitzinger
b836eee1e7
Merge pull request #205 from ClusterCockpit/166_add_scopes_analysis
166 add scopes analysis
2023-08-31 12:03:37 +02:00
9533f06eaf Refactor repository tests
Add context to tests.
Remove special test routines
2023-08-30 15:04:50 +02:00
Christoph Kluge
59c749a164 feat: add select to analysis view pie chart
- 'Walltime' as generic default value for top list
-  Change from nodes distribution to cores distribution
2023-08-29 17:38:17 +02:00
Christoph Kluge
3014f59cc2 feat: add new distribution plots to status view
- numCores and numAccs
2023-08-29 14:02:23 +02:00
Christoph Kluge
f933cad87f feat: add select to status view pie charts
- 'Jobs' as generic default value for top lists
- Prepare histograms for cores and accs in schema
2023-08-29 14:01:01 +02:00
Pay Giesselmann
81d9015d59 :fix delete user logging 2023-08-29 09:29:56 +02:00
Christoph Kluge
c84b819212 Fix frontend errors
- todo: debug backend handling
2023-08-28 10:00:20 +02:00
Christoph Kluge
ce758610b6 change: implement topX query in jobsStatistics 2023-08-25 17:38:25 +02:00
d7117f3d49 Add sorting and paging to JobStatsGrouped 2023-08-25 13:14:34 +02:00
3b8bcf7b32 Remove obsolete jobsCount resolver 2023-08-24 14:51:26 +02:00
a7dd3fbc0b fix bug in stats AddJobCount 2023-08-24 14:26:23 +02:00
Christoph Kluge
4eceab4dc7 fix: change analysis top users to core hours 2023-08-24 12:51:55 +02:00
14c487c9e4 Update test inputs 2023-08-18 09:31:57 +02:00
15231bc683 Cleanup and adapt to new structure 2023-08-17 12:34:30 +02:00
87ce4f63d4 Refactor auth module
Separate parts
Add user repository
Add user schema
2023-08-17 10:29:00 +02:00
b8273a9b02 refactor auth module
Restructure module
Separate JWT auth variants
Cleanup code
Fixes #189
2023-08-11 10:00:23 +02:00
Christoph Kluge
2f471dc192 Change listQuery to jobId array, adapt filter pipe 2023-06-30 16:55:34 +02:00
b5a7249ad5 Fix sqlite migration for configuration 2023-06-30 09:15:58 +02:00
dd80d5af9e Change config value datatype
Fixes #167
2023-06-29 14:55:38 +02:00
7174f27a89 Add node filter and concurrent job list query 2023-06-28 13:35:41 +02:00
3828c138b8 Add init flag 2023-06-28 12:41:27 +02:00
34050c8ce0 Fix argument dashes 2023-06-27 14:30:09 +02:00
eb626db9c2 Debug compression service 2023-06-27 14:29:56 +02:00
d1e3e06b10 Add insert timestamp to tag, jobtag
Fixes #43
2023-06-27 09:41:06 +02:00
8aaa5722e9 Fix errors in query logic 2023-06-26 16:48:13 +02:00
99a2888431 Fix typo in Query 2023-06-26 14:45:49 +02:00
Jan Eitzinger
7d85c0e9ad
Merge pull request #162 from ClusterCockpit/refactor-concurrent-job-resolver
Refactor concurrent job resolver
2023-06-26 14:28:00 +02:00
Christoph Kluge
f992ffc2da Fix SSL timing issues with best guess search 2023-06-23 16:09:33 +02:00
Jan Eitzinger
2f6c16a7d8
Merge pull request #156 from giesselmann/log_levels
lower log level for frequent messages
2023-06-23 10:33:44 +02:00
Jan Eitzinger
76d3018b5c
Merge pull request #159 from ClusterCockpit/158_fix_searchbar
158 fix searchbar
2023-06-23 10:31:19 +02:00
Christoph Kluge
bcadb1adda Remove errorcase from single searchterm logic 2023-06-22 10:58:36 +02:00
feba722a53 Refactor and Cleanup
Add SecurityCheck
2023-06-22 06:26:19 +02:00
bb7c1005c9 Refactor query logic and move to job.go 2023-06-20 15:52:16 +02:00
Pay Giesselmann
a9544f5609 lower log level for frequent messages 2023-06-20 15:47:38 +02:00
Jan Eitzinger
d0516f12b0
Merge pull request #154 from ClusterCockpit/hotfix
Hotfix
2023-06-20 13:00:00 +02:00
c973a29734 Restore api role access in SecurityCheck 2023-06-20 12:54:26 +02:00
33613cdda0 Sync commit 2023-06-20 10:38:53 +02:00
17113eddca Fix failed test due to config change 2023-06-15 11:23:50 +02:00
9137931b74 Add cpu_load and mem_used to Job stats
Fixes #111
2023-06-15 11:07:48 +02:00
Christoph Kluge
f31d8a3af0 fix test 2023-06-12 11:58:10 +02:00
Christoph Kluge
0d2e20e9e4 Handle users with no roles as "user role"
-for backwards compatibility
2023-06-12 11:35:16 +02:00
911dcb6626 Improve Compression Service
* Add Timing and more feedback
* Introduce persistent last compressed timestamp
2023-06-10 07:49:02 +02:00
918f1993f2 Add loglevel access. Fix timer labels. 2023-06-09 15:02:22 +02:00
Christoph Kluge
edb1b47281 Add AddJobCount() for analysis view 2023-06-09 13:15:25 +02:00
616095fe66 Add additional job stats, fix test 2023-06-09 11:29:07 +02:00
5ba6f0ed3a Refactor and adapt to new API 2023-06-09 09:09:41 +02:00
02752f52e4 Merge branch 'master' into refactor-job-repository 2023-06-08 06:22:51 +02:00
fb86ebdbcc Renaming 2023-06-08 06:18:19 +02:00
Jan Eitzinger
e244a7c85a
Merge pull request #122 from pc2/master
Fix database migration order
2023-06-07 17:26:58 +02:00
Jan Eitzinger
1b1e46bf01
Merge pull request #123 from ClusterCockpit/121_fix_filter_reactivity_crash
121 fix filter reactivity crash
2023-06-07 17:24:46 +02:00
Michael Schwarz
a183c23e25 Fix truncate call on mysql and provide step 4 migrations for mysql 2023-06-07 16:49:08 +02:00
Christoph Kluge
4e568e60cd Del JobName from Job type, jobStats name required
- Regenerated GQL
- Relates to #121
- return jobStats name as string
2023-06-07 14:13:59 +02:00
becb2bfa3a Refactor Jobs stats resolver 2023-06-07 11:58:58 +02:00
Michael Schwarz
df240c2394 Fix database migration order 2023-06-07 11:45:58 +02:00
695e8e270a Split job Repository in multiple files 2023-06-06 10:27:55 +02:00
Jan Eitzinger
797d5da80b
Merge pull request #120 from ClusterCockpit/optimize-sqlite-db-setup
Enable SQL hooks for statement debugging
2023-06-05 16:41:52 +02:00
96d036a128 Enable SQL hooks for statement debugging 2023-06-05 16:38:58 +02:00
Jan Eitzinger
e32872181f
Merge pull request #118 from ClusterCockpit/optimize-sqlite-db-setup
Add migration for job table contraints
2023-06-05 16:13:24 +02:00
d53ef526dd Fix tests 2023-06-05 16:10:47 +02:00
e444b83149 Fix errors 2023-06-05 16:07:01 +02:00
5ca4bdbd91 Remove VACUUM 2023-06-05 16:01:14 +02:00
8b6a1c8045 Add migration for job table contraints 2023-06-05 15:58:07 +02:00
Christoph Kluge
a6cb833843 Merge branch 'master' into 97_107_mark_and_show_shared
- Solves query.go conflict by splitting QueryJobLinks function aswell
2023-06-01 17:48:43 +02:00