f58efa2871
Allow to combine job update queries
2024-09-03 13:41:00 +02:00
6568b6d723
Prepare transaction API for general usage
2024-09-03 13:40:11 +02:00
39c09f8565
Introduce job duration update task
2024-09-03 10:03:38 +02:00
Christoph Kluge
275a77807e
fix typo in migration
2024-09-03 09:40:00 +02:00
Christoph Kluge
6443541a79
fix SQL migration syntax
2024-09-03 09:34:45 +02:00
Christoph Kluge
5eb6f7d307
fix: user name join not required for normal jobStats
2024-09-02 18:45:33 +02:00
Christoph Kluge
54f3a261c5
Rewrite sqlite indices from scratch for v8 migration
2024-09-02 18:20:32 +02:00
Christoph Kluge
8ded131666
Change user list name lookup to join
2024-09-02 17:54:25 +02:00
b0c9d1164d
Add initial version of footprint update service
...
Not tested yet
2024-08-30 07:22:40 +02:00
5b03cf826b
feat: Add total energy and energy footprint
2024-08-29 07:26:49 +02:00
db5809d522
Move rest of archiveing code into new archive package
2024-08-28 11:13:54 +02:00
Jan Eitzinger
83df6f015c
Merge pull request #287 from ClusterCockpit/refactor-archiving
...
Refactor archiving
2024-08-28 10:14:46 +02:00
e7231b0e13
Finish refactoring
...
Add new packages:
- metricDataDispatcher
- archiver
2024-08-28 10:03:04 +02:00
Christoph Kluge
cff60eb51c
increase server timeout limit, improve and add db indices
...
- change energy footprint key to string
2024-08-27 17:43:48 +02:00
Christoph Kluge
31765ce0ef
Merge branch 'dev' into 275_add_tag_scope
2024-08-23 14:52:42 +02:00
a8a27c9b51
Add project index to job table
2024-08-19 12:11:53 +02:00
5e074dad10
Resolve error in migration
2024-08-15 12:39:14 +02:00
5c99f5f8bb
Only add footprint columns if not 0
2024-08-15 12:35:11 +02:00
ba2f406bc0
Extend sqlite db migration
2024-08-15 09:41:54 +02:00
Christoph Kluge
9b5c6e3164
fix StartJobTest, add tag_scope to migration
2024-08-05 10:37:42 +02:00
Christoph Kluge
e6ebec8c1e
fix TestGetTags test, was missing scope and ctx
2024-08-05 10:19:00 +02:00
Christoph Kluge
e02575aad7
adds comments
2024-08-02 16:42:55 +02:00
Christoph Kluge
ff3502c87a
fix: fix tag filter results
...
- displayed multiple identical entries before
- job count was incorrect before
2024-08-02 16:11:47 +02:00
Christoph Kluge
017f9b2140
feat: Add tag scopes to front and backend, initial commit
2024-08-01 18:59:24 +02:00
Christoph Kluge
6a1cb51c2f
Refactor svelte frontend
...
- Adapt to new metricConfig logic
- Footprint-Metrics generalized for bar card
- Footprint-Metrics in stats filter and sorting
- Frontend always uses GQL, except adminOptions
- Job View will load scopes for all metrics on request
2024-07-22 15:41:33 +02:00
c2f72f72ac
Update go dependencies
2024-07-20 08:59:51 +02:00
b6f011c669
Move footprint update task placeholder to taskmanager
2024-07-16 12:34:27 +02:00
01a4d33514
Refactor: Archive workers and Tasks
...
Work in progress
2024-07-14 11:18:38 +02:00
e348ec74fd
Fix bugs in stats.go
2024-07-12 14:08:48 +02:00
0458675608
Convert histogram query to json keys
2024-07-12 13:42:12 +02:00
c61ffce0e9
Make job query on metric stats generic
2024-07-12 13:21:19 +02:00
Christoph Kluge
e14d6a81fe
fix: fix db migration to v8, changes key name to cpu_load
2024-07-11 17:24:33 +02:00
Christoph Kluge
bf6b87d65c
Fix circular import after merge
2024-07-09 09:50:32 +02:00
Christoph Kluge
f1e341f0b9
Initial commit for frontend refactor
2024-07-09 09:17:50 +02:00
Christoph Kluge
11176da5d8
Merge branch 'Refactor-job-footprint' into 264_user_api_access
2024-07-05 16:11:42 +02:00
Christoph Kluge
3afe40083d
rename api userconfig to frontend, return json on api auth error
2024-07-05 11:48:06 +02:00
ac9bba8b5b
Restructure and simplify job repo
2024-07-04 15:05:24 +02:00
80c46bea7f
Fix bugs and failed testcases
2024-07-04 14:14:27 +02:00
Christoph Kluge
61eebc9fbd
Rework initial commit
...
- moved frontend configuration api to new subrouter for compatibility
2024-07-03 17:24:26 +02:00
97c807cd33
Add migration for footprint
2024-06-28 16:49:24 +02:00
786770f56a
Start to convert to new footprint layout
2024-06-28 16:48:10 +02:00
Christoph Kluge
420bec7c46
fix: fix jobname and arrayjobid timeouts by adding additional 30d filter
...
- improve archive worker logs
- add arrayjobid filter to url if used
2024-05-23 11:53:23 +02:00
Christoph Kluge
597bccc080
fix: add SQL JSON validity check to meta_data query
2024-05-06 13:15:15 +02:00
Christoph Kluge
a22340196f
Fix: Improve jobName query by parsing DB field as JSON
...
- No DB mirgration required
- SQLite internal EXTRACT function used
2024-04-22 12:14:40 +02:00
b67f5436f8
Merge branch 'hotfix' of github.com:ClusterCockpit/cc-backend into hotfix
2024-04-21 15:04:09 +02:00
b637ddeb28
Refactor and reformat userConfig
2024-04-21 15:04:00 +02:00
fb8bbea99d
Remove year in copyright notice
2024-04-11 23:04:30 +02:00
0005469101
Refactor
2024-03-19 16:16:02 +01:00
Michael Schwarz
ce792426e6
Disable foreign key check while updating database
2024-03-14 09:15:15 +01:00
06d01962a6
feat: Allow to revert db to previous version
2024-03-08 11:28:26 +01:00
2c2c1accb5
Allow up and down migration of database
2024-03-08 10:58:45 +01:00
105b7eabf0
Add migration and introduce dirty flag handling
2024-03-08 10:47:32 +01:00
Jan Eitzinger
de1d83e1a9
Merge branch 'master' into 231-sql-statement-syntax
2024-03-08 09:05:13 +01:00
e81e56ea1d
Add rest endpoint edit_meta including helper routines
...
Fixes #219
2024-03-08 08:51:05 +01:00
aa6336ea1e
Refactor
...
Reformat.
Convert to query builder.
Add descriptive error log messages.
2024-03-06 14:50:08 +01:00
dd887cbb1f
Do all tag queries with query builder
...
Fix bug in mysql database initialization.
Fixes #231
2024-03-06 13:47:52 +01:00
Christoph Kluge
21dde870c6
Merge branch 'master' into 214_user_status_histograms
2024-02-08 12:26:07 +01:00
Christoph Kluge
07073e290a
feat: add selectable histograms to status view
2023-12-12 16:46:03 +01:00
Christoph Kluge
119637cb9b
Fix using crossjoin arguments not used
2023-12-12 15:07:23 +01:00
Christoph Kluge
ee4097a2dd
Add missing filters to crossjoinquery
2023-12-11 13:55:56 +01:00
Christoph Kluge
1185737eaa
Add metrics to histoselect, add userfilters
...
- edit struct to make only count return required
2023-12-08 12:03:04 +01:00
Christoph Kluge
ead5c54bcb
Prototype completed
2023-12-05 15:30:40 +01:00
Christoph Kluge
b5b355c16c
Finished backend sql query and gql resolve
2023-12-05 11:59:01 +01:00
Christoph Kluge
9bc36152d9
intermediate save
...
- DOES NOT COMPILE
2023-12-01 13:22:01 +01:00
Christoph Kluge
e34623b1ce
Add db average stats to gql, use in footprint
2023-11-24 15:11:38 +01:00
Christoph Kluge
69ee19bed0
fix: include running jobs case in statsQueries
2023-09-01 10:23:14 +02:00
Jan Eitzinger
b836eee1e7
Merge pull request #205 from ClusterCockpit/166_add_scopes_analysis
...
166 add scopes analysis
2023-08-31 12:03:37 +02:00
9533f06eaf
Refactor repository tests
...
Add context to tests.
Remove special test routines
2023-08-30 15:04:50 +02:00
Christoph Kluge
59c749a164
feat: add select to analysis view pie chart
...
- 'Walltime' as generic default value for top list
- Change from nodes distribution to cores distribution
2023-08-29 17:38:17 +02:00
Christoph Kluge
3014f59cc2
feat: add new distribution plots to status view
...
- numCores and numAccs
2023-08-29 14:02:23 +02:00
Christoph Kluge
f933cad87f
feat: add select to status view pie charts
...
- 'Jobs' as generic default value for top lists
- Prepare histograms for cores and accs in schema
2023-08-29 14:01:01 +02:00
Pay Giesselmann
81d9015d59
:fix delete user logging
2023-08-29 09:29:56 +02:00
Christoph Kluge
c84b819212
Fix frontend errors
...
- todo: debug backend handling
2023-08-28 10:00:20 +02:00
Christoph Kluge
ce758610b6
change: implement topX query in jobsStatistics
2023-08-25 17:38:25 +02:00
d7117f3d49
Add sorting and paging to JobStatsGrouped
2023-08-25 13:14:34 +02:00
3b8bcf7b32
Remove obsolete jobsCount resolver
2023-08-24 14:51:26 +02:00
a7dd3fbc0b
fix bug in stats AddJobCount
2023-08-24 14:26:23 +02:00
Christoph Kluge
4eceab4dc7
fix: change analysis top users to core hours
2023-08-24 12:51:55 +02:00
14c487c9e4
Update test inputs
2023-08-18 09:31:57 +02:00
15231bc683
Cleanup and adapt to new structure
2023-08-17 12:34:30 +02:00
87ce4f63d4
Refactor auth module
...
Separate parts
Add user repository
Add user schema
2023-08-17 10:29:00 +02:00
b8273a9b02
refactor auth module
...
Restructure module
Separate JWT auth variants
Cleanup code
Fixes #189
2023-08-11 10:00:23 +02:00
Christoph Kluge
2f471dc192
Change listQuery to jobId array, adapt filter pipe
2023-06-30 16:55:34 +02:00
b5a7249ad5
Fix sqlite migration for configuration
2023-06-30 09:15:58 +02:00
dd80d5af9e
Change config value datatype
...
Fixes #167
2023-06-29 14:55:38 +02:00
7174f27a89
Add node filter and concurrent job list query
2023-06-28 13:35:41 +02:00
3828c138b8
Add init flag
2023-06-28 12:41:27 +02:00
34050c8ce0
Fix argument dashes
2023-06-27 14:30:09 +02:00
eb626db9c2
Debug compression service
2023-06-27 14:29:56 +02:00
d1e3e06b10
Add insert timestamp to tag, jobtag
...
Fixes #43
2023-06-27 09:41:06 +02:00
8aaa5722e9
Fix errors in query logic
2023-06-26 16:48:13 +02:00
99a2888431
Fix typo in Query
2023-06-26 14:45:49 +02:00
Jan Eitzinger
7d85c0e9ad
Merge pull request #162 from ClusterCockpit/refactor-concurrent-job-resolver
...
Refactor concurrent job resolver
2023-06-26 14:28:00 +02:00
Christoph Kluge
f992ffc2da
Fix SSL timing issues with best guess search
2023-06-23 16:09:33 +02:00
Jan Eitzinger
2f6c16a7d8
Merge pull request #156 from giesselmann/log_levels
...
lower log level for frequent messages
2023-06-23 10:33:44 +02:00
Jan Eitzinger
76d3018b5c
Merge pull request #159 from ClusterCockpit/158_fix_searchbar
...
158 fix searchbar
2023-06-23 10:31:19 +02:00
Christoph Kluge
bcadb1adda
Remove errorcase from single searchterm logic
2023-06-22 10:58:36 +02:00
feba722a53
Refactor and Cleanup
...
Add SecurityCheck
2023-06-22 06:26:19 +02:00
bb7c1005c9
Refactor query logic and move to job.go
2023-06-20 15:52:16 +02:00
Pay Giesselmann
a9544f5609
lower log level for frequent messages
2023-06-20 15:47:38 +02:00