284 Commits

Author	SHA1	Message	Date
Jan Eitzinger	39c09f8565	Introduce job duration update task	2024-09-03 10:03:38 +02:00
Christoph Kluge	275a77807e	fix typo in migration	2024-09-03 09:40:00 +02:00
Christoph Kluge	6443541a79	fix SQL migration syntax	2024-09-03 09:34:45 +02:00
Christoph Kluge	5eb6f7d307	fix: user name join not required for normal jobStats	2024-09-02 18:45:33 +02:00
Christoph Kluge	54f3a261c5	Rewrite sqlite indices from scratch for v8 migration	2024-09-02 18:20:32 +02:00
Christoph Kluge	8ded131666	Change user list name lookup to join	2024-09-02 17:54:25 +02:00
Jan Eitzinger	b0c9d1164d	Add initial version of footprint update service ... Not tested yet	2024-08-30 07:22:40 +02:00
Jan Eitzinger	5b03cf826b	feat: Add total energy and energy footprint	2024-08-29 07:26:49 +02:00
Jan Eitzinger	db5809d522	Move rest of archiveing code into new archive package	2024-08-28 11:13:54 +02:00
Jan Eitzinger	83df6f015c	Merge pull request #287 from ClusterCockpit/refactor-archiving ... Refactor archiving	2024-08-28 10:14:46 +02:00
Jan Eitzinger	e7231b0e13	Finish refactoring ... Add new packages: - metricDataDispatcher - archiver	2024-08-28 10:03:04 +02:00
Christoph Kluge	cff60eb51c	increase server timeout limit, improve and add db indices ... - change energy footprint key to string	2024-08-27 17:43:48 +02:00
Christoph Kluge	31765ce0ef	Merge branch 'dev' into 275_add_tag_scope	2024-08-23 14:52:42 +02:00
Jan Eitzinger	a8a27c9b51	Add project index to job table	2024-08-19 12:11:53 +02:00
Jan Eitzinger	5e074dad10	Resolve error in migration	2024-08-15 12:39:14 +02:00
Jan Eitzinger	5c99f5f8bb	Only add footprint columns if not 0	2024-08-15 12:35:11 +02:00
Jan Eitzinger	ba2f406bc0	Extend sqlite db migration	2024-08-15 09:41:54 +02:00
Christoph Kluge	9b5c6e3164	fix StartJobTest, add tag_scope to migration	2024-08-05 10:37:42 +02:00
Christoph Kluge	e6ebec8c1e	fix TestGetTags test, was missing scope and ctx	2024-08-05 10:19:00 +02:00
Christoph Kluge	e02575aad7	adds comments	2024-08-02 16:42:55 +02:00
Christoph Kluge	ff3502c87a	fix: fix tag filter results ... - displayed multiple identical entries before - job count was incorrect before	2024-08-02 16:11:47 +02:00
Christoph Kluge	017f9b2140	feat: Add tag scopes to front and backend, initial commit	2024-08-01 18:59:24 +02:00
Christoph Kluge	6a1cb51c2f	Refactor svelte frontend ... - Adapt to new metricConfig logic - Footprint-Metrics generalized for bar card - Footprint-Metrics in stats filter and sorting - Frontend always uses GQL, except adminOptions - Job View will load scopes for all metrics on request	2024-07-22 15:41:33 +02:00
Jan Eitzinger	c2f72f72ac	Update go dependencies	2024-07-20 08:59:51 +02:00
Jan Eitzinger	b6f011c669	Move footprint update task placeholder to taskmanager	2024-07-16 12:34:27 +02:00
Jan Eitzinger	01a4d33514	Refactor: Archive workers and Tasks ... Work in progress	2024-07-14 11:18:38 +02:00
Jan Eitzinger	e348ec74fd	Fix bugs in stats.go	2024-07-12 14:08:48 +02:00
Jan Eitzinger	0458675608	Convert histogram query to json keys	2024-07-12 13:42:12 +02:00
Jan Eitzinger	c61ffce0e9	Make job query on metric stats generic	2024-07-12 13:21:19 +02:00
Christoph Kluge	e14d6a81fe	fix: fix db migration to v8, changes key name to cpu_load	2024-07-11 17:24:33 +02:00
Christoph Kluge	bf6b87d65c	Fix circular import after merge	2024-07-09 09:50:32 +02:00
Christoph Kluge	f1e341f0b9	Initial commit for frontend refactor	2024-07-09 09:17:50 +02:00
Christoph Kluge	11176da5d8	Merge branch 'Refactor-job-footprint' into 264_user_api_access	2024-07-05 16:11:42 +02:00
Christoph Kluge	3afe40083d	rename api userconfig to frontend, return json on api auth error	2024-07-05 11:48:06 +02:00
Jan Eitzinger	ac9bba8b5b	Restructure and simplify job repo	2024-07-04 15:05:24 +02:00
Jan Eitzinger	80c46bea7f	Fix bugs and failed testcases	2024-07-04 14:14:27 +02:00
Christoph Kluge	61eebc9fbd	Rework initial commit ... - moved frontend configuration api to new subrouter for compatibility	2024-07-03 17:24:26 +02:00
Jan Eitzinger	97c807cd33	Add migration for footprint	2024-06-28 16:49:24 +02:00
Jan Eitzinger	786770f56a	Start to convert to new footprint layout	2024-06-28 16:48:10 +02:00
Christoph Kluge	420bec7c46	fix: fix jobname and arrayjobid timeouts by adding additional 30d filter ... - improve archive worker logs - add arrayjobid filter to url if used	2024-05-23 11:53:23 +02:00
Christoph Kluge	597bccc080	fix: add SQL JSON validity check to meta_data query	2024-05-06 13:15:15 +02:00
Christoph Kluge	a22340196f	Fix: Improve jobName query by parsing DB field as JSON ... - No DB mirgration required - SQLite internal EXTRACT function used	2024-04-22 12:14:40 +02:00
Jan Eitzinger	b67f5436f8	Merge branch 'hotfix' of github.com:ClusterCockpit/cc-backend into hotfix	2024-04-21 15:04:09 +02:00
Jan Eitzinger	b637ddeb28	Refactor and reformat userConfig	2024-04-21 15:04:00 +02:00
Jan Eitzinger	fb8bbea99d	Remove year in copyright notice	2024-04-11 23:04:30 +02:00
Jan Eitzinger	0005469101	Refactor	2024-03-19 16:16:02 +01:00
Michael Schwarz	ce792426e6	Disable foreign key check while updating database	2024-03-14 09:15:15 +01:00
Jan Eitzinger	06d01962a6	feat: Allow to revert db to previous version	2024-03-08 11:28:26 +01:00
Jan Eitzinger	2c2c1accb5	Allow up and down migration of database	2024-03-08 10:58:45 +01:00
Jan Eitzinger	105b7eabf0	Add migration and introduce dirty flag handling	2024-03-08 10:47:32 +01:00
Jan Eitzinger	de1d83e1a9	Merge branch 'master' into 231-sql-statement-syntax	2024-03-08 09:05:13 +01:00
Jan Eitzinger	e81e56ea1d	Add rest endpoint edit_meta including helper routines ... Fixes #219	2024-03-08 08:51:05 +01:00
Jan Eitzinger	aa6336ea1e	Refactor ... Reformat. Convert to query builder. Add descriptive error log messages.	2024-03-06 14:50:08 +01:00
Jan Eitzinger	dd887cbb1f	Do all tag queries with query builder ... Fix bug in mysql database initialization. Fixes #231	2024-03-06 13:47:52 +01:00
Christoph Kluge	21dde870c6	Merge branch 'master' into 214_user_status_histograms	2024-02-08 12:26:07 +01:00
Christoph Kluge	07073e290a	feat: add selectable histograms to status view	2023-12-12 16:46:03 +01:00
Christoph Kluge	119637cb9b	Fix using crossjoin arguments not used	2023-12-12 15:07:23 +01:00
Christoph Kluge	ee4097a2dd	Add missing filters to crossjoinquery	2023-12-11 13:55:56 +01:00
Christoph Kluge	1185737eaa	Add metrics to histoselect, add userfilters ... - edit struct to make only count return required	2023-12-08 12:03:04 +01:00
Christoph Kluge	ead5c54bcb	Prototype completed	2023-12-05 15:30:40 +01:00
Christoph Kluge	b5b355c16c	Finished backend sql query and gql resolve	2023-12-05 11:59:01 +01:00
Christoph Kluge	9bc36152d9	intermediate save ... - DOES NOT COMPILE	2023-12-01 13:22:01 +01:00
Christoph Kluge	e34623b1ce	Add db average stats to gql, use in footprint	2023-11-24 15:11:38 +01:00
Christoph Kluge	69ee19bed0	fix: include running jobs case in statsQueries	2023-09-01 10:23:14 +02:00
Jan Eitzinger	b836eee1e7	Merge pull request #205 from ClusterCockpit/166_add_scopes_analysis ... 166 add scopes analysis	2023-08-31 12:03:37 +02:00
Jan Eitzinger	9533f06eaf	Refactor repository tests ... Add context to tests. Remove special test routines	2023-08-30 15:04:50 +02:00
Christoph Kluge	59c749a164	feat: add select to analysis view pie chart ... - 'Walltime' as generic default value for top list - Change from nodes distribution to cores distribution	2023-08-29 17:38:17 +02:00
Christoph Kluge	3014f59cc2	feat: add new distribution plots to status view ... - numCores and numAccs	2023-08-29 14:02:23 +02:00
Christoph Kluge	f933cad87f	feat: add select to status view pie charts ... - 'Jobs' as generic default value for top lists - Prepare histograms for cores and accs in schema	2023-08-29 14:01:01 +02:00
Pay Giesselmann	81d9015d59	:fix delete user logging	2023-08-29 09:29:56 +02:00
Christoph Kluge	c84b819212	Fix frontend errors ... - todo: debug backend handling	2023-08-28 10:00:20 +02:00
Christoph Kluge	ce758610b6	change: implement topX query in jobsStatistics	2023-08-25 17:38:25 +02:00
Jan Eitzinger	d7117f3d49	Add sorting and paging to JobStatsGrouped	2023-08-25 13:14:34 +02:00
Jan Eitzinger	3b8bcf7b32	Remove obsolete jobsCount resolver	2023-08-24 14:51:26 +02:00
Jan Eitzinger	a7dd3fbc0b	fix bug in stats AddJobCount	2023-08-24 14:26:23 +02:00
Christoph Kluge	4eceab4dc7	fix: change analysis top users to core hours	2023-08-24 12:51:55 +02:00
Jan Eitzinger	14c487c9e4	Update test inputs	2023-08-18 09:31:57 +02:00
Jan Eitzinger	15231bc683	Cleanup and adapt to new structure	2023-08-17 12:34:30 +02:00
Jan Eitzinger	87ce4f63d4	Refactor auth module ... Separate parts Add user repository Add user schema	2023-08-17 10:29:00 +02:00
Jan Eitzinger	b8273a9b02	refactor auth module ... Restructure module Separate JWT auth variants Cleanup code Fixes #189	2023-08-11 10:00:23 +02:00
Christoph Kluge	2f471dc192	Change listQuery to jobId array, adapt filter pipe	2023-06-30 16:55:34 +02:00
Jan Eitzinger	b5a7249ad5	Fix sqlite migration for configuration	2023-06-30 09:15:58 +02:00
Jan Eitzinger	dd80d5af9e	Change config value datatype ... Fixes #167	2023-06-29 14:55:38 +02:00
Jan Eitzinger	7174f27a89	Add node filter and concurrent job list query	2023-06-28 13:35:41 +02:00
Jan Eitzinger	3828c138b8	Add init flag	2023-06-28 12:41:27 +02:00
Jan Eitzinger	34050c8ce0	Fix argument dashes	2023-06-27 14:30:09 +02:00
Jan Eitzinger	eb626db9c2	Debug compression service	2023-06-27 14:29:56 +02:00
Jan Eitzinger	d1e3e06b10	Add insert timestamp to tag, jobtag ... Fixes #43	2023-06-27 09:41:06 +02:00
Jan Eitzinger	8aaa5722e9	Fix errors in query logic	2023-06-26 16:48:13 +02:00
Jan Eitzinger	99a2888431	Fix typo in Query	2023-06-26 14:45:49 +02:00
Jan Eitzinger	7d85c0e9ad	Merge pull request #162 from ClusterCockpit/refactor-concurrent-job-resolver ... Refactor concurrent job resolver	2023-06-26 14:28:00 +02:00
Christoph Kluge	f992ffc2da	Fix SSL timing issues with best guess search	2023-06-23 16:09:33 +02:00
Jan Eitzinger	2f6c16a7d8	Merge pull request #156 from giesselmann/log_levels ... lower log level for frequent messages	2023-06-23 10:33:44 +02:00
Jan Eitzinger	76d3018b5c	Merge pull request #159 from ClusterCockpit/158_fix_searchbar ... 158 fix searchbar	2023-06-23 10:31:19 +02:00
Christoph Kluge	bcadb1adda	Remove errorcase from single searchterm logic	2023-06-22 10:58:36 +02:00
Jan Eitzinger	feba722a53	Refactor and Cleanup ... Add SecurityCheck	2023-06-22 06:26:19 +02:00
Jan Eitzinger	bb7c1005c9	Refactor query logic and move to job.go	2023-06-20 15:52:16 +02:00
Pay Giesselmann	a9544f5609	lower log level for frequent messages	2023-06-20 15:47:38 +02:00
Jan Eitzinger	d0516f12b0	Merge pull request #154 from ClusterCockpit/hotfix ... Hotfix	2023-06-20 13:00:00 +02:00
Jan Eitzinger	c973a29734	Restore api role access in SecurityCheck	2023-06-20 12:54:26 +02:00