543 Commits

Author	SHA1	Message	Date
Christoph Kluge	54f3a261c5	Rewrite sqlite indices from scratch for v8 migration	2024-09-02 18:20:32 +02:00
Christoph Kluge	8ded131666	Change user list name lookup to join	2024-09-02 17:54:25 +02:00
Jan Eitzinger	47b14f932e	Start footprint service	2024-09-02 12:07:44 +02:00
Aditya Ujeniya	838ebb3f69	Updates res	2024-09-01 22:54:43 +02:00
Jan Eitzinger	c459724114	Resolve build errors	2024-08-30 13:50:49 +02:00
Jan Eitzinger	b0c9d1164d	Add initial version of footprint update service ... Not tested yet	2024-08-30 07:22:40 +02:00
Jan Eitzinger	7c51d88501	Add stub for Footprint update service	2024-08-29 08:45:04 +02:00
Jan Eitzinger	5b03cf826b	feat: Add total energy and energy footprint	2024-08-29 07:26:49 +02:00
Jan Eitzinger	f305863616	Bugs fixed in unit tests and archiver init	2024-08-28 12:26:35 +02:00
Jan Eitzinger	db5809d522	Move rest of archiveing code into new archive package	2024-08-28 11:13:54 +02:00
Jan Eitzinger	83df6f015c	Merge pull request #287 from ClusterCockpit/refactor-archiving ... Refactor archiving	2024-08-28 10:14:46 +02:00
Jan Eitzinger	e7231b0e13	Finish refactoring ... Add new packages: - metricDataDispatcher - archiver	2024-08-28 10:03:04 +02:00
Christoph Kluge	cff60eb51c	increase server timeout limit, improve and add db indices ... - change energy footprint key to string	2024-08-27 17:43:48 +02:00
Jan Eitzinger	f914a312f5	Introduce metricDataDispatcher ... Does not compile yet	2024-08-27 16:44:16 +02:00
Jan Eitzinger	56ebb301ca	Start to restructure ... Does not compile	2024-08-27 10:14:33 +02:00
Christoph Kluge	5cc7fc6ccb	Merge branch 'sample_resolution_select' of https://github.com/ClusterCockpit/cc-backend into sample_resolution_select	2024-08-26 09:55:36 +02:00
Christoph Kluge	55027cb630	fix: add resolution 60 default to ccms nodeData query	2024-08-26 09:55:33 +02:00
Aditya Ujeniya	036eba68e1	Fix for resampler	2024-08-25 16:13:43 +02:00
Christoph Kluge	31765ce0ef	Merge branch 'dev' into 275_add_tag_scope	2024-08-23 14:52:42 +02:00
Christoph Kluge	adc3502b6b	cleanup dev logline	2024-08-23 13:37:42 +02:00
Christoph Kluge	d629a58712	Merge branch 'dev' into sample_resolution_select	2024-08-22 17:33:16 +02:00
Aditya Ujeniya	ceb3a095d8	Sampling Feature for archived and fresh data	2024-08-22 14:29:51 +02:00
Jan Eitzinger	a8a27c9b51	Add project index to job table	2024-08-19 12:11:53 +02:00
Christoph Kluge	b1fd07cd30	add single update gql queries to metric wrapper	2024-08-16 14:50:31 +02:00
Jan Eitzinger	5e074dad10	Resolve error in migration	2024-08-15 12:39:14 +02:00
Jan Eitzinger	5c99f5f8bb	Only add footprint columns if not 0	2024-08-15 12:35:11 +02:00
Jan Eitzinger	ba2f406bc0	Extend sqlite db migration	2024-08-15 09:41:54 +02:00
Christoph Kluge	561fd41d5d	fix: add accelerator scope to to-be archived scopes ... - if numAcc > 0 - fixes Add accelerator scope to archive requests #282	2024-08-13 17:49:28 +02:00
Christoph Kluge	9b5c6e3164	fix StartJobTest, add tag_scope to migration	2024-08-05 10:37:42 +02:00
Christoph Kluge	e6ebec8c1e	fix TestGetTags test, was missing scope and ctx	2024-08-05 10:19:00 +02:00
Christoph Kluge	e02575aad7	adds comments	2024-08-02 16:42:55 +02:00
Christoph Kluge	ff3502c87a	fix: fix tag filter results ... - displayed multiple identical entries before - job count was incorrect before	2024-08-02 16:11:47 +02:00
Christoph Kluge	017f9b2140	feat: Add tag scopes to front and backend, initial commit	2024-08-01 18:59:24 +02:00
Christoph Kluge	6a1cb51c2f	Refactor svelte frontend ... - Adapt to new metricConfig logic - Footprint-Metrics generalized for bar card - Footprint-Metrics in stats filter and sorting - Frontend always uses GQL, except adminOptions - Job View will load scopes for all metrics on request	2024-07-22 15:41:33 +02:00
Jan Eitzinger	c4d93e492b	Remove bugs in main init	2024-07-20 10:03:14 +02:00
Jan Eitzinger	c2f72f72ac	Update go dependencies	2024-07-20 08:59:51 +02:00
Jan Eitzinger	721b6b2afa	Change footprint variabel from bool to string ... The footprint variable also indicates the type of statistic used now	2024-07-20 08:59:07 +02:00
Jan Eitzinger	b6f011c669	Move footprint update task placeholder to taskmanager	2024-07-16 12:34:27 +02:00
Jan Eitzinger	801607fc16	Refactor main ... Convert components to Singletons Restructure main package Reduce dependencies	2024-07-16 12:08:10 +02:00
Jan Eitzinger	01a4d33514	Refactor: Archive workers and Tasks ... Work in progress	2024-07-14 11:18:38 +02:00
Jan Eitzinger	e348ec74fd	Fix bugs in stats.go	2024-07-12 14:08:48 +02:00
Jan Eitzinger	0458675608	Convert histogram query to json keys	2024-07-12 13:42:12 +02:00
Jan Eitzinger	c61ffce0e9	Make job query on metric stats generic	2024-07-12 13:21:19 +02:00
Jan Eitzinger	a07d167390	Fix build error with updated prometheus client	2024-07-12 09:17:31 +02:00
Christoph Kluge	a8721dcc69	Regenerate gql after internal merge	2024-07-11 17:37:53 +02:00
Christoph Kluge	68cf952ac6	Merge branch 'Refactor-job-footprint' of https://github.com/ClusterCockpit/cc-backend into Refactor-job-footprint	2024-07-11 17:33:21 +02:00
Christoph Kluge	e14d6a81fe	fix: fix db migration to v8, changes key name to cpu_load	2024-07-11 17:24:33 +02:00
Christoph Kluge	a4912893a8	Frontend refactor backend changes	2024-07-11 17:23:59 +02:00
Jan Eitzinger	b64ce1f67f	Add LowerIsBetter Metric boolean. Upgrade dependencies.	2024-07-11 16:58:12 +02:00
Jan Eitzinger	f1427d5272	Add global metric list including graphQL query	2024-07-11 11:09:14 +02:00
Christoph Kluge	bf6b87d65c	Fix circular import after merge	2024-07-09 09:50:32 +02:00
Christoph Kluge	0240997257	Merge branch '263_use_median_for_statsseries' into Refactor-job-footprint	2024-07-09 09:28:21 +02:00
Christoph Kluge	f1e341f0b9	Initial commit for frontend refactor	2024-07-09 09:17:50 +02:00
Christoph Kluge	11176da5d8	Merge branch 'Refactor-job-footprint' into 264_user_api_access	2024-07-05 16:11:42 +02:00
Christoph Kluge	0a604336c4	Fix other apitest subtests	2024-07-05 15:42:08 +02:00
Christoph Kluge	be9df7649f	fix: setup user in api test config	2024-07-05 15:25:24 +02:00
Christoph Kluge	63fb923995	fix: fix api test router init	2024-07-05 13:16:21 +02:00
Christoph Kluge	3afe40083d	rename api userconfig to frontend, return json on api auth error	2024-07-05 11:48:06 +02:00
Jan Eitzinger	ac9bba8b5b	Restructure and simplify job repo	2024-07-04 15:05:24 +02:00
Jan Eitzinger	80c46bea7f	Fix bugs and failed testcases	2024-07-04 14:14:27 +02:00
Christoph Kluge	1072d7b449	Improve auth handling of rest apis used in frontend for compatibility	2024-07-04 11:16:45 +02:00
Christoph Kluge	61eebc9fbd	Rework initial commit ... - moved frontend configuration api to new subrouter for compatibility	2024-07-03 17:24:26 +02:00
Jan Eitzinger	130613b717	Fix build errors ... Code not yet functional	2024-06-28 17:08:28 +02:00
Jan Eitzinger	b3c1f39a0e	Merge branch 'master' into Refactor-job-footprint	2024-06-28 16:50:04 +02:00
Jan Eitzinger	97c807cd33	Add migration for footprint	2024-06-28 16:49:24 +02:00
Jan Eitzinger	786770f56a	Start to convert to new footprint layout	2024-06-28 16:48:10 +02:00
Jan Eitzinger	5c5484b4d2	Export package runtimeEnv	2024-06-25 07:12:46 +02:00
Christoph Kluge	70e63764ff	fix: allow single partial errors on otherwise non-empty returned metric array	2024-06-13 12:38:29 +02:00
Christoph Kluge	320c87a1db	fix: add additional 30d fitler to searchbar fallback handling	2024-05-27 11:11:25 +02:00
Christoph Kluge	420bec7c46	fix: fix jobname and arrayjobid timeouts by adding additional 30d filter ... - improve archive worker logs - add arrayjobid filter to url if used	2024-05-23 11:53:23 +02:00
Christoph Kluge	684cb5a376	feat: change statistics render of metric plot to min/max/median ... - #263	2024-05-08 16:17:42 +02:00
Christoph Kluge	597bccc080	fix: add SQL JSON validity check to meta_data query	2024-05-06 13:15:15 +02:00
Christoph Kluge	a22340196f	Fix: Improve jobName query by parsing DB field as JSON ... - No DB mirgration required - SQLite internal EXTRACT function used	2024-04-22 12:14:40 +02:00
Christoph Kluge	cbaeffde2c	fix: improve speed of hasNextPage query for infinite scroll	2024-04-22 11:29:31 +02:00
Jan Eitzinger	b67f5436f8	Merge branch 'hotfix' of github.com:ClusterCockpit/cc-backend into hotfix	2024-04-21 15:04:09 +02:00
Jan Eitzinger	b637ddeb28	Refactor and reformat userConfig	2024-04-21 15:04:00 +02:00
Jan Eitzinger	fb8bbea99d	Remove year in copyright notice	2024-04-11 23:04:30 +02:00
Jan Eitzinger	baa51db26c	Merge pull request #252 from ClusterCockpit/20_infinite_scroll ... 20 infinite scroll	2024-03-28 17:43:02 +01:00
Jan Eitzinger	6828c97415	Add central function to persist users on Login	2024-03-28 14:22:23 +01:00
Jan Eitzinger	50401e0030	Fix conditional rendering of OIDC button in login	2024-03-28 13:18:25 +01:00
Jan Eitzinger	642fd5cc91	Merge branch 'master' into 236-user-authentication-using-keycloak-or-any-openid-client-for-using-external-auth-providers-such-as-ldap-github-google	2024-03-28 12:07:58 +01:00
Jan Eitzinger	e8fb5a0030	Add OpenID Connect authentication ... Fixes #236 Template conditional not yet working Needs more testing	2024-03-28 12:01:13 +01:00
Christoph Kluge	0dee5073c6	fix: make hasnextpage optional parameter, use only if inf scroll configured	2024-03-26 16:27:04 +01:00
Christoph Kluge	b9b452f043	feat: prototype infinite scroll implementation	2024-03-26 15:56:07 +01:00
Christoph Kluge	1f5723a97e	Merge branch 'hotfix' of https://github.com/ClusterCockpit/cc-backend into hotfix	2024-03-22 16:10:35 +01:00
Christoph Kluge	5a177c952d	fix: multiple accs with identical label, cloned data for single acc ... - GPU id label in job view statistic table is always the same on multi GPU jobs #239 - Multiple accelerators listed in plot despite using only one #241	2024-03-22 16:10:30 +01:00
Jan Eitzinger	83c38e74db	Refactoring: Reduze bytesize of structs.	2024-03-22 08:59:35 +01:00
Jan Eitzinger	1e5f2944cf	Upgrade dependencies. Port to jwt-auth v5.	2024-03-21 22:02:59 +01:00
Jan Eitzinger	c65694b36c	Add tags and metadata to job queries. Fix query parameter handling. ... Fixes #248	2024-03-19 16:18:43 +01:00
Jan Eitzinger	0005469101	Refactor	2024-03-19 16:16:02 +01:00
Jan Eitzinger	81fe492655	Merge pull request #247 from ClusterCockpit/hotfix ... Hotfix	2024-03-15 09:30:48 +01:00
Christoph Kluge	849b7e038d	Fix: make footprint display configurable app-wide ... - note: requires full ui-defaults object in config	2024-03-14 15:14:19 +01:00
Michael Schwarz	ce792426e6	Disable foreign key check while updating database	2024-03-14 09:15:15 +01:00
Jan Eitzinger	e92e727279	Extend oidc auth provider	2024-03-13 17:09:36 +01:00
Jan Eitzinger	f761900a3e	Add initial code for oidc authentication support	2024-03-13 09:37:12 +01:00
Jan Eitzinger	99d55f05f8	feat: Add cluster config endpoint to rest api	2024-03-08 16:35:30 +01:00
Jan Eitzinger	9fd839fad8	Add rest endpoint to get all job data ... Fixes #203	2024-03-08 15:31:34 +01:00
Jan Eitzinger	06d01962a6	feat: Allow to revert db to previous version	2024-03-08 11:28:26 +01:00
Jan Eitzinger	2c2c1accb5	Allow up and down migration of database	2024-03-08 10:58:45 +01:00
Jan Eitzinger	105b7eabf0	Add migration and introduce dirty flag handling	2024-03-08 10:47:32 +01:00
Jan Eitzinger	de1d83e1a9	Merge branch 'master' into 231-sql-statement-syntax	2024-03-08 09:05:13 +01:00
Jan Eitzinger	e81e56ea1d	Add rest endpoint edit_meta including helper routines ... Fixes #219	2024-03-08 08:51:05 +01:00
Jan Eitzinger	aa6336ea1e	Refactor ... Reformat. Convert to query builder. Add descriptive error log messages.	2024-03-06 14:50:08 +01:00
Jan Eitzinger	dd887cbb1f	Do all tag queries with query builder ... Fix bug in mysql database initialization. Fixes #231	2024-03-06 13:47:52 +01:00
Jan Eitzinger	5a4671b7b1	Always return on metricstore error.	2024-02-23 10:08:41 +01:00
Christoph Kluge	21dde870c6	Merge branch 'master' into 214_user_status_histograms	2024-02-08 12:26:07 +01:00
Christoph Kluge	07073e290a	feat: add selectable histograms to status view	2023-12-12 16:46:03 +01:00
Christoph Kluge	119637cb9b	Fix using crossjoin arguments not used	2023-12-12 15:07:23 +01:00
Christoph Kluge	ee4097a2dd	Add missing filters to crossjoinquery	2023-12-11 13:55:56 +01:00
Christoph Kluge	1185737eaa	Add metrics to histoselect, add userfilters ... - edit struct to make only count return required	2023-12-08 12:03:04 +01:00
Christoph Kluge	ead5c54bcb	Prototype completed	2023-12-05 15:30:40 +01:00
Christoph Kluge	b5b355c16c	Finished backend sql query and gql resolve	2023-12-05 11:59:01 +01:00
Christoph Kluge	9bc36152d9	intermediate save ... - DOES NOT COMPILE	2023-12-01 13:22:01 +01:00
Christoph Kluge	e34623b1ce	Add db average stats to gql, use in footprint	2023-11-24 15:11:38 +01:00
Jan Eitzinger	bb1c8cc25d	fix: Move name extract from token in else branch	2023-09-08 12:11:49 +02:00
Jan Eitzinger	4b06fa788d	fix: Fix buggy logic and simplify code if ValidateUser enabled	2023-09-08 11:50:28 +02:00
Jan Eitzinger	7a5ccff6da	fix: Remove port before IP check	2023-09-07 16:36:47 +02:00
Jan Eitzinger	ed5ecbd914	fix: Restructure swagger docs	2023-09-07 15:14:09 +02:00
Jan Eitzinger	2d4759114e	Add Release Notes link to release page	2023-09-07 14:33:22 +02:00
Jan Eitzinger	c68b9fec42	fix: Add documentation for apiAllowedIPs option	2023-09-07 14:03:41 +02:00
Christoph Kluge	69ee19bed0	fix: include running jobs case in statsQueries	2023-09-01 10:23:14 +02:00
Christoph Kluge	cffdd055c9	change: use continue for ccms.loadStats errors	2023-08-31 15:17:40 +02:00
Christoph Kluge	64796519c6	change: use continue for rooflineHeatmap errors ... - hard errors blocked rendering in frontend	2023-08-31 15:10:57 +02:00
Jan Eitzinger	b836eee1e7	Merge pull request #205 from ClusterCockpit/166_add_scopes_analysis ... 166 add scopes analysis	2023-08-31 12:03:37 +02:00
Christoph Kluge	b623092721	feat: persist analysis and status pie selections	2023-08-30 15:15:53 +02:00
Jan Eitzinger	9533f06eaf	Refactor repository tests ... Add context to tests. Remove special test routines	2023-08-30 15:04:50 +02:00
Christoph Kluge	59c749a164	feat: add select to analysis view pie chart ... - 'Walltime' as generic default value for top list - Change from nodes distribution to cores distribution	2023-08-29 17:38:17 +02:00
Christoph Kluge	3014f59cc2	feat: add new distribution plots to status view ... - numCores and numAccs	2023-08-29 14:02:23 +02:00
Christoph Kluge	f933cad87f	feat: add select to status view pie charts ... - 'Jobs' as generic default value for top lists - Prepare histograms for cores and accs in schema	2023-08-29 14:01:01 +02:00
Pay Giesselmann	fd94d30a8e	make ldap username attribute configurable	2023-08-29 09:30:57 +02:00
Pay Giesselmann	81d9015d59	:fix delete user logging	2023-08-29 09:29:56 +02:00
Christoph Kluge	69519ec040	Add requireField cases to resolver	2023-08-28 10:19:26 +02:00
Christoph Kluge	c84b819212	Fix frontend errors ... - todo: debug backend handling	2023-08-28 10:00:20 +02:00
Christoph Kluge	ce758610b6	change: implement topX query in jobsStatistics	2023-08-25 17:38:25 +02:00
Jan Eitzinger	d7117f3d49	Add sorting and paging to JobStatsGrouped	2023-08-25 13:14:34 +02:00
Jan Eitzinger	13d99a6ae0	Fix typo in Jobstats resolver	2023-08-24 14:55:49 +02:00
Jan Eitzinger	3b8bcf7b32	Remove obsolete jobsCount resolver	2023-08-24 14:51:26 +02:00
Jan Eitzinger	a7dd3fbc0b	fix bug in stats AddJobCount	2023-08-24 14:26:23 +02:00
Christoph Kluge	28609a3372	adapt core timeweight to sqlite name logic	2023-08-24 12:56:35 +02:00
Christoph Kluge	4eceab4dc7	fix: change analysis top users to core hours	2023-08-24 12:51:55 +02:00
Christoph Kluge	6a1e35107f	fix: analysis metric histogram normalized by scope ... - native acc metrics normalized by accHours - native core metrics normalized by coreHours	2023-08-24 11:52:36 +02:00
Jan Eitzinger	b7aacd1b33	Merge pull request #194 from ClusterCockpit/105_modify_user_via_api ... first iteraton of implementing ip-secured enpoint	2023-08-23 08:57:40 +02:00
Christoph Kluge	2f35482aff	Merge branch 'master' into 166_add_scopes_analysis	2023-08-22 15:26:20 +02:00
Christoph Kluge	f36f62fb47	Improve user endpoint swagger docs	2023-08-21 12:12:28 +02:00
Jan Eitzinger	dc67a1f103	Update frontend and backend dependencies	2023-08-21 08:49:42 +02:00
Christoph Kluge	f6c4c963ec	feat: Add users rest endpoint swagger docs	2023-08-18 17:18:31 +02:00
Jan Eitzinger	ebcae32e23	Update docs and cleanup	2023-08-18 15:56:11 +02:00
Jan Eitzinger	cda46141cc	Cleanup and add wildcard for IP Filter	2023-08-18 13:03:11 +02:00
Jan Eitzinger	3028f60807	Reformat and add debug output	2023-08-18 11:59:16 +02:00
Christoph Kluge	734e818b19	Merge branch '189-refactor-authentication-module' of https://github.com/ClusterCockpit/cc-backend into 189-refactor-authentication-module	2023-08-18 11:17:33 +02:00