Commit Graph
90 Commits
Author SHA1 Message Date
Lou Knauer 6d0a4a91a3 Remove needless tls option in ldap config
Go's LDAP client uses tls automatically if the url starts with 'ldaps'.
2022-02-15 10:00:55 +01:00
Lou Knauer ec1f200061 return more erros as JSON 2022-02-14 17:40:47 +01:00
Lou Knauer b40c046f62 return errors as JSON 2022-02-14 17:31:51 +01:00
Lou Knauer 0fef4debca Bugfix in roles parsing 2022-02-14 15:52:59 +01:00
Lou Knauer 5282b7dd8d Update frontend 2022-02-14 14:51:02 +01:00
Lou Knauer 9682ddaab5 Automatically sync via LDAP at interval 2022-02-14 14:37:33 +01:00
Lou Knauer 3bf1c3bdad Refactor auth/ 2022-02-14 14:22:44 +01:00
Lou Knauer 27fd3c4e5a Add /search endpoint which redirects to user/job 2022-02-09 15:03:12 +01:00
Lou Knauer 0ca7dbb4f1 Create tags if needed 2022-02-08 12:49:28 +01:00
Lou Knauer 0c2904d982 Fix vet and staticcheck warning 2022-02-08 11:10:05 +01:00
Lou Knauer 1d0bdd56c7 use go logger internally 2022-02-08 11:04:21 +01:00
Lou Knauer 6f56274ff6 Update frontend 2022-02-08 11:03:32 +01:00
Lou Knauer 9167959875 Update frontend 2022-02-03 16:00:08 +01:00
Lou Knauer e3596b4776 fix SQL error (cast between float/int) 2022-02-03 15:59:45 +01:00
Lou Knauer e8c6a7d589 Add /monitoring/analysis route 2022-02-03 10:42:15 +01:00
Lou Knauer 4f431d0236 Update frontend; Remove debug logging 2022-02-02 13:59:08 +01:00
Lou Knauer 3e7b89aebb make partition optional in nodeMetrics query 2022-02-02 13:05:21 +01:00
Lou Knauer f7959cb1bd Update cc-metric-store client; Bugfix in LoadNodeData 2022-02-02 13:04:38 +01:00
Lou Knauer 3d5aa9f904 Re-enable /monitoring/systems and /monitoring/node 2022-02-02 10:12:16 +01:00
Lou Knauer 3dd1d48f86 Update frontend 2022-01-31 15:16:34 +01:00
Lou Knauer 29a25dbaff start working on non-node-scoped metrics in node/system view 2022-01-31 15:16:05 +01:00
Lou Knauer 84431585f9 better logging 2022-01-31 15:15:29 +01:00
Lou Knauer f82caee28b use sd-deamon prefixes for logging 2022-01-27 13:11:48 +01:00
Lou Knauer eca7ad0de0 Add numHWThreads/numAccelerators filter 2022-01-27 12:32:28 +01:00
Lou Knauer 9e92d6076f Add partition and array-job-id filters 2022-01-27 10:49:19 +01:00
Lou Knauer f8ad53caf0 use a custom logger 2022-01-27 10:35:26 +01:00
Lou Knauer 436eaf0a9d Change import path 2022-01-27 09:40:59 +01:00
Lou Knauer 1c1b043246 Add REST endpoint for metrics 2022-01-27 09:29:53 +01:00
Lou Knauer 32c32ba949 authentication: roles as regular array; simplified LDAP 2022-01-27 09:29:11 +01:00
Lou Knauer 7359a556d9 new test: start/stop job via REST API 2022-01-24 10:08:47 +01:00
Lou Knauer ae3e03f9b9 Add metric renaming map and mock-repo 2022-01-24 10:06:25 +01:00
Lou Knauer 6743d94b0e Use new simpler cc-metric-store API 2022-01-20 10:43:46 +01:00
Lou Knauer c254c689af Add statisticsSeries support 2022-01-20 10:08:50 +01:00
Lou Knauer 9034cb90aa make database schema mysql compatible; use prepared statements 2022-01-20 10:00:55 +01:00
Lou Knauer a64944f3c3 update README.md; gen-keypair utility 2022-01-17 13:51:20 +01:00
Lou Knauer ef91f862c9 working support for non-node scoped metrics; caching 2022-01-17 13:51:20 +01:00
Lou Knauer 7f3bbdd576 update templates and frontend 2022-01-17 13:51:20 +01:00
Lou Knauer 1a9f67fa28 new /api/jobs/ REST endpoint 2022-01-17 13:51:20 +01:00
Lou Knauer 98c4de65a7 work on socket scoped metrics 2022-01-17 13:51:20 +01:00
Lou Knauer f185d12078 read .env automatically, support systemd 2022-01-17 13:51:20 +01:00
LouandGitHub ff24d946fd Merge pull request #1 from ClusterCockpit/full-backend
Full backend
2022-01-10 16:19:43 +01:00
Lou Knauer 102dd85524 renamed submodule 2022-01-10 16:17:40 +01:00
Lou Knauer 290e9b89bf add cli option for generating a JWT; simplify templates 2022-01-10 16:14:54 +01:00
Lou Knauer b7432fca5f continue working on non-node scoped metrics 2022-01-10 16:13:40 +01:00
Lou Knauer 1c6ab3d062 update go.mod and go.sum 2022-01-07 09:54:12 +01:00
Lou Knauer e581bfc70f start work on supporting metrics with a scope of hwthread 2022-01-07 09:47:41 +01:00
Lou Knauer 3f88e512f0 fixes in the GraphQL schema 2022-01-07 09:44:34 +01:00
Lou Knauer 9d87e8874c slight change to job structure 2022-01-07 09:39:00 +01:00
Lou Knauer 30a436e27e use token from cluster.json 2021-12-20 10:49:46 +01:00
Lou Knauer a6e8d5b484 Slight GraphQL-API changes 2021-12-20 10:48:58 +01:00
Lou Knauer 5403177edc all schemas new 2021-12-17 15:49:22 +01:00
Lou Knauer 89333666b3 BC: new schemas for basically everything 2021-12-16 13:17:48 +01:00
Lou Knauer 7fcc39a144 Add async archiving option; Move REST-API to new package 2021-12-16 09:35:03 +01:00
Lou Knauer 9c5c8a05e2 Add more views 2021-12-09 16:27:48 +01:00
Lou Knauer b1d2403839 Bugfixes 2021-12-09 16:26:59 +01:00
Lou Knauer 8178b6e854 Implement nodeMetrics query 2021-12-09 16:25:48 +01:00
Lou Knauer a26d652332 Add templates and custom urls for monitoring views 2021-12-08 15:50:03 +01:00
Lou Knauer c79fcec3ba Update submodule 2021-12-08 12:09:45 +01:00
Lou Knauer 45dc12cc0c Fix bug in archiving 2021-12-08 11:50:47 +01:00
Lou Knauer eb2df5aa1c Add queries to metric data repositories 2021-12-08 11:50:16 +01:00
Lou Knauer bc8ad593fd update main; make REST API compatible to ClusterCockpit 2021-12-08 10:15:25 +01:00
Lou Knauer 34317e0e64 Add InfluxDBv2 as metric data repo 2021-12-08 10:14:45 +01:00
Lou Knauer 4ca0cba7cd individual configurations per user 2021-12-08 10:12:19 +01:00
Lou Knauer 960b0245b2 templates for the login page 2021-12-08 10:09:47 +01:00
Lou Knauer 84c5cd47f6 support the new job archive directory structure 2021-12-08 10:08:41 +01:00
Lou Knauer c1f0d2ed40 authentication via database and/or ldap 2021-12-08 10:03:00 +01:00
Lou Knauer 6387333add Fix format string 2021-11-26 10:38:38 +01:00
Lou Knauer 2c81a96133 Fixes; Get Clusters from config.go 2021-11-26 10:35:07 +01:00
Lou Knauer 8e5e278ea4 Add rest-api for starting/stoping jobs 2021-11-26 10:34:29 +01:00
Lou Knauer 4ef6d47830 Add cc-metric-store client 2021-11-26 10:32:36 +01:00
Lou Knauer c61a5a8e77 Add frontend as submodule; Update README.md 2021-10-26 10:26:39 +02:00
Lou Knauer 61cdcf4ead Implementation of resolvers for new GraphQL schema 2021-10-26 10:24:43 +02:00
Lou Knauer b8d23f8ea1 New GraphQL schema 2021-10-26 10:22:02 +02:00
Lou Knauer 236f51ba9a Massive speedup in job table initialization
It went from taking like 15 minutes on a ramdisk to taking 430 seconds
on my SSD (~900000 jobs inserted).

- Create indexes after inserts so that they do not need to be updated continually
- Use prepared statements for the job insert
- Bundle 200 job inserts into a single transaction
2021-10-20 09:30:50 +02:00
Lou Knauer 22e3e49970 Optionally initialise new db from JSON files 2021-10-11 11:11:14 +02:00
Lou Knauer e4c0b3e955 Update GraphQL schema 2021-09-23 11:45:20 +02:00
Lou Knauer 341091a796 Enable serving of static files 2021-09-21 16:06:41 +02:00
Lou Knauer ad80e1373c Add tag mutations 2021-05-21 09:30:15 +02:00
Lou Knauer 2605623324 Change cluster.json to camelCase, go fmt 2021-05-12 18:34:55 +02:00
Lou Knauer 030f1a3fba Add filters for jobs by statistics like load 2021-05-06 13:50:38 +02:00
Lou Knauer b6df8e88b9 new filterRanges query and Cluster.filterRanges field 2021-05-06 08:36:24 +02:00
Lou Knauer 836c1aea3a change tags filter api, add load_avg, use camelCase in API 2021-04-30 10:26:13 +02:00
Lou Knauer 365b1a2066 Introduce clusters query and type 2021-04-22 15:00:54 +02:00
Lou Knauer 3004e2909a Add tags field to Job 2021-04-21 10:12:19 +02:00
Lou Knauer 499d2cdc22 started implementing support for tags 2021-04-14 18:53:18 +02:00
Lou Knauer bbb3281b6a add memUsed_max, flopsAny_avg, ... to Job type 2021-04-14 17:57:19 +02:00
Lou Knauer 7e32855030 remove JobData, add hasProfile, rename Job-Metrics-Query 2021-04-12 14:01:59 +02:00
Lou Knauer 1d8b9a96c7 New selection possibility when querying available metrics 2021-04-08 11:11:59 +02:00
Lou Knauer b7186cb1cd Make jobAvailableMetricsById more flexible
There are more different metrics than I thought. With this
change, the query mentioned above does not care about the
name of the Metric or whether it is part of the JobData type.
2021-04-07 14:46:02 +02:00
Lou Knauer a52445086b Serve job metric data via GraphQL 2021-04-07 09:19:21 +02:00