Commit Graph
100 Commits
Author SHA1 Message Date
Lou Knauer b85832646f Show correct count of jobs/tags 2022-02-16 09:32:38 +01:00
Lou Knauer 319cdfd069 Fix beeing logged out 2022-02-16 09:01:47 +01:00
Lou Knauer 0c074e8c29 Fix default monitoring status and test 2022-02-16 09:01:32 +01:00
Lou Knauer 2f32760cc5 fix stop_job returned state; handle monitoring status 2022-02-15 14:25:39 +01:00
Lou Knauer 8d4498f58e Add success log message 2022-02-15 13:31:54 +01:00
Lou Knauer 5c5a9f8453 Update frontend 2022-02-15 13:19:40 +01:00
Lou Knauer f738a332c1 Support for memoryDomain scoped metrics 2022-02-15 13:19:26 +01:00
Lou Knauer 53312c4882 refactor stopJob, remove non-async archiving 2022-02-15 13:18:27 +01:00
Lou Knauer d65ff549b5 fix auth error page 2022-02-15 12:48:18 +01:00
Lou Knauer df3c806ab7 Header in svelte 2022-02-15 10:03:09 +01:00
Lou Knauer 6d0a4a91a3 Remove needless tls option in ldap config
Go's LDAP client uses tls automatically if the url starts with 'ldaps'.
2022-02-15 10:00:55 +01:00
Lou Knauer ec1f200061 return more erros as JSON 2022-02-14 17:40:47 +01:00
Lou Knauer b40c046f62 return errors as JSON 2022-02-14 17:31:51 +01:00
Lou Knauer 0fef4debca Bugfix in roles parsing 2022-02-14 15:52:59 +01:00
Lou Knauer 5282b7dd8d Update frontend 2022-02-14 14:51:02 +01:00
Lou Knauer 9682ddaab5 Automatically sync via LDAP at interval 2022-02-14 14:37:33 +01:00
Lou Knauer 3bf1c3bdad Refactor auth/ 2022-02-14 14:22:44 +01:00
Lou Knauer 27fd3c4e5a Add /search endpoint which redirects to user/job 2022-02-09 15:03:12 +01:00
Lou Knauer 0ca7dbb4f1 Create tags if needed 2022-02-08 12:49:28 +01:00
Lou Knauer 0c2904d982 Fix vet and staticcheck warning 2022-02-08 11:10:05 +01:00
Lou Knauer 1d0bdd56c7 use go logger internally 2022-02-08 11:04:21 +01:00
Lou Knauer 6f56274ff6 Update frontend 2022-02-08 11:03:32 +01:00
Lou Knauer 9167959875 Update frontend 2022-02-03 16:00:08 +01:00
Lou Knauer e3596b4776 fix SQL error (cast between float/int) 2022-02-03 15:59:45 +01:00
Lou Knauer e8c6a7d589 Add /monitoring/analysis route 2022-02-03 10:42:15 +01:00
Lou Knauer 4f431d0236 Update frontend; Remove debug logging 2022-02-02 13:59:08 +01:00
Lou Knauer 3e7b89aebb make partition optional in nodeMetrics query 2022-02-02 13:05:21 +01:00
Lou Knauer f7959cb1bd Update cc-metric-store client; Bugfix in LoadNodeData 2022-02-02 13:04:38 +01:00
Lou Knauer 3d5aa9f904 Re-enable /monitoring/systems and /monitoring/node 2022-02-02 10:12:16 +01:00
Lou Knauer 3dd1d48f86 Update frontend 2022-01-31 15:16:34 +01:00
Lou Knauer 29a25dbaff start working on non-node-scoped metrics in node/system view 2022-01-31 15:16:05 +01:00
Lou Knauer 84431585f9 better logging 2022-01-31 15:15:29 +01:00
Lou Knauer f82caee28b use sd-deamon prefixes for logging 2022-01-27 13:11:48 +01:00
Lou Knauer eca7ad0de0 Add numHWThreads/numAccelerators filter 2022-01-27 12:32:28 +01:00
Lou Knauer 9e92d6076f Add partition and array-job-id filters 2022-01-27 10:49:19 +01:00
Lou Knauer f8ad53caf0 use a custom logger 2022-01-27 10:35:26 +01:00
Lou Knauer 436eaf0a9d Change import path 2022-01-27 09:40:59 +01:00
Lou Knauer 1c1b043246 Add REST endpoint for metrics 2022-01-27 09:29:53 +01:00
Lou Knauer 32c32ba949 authentication: roles as regular array; simplified LDAP 2022-01-27 09:29:11 +01:00
Lou Knauer 7359a556d9 new test: start/stop job via REST API 2022-01-24 10:08:47 +01:00
Lou Knauer ae3e03f9b9 Add metric renaming map and mock-repo 2022-01-24 10:06:25 +01:00
Lou Knauer 6743d94b0e Use new simpler cc-metric-store API 2022-01-20 10:43:46 +01:00
Lou Knauer c254c689af Add statisticsSeries support 2022-01-20 10:08:50 +01:00
Lou Knauer 9034cb90aa make database schema mysql compatible; use prepared statements 2022-01-20 10:00:55 +01:00
Lou Knauer a64944f3c3 update README.md; gen-keypair utility 2022-01-17 13:51:20 +01:00
Lou Knauer ef91f862c9 working support for non-node scoped metrics; caching 2022-01-17 13:51:20 +01:00
Lou Knauer 7f3bbdd576 update templates and frontend 2022-01-17 13:51:20 +01:00
Lou Knauer 1a9f67fa28 new /api/jobs/ REST endpoint 2022-01-17 13:51:20 +01:00
Lou Knauer 98c4de65a7 work on socket scoped metrics 2022-01-17 13:51:20 +01:00
Lou Knauer f185d12078 read .env automatically, support systemd 2022-01-17 13:51:20 +01:00
LouandGitHub ff24d946fd Merge pull request #1 from ClusterCockpit/full-backend
Full backend
2022-01-10 16:19:43 +01:00
Lou Knauer 102dd85524 renamed submodule 2022-01-10 16:17:40 +01:00
Lou Knauer 290e9b89bf add cli option for generating a JWT; simplify templates 2022-01-10 16:14:54 +01:00
Lou Knauer b7432fca5f continue working on non-node scoped metrics 2022-01-10 16:13:40 +01:00
Lou Knauer 1c6ab3d062 update go.mod and go.sum 2022-01-07 09:54:12 +01:00
Lou Knauer e581bfc70f start work on supporting metrics with a scope of hwthread 2022-01-07 09:47:41 +01:00
Lou Knauer 3f88e512f0 fixes in the GraphQL schema 2022-01-07 09:44:34 +01:00
Lou Knauer 9d87e8874c slight change to job structure 2022-01-07 09:39:00 +01:00
Lou Knauer 30a436e27e use token from cluster.json 2021-12-20 10:49:46 +01:00
Lou Knauer a6e8d5b484 Slight GraphQL-API changes 2021-12-20 10:48:58 +01:00
Lou Knauer 5403177edc all schemas new 2021-12-17 15:49:22 +01:00
Lou Knauer 89333666b3 BC: new schemas for basically everything 2021-12-16 13:17:48 +01:00
Lou Knauer 7fcc39a144 Add async archiving option; Move REST-API to new package 2021-12-16 09:35:03 +01:00
Lou Knauer 9c5c8a05e2 Add more views 2021-12-09 16:27:48 +01:00
Lou Knauer b1d2403839 Bugfixes 2021-12-09 16:26:59 +01:00
Lou Knauer 8178b6e854 Implement nodeMetrics query 2021-12-09 16:25:48 +01:00
Lou Knauer a26d652332 Add templates and custom urls for monitoring views 2021-12-08 15:50:03 +01:00
Lou Knauer c79fcec3ba Update submodule 2021-12-08 12:09:45 +01:00
Lou Knauer 45dc12cc0c Fix bug in archiving 2021-12-08 11:50:47 +01:00
Lou Knauer eb2df5aa1c Add queries to metric data repositories 2021-12-08 11:50:16 +01:00
Lou Knauer bc8ad593fd update main; make REST API compatible to ClusterCockpit 2021-12-08 10:15:25 +01:00
Lou Knauer 34317e0e64 Add InfluxDBv2 as metric data repo 2021-12-08 10:14:45 +01:00
Lou Knauer 4ca0cba7cd individual configurations per user 2021-12-08 10:12:19 +01:00
Lou Knauer 960b0245b2 templates for the login page 2021-12-08 10:09:47 +01:00
Lou Knauer 84c5cd47f6 support the new job archive directory structure 2021-12-08 10:08:41 +01:00
Lou Knauer c1f0d2ed40 authentication via database and/or ldap 2021-12-08 10:03:00 +01:00
Lou Knauer 6387333add Fix format string 2021-11-26 10:38:38 +01:00
Lou Knauer 2c81a96133 Fixes; Get Clusters from config.go 2021-11-26 10:35:07 +01:00
Lou Knauer 8e5e278ea4 Add rest-api for starting/stoping jobs 2021-11-26 10:34:29 +01:00
Lou Knauer 4ef6d47830 Add cc-metric-store client 2021-11-26 10:32:36 +01:00
Lou Knauer c61a5a8e77 Add frontend as submodule; Update README.md 2021-10-26 10:26:39 +02:00
Lou Knauer 61cdcf4ead Implementation of resolvers for new GraphQL schema 2021-10-26 10:24:43 +02:00
Lou Knauer b8d23f8ea1 New GraphQL schema 2021-10-26 10:22:02 +02:00
Lou Knauer 236f51ba9a Massive speedup in job table initialization
It went from taking like 15 minutes on a ramdisk to taking 430 seconds
on my SSD (~900000 jobs inserted).

- Create indexes after inserts so that they do not need to be updated continually
- Use prepared statements for the job insert
- Bundle 200 job inserts into a single transaction
2021-10-20 09:30:50 +02:00
Lou Knauer 22e3e49970 Optionally initialise new db from JSON files 2021-10-11 11:11:14 +02:00
Lou Knauer e4c0b3e955 Update GraphQL schema 2021-09-23 11:45:20 +02:00
Lou Knauer 341091a796 Enable serving of static files 2021-09-21 16:06:41 +02:00
Lou Knauer ad80e1373c Add tag mutations 2021-05-21 09:30:15 +02:00
Lou Knauer 2605623324 Change cluster.json to camelCase, go fmt 2021-05-12 18:34:55 +02:00
Lou Knauer 030f1a3fba Add filters for jobs by statistics like load 2021-05-06 13:50:38 +02:00
Lou Knauer b6df8e88b9 new filterRanges query and Cluster.filterRanges field 2021-05-06 08:36:24 +02:00
Lou Knauer 836c1aea3a change tags filter api, add load_avg, use camelCase in API 2021-04-30 10:26:13 +02:00
Lou Knauer 365b1a2066 Introduce clusters query and type 2021-04-22 15:00:54 +02:00
Lou Knauer 3004e2909a Add tags field to Job 2021-04-21 10:12:19 +02:00
Lou Knauer 499d2cdc22 started implementing support for tags 2021-04-14 18:53:18 +02:00
Lou Knauer bbb3281b6a add memUsed_max, flopsAny_avg, ... to Job type 2021-04-14 17:57:19 +02:00
Lou Knauer 7e32855030 remove JobData, add hasProfile, rename Job-Metrics-Query 2021-04-12 14:01:59 +02:00
Lou Knauer 1d8b9a96c7 New selection possibility when querying available metrics 2021-04-08 11:11:59 +02:00
Lou Knauer b7186cb1cd Make jobAvailableMetricsById more flexible
There are more different metrics than I thought. With this
change, the query mentioned above does not care about the
name of the Metric or whether it is part of the JobData type.
2021-04-07 14:46:02 +02:00
Lou Knauer a52445086b Serve job metric data via GraphQL 2021-04-07 09:19:21 +02:00