Commit Graph

2606 Commits

Author SHA1 Message Date
Lou Knauer f8ad53caf0 use a custom logger 2022-01-27 10:35:26 +01:00
Lou Knauer 436eaf0a9d Change import path 2022-01-27 09:40:59 +01:00
Lou Knauer 1c1b043246 Add REST endpoint for metrics 2022-01-27 09:29:53 +01:00
Lou Knauer 32c32ba949 authentication: roles as regular array; simplified LDAP 2022-01-27 09:29:11 +01:00
Lou Knauer 7359a556d9 new test: start/stop job via REST API 2022-01-24 10:08:47 +01:00
Lou Knauer ae3e03f9b9 Add metric renaming map and mock-repo 2022-01-24 10:06:25 +01:00
Lou Knauer 6743d94b0e Use new simpler cc-metric-store API 2022-01-20 10:43:46 +01:00
Lou Knauer c254c689af Add statisticsSeries support 2022-01-20 10:08:50 +01:00
Lou Knauer 9034cb90aa make database schema mysql compatible; use prepared statements 2022-01-20 10:00:55 +01:00
Lou Knauer a64944f3c3 update README.md; gen-keypair utility 2022-01-17 13:51:20 +01:00
Lou Knauer ef91f862c9 working support for non-node scoped metrics; caching 2022-01-17 13:51:20 +01:00
Lou Knauer 7f3bbdd576 update templates and frontend 2022-01-17 13:51:20 +01:00
Lou Knauer 1a9f67fa28 new /api/jobs/ REST endpoint 2022-01-17 13:51:20 +01:00
Lou Knauer 98c4de65a7 work on socket scoped metrics 2022-01-17 13:51:20 +01:00
Lou Knauer f185d12078 read .env automatically, support systemd 2022-01-17 13:51:20 +01:00
Lou ff24d946fd Merge pull request #1 from ClusterCockpit/full-backend
Full backend
2022-01-10 16:19:43 +01:00
Lou Knauer 102dd85524 renamed submodule 2022-01-10 16:17:40 +01:00
Lou Knauer 290e9b89bf add cli option for generating a JWT; simplify templates 2022-01-10 16:14:54 +01:00
Lou Knauer b7432fca5f continue working on non-node scoped metrics 2022-01-10 16:13:40 +01:00
Lou Knauer 1c6ab3d062 update go.mod and go.sum 2022-01-07 09:54:12 +01:00
Lou Knauer e581bfc70f start work on supporting metrics with a scope of hwthread 2022-01-07 09:47:41 +01:00
Lou Knauer 3f88e512f0 fixes in the GraphQL schema 2022-01-07 09:44:34 +01:00
Lou Knauer 9d87e8874c slight change to job structure 2022-01-07 09:39:00 +01:00
Lou Knauer 30a436e27e use token from cluster.json 2021-12-20 10:49:46 +01:00
Lou Knauer a6e8d5b484 Slight GraphQL-API changes 2021-12-20 10:48:58 +01:00
Lou Knauer 5403177edc all schemas new 2021-12-17 15:49:22 +01:00
Lou Knauer 89333666b3 BC: new schemas for basically everything 2021-12-16 13:17:48 +01:00
Lou Knauer 7fcc39a144 Add async archiving option; Move REST-API to new package 2021-12-16 09:35:03 +01:00
Lou Knauer 9c5c8a05e2 Add more views 2021-12-09 16:27:48 +01:00
Lou Knauer b1d2403839 Bugfixes 2021-12-09 16:26:59 +01:00
Lou Knauer 8178b6e854 Implement nodeMetrics query 2021-12-09 16:25:48 +01:00
Lou Knauer a26d652332 Add templates and custom urls for monitoring views 2021-12-08 15:50:03 +01:00
Lou Knauer c79fcec3ba Update submodule 2021-12-08 12:09:45 +01:00
Lou Knauer 45dc12cc0c Fix bug in archiving 2021-12-08 11:50:47 +01:00
Lou Knauer eb2df5aa1c Add queries to metric data repositories 2021-12-08 11:50:16 +01:00
Lou Knauer bc8ad593fd update main; make REST API compatible to ClusterCockpit 2021-12-08 10:15:25 +01:00
Lou Knauer 34317e0e64 Add InfluxDBv2 as metric data repo 2021-12-08 10:14:45 +01:00
Lou Knauer 4ca0cba7cd individual configurations per user 2021-12-08 10:12:19 +01:00
Lou Knauer 960b0245b2 templates for the login page 2021-12-08 10:09:47 +01:00
Lou Knauer 84c5cd47f6 support the new job archive directory structure 2021-12-08 10:08:41 +01:00
Lou Knauer c1f0d2ed40 authentication via database and/or ldap 2021-12-08 10:03:00 +01:00
Lou Knauer 6387333add Fix format string 2021-11-26 10:38:38 +01:00
Lou Knauer 2c81a96133 Fixes; Get Clusters from config.go 2021-11-26 10:35:07 +01:00
Lou Knauer 8e5e278ea4 Add rest-api for starting/stoping jobs 2021-11-26 10:34:29 +01:00
Lou Knauer 4ef6d47830 Add cc-metric-store client 2021-11-26 10:32:36 +01:00
Lou Knauer c61a5a8e77 Add frontend as submodule; Update README.md 2021-10-26 10:26:39 +02:00
Lou Knauer 61cdcf4ead Implementation of resolvers for new GraphQL schema 2021-10-26 10:24:43 +02:00
Lou Knauer b8d23f8ea1 New GraphQL schema 2021-10-26 10:22:02 +02:00
Lou Knauer 236f51ba9a Massive speedup in job table initialization
It went from taking like 15 minutes on a ramdisk to taking 430 seconds
on my SSD (~900000 jobs inserted).

- Create indexes after inserts so that they do not need to be updated continually
- Use prepared statements for the job insert
- Bundle 200 job inserts into a single transaction
2021-10-20 09:30:50 +02:00
Lou Knauer 22e3e49970 Optionally initialise new db from JSON files 2021-10-11 11:11:14 +02:00