Lou Knauer
0ca7dbb4f1
Create tags if needed
2022-02-08 12:49:28 +01:00
Lou Knauer
0c2904d982
Fix vet and staticcheck warning
2022-02-08 11:10:05 +01:00
Lou Knauer
1d0bdd56c7
use go logger internally
2022-02-08 11:04:21 +01:00
Lou Knauer
6f56274ff6
Update frontend
2022-02-08 11:03:32 +01:00
Lou Knauer
9167959875
Update frontend
2022-02-03 16:00:08 +01:00
Lou Knauer
e3596b4776
fix SQL error (cast between float/int)
2022-02-03 15:59:45 +01:00
Lou Knauer
e8c6a7d589
Add /monitoring/analysis route
2022-02-03 10:42:15 +01:00
Lou Knauer
4f431d0236
Update frontend; Remove debug logging
2022-02-02 13:59:08 +01:00
Lou Knauer
3e7b89aebb
make partition optional in nodeMetrics query
2022-02-02 13:05:21 +01:00
Lou Knauer
f7959cb1bd
Update cc-metric-store client; Bugfix in LoadNodeData
2022-02-02 13:04:38 +01:00
Lou Knauer
3d5aa9f904
Re-enable /monitoring/systems and /monitoring/node
2022-02-02 10:12:16 +01:00
Lou Knauer
3dd1d48f86
Update frontend
2022-01-31 15:16:34 +01:00
Lou Knauer
29a25dbaff
start working on non-node-scoped metrics in node/system view
2022-01-31 15:16:05 +01:00
Lou Knauer
84431585f9
better logging
2022-01-31 15:15:29 +01:00
Lou Knauer
f82caee28b
use sd-deamon prefixes for logging
2022-01-27 13:11:48 +01:00
Lou Knauer
eca7ad0de0
Add numHWThreads/numAccelerators filter
2022-01-27 12:32:28 +01:00
Lou Knauer
9e92d6076f
Add partition and array-job-id filters
2022-01-27 10:49:19 +01:00
Lou Knauer
f8ad53caf0
use a custom logger
2022-01-27 10:35:26 +01:00
Lou Knauer
436eaf0a9d
Change import path
2022-01-27 09:40:59 +01:00
Lou Knauer
1c1b043246
Add REST endpoint for metrics
2022-01-27 09:29:53 +01:00
Lou Knauer
32c32ba949
authentication: roles as regular array; simplified LDAP
2022-01-27 09:29:11 +01:00
Lou Knauer
7359a556d9
new test: start/stop job via REST API
2022-01-24 10:08:47 +01:00
Lou Knauer
ae3e03f9b9
Add metric renaming map and mock-repo
2022-01-24 10:06:25 +01:00
Lou Knauer
6743d94b0e
Use new simpler cc-metric-store API
2022-01-20 10:43:46 +01:00
Lou Knauer
c254c689af
Add statisticsSeries support
2022-01-20 10:08:50 +01:00
Lou Knauer
9034cb90aa
make database schema mysql compatible; use prepared statements
2022-01-20 10:00:55 +01:00
Lou Knauer
a64944f3c3
update README.md; gen-keypair utility
2022-01-17 13:51:20 +01:00
Lou Knauer
ef91f862c9
working support for non-node scoped metrics; caching
2022-01-17 13:51:20 +01:00
Lou Knauer
7f3bbdd576
update templates and frontend
2022-01-17 13:51:20 +01:00
Lou Knauer
1a9f67fa28
new /api/jobs/ REST endpoint
2022-01-17 13:51:20 +01:00
Lou Knauer
98c4de65a7
work on socket scoped metrics
2022-01-17 13:51:20 +01:00
Lou Knauer
f185d12078
read .env automatically, support systemd
2022-01-17 13:51:20 +01:00
Lou and GitHub
ff24d946fd
Merge pull request #1 from ClusterCockpit/full-backend
...
Full backend
2022-01-10 16:19:43 +01:00
Lou Knauer
102dd85524
renamed submodule
2022-01-10 16:17:40 +01:00
Lou Knauer
290e9b89bf
add cli option for generating a JWT; simplify templates
2022-01-10 16:14:54 +01:00
Lou Knauer
b7432fca5f
continue working on non-node scoped metrics
2022-01-10 16:13:40 +01:00
Lou Knauer
1c6ab3d062
update go.mod and go.sum
2022-01-07 09:54:12 +01:00
Lou Knauer
e581bfc70f
start work on supporting metrics with a scope of hwthread
2022-01-07 09:47:41 +01:00
Lou Knauer
3f88e512f0
fixes in the GraphQL schema
2022-01-07 09:44:34 +01:00
Lou Knauer
9d87e8874c
slight change to job structure
2022-01-07 09:39:00 +01:00
Lou Knauer
30a436e27e
use token from cluster.json
2021-12-20 10:49:46 +01:00
Lou Knauer
a6e8d5b484
Slight GraphQL-API changes
2021-12-20 10:48:58 +01:00
Lou Knauer
5403177edc
all schemas new
2021-12-17 15:49:22 +01:00
Lou Knauer
89333666b3
BC: new schemas for basically everything
2021-12-16 13:17:48 +01:00
Lou Knauer
7fcc39a144
Add async archiving option; Move REST-API to new package
2021-12-16 09:35:03 +01:00
Lou Knauer
9c5c8a05e2
Add more views
2021-12-09 16:27:48 +01:00
Lou Knauer
b1d2403839
Bugfixes
2021-12-09 16:26:59 +01:00
Lou Knauer
8178b6e854
Implement nodeMetrics query
2021-12-09 16:25:48 +01:00
Lou Knauer
a26d652332
Add templates and custom urls for monitoring views
2021-12-08 15:50:03 +01:00
Lou Knauer
c79fcec3ba
Update submodule
2021-12-08 12:09:45 +01:00
Lou Knauer
45dc12cc0c
Fix bug in archiving
2021-12-08 11:50:47 +01:00
Lou Knauer
eb2df5aa1c
Add queries to metric data repositories
2021-12-08 11:50:16 +01:00
Lou Knauer
bc8ad593fd
update main; make REST API compatible to ClusterCockpit
2021-12-08 10:15:25 +01:00
Lou Knauer
34317e0e64
Add InfluxDBv2 as metric data repo
2021-12-08 10:14:45 +01:00
Lou Knauer
4ca0cba7cd
individual configurations per user
2021-12-08 10:12:19 +01:00
Lou Knauer
960b0245b2
templates for the login page
2021-12-08 10:09:47 +01:00
Lou Knauer
84c5cd47f6
support the new job archive directory structure
2021-12-08 10:08:41 +01:00
Lou Knauer
c1f0d2ed40
authentication via database and/or ldap
2021-12-08 10:03:00 +01:00
Lou Knauer
6387333add
Fix format string
2021-11-26 10:38:38 +01:00
Lou Knauer
2c81a96133
Fixes; Get Clusters from config.go
2021-11-26 10:35:07 +01:00
Lou Knauer
8e5e278ea4
Add rest-api for starting/stoping jobs
2021-11-26 10:34:29 +01:00
Lou Knauer
4ef6d47830
Add cc-metric-store client
2021-11-26 10:32:36 +01:00
Lou Knauer
c61a5a8e77
Add frontend as submodule; Update README.md
2021-10-26 10:26:39 +02:00
Lou Knauer
61cdcf4ead
Implementation of resolvers for new GraphQL schema
2021-10-26 10:24:43 +02:00
Lou Knauer
b8d23f8ea1
New GraphQL schema
2021-10-26 10:22:02 +02:00
Lou Knauer
236f51ba9a
Massive speedup in job table initialization
...
It went from taking like 15 minutes on a ramdisk to taking 430 seconds
on my SSD (~900000 jobs inserted).
- Create indexes after inserts so that they do not need to be updated continually
- Use prepared statements for the job insert
- Bundle 200 job inserts into a single transaction
2021-10-20 09:30:50 +02:00
Lou Knauer
22e3e49970
Optionally initialise new db from JSON files
2021-10-11 11:11:14 +02:00
Lou Knauer
e4c0b3e955
Update GraphQL schema
2021-09-23 11:45:20 +02:00
Lou Knauer
341091a796
Enable serving of static files
2021-09-21 16:06:41 +02:00
Lou Knauer
ad80e1373c
Add tag mutations
2021-05-21 09:30:15 +02:00
Lou Knauer
2605623324
Change cluster.json to camelCase, go fmt
2021-05-12 18:34:55 +02:00
Lou Knauer
030f1a3fba
Add filters for jobs by statistics like load
2021-05-06 13:50:38 +02:00
Lou Knauer
b6df8e88b9
new filterRanges query and Cluster.filterRanges field
2021-05-06 08:36:24 +02:00
Lou Knauer
836c1aea3a
change tags filter api, add load_avg, use camelCase in API
2021-04-30 10:26:13 +02:00
Lou Knauer
365b1a2066
Introduce clusters query and type
2021-04-22 15:00:54 +02:00
Lou Knauer
3004e2909a
Add tags field to Job
2021-04-21 10:12:19 +02:00
Lou Knauer
499d2cdc22
started implementing support for tags
2021-04-14 18:53:18 +02:00
Lou Knauer
bbb3281b6a
add memUsed_max, flopsAny_avg, ... to Job type
2021-04-14 17:57:19 +02:00
Lou Knauer
7e32855030
remove JobData, add hasProfile, rename Job-Metrics-Query
2021-04-12 14:01:59 +02:00
Lou Knauer
1d8b9a96c7
New selection possibility when querying available metrics
2021-04-08 11:11:59 +02:00
Lou Knauer
b7186cb1cd
Make jobAvailableMetricsById more flexible
...
There are more different metrics than I thought. With this
change, the query mentioned above does not care about the
name of the Metric or whether it is part of the JobData type.
2021-04-07 14:46:02 +02:00
Lou Knauer
a52445086b
Serve job metric data via GraphQL
2021-04-07 09:19:21 +02:00