Commit Graph

92 Commits

Author SHA1 Message Date
Lou Knauer
f3d7e5c28a Cleanup; /api/debug returns JSON 2022-03-31 14:17:27 +02:00
Lou Knauer
aca13c1769 Some more heap/gc tuning 2022-03-24 10:31:11 +01:00
Lou Knauer
3eba385e97 Handle unaligned data more robustly 2022-03-18 08:37:25 +01:00
Lou Knauer
5431dd113e Cache decoded tokens (signature check is expensive) 2022-03-14 08:50:28 +01:00
Lou Knauer
fdbf94f2a1 Optionally delete checkpoints instead of archiving 2022-03-14 08:48:22 +01:00
Lou Knauer
0b66f7c5d7 Reduce gc target percentage 2022-03-09 14:21:03 +01:00
Lou Knauer
720924a7dd Fix float precision 2022-03-08 09:32:35 +01:00
Lou Knauer
2528dc8403 Add decodeLine benchmark 2022-03-08 09:31:16 +01:00
Lou Knauer
3619d7a157 Refactor and simplify 2022-03-08 09:27:44 +01:00
Lou
66be268b57
Merge pull request #8 from ClusterCockpit/rename_and_makefile
Rename main Go file and add scripts for system(d) integration
2022-03-08 09:19:24 +01:00
Thomas Roehl
bbf49e1b21 Add Makefile 2022-03-07 12:22:22 +01:00
Thomas Roehl
3ec4dd7f69 Add spec file for RPM building 2022-03-07 12:22:14 +01:00
Thomas Roehl
7a5a611d8e Add additional files for systemd and init system 2022-03-07 12:21:59 +01:00
Thomas Roehl
d546b0e7d1 Move systemd service file to scripts subfolder 2022-03-07 12:21:20 +01:00
Thomas Roehl
36c1e81609 Rename main source to fit binary name 2022-03-07 12:21:01 +01:00
Lou Knauer
af8a275088 Fix panic in ListChildren 2022-03-04 15:33:47 +01:00
Lou Knauer
902fcf9510 Allow multiple nats subscriptions 2022-02-22 14:18:44 +01:00
Lou Knauer
d8e25063f9 allow setting the cluster tag via query parameter 2022-02-22 13:58:10 +01:00
Lou Knauer
182a1fa67d fix file descriptor leak 2022-02-21 12:29:46 +01:00
Lou Knauer
29fe272ea9 Remove 'scope' field from config 2022-02-21 10:00:29 +01:00
Lou Knauer
eb2f4edfe1 parallelize zipping/archiving 2022-02-21 09:53:40 +01:00
Lou Knauer
dea577424e parallel checkpointing 2022-02-17 11:00:30 +01:00
Lou Knauer
6ab7b6879c Continue even if checkpointing some singel file fails 2022-02-17 10:11:27 +01:00
Lou Knauer
7201251600 Enable basic authentication for NATS 2022-02-04 08:52:53 +01:00
Lou Knauer
83d1cb2a98 Add documentation, change config format 2022-02-04 08:46:14 +01:00
Lou Knauer
8fb2557f97 Support HTTPS; Add /api/debug 2022-02-04 08:31:03 +01:00
Lou Knauer
f38353a879 fix error behaviour, enable padding by default 2022-02-02 11:45:52 +01:00
Lou Knauer
15d28af12d Change /api/query return type 2022-02-02 11:26:05 +01:00
Lou Knauer
407e650745 fix NaN too null conversion and restore duration 2022-01-31 16:34:42 +01:00
Lou Knauer
371afe5ab5 optionally pad the returned data with null 2022-01-31 16:32:50 +01:00
Lou Knauer
5c16393e30 Update README.md 2022-01-31 10:53:06 +01:00
Lou Knauer
f8ec5994c3 Use time.ParseDuration for intervals in config 2022-01-31 10:52:30 +01:00
Lou Knauer
af38004a76 better JSON encoding (less allocs) 2022-01-24 09:55:33 +01:00
Lou Knauer
4a78a24034 Copy all byte slices from decoder
While trying to optimize things I overread this: "the byte slices returned by the Decoder methods are only valid until the next call to any other Decode method."
2022-01-24 09:50:12 +01:00
Lou Knauer
bf7c33513b reduce allocations and locking 2022-01-21 10:47:40 +01:00
Lou Knauer
76c58d7799 Add OpenAPI spec 2022-01-20 10:43:10 +01:00
Lou Knauer
b6b219a9ad Unified API for all query types; remove dead code 2022-01-20 10:42:44 +01:00
Lou Knauer
15733cb1b7 move decodeLine function 2022-01-20 10:14:28 +01:00
Lou Knauer
3fb95f88ee bugfix in query endpoint 2022-01-10 16:11:13 +01:00
Lou Knauer
97dcc95a2f add query api endpoint 2022-01-07 08:52:55 +01:00
Lou Knauer
4509a4a355 support subtypes in line protocol 2022-01-07 08:49:13 +01:00
Lou Knauer
50731e43a8 add config flag; fix bug in archive 2021-12-15 10:58:03 +01:00
Lou Knauer
ac7e981321 improve logging messages 2021-12-15 10:23:21 +01:00
Lou Knauer
878e9d7154 Start working on pre-computed stats 2021-12-15 09:59:33 +01:00
Lou Knauer
5d89d87a2d Reduce gaps/rewrites in the same cell with offset
A new buffer remembers the timestamp of the first write.
Instead of cutting of cells relative to that time, have
a little "time buffer" so that rewriting the same cell twice
happens less often.
2021-12-02 12:57:35 +01:00
Lou Knauer
becf41f98c Reset buffer size when reused
The buffers data slice size needs to be reset to 0
before it can be reused. Also, buffers that come from
the archive should not be reused as they might have
strange capacities.
2021-12-02 12:53:49 +01:00
Lou Knauer
fee0061172 Fix panic in findBuffers when Any pattern is used 2021-12-01 13:22:07 +01:00
Lou Knauer
61f9056781 Improve startup time by reading data in parallel 2021-12-01 12:30:01 +01:00
Lou Knauer
0219c48e78 Fix bug when reading past newest buffer 2021-11-30 13:09:21 +01:00
Lou Knauer
38d605b6c4 Optionally provide statistics on the timeseries enpoint
This is not useful for ClusterCockpit currently, but when archiving
a job or for the job-view, this can speed things up in the future.
2021-11-26 09:51:18 +01:00