Commit Graph

122 Commits

Author SHA1 Message Date
Lou Knauer
eb2f4edfe1 parallelize zipping/archiving 2022-02-21 09:53:40 +01:00
Lou Knauer
dea577424e parallel checkpointing 2022-02-17 11:00:30 +01:00
Lou Knauer
6ab7b6879c Continue even if checkpointing some singel file fails 2022-02-17 10:11:27 +01:00
Lou Knauer
7201251600 Enable basic authentication for NATS 2022-02-04 08:52:53 +01:00
Lou Knauer
83d1cb2a98 Add documentation, change config format 2022-02-04 08:46:14 +01:00
Lou Knauer
8fb2557f97 Support HTTPS; Add /api/debug 2022-02-04 08:31:03 +01:00
Lou Knauer
f38353a879 fix error behaviour, enable padding by default 2022-02-02 11:45:52 +01:00
Lou Knauer
15d28af12d Change /api/query return type 2022-02-02 11:26:05 +01:00
Lou Knauer
407e650745 fix NaN too null conversion and restore duration 2022-01-31 16:34:42 +01:00
Lou Knauer
371afe5ab5 optionally pad the returned data with null 2022-01-31 16:32:50 +01:00
Lou Knauer
5c16393e30 Update README.md 2022-01-31 10:53:06 +01:00
Lou Knauer
f8ec5994c3 Use time.ParseDuration for intervals in config 2022-01-31 10:52:30 +01:00
Lou Knauer
af38004a76 better JSON encoding (less allocs) 2022-01-24 09:55:33 +01:00
Lou Knauer
4a78a24034 Copy all byte slices from decoder
While trying to optimize things I overread this: "the byte slices returned by the Decoder methods are only valid until the next call to any other Decode method."
2022-01-24 09:50:12 +01:00
Lou Knauer
bf7c33513b reduce allocations and locking 2022-01-21 10:47:40 +01:00
Lou Knauer
76c58d7799 Add OpenAPI spec 2022-01-20 10:43:10 +01:00
Lou Knauer
b6b219a9ad Unified API for all query types; remove dead code 2022-01-20 10:42:44 +01:00
Lou Knauer
15733cb1b7 move decodeLine function 2022-01-20 10:14:28 +01:00
Lou Knauer
3fb95f88ee bugfix in query endpoint 2022-01-10 16:11:13 +01:00
Lou Knauer
97dcc95a2f add query api endpoint 2022-01-07 08:52:55 +01:00
Lou Knauer
4509a4a355 support subtypes in line protocol 2022-01-07 08:49:13 +01:00
Lou Knauer
50731e43a8 add config flag; fix bug in archive 2021-12-15 10:58:03 +01:00
Lou Knauer
ac7e981321 improve logging messages 2021-12-15 10:23:21 +01:00
Lou Knauer
878e9d7154 Start working on pre-computed stats 2021-12-15 09:59:33 +01:00
Lou Knauer
5d89d87a2d Reduce gaps/rewrites in the same cell with offset
A new buffer remembers the timestamp of the first write.
Instead of cutting of cells relative to that time, have
a little "time buffer" so that rewriting the same cell twice
happens less often.
2021-12-02 12:57:35 +01:00
Lou Knauer
becf41f98c Reset buffer size when reused
The buffers data slice size needs to be reset to 0
before it can be reused. Also, buffers that come from
the archive should not be reused as they might have
strange capacities.
2021-12-02 12:53:49 +01:00
Lou Knauer
fee0061172 Fix panic in findBuffers when Any pattern is used 2021-12-01 13:22:07 +01:00
Lou Knauer
61f9056781 Improve startup time by reading data in parallel 2021-12-01 12:30:01 +01:00
Lou Knauer
0219c48e78 Fix bug when reading past newest buffer 2021-11-30 13:09:21 +01:00
Lou Knauer
38d605b6c4 Optionally provide statistics on the timeseries enpoint
This is not useful for ClusterCockpit currently, but when archiving
a job or for the job-view, this can speed things up in the future.
2021-11-26 09:51:18 +01:00
Lou Knauer
579a05e4df Fix bug in calculation of what is archived 2021-11-22 17:50:15 +01:00
Lou Knauer
458383d152 Do re-write buffers loaded from checkpoint; Add SIGUSR1 for debugging 2021-11-22 17:04:09 +01:00
Lou Knauer
d006e26fd4 Add all-nodes api endpoint for system view 2021-11-16 11:27:28 +01:00
Christoph Kluge
eff61ce93e Use argument instead of default value for nats connection 2021-11-12 13:41:30 +01:00
Lou Knauer
1c12c655f1 api: return errors via JSON, not status codes 2021-10-19 12:17:16 +02:00
Lou Knauer
024f66f49c Make nats optional; Update README.md 2021-10-12 13:26:54 +02:00
Lou
26528151b1
Merge pull request #7 from ClusterCockpit/new-line-protocol-format
New line protocol format
2021-10-11 16:29:16 +02:00
Lou Knauer
807c613cae Add (untested) HTTP write API 2021-10-11 16:28:05 +02:00
Lou Knauer
a15238a7a9 Add multiplication by time.Second 2021-10-11 11:06:42 +02:00
Lou Knauer
fecc33a224 One less allocation 2021-10-11 10:56:38 +02:00
Lou Knauer
3aae1e80fb host to hostname in lp; update README.md 2021-10-11 10:55:36 +02:00
Lou Knauer
2fc6ad284f Handle new line-protrocol format in handleLine 2021-10-07 14:59:07 +02:00
Lou Knauer
85591e7a03 Switch to influxes line protocol parser 2021-10-07 14:52:45 +02:00
Lou Knauer
3b2ec98ba0 Update README.md, document API endpoints
Fixes #2
2021-09-20 11:25:25 +02:00
Lou Knauer
2046415f9c Change out-of-bounds behaviour 2021-09-20 10:29:55 +02:00
Lou Knauer
27a5c0b561 Use JWT authentication for the API
This commit takes care of the API part of issue #6.
2021-09-20 09:27:31 +02:00
Lou Knauer
22de7da5e4 ZIP checkpoints and move to archive 2021-09-13 13:40:39 +02:00
Lou Knauer
372d07b454 Rename archive to checkpoints; new config 2021-09-13 12:28:33 +02:00
Lou Knauer
4d17abdbc8 Support more than one line per message 2021-09-13 12:26:55 +02:00
Lou Knauer
53d5734fd5 New peek query (newest values) 2021-09-13 12:25:56 +02:00