e83bd2babd
Consolidate migrations
...
Entire-Checkpoint: a3dba4105838
2026-03-13 17:14:13 +01:00
Christoph Kluge
ba366d0d72
use inline literals in simple queries, add downgrade optimize
2026-03-13 15:16:19 +01:00
f15f1452cc
Inline jobstate literal in query
...
Entire-Checkpoint: 35f06df74b51
2026-03-13 15:16:07 +01:00
d586fe4b43
Optimize usage dashboard: partial indexes, request cache, parallel histograms
...
- Add migration 14: partial covering indexes WHERE job_state='running'
for user/project/subcluster groupings (tiny B-tree vs full table)
- Inline literal state value in BuildWhereClause so SQLite matches
partial indexes instead of parameterized placeholders
- Add per-request statsGroupCache (sync.Once per filter+groupBy key)
so identical grouped stats queries execute only once per GQL operation
- Parallelize 4 histogram queries in AddHistograms using errgroup
- Consolidate frontend from 6 GQL aliases to 2, sort+slice top-10
client-side via $derived
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com >
Entire-Checkpoint: 5b26a6e5ff10
2026-03-13 14:31:37 +01:00
cbe46c3524
Merge branch 'hotfix' of github.com:ClusterCockpit/cc-backend into hotfix
2026-03-13 13:17:34 +01:00
dd3e5427f4
Add covering indexes for status/dashboard queries (migration 13)
...
Adds composite covering indexes on (cluster, job_state, <group_col>, ...)
for user, project, and subcluster groupings to enable index-only scans
for status views. Drops subsumed 3-column indexes.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com >
Entire-Checkpoint: 3d8def28e96e
2026-03-13 13:12:54 +01:00
Christoph Kluge
e666980184
fix typo
2026-03-13 12:07:43 +01:00
Christoph Kluge
c238f68af6
reduce unnecessary complexity
2026-03-13 12:05:16 +01:00
Christoph Kluge
58c0c79f72
handle single job state queries as simple stringquery
...
- this will improve index usage for single state queries
2026-03-13 12:03:06 +01:00
Christoph Kluge
a877937a25
add missing downgarde index drop, add optimize after downgrades
2026-03-13 10:11:11 +01:00
a4f9ba6975
Apply correct log level
...
Entire-Checkpoint: 8288af281b94
2026-03-13 07:58:57 +01:00
96fc44a649
fix: Optimize project stat query
2026-03-13 06:06:38 +01:00
8e86e8720d
Make stats query selective. Add stats index. Add paging to user list.
...
Entire-Checkpoint: d42431eee30d
2026-03-12 20:16:55 +01:00
4555fb8a86
Merge branch 'hotfix' of github.com:ClusterCockpit/cc-backend into hotfix
2026-03-12 20:15:54 +01:00
0e27624d73
Add flag to optimize db. Remove ANALYZE on startup.
...
Entire-Checkpoint: d49917ff4b10
2026-03-12 20:12:49 +01:00
Christoph Kluge
8563ed5e08
fix: remove indices from migration 9
...
- optimization migration 11 drops these indices, so rather not create them in the first place
2026-03-12 14:45:45 +01:00
Christoph Kluge
972b14033a
add db migration 11, optimizing index count
2026-03-11 16:07:29 +01:00
af78f06ced
fix: Reduce complexity for groupBy stats queries
...
Entire-Checkpoint: fc899a70a751
2026-03-11 15:14:59 +01:00
00d2f97c4c
fix: Large heap allocations in sqlite driver. Sanitize sqlite config and make it configurablex. Allow to cancel queries.
2026-03-11 11:14:37 +01:00
eba3995610
Add Analyse on db startup
...
Entire-Checkpoint: ea70a955214d
2026-03-11 05:28:52 +01:00
f8831e7040
Fixed merge errors
...
Entire-Checkpoint: ddd4fa4a7bbb
2026-03-11 05:09:38 +01:00
1cf99206a9
Merge branch 'hotfix' of github.com:ClusterCockpit/cc-backend into hotfix
2026-03-11 05:06:26 +01:00
5d3d77620e
fix: Add defer.close for all queries
2026-03-11 05:04:20 +01:00
Christoph Kluge
cc38b17472
fix wrong field checked vor json validity
2026-03-10 17:02:09 +01:00
Christoph Kluge
d2bc046fc6
fix ranged filter GT and LT conditions, reduce energy filter preset
2026-03-09 11:28:30 +01:00
6da41982ce
Further optimize queries for better index usage
2026-03-03 15:54:51 +01:00
5669eb5818
Optimize queries for existing indices
2026-03-03 15:41:44 +01:00
Christoph Kluge
d00aa2666d
activate update of roles and projects if updateUserOnLogin is set
2026-02-27 15:20:09 +01:00
03c65e06f6
Allow finer control for omit tagged jobs in retention policies
2026-02-23 08:46:47 +01:00
e1c1148160
Fix more bugs related to job_cache ids used in job table
2026-02-20 09:20:18 +01:00
dc161ec421
Fix bug in SyncJobs causing start job hooks being called with job_cache ID
2026-02-20 08:29:41 +01:00
abd11d783b
Use alternative solution to deal with NULL values in health_state column
2026-02-20 08:12:15 +01:00
745c0357f3
Handle NULL values on health_metrics column
2026-02-19 08:04:45 +01:00
2da35909c1
Optimize sort order in job parquet files
2026-02-18 08:13:00 +01:00
2e24fde430
Optimize sort order in nodestate parquet files
2026-02-18 08:06:00 +01:00
29c440a637
Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev
2026-02-17 21:06:20 +01:00
6035b62734
Run go fix
2026-02-17 21:04:17 +01:00
Christoph Kluge
fe3ebe0abc
add healthStatus tab to status details, add graphql endpoints and handlers
2026-02-17 14:38:06 +01:00
c15f1117f5
Review and improve node repo queries
2026-02-12 15:45:15 +01:00
f016bd4232
Extend node repository unit tests
2026-02-12 09:30:14 +01:00
54ea5d7900
Add nodestate retention and archiving
2026-02-12 09:21:44 +01:00
865cd3db54
Prersist faulty nodestate metric lists to db
2026-02-12 08:48:15 +01:00
90c8fbf07c
Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev
2026-02-12 07:34:26 +01:00
f4ee0d1042
Update cc-lib and extend nodestate sql schema
2026-02-12 07:34:24 +01:00
Christoph Kluge
12e9f6700e
fix nodeList resolver data handling, increase nodestate filter cutoff
...
- add comment on cutoff
2026-02-11 16:16:09 +01:00
8d6c6b819b
Update and port to cc-lib
2026-02-11 07:06:06 +01:00
1feb3baf68
Create copy of test db before unit tests
2026-02-10 07:53:30 +01:00
ac7eb93141
fix: Transfer always to main job table before archiving
2026-02-09 19:57:46 +01:00
0adf2bad92
Add info log about applied tag
2026-02-06 14:50:13 +01:00
db8772dc0b
Merge branch 'dev' of github.com:ClusterCockpit/cc-backend into dev
2026-02-06 14:06:59 +01:00
