Commit Graph

1608 Commits

Author SHA1 Message Date
Lou Knauer
236f51ba9a Massive speedup in job table initialization
It went from taking like 15 minutes on a ramdisk to taking 430 seconds
on my SSD (~900000 jobs inserted).

- Create indexes after inserts so that they do not need to be updated continually
- Use prepared statements for the job insert
- Bundle 200 job inserts into a single transaction
2021-10-20 09:30:50 +02:00
Lou Knauer
22e3e49970 Optionally initialise new db from JSON files 2021-10-11 11:11:14 +02:00
Lou Knauer
e4c0b3e955 Update GraphQL schema 2021-09-23 11:45:20 +02:00
Lou Knauer
341091a796 Enable serving of static files 2021-09-21 16:06:41 +02:00
Lou Knauer
ad80e1373c Add tag mutations 2021-05-21 09:30:15 +02:00
Lou Knauer
2605623324 Change cluster.json to camelCase, go fmt 2021-05-12 18:34:55 +02:00
Lou Knauer
030f1a3fba Add filters for jobs by statistics like load 2021-05-06 13:50:38 +02:00
Lou Knauer
b6df8e88b9 new filterRanges query and Cluster.filterRanges field 2021-05-06 08:36:24 +02:00
Jan Eitzinger
5c0ada7ec9 Load cluster jsons from jobArchive. 2021-05-03 10:23:47 +02:00
Jan Eitzinger
3e6fccd273 Cleanup obsolete data type in Schema. 2021-05-03 10:23:30 +02:00
Lou Knauer
836c1aea3a change tags filter api, add load_avg, use camelCase in API 2021-04-30 10:26:13 +02:00
Lou Knauer
365b1a2066 Introduce clusters query and type 2021-04-22 15:00:54 +02:00
Lou Knauer
3004e2909a Add tags field to Job 2021-04-21 10:12:19 +02:00
Lou Knauer
499d2cdc22 started implementing support for tags 2021-04-14 18:53:18 +02:00
Lou Knauer
bbb3281b6a add memUsed_max, flopsAny_avg, ... to Job type 2021-04-14 17:57:19 +02:00
Lou Knauer
7e32855030 remove JobData, add hasProfile, rename Job-Metrics-Query 2021-04-12 14:01:59 +02:00
Lou Knauer
1d8b9a96c7 New selection possibility when querying available metrics 2021-04-08 11:11:59 +02:00
Lou Knauer
b7186cb1cd Make jobAvailableMetricsById more flexible
There are more different metrics than I thought. With this
change, the query mentioned above does not care about the
name of the Metric or whether it is part of the JobData type.
2021-04-07 14:46:02 +02:00
Lou Knauer
a52445086b Serve job metric data via GraphQL 2021-04-07 09:19:21 +02:00
moebiusband73
4273878e9b
Update README.md 2021-03-31 08:58:34 +02:00
moebiusband73
279834902e
Update README.md 2021-03-31 08:56:36 +02:00
moebiusband73
bf97407891
Update README.md 2021-03-31 08:54:14 +02:00
moebiusband73
ffcec6a1ad
Update README.md 2021-03-31 08:52:43 +02:00
Jan Eitzinger
9940c44f2b Fix path errors. Fix data schema. 2021-03-31 08:50:53 +02:00
Jan Eitzinger
b7970585ea Introduce new golang job-archive backend 2021-03-31 07:23:48 +02:00
Jan Eitzinger
90ae832c2e Update scripts 2019-12-10 09:49:58 +01:00
Jan Eitzinger
e27a3fda79 Work on jobTag Script 2019-11-13 08:16:26 +01:00
Jan Eitzinger
95f616f45e Sync state. Add job tagging scripts and siurce code. 2019-11-11 09:37:56 +01:00
Jan Eitzinger
cb0fae0216 Adopt scripts for sync of DB with json. 2019-11-08 09:07:02 +01:00
Jan Eitzinger
439f937adb Save commit 2019-10-15 20:43:25 +02:00
Jan Eitzinger
8e2475ca39 Add unit json schema. Add exclusive boolean. 2019-10-15 20:43:09 +02:00
Jan Eitzinger
deaf49e50d Add cluster description json schema. 2019-10-15 20:42:01 +02:00
Jan Eitzinger
b980f191f0 Reformat and cleanup 2019-09-15 10:35:02 +02:00
Jan Eitzinger
36e1558bec Fix error in json. 2019-09-15 10:02:46 +02:00
moebiusband73
6ea8f4fe3e
Update README.md 2019-09-06 16:39:01 +02:00
Jan Eitzinger
932357d1d7 Add allowed terms for scope. 2019-09-06 16:31:34 +02:00
Jan Eitzinger
ed59fa924a Added more json schema spec files 2019-09-06 16:16:32 +02:00
Jan Eitzinger
2eed27dd80 Add json schema files 2019-09-06 10:44:04 +02:00
Jan Eitzinger
90ab25e3ec Update help text in README 2019-06-05 08:36:51 +02:00
Jan Eitzinger
4b3dff82e1 Merge branch 'master' of github.com:RRZE-HPC/HPCJobDatabase 2019-06-05 08:34:38 +02:00
Jan Eitzinger
3d2366cf67 Update help text. Update helper scripts. 2019-06-05 08:34:20 +02:00
moebiusband73
479be6a39a
Update README.md 2019-05-13 10:45:56 +02:00
moebiusband73
d78b9903df
Update README.md 2019-05-13 10:37:50 +02:00
Jan Eitzinger
e5e6f704cf Merge branch 'master' of github.com:RRZE-HPC/HPCJobDatabase 2019-05-10 06:33:06 +02:00
Jan Eitzinger
6a020f1469 Extend datetime format for starttime option 2019-05-10 06:32:44 +02:00
Jan Eitzinger
7e873770eb Complete implementation of perf stat mode. 2019-05-09 15:48:18 +02:00
Jan Eitzinger
29b9f7e6bd Add Perfstat option. 2019-05-09 13:10:35 +02:00
Jan Eitzinger
173ddd5a48 First working version of anonymize script 2019-05-09 11:40:47 +02:00
Jan Eitzinger
6b26f8b4e9 Start implementing anonDB.pl 2019-05-09 07:18:28 +02:00
Jan Eitzinger
e81afc84ab Small fixes. Start script to anonymize user infos. 2019-05-08 08:46:58 +02:00