Commit Graph

295 Commits

Author SHA1 Message Date
Christoph Kluge
a651219a2c
Merge pull request #96 from ClusterCockpit/92_add_shortjobduration_config
Move ShortRunningJobsDuration value to root config
2023-03-09 16:43:43 +01:00
Christoph Kluge
14665df439 Better test array 2023-03-06 16:35:14 +01:00
Christoph Kluge
cae7257673 Add tests for role checks, update test.db 2023-03-06 16:32:58 +01:00
Christoph Kluge
f37e7c26f6 Rework roles as enum, change AuthSource to enum 2023-03-06 11:44:38 +01:00
Christoph Kluge
4f1f034702 Move ShortRunningJobsDuration value to root config 2023-03-01 16:34:59 +01:00
9d28cb83f0 Remove swagger enum comment and rebuild Swagger docs
Relates to #95
2023-03-01 10:49:08 +01:00
Christoph Kluge
df44bd9621 Merge branch 'master' into 40_45_82_update_roles 2023-02-28 11:18:46 +01:00
1fc090965d Add missing error code 2023-02-27 09:16:18 +01:00
e13f184414 Regenerate Swagger docs
Relates to #94 and #95
2023-02-27 07:49:37 +01:00
89b1d8f7da Treat error no change as non fatal 2023-02-25 08:26:56 +01:00
ae5a73335d Fix bugs in getJobs REST Api endpoint
Relates to #94 and #95
2023-02-25 07:21:54 +01:00
Christoph Kluge
8bd72ce807 Small fixes after full file review
- Remove unnecessary field 'project' from GQl and regenerate
- Add newlines to file ends
- Fix command-line manager user addition
2023-02-23 12:33:14 +01:00
Christoph Kluge
d30dba109d Fix test 2023-02-22 16:57:15 +01:00
Christoph Kluge
365888c645 Fix tag panic and simplify code 2023-02-22 16:49:23 +01:00
Christoph Kluge
d6b8d711f6 Rework searchbar functions, add user jobtable 2023-02-22 16:30:01 +01:00
Christoph Kluge
d0d578a1e6 Fix user.projects up migration file 2023-02-22 10:17:40 +01:00
Christoph Kluge
48728e64c4 Merge branch 'master' into 40_45_82_update_roles 2023-02-22 09:28:41 +01:00
60437ce264 Rebuild GraphQL api and Swagger UI code. 2023-02-21 18:13:16 +01:00
Christoph Kluge
822c8b570c Remove exists checks from sql migrations to v3 2023-02-21 18:05:29 +01:00
Christoph Kluge
3b7ca17b3c Merge branch 'master' into 40_45_82_update_roles 2023-02-21 17:36:58 +01:00
Christoph Kluge
acbef39045 Fix header, add migration for user.projects column 2023-02-21 17:33:27 +01:00
af26331f59 Merge back changes from main 2023-02-21 17:18:54 +01:00
Christoph Kluge
e0e51813ad Merge branch 'master' into 40_45_82_update_roles 2023-02-21 17:17:41 +01:00
Jan Eitzinger
33b20620ee
Merge branch 'master' into sql-repository-opt 2023-02-21 16:21:47 +01:00
999609a17a Add backend type and adopt cast expressions
Fixes #67
2023-02-21 15:22:05 +01:00
63f8555af7 Add migration support for mysql 2023-02-21 14:45:59 +01:00
d429327ce5 Fix unit test 2023-02-21 13:54:42 +01:00
42d3318125 Add documentation in README 2023-02-21 13:50:15 +01:00
5ff88e1701 Add routine names to sql query timer 2023-02-21 12:08:06 +01:00
a4f5b139f9 Remove hardcoded index generation 2023-02-21 11:36:23 +01:00
8ffb562d6b Introduce db migration support 2023-02-21 10:57:22 +01:00
643bd3fb21 Add timer calls to repository functions 2023-02-20 15:08:23 +01:00
Christoph Kluge
68efe871c7 Centralize project filter for manager role
- Remove all unnecessary frontend code for managerfilters
2023-02-20 11:24:18 +01:00
Christoph Kluge
09bcf9f355 Better implementation for querying multiple users 2023-02-20 10:20:08 +01:00
Christoph Kluge
397ab08b3b Add support for multiple projects per manager
- Handled like roles in admin view
- !! NEW COLUMN CHANGED TO "projects"
2023-02-17 15:45:31 +01:00
Christoph Kluge
bf6ec1bc98 Add search for user names, add names in user table
- Regenerated GraphQL due to new required query 'multiUser'
2023-02-17 10:45:27 +01:00
3b38d8042e Fix tests 2023-02-15 13:07:19 +01:00
033598a656 Remove loglevel notice 2023-02-15 11:50:51 +01:00
491baafd1d Add index. Formatting 2023-02-15 09:50:27 +01:00
51b2a7f30e Relocate JobStatistics from GraphQL resolver to JobRepository 2023-02-13 13:53:24 +01:00
aef821fa7e Add SQL hook for logging and timing 2023-02-13 13:52:17 +01:00
Christoph Kluge
728531946a
Merge branch 'master' into 26_improve_logmessages 2023-02-09 13:52:58 +01:00
Jan Eitzinger
180e9cb09d
Merge pull request #80 from ClusterCockpit/34-52-rework-searchbar
Merge Searchbar Rework
2023-02-09 11:38:02 +01:00
Christoph Kluge
641affbbdf Move /search code to routerConfig, add simple docs for searchbar 2023-02-09 10:11:11 +01:00
Christoph Kluge
94523150f5 Fix small typo 2023-02-01 15:46:50 +01:00
Christoph Kluge
a2ebebd7f6 Remove role label array from frontend
- made centralized role array uncentralized again
2023-02-01 14:49:10 +01:00
Christoph Kluge
ef1b2d7a81 Fix typo 2023-02-01 12:29:58 +01:00
Christoph Kluge
a885e69125 Adapt loglevel for logs, shorten strings, fix formats, streamline
- Switched to Warn for most errors, reduces bloat, improves log control
2023-02-01 11:58:27 +01:00
Christoph Kluge
b77bd078e5 Add log messages to error events w/o log message, primaryly error level
- "log spam" to be controlled via loglevel flag on startup
2023-01-31 18:28:44 +01:00
Christoph Kluge
7fb94c33cf Add API call for frontend to fetch list of valid roles from backend
- only relevant for admin config (addUser, editRole)
- admin only (double-checked)
2023-01-30 17:01:11 +01:00
Christoph Kluge
7d4f4ab2c8 Merge branch 'master' into 40_45_82_update_roles 2023-01-30 14:33:44 +01:00
Christoph Kluge
186c8f7311 Fix user display configrations not persisting in SQLite table
- Was missing user.username key
2023-01-30 14:33:12 +01:00
Christoph Kluge
dd5e0682a1 Fix test file, add suer table project column to test.db 2023-01-30 14:03:44 +01:00
Christoph Kluge
c4d91039e2 Add support role to tag count
- works equal to admin
2023-01-30 13:48:27 +01:00
Christoph Kluge
2590ce7e44 Adapt count tags for managers 2023-01-30 13:43:12 +01:00
Christoph Kluge
b2aed2f16b Add 'project' to user table, add 'manager' role, conditional web render
- Addresses issues #40 #45 #82
- Reworked Navigation Header for all roles
- 'Manager' role added, can be assigned a project-id in config by admins
- BREAKING! -> Added 'project' column in SQLite3 table 'user'
- Manager-Assigned project will be added to all graphql filters: Only show Jobs and Users of given project
- 'My Jobs' Tab for all Roles
- Switched from Bool "isAdmin" to integer authLevels
- Removed critical data frontend logging
- Reworked repo.query.SecurityCheck()
2023-01-27 18:36:58 +01:00
Christoph Kluge
834f9d9085 Add role helper functions, add project role barebone, add valid role arr
- HasAnyRoles([]string): Checks if user has *one* of the roles
- HasAllRoles([]string): Cheks if user has *all* of the roles
- HasNotRoles([]string): Checks if user has *none* of the roles
- IsValidRole(string): Checks if given string is known valid role
2023-01-25 16:59:16 +01:00
Christoph Kluge
25eb3bb481 Add missing dependency 2023-01-24 12:03:36 +01:00
Christoph Kluge
bd770d0e32 Fix return error, fix wrong log path, add notice log where applicable
- Adresses issue #26
2023-01-24 12:02:29 +01:00
Christoph Kluge
79a949b55e Rework pkg/log, add 'loglevel' and 'logdate' flags, streamline
- removes some previously added manual location strings: now handled by pkg/log depending on loglevel
- kept manual string locations on fmt print functions
- add 'notice' and 'critical' loglevels
- add 'Panic' and 'Panicf' functions to log panics
- adresses issue #26
2023-01-23 18:48:06 +01:00
Christoph Kluge
24a4244f19 add more information to existing errors logs and panics
- '$ROOT/$FILE' for better localization in the code
- add text where none was given
- fix unnecessary sprintf nesting in influxv2 and prometheus metricrepo logging
2023-01-19 16:59:14 +01:00
Christoph Kluge
1873c6a87d
Merge branch 'master' into 34-52-rework-searchbar 2023-01-13 09:58:56 +01:00
Christoph Kluge
b0cd88bba1
Merge pull request #77 from giesselmann/serial_archiving
archive jobs in single worker thread
2023-01-12 15:12:11 +01:00
Christoph Kluge
7998577076 Remove metadata from scanJob
- Leftover from initial jobName query implementation tryouts: unnecessary
2023-01-12 11:57:44 +01:00
Christoph Kluge
84a1c4bdaf fix wrong vartype for log 2023-01-12 11:34:21 +01:00
Christoph Kluge
bad3f9ea95 Makeover of searchbar, add "not found" results-redirects
- Tagged Search has priority
- Best guess search if no tag provided
- "Hard" errors only on searchtag-malformed or searchtag-unknown, or if best guess search fails
2023-01-12 11:26:01 +01:00
Christoph Kluge
a642e9cc7c Add working, but manually entered jobName url query 2023-01-11 16:25:02 +01:00
Christoph Kluge
c9ee8b552d Rework search to show jobId matches in table, add projectId search 2022-12-14 10:02:22 +01:00
Christoph Kluge
ac8548a950 Initial orientation 2022-12-13 09:53:37 +01:00
Pay Giesselmann
c4bdff2210 do not close channel on wait 2022-12-08 16:21:56 +01:00
Pay Giesselmann
a0f7a598ad archive jobs in single worker thread 2022-12-08 15:04:58 +01:00
Pay Giesselmann
c3749f0f36 add prometheus metricdata backend 2022-12-08 13:51:44 +01:00
Jan Eitzinger
ded5cda6ba
Merge pull request #75 from giesselmann/fix_remove_role_support
Fix remove role support
2022-11-30 14:49:56 +01:00
Jan Eitzinger
c7eaccd3b5
Merge pull request #73 from ClusterCockpit/feature-62-rest-endpoint-delete-jobs
Feature 62 rest endpoint delete jobs
Fix #62
2022-11-30 14:48:44 +01:00
Christoph Kluge
a39fc73345 Rerun swagger and fix typo 2022-11-30 12:40:07 +01:00
Pay Gießelmann
e5573a9b29
Fix remove role support 2022-11-30 11:46:32 +01:00
Jan Eitzinger
fd16a1b637 Fix cnt query scan. Cosmetic changes. 2022-11-25 15:15:05 +01:00
Pay Giesselmann
f736b7ff68 preserve job state in StopJob 2022-11-24 15:26:07 +01:00
Pay Giesselmann
e4a1422e05 secure addJob with mutex 2022-11-24 15:25:03 +01:00
Jan Eitzinger
948da8f10b Review Sagger config. Delete Job endpoints 2022-11-11 15:26:27 +01:00
Joachim Meyer
574d941c6c Upon start job, compare start time against all matching jobs.
For requeued jobs, we might have multiple jobs with matching cluster and job id, but differing start time. So check all of the matching ones against the start time.
2022-11-09 11:49:36 +01:00
Michael Schwarz
f817ac5240 Accept externally generated JWTs provided via cookie
If there is an external service like an AuthAPI that can generate JWTs and
  hand them over to ClusterCockpit via cookies, CC can be configured to
  accept them
2022-10-19 13:36:13 +02:00
Christoph Kluge
3867ea137b Update and regenerate graphQL for new unit type 2022-10-06 18:04:47 +02:00
Christoph Kluge
ec772f5aff Fix the fix
Note: Changes should be removed before merge - Fix to allow compilation only
2022-10-05 14:09:11 +02:00
Christoph Kluge
bb0f8a2905 Fix compilation
- Unit.Prefix prop used in assignement instead if Unit type
2022-10-05 11:16:43 +02:00
Christoph Kluge
74c50bd424 Merge branch 'import-data-sanitation' into 48_improve_status_view: Unit pkg update required for dev 2022-10-05 11:01:43 +02:00
Jan Eitzinger
29d215fcea Intermediate Save commit 2022-10-04 10:12:35 +02:00
Jan Eitzinger
7251344d4a Add convenience routines to unit package 2022-09-28 16:25:26 +02:00
Christoph Kluge
21b03d02b2 Swagger definition URL now based on config.json Addr field 2022-09-27 10:33:36 +02:00
Christoph Kluge
24f9d4f934 Add buildInfo to frontend footer 2022-09-27 09:56:17 +02:00
Jan Eitzinger
918a07735d
Merge branch 'master' into dev-job-archive-module 2022-09-26 15:12:46 +02:00
Jan Eitzinger
9ae7a813fa Restructure import job test due to db handle clash 2022-09-23 16:11:35 +02:00
Jan Eitzinger
5c715b6ec2 Add test for import job handler. Improve error messages. 2022-09-23 15:23:45 +02:00
Christoph Kluge
c9184a7575 Move identical parts of stopJob routines to new function
- No solution for two swagger doc annotations for one function (ie function handles two inputs) found
- Also: Delete handwritten openapi.yaml
2022-09-23 11:59:18 +02:00
Christoph Kluge
b96c515c2c Small additions to 'getJobs' API docs 2022-09-22 13:32:40 +02:00
Christoph Kluge
93713edcac Add '401 unauthorized' to api docs 2022-09-21 17:13:55 +02:00
Christoph Kluge
872bc77708 Add missing error codes to documentation, fix wrong success type 2022-09-21 17:03:01 +02:00
Christoph Kluge
6712b15034 Better represent 'exclusiveMinimum' from JSON schemata 2022-09-21 14:21:13 +02:00
Christoph Kluge
94c77d8a67 Small additions to swagger docs 2022-09-21 14:12:24 +02:00
Christoph Kluge
05a84cb95c Extend parsed swagger documentation by adding comments 2022-09-21 11:54:19 +02:00
Jan Eitzinger
35114aeb2d Cleanup. Fix failing test 2022-09-20 13:07:46 +02:00
Jan Eitzinger
e8d7722c42 Add json schema validation for config file 2022-09-19 16:16:05 +02:00
Christoph Kluge
9f9462496a Move swagger comment from TagJobApiRequest to Tag 2022-09-16 13:18:50 +02:00
Jan Eitzinger
24f374ed36 Fix API tag data type 2022-09-16 11:21:27 +02:00
Christoph Kluge
705f76fa3a Remove GitHub merge comment lines 2022-09-16 10:12:37 +02:00
Jan Eitzinger
6325f02ba2 Merge branch 'dev-job-archive-module' of github.com:ClusterCockpit/cc-backend into dev-job-archive-module 2022-09-16 06:28:07 +02:00
Jan Eitzinger
f1941b5e67 Reconfigure Swagger integration. Regenerate API docs 2022-09-16 06:09:55 +02:00
Christoph Kluge
922e94e835 Fix API data types, use unsecured router for /docs
- Note: Use /docs swagger playground without login
- Otherwise: Session User will be used which leads to role mismatch
2022-09-15 17:38:11 +02:00
Christoph Kluge
8e90c954ff First commit for swagger api documentation, not yet fully functional
- Problems with JWT auth (eg startJob fails with missing role)
- Manually fixed auto-parsing errors (missing api.TagJobApiRequest, wrong API @Description)
2022-09-15 12:37:44 +02:00
Jan Eitzinger
777f225e91 Add option for json validation 2022-09-13 15:22:20 +02:00
Jan Eitzinger
732801548f Enable caching for job metric data 2022-09-13 15:21:50 +02:00
Jan Eitzinger
520c814e3b Introduce import job flag 2022-09-13 15:20:07 +02:00
Jan Eitzinger
adc22f6bc1
Merge branch 'master' into config-component 2022-09-13 09:05:07 +02:00
Jan Eitzinger
d8aaa26c27 Cleanup and small fixes 2022-09-13 07:38:18 +02:00
Jan Eitzinger
00fc5f4774 Remove to set ArrayJobId on DB Init 2022-09-12 14:51:51 +02:00
Jan Eitzinger
cca0722b01 Remove obsolete variable 2022-09-12 14:46:18 +02:00
Jan Eitzinger
10c6b366a5 Refactor UserCfg, add test 2022-09-12 13:34:21 +02:00
Jan Eitzinger
c0daad256f Regenerate GraphQL Api. Remove FilterRanger 2022-09-12 13:33:01 +02:00
Jan Eitzinger
c64a935750 Cleanup and improve error handling 2022-09-11 07:13:08 +02:00
Christoph Kluge
802c10588f Completely replace outdated template config rendering
- Deleted respective old files
- Renamed new components
2022-09-09 15:27:00 +02:00
Jan Eitzinger
8856f26fb0 Reformat and Refactor packages. Rebuild GraphQL. 2022-09-07 12:24:45 +02:00
Jan Eitzinger
b7907d33aa Move data structures to config package 2022-09-06 15:43:57 +02:00
Jan Eitzinger
937e72954d Make api test pass and cleanup 2022-09-06 14:40:14 +02:00
Jan Eitzinger
fc76eed899 Refactor package structure
Builds but not tested
2022-09-05 17:46:38 +02:00
Christoph Kluge
c9954787c1 Add admin function to remove roles, rename addroles to editroles 2022-08-26 15:15:36 +02:00
Christoph Kluge
7bfdc83779 Initial commit on branch: Rewrite config.tmpl as svelte component(s) 2022-08-26 11:45:14 +02:00
Michael Schwarz
84bac7e520 Add new role support. This enables designated users to see all jobs. 2022-08-25 12:45:11 +02:00
Jan Eitzinger
26df1e7c14 Add copyright and license header. Update license year 2022-07-29 06:29:21 +02:00
Lou Knauer
aac19c938f Allow CORS credentials; cpu->hwthread for cc-metric-store 2022-07-28 18:07:30 +02:00
Lou Knauer
d4b1b32ca0 token based login: fix re-logins 2022-07-26 13:50:54 +02:00
Lou Knauer
dc0bf80742 Fix auth.AddUser method 2022-07-26 11:00:41 +02:00
Lou Knauer
dc4c7f0033 bugfix: LDAP is optional 2022-07-25 17:27:42 +02:00
Lou Knauer
e500c1515e Allow login via token in URL 2022-07-25 10:36:20 +02:00
Lou Knauer
a48e94ab3e bugfixes in auth/ 2022-07-25 09:33:36 +02:00
Lou Knauer
2d57e4cfe8 Change to HS256 as login token alg 2022-07-25 09:03:48 +02:00
Lou Knauer
f0530f2908 Different keypair for token based login 2022-07-13 15:04:11 +02:00
Lou Knauer
04574db32f Integrate new auth interface 2022-07-07 14:08:37 +02:00
Lou Knauer
db86d2cf7e Glue authenticators together 2022-07-07 13:40:38 +02:00
Lou Knauer
23f6015494 Add login via JWT 2022-07-07 12:48:04 +02:00
Lou Knauer
5041685df1 Refactor authentication 2022-07-07 12:11:49 +02:00
Lou Knauer
94017dc040 embed templates into binary (issue #2) 2022-07-06 15:00:08 +02:00
Lou Knauer
65f7e5e6c8 load config.json in current directory by default (issue #17) 2022-07-05 10:23:26 +02:00
Jan Eitzinger
29fe28fce6 Cleanup duplicate schema file 2022-06-22 15:29:38 +02:00
Jan Eitzinger
8446f6267a Use internal lrucache 2022-06-22 06:11:00 +02:00
Jan Eitzinger
81819db436 Refactor directory structure 2022-06-21 17:52:36 +02:00