Hao Liu
892410477a
Fix promote from release event ( #15215 )
2024-05-22 18:58:11 +00:00
Hao Liu
fc9064e27f
Allow wsrelay to fail without FATAL ( #15191 )
...
We have not identify the root cause of wsrelay failure but attempt to make wsrelay restart itself resulted in postgres and redis connection leak. We were not able to fully identify where the redis connection leak comes from so reverting back to failing and removing startsecs 30 will prevent wsrelay to FATAL
2024-05-20 23:34:12 +00:00
Hao Liu
a2f083bd8e
Fix podman failure in development environment ( #15188 )
...
```
ERRO[0000] path "/var/lib/awx/.config" exists and it is not owned by the current user
```
start to happen with podman 5
it seems that the config files are no longer needed removing it fixes the problem
2024-05-14 14:18:48 -04:00
Hao Liu
158314af50
Delete deprecated Cypress UI e2e_test.yml ( #15155 )
...
Delete e2e_test.yml
Remove because it's no longer being maintained
2024-04-29 12:58:10 -04:00
Hao Liu
e873bb1304
Fix wsrelay connection leak ( #15113 )
...
- when re-establishing connection to db close old connection
- re-initialize WebSocketRelayManager when restarting asyncio.run
- log and ignore error in cleanup_offline_host (this might come back to bite us)
- cleanup connection when WebSocketRelayManager crash
2024-04-16 14:54:36 -04:00
Hao Liu
e8a3b96482
Use latest awx-ee in devel CI ( #15098 )
2024-04-12 14:30:39 -04:00
Hao Liu
c015e8413e
Store molecule debug output to github artifacts ( #15107 )
...
Related to https://github.com/ansible/awx-operator/pull/1823
2024-04-12 13:56:25 -04:00
Hao Liu
8db3ffe719
Check galaxy collection with and without redirect
2024-04-10 11:26:42 -04:00
Hao Liu
86204cf23b
Publish amd64 and arm64 awx image on release ( #15053 )
...
* Stage multi-arch awx image
- change CI to use `make awx-kube-build` instead of build playbook
- update staging CI to build and push multiarch awx image
- update doc to use `make awx-kube-build` to build awx image
- remove build playbook (no longer used)
2024-04-09 09:50:09 -04:00
Hao Liu
7cdf1c7f96
Update DOCKER_COMPOSE command to docker compose ( #15056 )
...
* Update DOCKER_COMPOSE command
docker-compose will stop being supported soon and this is causing CI flake setting DOCKER_COMPOSE default to `docker compose`
* Give AWX network a static name
2024-04-02 15:13:14 -04:00
Hao Liu and Jeff Bradberry
d558204192
Make db password optional for wsrelay ( #15046 )
...
* Make db password optional for wsrelay
* Change DB setting copy to deepcopy
safer than copy()
Co-Authored-By: Jeff Bradberry <685957+jbradberry@users.noreply.github.com >
---------
Co-authored-by: Jeff Bradberry <685957+jbradberry@users.noreply.github.com >
2024-04-02 11:47:24 -04:00
Hao Liu
8cafdf0400
Fix wsrelay KeyboardInteruption not respected ( #15036 )
...
- stop wsrelay on keyboard interuption
- restart wsrelay for any other failure reason
2024-03-26 17:29:15 +00:00
Hao Liu
3f566c8737
Fix wsrelay not retry to establish db connection ( #15031 )
...
- run_wsrelay retry to run wsrelay forever with 10 second sleep
- wsrelay restart on`on_ws_heartbeat` task if fail to db connection goes away
2024-03-26 11:56:16 -04:00
Hao Liu
c8021a25bf
Fix keycloak doc ( #15024 )
2024-03-25 15:01:49 -04:00
Hao Liu
7150f5edc6
Editable dependencies in docker compose development environment ( #14979 )
...
* Editable dependencies in docker compose development environment
2024-03-19 15:09:15 -04:00
Hao Liu
93da15c0ee
Setting modification to address requests from UI_NEXT devs ( #14996 )
...
Modification to settings
- Add hidden to indicate to UI_NEXT to hide the field
- Add warning_text to indicate to UI_NEXT to display the warning when specific setting is modified
- Address some non required field being marked as required
2024-03-19 15:08:41 -04:00
Hao Liu
ab593bda45
Add setting for configuring optional URL prefix for /api ( #14939 )
...
* Add setting for configuring optional URL prefix for /api
Add OPTIONAL_API_URLPATTERN_PREFIX setting
examples:
- if set to `''` (empty string) API pattern will be `/api`
- if set to 'controller' API pattern will be `/api` AND `/api/controller`
2024-03-19 15:56:33 +00:00
Hao Liu and jessicamack
8ff7260bc6
Add dump_auth_config management cmd (for SAML and LDAP) ( #14947 )
...
* Add dump_auth_config management cmd
- Dump SAML config from AWX to DAB authenticator config in json format
* Add dumping of LDAP settings
* add test for command
* Fix is_enabled
* fix command name typo
Co-authored-by: Hao Liu <44379968+TheRealHaoLiu@users.noreply.github.com >
* add fields to config, add name to data
* break out IDP values
* change test fields and value comparison
* edit help text, reformat settings
---------
Co-authored-by: jessicamack <jmack@redhat.com >
2024-03-15 13:47:30 -04:00
Hao Liu
a635445082
Fix failing bulk launch job due to create partition race
...
https://github.com/ansible/awx/pull/14910/files
introduced a bug where we no longer accept the right exceptions
when 2 job launch at the sametime and try to create jobevent table partition 1 of the job will fail
2024-03-15 10:10:38 -04:00
Hao Liu
949e7efab1
Fix wsrelay hanging after db outage
...
TCP keepalive settings was moved out from settings.DATABASE to settings.LISTENER_DATABASES and it's not longer being respected by wsrelay
2024-03-14 15:51:30 -04:00
Hao Liu
615f09226f
Fix awx-manage run_wsrelay --status ( #14997 )
...
by don't start the metrics server if --status is passed in
2024-03-14 18:55:05 +00:00
Hao Liu
dfab342bb4
Skip replicas test for awx-operator ( #14987 )
...
speed up CI, also AWX code change won't effect that test
2024-03-13 18:01:02 +00:00
Hao Liu
dd9160135d
Prune dangle image periodically ( #14957 )
...
Prune dangle image periodically
pairs with https://github.com/ansible/ansible-runner/pull/1342
this fix the problem of us forcefully remove images when setting changing ee image that's being used in a job causing the job to fail
2024-03-12 10:57:57 -04:00
Hao Liu
b076cb00a9
Revert "Implement project pulling from Azure DevOps using Service Pri… ( #14977 )
...
Revert "Implement project pulling from Azure DevOps using Service Principals (#14628 )"
This reverts commit 2e2cd7f2de .
2024-03-11 14:05:24 +00:00
Hao Liu
3f2f7b75a6
[developer productivity improvement] Running awx components in vscode debugger ( #14942 )
...
Enable VSCode debugger integration when attaching VSCode to with AWX docker-compose development environment container
- add debugpy launch target in `.vscode/launch.json` to enable launching awx processes with debugpy
- add vscode tasks in `.vscode/tasks.json` to facilitate shutting down corresponding supervisord managed processes while launching process with debugpy
- modify nginx conf to add django runserver as fallback to uwsgi (enable launching API server via debugpy)
2024-03-07 19:31:50 +00:00
Hao Liu
eb300252b8
Fix awx-autoreload in dev environment ( #14968 )
...
Fix awx-autoreload, recent change made autoreload no longer take the command parameter
2024-03-07 16:33:23 +00:00
Hao Liu
727278aaa3
Add pip>=21.3 to dev requirement to install django-ansible-base in editable mode ( #14961 )
...
Add pip>=21.3 to dev requirement required for installing django-ansible-base in editable mode
https://peps.python.org/pep-0660/
PEP 660 – Editable installs for pyproject.toml based builds (wheel based)
2024-03-06 21:28:41 -05:00
Hao Liu
1b56d94d30
In development environment not auto-reload explicitly STOPPED processes ( #14958 )
...
Not auto-reload explicitly STOPPED processes
In development/debug workflow sometime we explicitly STOP processes this will make sure auto-reload does not start them back up
2024-03-06 20:22:44 +00:00
Hao Liu
b7b7bfa520
Fix test that fail on rerun due to expecting exact IDs ( #14943 )
...
Fix test that fail on rerun
due to expecting exact IDs
2024-03-01 12:37:17 -05:00
Hao Liu
ec28eff7f7
Convert swagger release fixture to env var ( #14940 )
...
`pytest awx/main/tests/docs --release=$(VERSION_TARGET)`
where --release is required breaks test discovery and running in vscode (from within the container)
2024-02-29 14:55:02 -05:00
Hao Liu
237adc6150
Publish multi-arch versioned awx-ee
...
dependent on https://github.com/ansible/awx-ee/pull/235
2024-02-27 08:21:51 +00:00
Hao Liu
09b028ee3c
Publish multi-arch manifest of awx ( #14929 )
...
Promote multi-arch awx manifest
2024-02-26 17:05:57 -05:00
Hao Liu
fb83bfbc31
Fix ui_next banner ( #14928 )
2024-02-26 14:20:42 -05:00
Hao Liu
88e406e121
Fix CVEs and bump receptorctl ( #14925 )
...
CVE-2023-47627
CVE-2023-49083
CVE-2023-41040
CVE-2024-22195
CVE-2023-46137
2024-02-26 15:48:38 +00:00
Hao Liu and Alan Rominger
3fb3125bc3
Send QUIT to worker before dying ( #14913 )
...
Fix deadlock scenario where dispatcher child process stuck in reading from queue loop after dispatcher parent process decided to quit
Co-authored-by: Alan Rominger <arominge@redhat.com >
2024-02-21 16:08:43 -05:00
Hao Liu
7caca60308
Multi-arch build for AWX images in ghcr.io ( #14899 )
...
build amd64 and ARM image for
- awx
- awx_devel
- awx_kube_devel
2024-02-20 17:17:31 -05:00
Hao Liu and Rick Elrod
0bdb01a9e9
Allow dev image to build on fork ( #14898 )
...
* Allow dev image to build on fork
Fix uppercase repo owner error in CI
example
```
Run docker pull ghcr.io/TheRealHaoLiu/awx_devel:devel
docker pull ghcr.io/TheRealHaoLiu/awx_devel:devel
shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
env:
LC_ALL: C.UTF-8
CI_GITHUB_TOKEN: ***
DEV_DOCKER_OWNER: TheRealHaoLiu
COMPOSE_TAG: devel
py_version: 3
invalid reference format: repository name must be lowercase
```
---------
Co-authored-by: Rick Elrod <rick@elrod.me >
2024-02-19 16:19:59 +00:00
Hao Liu
decff01fa4
Update command for sos-report
...
wsbroadcast has been renamed to wsrelay
2024-02-15 12:32:05 +00:00
Hao Liu
b0565e9937
Switch to docker_compose_v2 in tools playbook ( #14872 )
...
Switch to docker_compose_v2
Fix
```
"Configuration error - kwargs_from_env() got an unexpected keyword argument 'ssl_version'"}
```
2024-02-13 13:05:33 -05:00
Hao Liu
44d85b589c
Retries on vault on seal ( #14873 )
...
Sometime we tried to unseal when vault is not ready yet
2024-02-13 13:05:23 -05:00
Hao Liu
4b637c1319
gitignore pyenv python-version file
...
pyenv local can be use to set directory specific python version in `.python-version` file in the directory
Signed-off-by: Hao Liu <44379968+TheRealHaoLiu@users.noreply.github.com >
2024-02-13 12:00:57 +00:00
Hao Liu
30d4df788f
Update dependency django-ansible-base ( #14752 )
2024-01-10 11:05:57 -05:00
Hao Liu
bf42c63c12
Remove superwatcher from docker-compose dev ( #14708 )
...
When making changes to the application sometime you can accidentally cause FATAL state and cause the dev container to crash which will remove any ephemeral changes that you have made and is ANNOYING!
2023-12-13 14:26:53 -05:00
Hao Liu and John Barker
478e2cb28d
Fix awx collection publishing on galaxy ( #14642 )
...
--location (-L) parameter will prompt curl to submit a new request if the URL is a redirect.
After moving to galaxy-NG without -L the curl falsely return 302 for any version
Co-authored-by: John Barker <john@johnrbarker.com >
2023-11-29 20:28:22 +00:00
Hao Liu
ec364cc60e
Make vault init more idempotent ( #14664 )
...
Currently if you cleanup docker volume for vault and bring docker-compose development back up with vault enabled we will not initialize vault because the secret files still exist.
This change will attempt to initialize vault reguardless and update the secret file if vault is initialized
2023-11-16 09:43:45 -06:00
Hao Liu
f4c53aaf22
Update receptor-collection version to 2.0.2 ( #14613 )
2023-10-30 17:24:02 +00:00
Hao Liu
20f5b255c9
Fix "upgrade in progress" status page not showing up while migration is in progress ( #14579 )
...
Web container does not need to wait for migration
if the database is running and responsive, but migrations have not finished, it will start serving, and users will get the upgrading page
wait-for-migration prevent nginix and uwsgi from starting up to serve the "upgrade in progress" status page
2023-10-24 14:27:09 -04:00
Hao Liu
bcefcd8cf8
Remove specific version for receptorctl ( #14593 )
2023-10-19 22:49:42 -04:00
Hao Liu
376993077a
Removing mailing list from get involved ( #14580 )
2023-10-13 17:49:34 +00:00
Hao Liu
48f586bac4
Make wait-for-migrations wait forever ( #14566 )
2023-10-13 13:48:12 +00:00
Hao Liu
e9bd99c1ff
Fix CVE-2023-43665 ( #14561 )
2023-10-12 14:00:32 -04:00
Hao Liu and Alan Rominger
bb3acbb8ad
Debug log for scheduler commit duration ( #14035 )
...
Co-authored-by: Alan Rominger <arominge@redhat.com >
2023-09-27 09:46:55 -04:00
Hao Liu
a88e47930c
Update django version to address CVE-2023-41164 ( #14460 )
2023-09-27 09:36:02 -04:00
Hao Liu
a0d4515ba4
Explicitly set collection version during promotion ( #14484 )
2023-09-26 14:19:22 -04:00
Hao Liu
a290b082db
Use ldap container hostname for LDAP config ( #14473 )
2023-09-21 11:31:51 -04:00
Hao Liu
6d3c22e801
Update how to get involved with matrix and forum ( #14472 )
2023-09-20 18:33:04 +00:00
Hao Liu and Rick Elrod
7b846e1e49
Add makefile target to load dev image into Kind ( #13775 )
...
Signed-off-by: Rick Elrod <rick@elrod.me >
Co-authored-by: Rick Elrod <rick@elrod.me >
2023-09-19 13:34:10 -04:00
Hao Liu
ffa59864ee
Fix CVE-2023-40267 ( #14388 )
...
CVE-2023-40267 GitPython: Insecure non-multi options in clone and clone_from is not blocked https://bugzilla.redhat.com/show_bug.cgi?id=2231474
GitPython before 3.1.32 does not block insecure non-multi options in clone and clone_from. NOTE: this issue exists because of an incomplete fix for CVE-2022-24439.
References:
gitpython-developers/GitPython@ca965ec gitpython-developers/GitPython#1609
2023-08-28 15:35:32 -04:00
Hao Liu
7e7a9f541c
Remove install bundle download restriction ( #14092 )
2023-06-12 16:08:44 -04:00
Hao Liu
b96564da55
Rename/relocate receptor cert and keys ( #14091 )
2023-06-09 12:57:04 -04:00
Hao Liu
00d8291d40
Change logging setting for task analytic scheduler ( #14031 )
2023-05-23 13:01:12 -04:00
Hao Liu
f61b73010a
Merge pull request #13889 from TheRealHaoLiu/egg-liminate
...
Remove unnecessary egg-link linking
2023-04-19 17:12:28 -04:00
Hao Liu
3e509b3d55
Merge pull request #13883 from ZitaNemeckova/remove_inventories_from_host_metrics
...
Remove Inventories column for now
2023-04-19 15:41:32 -04:00
Hao Liu
f0badea9d3
Merge pull request #13888 from TheRealHaoLiu/correct-make-call-make
...
Make target should not call make directly
2023-04-19 15:38:58 -04:00
Hao Liu
6a1ec0dc89
Merge pull request #13887 from TheRealHaoLiu/no-make-run-stuff-in-docker-compose
...
Stop using make to start awx processes part 1
2023-04-19 15:35:32 -04:00
Hao Liu
33f1c35292
Merge pull request #13658 from TheRealHaoLiu/different-dockerfile
...
Use different dockerfile for docker-compose-build
2023-04-19 12:12:54 -04:00
Hao Liu
ba899324f2
Merge pull request #13856 from TheRealHaoLiu/kube-dev-autoreload
...
Auto reload services in kube dev env
2023-04-19 12:08:52 -04:00
Hao Liu
9c236eb8dd
Merge pull request #13882 from TheRealHaoLiu/link-launch-n-supervisord
...
Link launch script and supervisor conf in kube dev
2023-04-19 12:03:22 -04:00
Hao Liu
7a4b3ed139
Merge pull request #13881 from TheRealHaoLiu/fix-copy
...
Fix copy API
2023-04-19 09:39:39 -04:00
Hao Liu
b75b84e282
Merge pull request #13725 from l3acon/collection-existential-state-for-credential-module
...
[collection] Add "exists" state for credential module
2023-04-18 20:51:14 -04:00
Hao Liu
12a4c301b8
Merge pull request #13721 from sscheib-rh/feat-add_secret_field_dsv_lookup
...
Add missing filtering mechanism for the Thycotic Devops Vault credential lookup
2023-04-13 08:58:59 -04:00
Hao Liu
8a1cdf859e
Merge pull request #12627 from vician/tss-domain
...
Added domain entry and authorizer for TSS
2023-04-12 16:33:46 -04:00
Hao Liu
b80d0ae85b
Merge pull request #13840 from AlanCoding/one_less_connection
...
Get rid of 1 perpetually unused connection in our app
2023-04-12 09:30:51 -04:00
Hao Liu
1c0142f75c
Merge pull request #13841 from AlanCoding/tower_processes
...
Add run-clear-cache to tower-processes for auto-reload
2023-04-12 08:54:34 -04:00
Hao Liu
1a56272eaf
Merge pull request #13767 from Ladas/analytics_export_subscription_id
...
Analytics export other subs attrs
2023-04-11 15:55:26 -04:00
Hao Liu
80ebe13841
Merge pull request #13825 from TheRealHaoLiu/fix-dependency-conflict
...
Fix importlib-metadata dependency conflict
2023-04-07 13:17:49 -04:00
Hao Liu
c0491a7b10
Merge pull request #13816 from TheRealHaoLiu/workaround-failed-make-requirements_awx
...
Temporary workaround for make requirements_awx failure and fix license test
2023-04-07 00:07:13 -04:00
Hao Liu
c9c150b5a6
Merge pull request #13799 from TheRealHaoLiu/fix-supervisor-conf-file
...
Fix supervisor conf file inconsistancy
2023-04-05 11:07:05 -04:00
Hao Liu
f97605430b
Merge pull request #13804 from TheRealHaoLiu/heartbeet-logging
...
Add log handler and file for heartbeet
2023-04-05 11:06:32 -04:00
Hao Liu
acb22f0131
Merge pull request #13423 from ansible/feature_web-task-split
...
Allow web and task container to be deployed in separate deployment on Kubernetes
2023-03-30 12:52:22 -04:00
Hao Liu
d33573b29c
Merge pull request #13603 from jjwatt/jjwatt-fix-clean-languages
2023-03-29 22:49:13 -04:00
Hao Liu
38cc193aea
update permission to launch_awx_rsyslog.sh permission to +x ( #13399 )
...
Signed-off-by: Hao Liu <haoli@redhat.com >
2023-03-29 22:04:43 -04:00
Hao Liu
7f085e159f
Merge pull request #13712 from ansible/feature_usage-collection
...
Allow soft deletion of HostMetrics and add usage collection utility
2023-03-28 12:16:02 -04:00
Hao Liu
4bf8366687
Merge pull request #13743 from TheRealHaoLiu/ui-next-non-phony
...
Turn ui-next make targets non-PHONY
2023-03-22 21:05:18 -04:00
Hao Liu
6908f415a1
Merge pull request #13660 from ansible/feature_ui-next
...
Introducing tech preview of the new AWX UI
2023-03-21 14:09:47 -04:00
Hao Liu
a24aaba6bc
Merge pull request #13663 from slemrmartin/fix-analytics-collectors
...
Fix analytics collector
2023-03-08 12:03:16 -05:00
Hao Liu
7cca6c4cd9
Merge pull request #13656 from TheRealHaoLiu/feature-branch-build
...
Automatically build image for feature branch
2023-03-07 16:53:55 -05:00
Hao Liu
252b0dda9f
Merge pull request #13633 from TheRealHaoLiu/phony-dockerfile
...
[fix] Dockerfile collision between awx-kube-build and docker-compose-build
2023-03-07 15:42:58 -05:00
Hao Liu
f0c967c1b2
Merge pull request #13645 from TheRealHaoLiu/fix-websocket
...
Revert "Remove trailing $ from websocket_urlpatterns to work with cus…
2023-03-02 21:36:21 -05:00
Hao Liu
a47cfc55ab
Merge pull request #13574 from tomsiewert/use-compose-plugin
...
Make docker-compose command configurable in Makefile
2023-03-01 15:41:33 -05:00
Hao Liu
0eb9de02f3
Merge pull request #13627 from infamousjoeg/fix-13597-webservice_id-default
...
Fixes #13597 webservice_id default value added
2023-03-01 15:29:53 -05:00
Hao Liu
c2df22e0f0
Merge pull request #13632 from TheRealHaoLiu/reshaving-the-yak
...
[chore] update project_update playbook to be compliant with ansible-lint
2023-02-28 13:17:45 -05:00
Hao Liu
2902b40084
Merge pull request #13623 from TheRealHaoLiu/revert-project-update-playbook
...
Revert project_update.yml
2023-02-27 08:47:24 -05:00
Hao Liu
d088d36448
Merge pull request #13618 from TheRealHaoLiu/head-to-tail
...
[fix] switch from head to tail in project update playbook when clearing project dir
2023-02-23 11:13:03 -05:00
Hao Liu
283adc30a8
Merge pull request #13526 from TheRealHaoLiu/project_update_playbook_lint
...
[chore] Update project_update playbook to be compliant with ansible-lint
2023-02-22 21:39:42 -05:00
Hao Liu
35e5610642
Merge pull request #13615 from TheRealHaoLiu/update-kind-devel-doc
...
update kind development environment instruction
2023-02-22 19:25:03 -05:00
Hao Liu
46ea031566
Merge pull request #13539 from gamuniz/fix_dependent_schedule_export
...
[fix] adding Schedule to dependent_export to allow previous behavior on job template export
2023-02-08 17:04:35 -05:00
Hao Liu
058ae132cf
Merge pull request #13489 from gamuniz/add_management_command
...
adding new management command to allow failsafe enabling of local auth
2023-01-31 13:52:10 -05:00
Hao Liu
6483575437
Merge pull request #13379 from OscarBell/issue_13377
...
Fix verbosity parameter choices for ad_hoc_command module
2023-01-31 13:21:27 -05:00
Hao Liu
a15a23c1d3
Merge pull request #13483 from mahaffey/cli-add-order-by
...
add '--order_by' option to awx CLI
2023-01-31 13:13:52 -05:00