External-Mirrors/awx
2
0
Fork 0
mirror of https://github.com/ansible/awx.git synced 2026-09-16 08:50:10 -02:30
Code Issues Packages Projects Releases Wiki Activity
33,957 Commits 65 Branches 102 Tags
e4646ae611dec3cc5ddee3a76330f8c87d7ec569
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Hao Liu e873bb1304 Fix wsrelay connection leak (#15113) 
- when re-establishing connection to db close old connection
- re-initialize WebSocketRelayManager when restarting asyncio.run
- log and ignore error in cleanup_offline_host (this might come back to bite us)
- cleanup connection when WebSocketRelayManager crash
 2024-04-16 14:54:36 -04:00
Hao Liu e8a3b96482 Use latest awx-ee in devel CI (#15098) 2024-04-12 14:30:39 -04:00
Hao Liu c015e8413e Store molecule debug output to github artifacts (#15107) 
Related to https://github.com/ansible/awx-operator/pull/1823
 2024-04-12 13:56:25 -04:00
Hao Liu 8db3ffe719 Check galaxy collection with and without redirect 2024-04-10 11:26:42 -04:00
Hao Liu 86204cf23b Publish amd64 and arm64 awx image on release (#15053) 
* Stage multi-arch awx image

- change CI to use `make awx-kube-build` instead of build playbook
- update staging CI to build and push multiarch awx image
- update doc to use `make awx-kube-build` to build awx image
- remove build playbook (no longer used)
 2024-04-09 09:50:09 -04:00
Hao Liu 7cdf1c7f96 Update DOCKER_COMPOSE command to docker compose (#15056) 
* Update DOCKER_COMPOSE command

docker-compose will stop being supported soon and this is causing CI flake setting DOCKER_COMPOSE default to `docker compose`

* Give AWX network a static name
 2024-04-02 15:13:14 -04:00
Hao LiuandJeff Bradberry d558204192 Make db password optional for wsrelay (#15046) 
* Make db password optional for wsrelay

* Change DB setting copy to deepcopy

safer than copy()

Co-Authored-By: Jeff Bradberry <685957+jbradberry@users.noreply.github.com>

---------

Co-authored-by: Jeff Bradberry <685957+jbradberry@users.noreply.github.com>
 2024-04-02 11:47:24 -04:00
Hao Liu 8cafdf0400 Fix wsrelay KeyboardInteruption not respected (#15036) 
- stop wsrelay on keyboard interuption
- restart wsrelay for any other failure reason
 2024-03-26 17:29:15 +00:00
Hao Liu 3f566c8737 Fix wsrelay not retry to establish db connection (#15031) 
- run_wsrelay retry to run wsrelay forever with 10 second sleep
- wsrelay restart on`on_ws_heartbeat` task if fail to db connection goes away
 2024-03-26 11:56:16 -04:00
Hao Liu c8021a25bf Fix keycloak doc (#15024) 2024-03-25 15:01:49 -04:00
Hao Liu 7150f5edc6 Editable dependencies in docker compose development environment (#14979) 
* Editable dependencies in docker compose development environment
 2024-03-19 15:09:15 -04:00
Hao Liu 93da15c0ee Setting modification to address requests from UI_NEXT devs (#14996) 
Modification to settings

- Add hidden to indicate to UI_NEXT to hide the field
- Add warning_text to indicate to UI_NEXT to display the warning when specific setting is modified
- Address some non required field being marked as required
 2024-03-19 15:08:41 -04:00
Hao Liu ab593bda45 Add setting for configuring optional URL prefix for /api (#14939) 
* Add setting for configuring optional URL prefix for /api

Add OPTIONAL_API_URLPATTERN_PREFIX setting

examples:
- if set to `''` (empty string) API pattern will be `/api`
- if set to 'controller' API pattern will be `/api` AND `/api/controller`
 2024-03-19 15:56:33 +00:00
Hao Liuandjessicamack 8ff7260bc6 Add dump_auth_config management cmd (for SAML and LDAP) (#14947) 
* Add dump_auth_config management cmd

- Dump SAML config from AWX to DAB authenticator config in json format

* Add dumping of LDAP settings

* add test for command

* Fix is_enabled

* fix command name typo

Co-authored-by: Hao Liu <44379968+TheRealHaoLiu@users.noreply.github.com>

* add fields to config, add name to data

* break out IDP values

* change test fields and value comparison

* edit help text, reformat settings

---------

Co-authored-by: jessicamack <jmack@redhat.com>
 2024-03-15 13:47:30 -04:00
Hao Liu a635445082 Fix failing bulk launch job due to create partition race 
https://github.com/ansible/awx/pull/14910/files

introduced a bug where we no longer accept the right exceptions

when 2 job launch at the sametime and try to create jobevent table partition 1 of the job will fail
 2024-03-15 10:10:38 -04:00
Hao Liu 949e7efab1 Fix wsrelay hanging after db outage 
TCP keepalive settings was moved out from settings.DATABASE to settings.LISTENER_DATABASES and it's not longer being respected by wsrelay
 2024-03-14 15:51:30 -04:00
Hao Liu 615f09226f Fix awx-manage run_wsrelay --status (#14997) 
by don't start the metrics server if --status is passed in
 2024-03-14 18:55:05 +00:00
Hao Liu dfab342bb4 Skip replicas test for awx-operator (#14987) 
speed up CI, also AWX code change won't effect that test
 2024-03-13 18:01:02 +00:00
Hao Liu dd9160135d Prune dangle image periodically (#14957) 
Prune dangle image periodically

pairs with https://github.com/ansible/ansible-runner/pull/1342

this fix the problem of us forcefully remove images when setting changing ee image that's being used in a job causing the job to fail
 2024-03-12 10:57:57 -04:00
Hao Liu b076cb00a9 Revert "Implement project pulling from Azure DevOps using Service Pri… (#14977) 
Revert "Implement project pulling from Azure DevOps using Service Principals (#14628)"

This reverts commit 2e2cd7f2de.
 2024-03-11 14:05:24 +00:00
Hao Liu 3f2f7b75a6 [developer productivity improvement] Running awx components in vscode debugger (#14942) 
Enable VSCode debugger integration when attaching VSCode to with AWX docker-compose development environment container

- add debugpy launch target in `.vscode/launch.json` to enable launching awx processes with debugpy
- add vscode tasks in `.vscode/tasks.json` to facilitate shutting down corresponding supervisord managed processes while launching process with debugpy
- modify nginx conf to add django runserver as fallback to uwsgi (enable launching API server via debugpy)
 2024-03-07 19:31:50 +00:00
Hao Liu eb300252b8 Fix awx-autoreload in dev environment (#14968) 
Fix awx-autoreload, recent change made autoreload no longer take the command parameter
 2024-03-07 16:33:23 +00:00
Hao Liu 727278aaa3 Add pip>=21.3 to dev requirement to install django-ansible-base in editable mode (#14961) 
Add  pip>=21.3 to dev requirement required for installing django-ansible-base in editable mode

https://peps.python.org/pep-0660/

PEP 660 – Editable installs for pyproject.toml based builds (wheel based)
 2024-03-06 21:28:41 -05:00
Hao Liu 1b56d94d30 In development environment not auto-reload explicitly STOPPED processes (#14958) 
Not auto-reload explicitly STOPPED processes

In development/debug workflow sometime we explicitly STOP processes this will make sure auto-reload does not start them back up
 2024-03-06 20:22:44 +00:00
Hao Liu b7b7bfa520 Fix test that fail on rerun due to expecting exact IDs (#14943) 
Fix test that fail on rerun

due to expecting exact IDs
 2024-03-01 12:37:17 -05:00
Hao Liu ec28eff7f7 Convert swagger release fixture to env var (#14940) 
`pytest awx/main/tests/docs --release=$(VERSION_TARGET)`
where --release is required breaks test discovery and running in vscode (from within the container)
 2024-02-29 14:55:02 -05:00
Hao Liu 237adc6150 Publish multi-arch versioned awx-ee 
dependent on https://github.com/ansible/awx-ee/pull/235
 2024-02-27 08:21:51 +00:00
Hao Liu 09b028ee3c Publish multi-arch manifest of awx (#14929) 
Promote multi-arch awx manifest
 2024-02-26 17:05:57 -05:00
Hao Liu fb83bfbc31 Fix ui_next banner (#14928) 2024-02-26 14:20:42 -05:00
Hao Liu 88e406e121 Fix CVEs and bump receptorctl (#14925) 
CVE-2023-47627
CVE-2023-49083
CVE-2023-41040
CVE-2024-22195
CVE-2023-46137
 2024-02-26 15:48:38 +00:00
Hao LiuandAlan Rominger 3fb3125bc3 Send QUIT to worker before dying (#14913) 
Fix deadlock scenario where dispatcher child process stuck in reading from queue loop after dispatcher parent process decided to quit

Co-authored-by: Alan Rominger <arominge@redhat.com>
 2024-02-21 16:08:43 -05:00
Hao Liu 7caca60308 Multi-arch build for AWX images in ghcr.io (#14899) 
build amd64 and ARM image for
- awx
- awx_devel
- awx_kube_devel
 2024-02-20 17:17:31 -05:00
Hao LiuandRick Elrod 0bdb01a9e9 Allow dev image to build on fork (#14898) 
* Allow dev image to build on fork

Fix uppercase repo owner error in CI
example
```
Run docker pull ghcr.io/TheRealHaoLiu/awx_devel:devel
  docker pull ghcr.io/TheRealHaoLiu/awx_devel:devel
  shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0}
  env:
    LC_ALL: C.UTF-8
    CI_GITHUB_TOKEN: ***
    DEV_DOCKER_OWNER: TheRealHaoLiu
    COMPOSE_TAG: devel
    py_version: 3
invalid reference format: repository name must be lowercase
```

---------

Co-authored-by: Rick Elrod <rick@elrod.me>
 2024-02-19 16:19:59 +00:00
Hao Liu decff01fa4 Update command for sos-report 
wsbroadcast has been renamed to wsrelay
 2024-02-15 12:32:05 +00:00
Hao Liu b0565e9937 Switch to docker_compose_v2 in tools playbook (#14872) 
Switch to docker_compose_v2

Fix
```
"Configuration error - kwargs_from_env() got an unexpected keyword argument 'ssl_version'"}
```
 2024-02-13 13:05:33 -05:00
Hao Liu 44d85b589c Retries on vault on seal (#14873) 
Sometime we tried to unseal when vault is not ready yet
 2024-02-13 13:05:23 -05:00
Hao Liu 4b637c1319 gitignore pyenv python-version file 
pyenv local can be use to set directory specific python version in `.python-version` file in the directory

Signed-off-by: Hao Liu <44379968+TheRealHaoLiu@users.noreply.github.com>
 2024-02-13 12:00:57 +00:00
Hao Liu 30d4df788f Update dependency django-ansible-base (#14752) 2024-01-10 11:05:57 -05:00
Hao Liu bf42c63c12 Remove superwatcher from docker-compose dev (#14708) 
When making changes to the application sometime you can accidentally cause FATAL state and cause the dev container to crash which will remove any ephemeral changes that you have made and is ANNOYING!
 2023-12-13 14:26:53 -05:00
Hao LiuandJohn Barker 478e2cb28d Fix awx collection publishing on galaxy (#14642) 
--location (-L) parameter will prompt curl to submit a new request if the URL is a redirect.

After moving to galaxy-NG without -L the curl falsely return 302 for any version

Co-authored-by: John Barker <john@johnrbarker.com>
 2023-11-29 20:28:22 +00:00
Hao Liu ec364cc60e Make vault init more idempotent (#14664) 
Currently if you cleanup docker volume for vault and bring docker-compose development back up with vault enabled we will not initialize vault because the secret files still exist.

This change will attempt to initialize vault reguardless and update the secret file if vault is initialized
 2023-11-16 09:43:45 -06:00
Hao Liu f4c53aaf22 Update receptor-collection version to 2.0.2 (#14613) 2023-10-30 17:24:02 +00:00
Hao Liu 20f5b255c9 Fix "upgrade in progress" status page not showing up while migration is in progress (#14579) 
Web container does not need to wait for migration

if the database is running and responsive, but migrations have not finished, it will start serving, and users will get the upgrading page

wait-for-migration prevent nginix and uwsgi from starting up to serve the "upgrade in progress" status page
 2023-10-24 14:27:09 -04:00
Hao Liu bcefcd8cf8 Remove specific version for receptorctl (#14593) 2023-10-19 22:49:42 -04:00
Hao Liu 376993077a Removing mailing list from get involved (#14580) 2023-10-13 17:49:34 +00:00
Hao Liu 48f586bac4 Make wait-for-migrations wait forever (#14566) 2023-10-13 13:48:12 +00:00
Hao Liu e9bd99c1ff Fix CVE-2023-43665 (#14561) 2023-10-12 14:00:32 -04:00
Hao LiuandAlan Rominger bb3acbb8ad Debug log for scheduler commit duration (#14035) 
Co-authored-by: Alan Rominger <arominge@redhat.com>
 2023-09-27 09:46:55 -04:00
Hao Liu a88e47930c Update django version to address CVE-2023-41164 (#14460) 2023-09-27 09:36:02 -04:00
Hao Liu a0d4515ba4 Explicitly set collection version during promotion (#14484) 2023-09-26 14:19:22 -04:00
Hao Liu a290b082db Use ldap container hostname for LDAP config (#14473) 2023-09-21 11:31:51 -04:00
Hao Liu 6d3c22e801 Update how to get involved with matrix and forum (#14472) 2023-09-20 18:33:04 +00:00
Hao LiuandRick Elrod 7b846e1e49 Add makefile target to load dev image into Kind (#13775) 
Signed-off-by: Rick Elrod <rick@elrod.me>
Co-authored-by: Rick Elrod <rick@elrod.me>
 2023-09-19 13:34:10 -04:00
Hao Liu ffa59864ee Fix CVE-2023-40267 (#14388) 
CVE-2023-40267 GitPython: Insecure non-multi options in clone and clone_from is not blocked https://bugzilla.redhat.com/show_bug.cgi?id=2231474

GitPython before 3.1.32 does not block insecure non-multi options in clone and clone_from. NOTE: this issue exists because of an incomplete fix for CVE-2022-24439.

References:
gitpython-developers/GitPython@ca965ec gitpython-developers/GitPython#1609
 2023-08-28 15:35:32 -04:00
Hao Liu 7e7a9f541c Remove install bundle download restriction (#14092) 2023-06-12 16:08:44 -04:00
Hao Liu b96564da55 Rename/relocate receptor cert and keys (#14091) 2023-06-09 12:57:04 -04:00
Hao Liu 00d8291d40 Change logging setting for task analytic scheduler (#14031) 2023-05-23 13:01:12 -04:00
Hao Liu f61b73010a Merge pull request #13889 from TheRealHaoLiu/egg-liminate 
Remove unnecessary egg-link linking
 2023-04-19 17:12:28 -04:00
Hao Liu 3e509b3d55 Merge pull request #13883 from ZitaNemeckova/remove_inventories_from_host_metrics 
Remove Inventories column for now
 2023-04-19 15:41:32 -04:00
Hao Liu f0badea9d3 Merge pull request #13888 from TheRealHaoLiu/correct-make-call-make 
Make target should not call make directly
 2023-04-19 15:38:58 -04:00
Hao Liu 6a1ec0dc89 Merge pull request #13887 from TheRealHaoLiu/no-make-run-stuff-in-docker-compose 
Stop using make to start awx processes part 1
 2023-04-19 15:35:32 -04:00
Hao Liu 33f1c35292 Merge pull request #13658 from TheRealHaoLiu/different-dockerfile 
Use different dockerfile for docker-compose-build
 2023-04-19 12:12:54 -04:00
Hao Liu ba899324f2 Merge pull request #13856 from TheRealHaoLiu/kube-dev-autoreload 
Auto reload services in kube dev env
 2023-04-19 12:08:52 -04:00
Hao Liu 9c236eb8dd Merge pull request #13882 from TheRealHaoLiu/link-launch-n-supervisord 
Link launch script and supervisor conf in kube dev
 2023-04-19 12:03:22 -04:00
Hao Liu 7a4b3ed139 Merge pull request #13881 from TheRealHaoLiu/fix-copy 
Fix copy API
 2023-04-19 09:39:39 -04:00
Hao Liu b75b84e282 Merge pull request #13725 from l3acon/collection-existential-state-for-credential-module 
[collection] Add "exists" state for credential module
 2023-04-18 20:51:14 -04:00
Hao Liu 12a4c301b8 Merge pull request #13721 from sscheib-rh/feat-add_secret_field_dsv_lookup 
Add missing filtering mechanism for the Thycotic Devops Vault credential lookup
 2023-04-13 08:58:59 -04:00
Hao Liu 8a1cdf859e Merge pull request #12627 from vician/tss-domain 
Added domain entry and authorizer for TSS
 2023-04-12 16:33:46 -04:00
Hao Liu b80d0ae85b Merge pull request #13840 from AlanCoding/one_less_connection 
Get rid of 1 perpetually unused connection in our app
 2023-04-12 09:30:51 -04:00
Hao Liu 1c0142f75c Merge pull request #13841 from AlanCoding/tower_processes 
Add run-clear-cache to tower-processes for auto-reload
 2023-04-12 08:54:34 -04:00
Hao Liu 1a56272eaf Merge pull request #13767 from Ladas/analytics_export_subscription_id 
Analytics export other subs attrs
 2023-04-11 15:55:26 -04:00
Hao Liu 80ebe13841 Merge pull request #13825 from TheRealHaoLiu/fix-dependency-conflict 
Fix importlib-metadata dependency conflict
 2023-04-07 13:17:49 -04:00
Hao Liu c0491a7b10 Merge pull request #13816 from TheRealHaoLiu/workaround-failed-make-requirements_awx 
Temporary workaround for make requirements_awx failure and fix license test
 2023-04-07 00:07:13 -04:00
Hao Liu c9c150b5a6 Merge pull request #13799 from TheRealHaoLiu/fix-supervisor-conf-file 
Fix supervisor conf file inconsistancy
 2023-04-05 11:07:05 -04:00
Hao Liu f97605430b Merge pull request #13804 from TheRealHaoLiu/heartbeet-logging 
Add log handler and file for heartbeet
 2023-04-05 11:06:32 -04:00
Hao Liu acb22f0131 Merge pull request #13423 from ansible/feature_web-task-split 
Allow web and task container to be deployed in separate deployment on Kubernetes
 2023-03-30 12:52:22 -04:00
Hao Liu d33573b29c Merge pull request #13603 from jjwatt/jjwatt-fix-clean-languages 2023-03-29 22:49:13 -04:00
Hao Liu 38cc193aea update permission to launch_awx_rsyslog.sh permission to +x (#13399) 
Signed-off-by: Hao Liu <haoli@redhat.com>
 2023-03-29 22:04:43 -04:00
Hao Liu 7f085e159f Merge pull request #13712 from ansible/feature_usage-collection 
Allow soft deletion of HostMetrics and add usage collection utility
 2023-03-28 12:16:02 -04:00
Hao Liu 4bf8366687 Merge pull request #13743 from TheRealHaoLiu/ui-next-non-phony 
Turn ui-next make targets non-PHONY
 2023-03-22 21:05:18 -04:00
Hao Liu 6908f415a1 Merge pull request #13660 from ansible/feature_ui-next 
Introducing tech preview of the new AWX UI
 2023-03-21 14:09:47 -04:00
Hao Liu a24aaba6bc Merge pull request #13663 from slemrmartin/fix-analytics-collectors 
Fix analytics collector
 2023-03-08 12:03:16 -05:00
Hao Liu 7cca6c4cd9 Merge pull request #13656 from TheRealHaoLiu/feature-branch-build 
Automatically build image for feature branch
 2023-03-07 16:53:55 -05:00
Hao Liu 252b0dda9f Merge pull request #13633 from TheRealHaoLiu/phony-dockerfile 
[fix] Dockerfile collision between awx-kube-build and docker-compose-build
 2023-03-07 15:42:58 -05:00
Hao Liu f0c967c1b2 Merge pull request #13645 from TheRealHaoLiu/fix-websocket 
Revert "Remove trailing $ from websocket_urlpatterns to work with cus…
 2023-03-02 21:36:21 -05:00
Hao Liu a47cfc55ab Merge pull request #13574 from tomsiewert/use-compose-plugin 
Make docker-compose command configurable in Makefile
 2023-03-01 15:41:33 -05:00
Hao Liu 0eb9de02f3 Merge pull request #13627 from infamousjoeg/fix-13597-webservice_id-default 
Fixes #13597 webservice_id default value added
 2023-03-01 15:29:53 -05:00
Hao Liu c2df22e0f0 Merge pull request #13632 from TheRealHaoLiu/reshaving-the-yak 
[chore] update project_update playbook to be compliant with ansible-lint
 2023-02-28 13:17:45 -05:00
Hao Liu 2902b40084 Merge pull request #13623 from TheRealHaoLiu/revert-project-update-playbook 
Revert project_update.yml
 2023-02-27 08:47:24 -05:00
Hao Liu d088d36448 Merge pull request #13618 from TheRealHaoLiu/head-to-tail 
[fix] switch from head to tail in project update playbook when clearing project dir
 2023-02-23 11:13:03 -05:00
Hao Liu 283adc30a8 Merge pull request #13526 from TheRealHaoLiu/project_update_playbook_lint 
[chore] Update project_update playbook to be compliant with ansible-lint
 2023-02-22 21:39:42 -05:00
Hao Liu 35e5610642 Merge pull request #13615 from TheRealHaoLiu/update-kind-devel-doc 
update kind development environment instruction
 2023-02-22 19:25:03 -05:00
Hao Liu 46ea031566 Merge pull request #13539 from gamuniz/fix_dependent_schedule_export 
[fix] adding Schedule to dependent_export to allow previous behavior on job template export
 2023-02-08 17:04:35 -05:00
Hao Liu 058ae132cf Merge pull request #13489 from gamuniz/add_management_command 
adding new management command to allow failsafe enabling of local auth
 2023-01-31 13:52:10 -05:00
Hao Liu 6483575437 Merge pull request #13379 from OscarBell/issue_13377 
Fix verbosity parameter choices for ad_hoc_command module
 2023-01-31 13:21:27 -05:00
Hao Liu a15a23c1d3 Merge pull request #13483 from mahaffey/cli-add-order-by 
add '--order_by' option to awx CLI
 2023-01-31 13:13:52 -05:00
Hao Liu 7aae7e8ed4 Delete network.feature doc (#13107) 
not implemented and no longer needed
 2022-12-02 12:16:53 -05:00
Hao Liu 40499a4084 prevent unsupported locale setting error in GHA 
related to https://github.com/ansible/ansible/pull/78175

the way the GHA runner is built, Python runs with a mixed locale between the FS bits and the default encoding, which can cause unpredictable issues

adding env var `LC_ALL: "C.UTF-8"` prevent flakiness due to locale issue

Signed-off-by: Hao Liu <haoli@redhat.com>
 2022-11-29 18:03:46 +00:00
Hao Liu 6e25a552d3 enable feature branch api-schema test (#12550) 
- enable schema upload to s3 bucket for feature branch
- add workflow to delete schema from s3 bucket when feature branch is deleted

Signed-off-by: Hao Liu <haoli@redhat.com>
 2022-11-04 16:14:55 +00:00
Hao Liu eba24db74c Merge pull request #13103 from saito-hideki/pr/add_arm64_arch_to_fact_list 
Add arm64 architecture mapping to image_architecture for m1mac
 2022-10-27 13:23:59 -04:00