Commit Graph
100 Commits
Author SHA1 Message Date
Matthew Jones b2cfd38a1c Update dm.xmlsec.bindings requirement to point to a version with updated cflags 2015-11-04 16:43:06 -05:00
Matthew Jones f78f69159d Fix up pyflakes indentation issues 2015-11-04 09:50:50 -05:00
Matthew Jones ec6ef4974a Update GCE Region Choices per Google 2015-11-03 23:34:46 -05:00
Matthew Jones 99f048dfe5 Add object_association for m2m relationships
Now when displaying a m2m relationship change we'll show the related
field mapping that changed.
2015-11-02 14:39:24 -05:00
Matthew Jones 113c5ed78f Clean up authenticate and get_user for ldap auth 2015-11-02 12:02:14 -05:00
Matthew Jones dd29bc40d9 Add logging and improve validation for certain auth backends
* Abstract authention to provide a hook for emitting an error message
* Perform some license validation that wasn't present before for
  enterprise licenses
2015-11-02 11:59:17 -05:00
Matthew Jones 2ba7b3bdac Update vendored ec2 module 2015-10-29 13:27:34 -04:00
Matthew Jones 4603ac5d1c Change dependent job failure message entity ref.
Originally we were looking at the underlying project/inventory update
but we are now populating the name of project updates and inventory
updates a lot better so we'll just take their names
2015-10-22 10:49:42 -04:00
Matthew Jones 152ddc4f4f Rename task_ to job_ for pre-task fail error 2015-10-20 21:32:45 -04:00
Matthew Jones b579b76099 Handle playbook_on_include events from v2 ansible 2015-10-20 11:18:07 -04:00
Matthew Jones 99da0965ef Add a docker-ui container to the compose workflow 2015-10-19 12:07:09 -04:00
Matthew Jones b25413002c Fix custom inventory scripts on org deletion
We'll now clear the organization for it, this requires a database
migration to accept null values for custom inventory scripts
2015-10-19 12:07:09 -04:00
Matthew Jones 1bbd5fbe0a Update UI error text for single data picker
When no data is available
2015-10-14 10:19:05 -04:00
Matthew Jones fd33d7df58 Tweak proj rbac for orphaned projects
Slight tweak to the rbac for projects related to the user who created
them.  IF a user created a project but it is orphaned/not associated
with an organization then they will be able to see/change it.  If,
however, it is created and associated with an organization and then they
are removed as an org admin they will no longer have access to it.
2015-10-13 16:42:12 -04:00
Matthew Jones a27a620bcf Remove pdb trace from unit test 2015-10-13 14:10:40 -04:00
Matthew Jones 4b46f33299 Fix up unit tests for overwrite_vars 2015-10-13 11:38:37 -04:00
Matthew Jones f7ebf956c1 Remove the created_by access ability for projects
Now, simply being the creator of a project does not convey any access
for users.  You must be in a project/team that has access to it and you
must be an org admin for an org that has the project to be able to make
changes to it
2015-10-13 11:24:48 -04:00
Matthew Jones 46aa6dfabb Prevent deleting organizations on basic licenses
Plus unit tests
2015-10-12 14:52:03 -04:00
Matthew Jones 98c1301e23 Clean up some flake8 issues 2015-10-12 14:18:02 -04:00
Matthew Jones 231a7d8f77 Add rax module to those not scanned by flake8 2015-10-12 13:52:17 -04:00
Matthew Jones 6cd39efb85 Add a cleanup_authtokens management command
We also will now clean these up during cleanup_deleted
2015-10-12 13:44:22 -04:00
Matthew Jones ae3f5c220e Change celery task id in dependent job failure msg
We'll now display a little json that should help the UI in rendering a
link to the dependent job in the job detail screen
2015-10-12 13:24:03 -04:00
Matthew Jones 6e2efd3f8a Overwrite should not imply overwrite-vars 2015-10-12 13:07:50 -04:00
Matthew Jones 484a33f9c6 Update azure module from ansible 2015-10-12 11:46:20 -04:00
Matthew Jones 7a7e1941b1 Update vmware module from ansible 2015-10-12 11:44:58 -04:00
Matthew Jones e7c274b80c Updating rax module from ansible 2015-10-12 11:41:59 -04:00
Matthew Jones d382bf6f4f Update to latest GCE inventory module 2015-10-12 11:37:00 -04:00
Matthew Jones 9dd0c7ae1f Fix api static location references for api browser 2015-10-09 14:26:00 -04:00
Matthew Jones 40d2b9c9be Revert "Bump version number for devel to 3.0"
This reverts commit 9b51362ee6f63afebade5fd9a4ccb74ad6ae4eb1.
2015-10-09 12:22:42 -04:00
Matthew Jones 4dc56e5d66 Fix an issue with ansible 2.0 and our fact cacher
This will be dependent on a PR submitted to core for 2.0 also:
https://github.com/ansible/ansible/pull/12695

So will not work right away unless you are pulling from devel.
2015-10-09 12:17:17 -04:00
Matthew Jones 523a96ebce Add mongo shell container entrypoint also 2015-10-09 12:16:49 -04:00
Matthew Jones 531f00b1ac rm the old docker run container after stopping 2015-10-09 12:04:34 -04:00
Matthew Jones e543a806ee Bump version number for devel to 3.0 2015-10-09 11:58:48 -04:00
Matthew Jones aa9357fb14 Include new social auth settings in compose 2015-10-09 11:58:48 -04:00
Matthew Jones ad95548d48 Fix up docker compose local settings 2015-10-09 11:58:48 -04:00
Matthew Jones bfc9512dc7 Also remove .deps_built with make clean 2015-10-09 11:58:48 -04:00
Matthew Jones 950a299c87 Add swig to dependencies for compose 2015-10-09 11:58:47 -04:00
Matthew Jones f85fb0551d Add libxmlsec1-dev to the docker compose workflow 2015-10-09 11:58:47 -04:00
Matthew Jones b06f7fb883 Remove logging from fact init 2015-10-02 16:56:13 -04:00
Matthew Jones dbd0a01410 Merge branch 'release_2.3.1' into devel
* release_2.3.1:
  Add 2.3.1 to the reprepro distribution manifest
  Update version to 2.3.1 and update changelog
  Remove unused time import
  Fix proot controlpersist cleanup issue
  Propagate necessary build changes from devel
  Update reprepro components
  Reenable the reprepro i386 repository
  Fix supervisor migration
  Fix reprepro/conf path in Makefile
  prefer the first version when packages are ambiguous
  Correct error message
  Fix omission
  Correct conditional stmt
  Improve logging when sourcerpm fails
  Fix typo
  Fix OFFICIAL deb Makefile
2015-10-02 16:37:45 -04:00
Matthew Jones ac37667649 Clean up fact module imports 2015-10-02 16:08:02 -04:00
Matthew Jones c65d068d55 Add note about wanting to use register_connection
I think this would be the cleaner way to go about things but there are
some unanswered questions about that route.
2015-10-02 16:04:47 -04:00
Matthew Jones 1425718d9e Improve the efficiency of mongo connections
- Remove the connect action in the fact __init__ module
- Monkeypatch mongoengine.Document's _get_db to force a new connection
  or raise an error if we don't have the proper settings.
2015-10-02 15:57:50 -04:00
Matthew Jones 71081a5b63 Update version to 2.3.1 and update changelog 2015-10-01 14:40:21 -04:00
Matthew Jones 0146b8acb0 Remove unused time import 2015-10-01 14:40:20 -04:00
Matthew Jones b4ed547b2b Fix proot controlpersist cleanup issue
* Also removed psutil version and feature check from tasks.  We now
  include the most recent version of psutil all around
* Old versions of psutil must have had these Process() items as
  properties, they are functions now so we weren't properly evaluating
  them.  With this change we are and things are back to working normally
2015-10-01 14:40:20 -04:00
Matthew Jones 6a3a36513a Add failure test for sts tokens 2015-10-01 10:49:58 -04:00
Matthew Jones 5de5b0209b Remove unused time import 2015-09-30 16:20:41 -04:00
Matthew Jones e034c0b326 Fix proot controlpersist cleanup issue
* Also removed psutil version and feature check from tasks.  We now
  include the most recent version of psutil all around
* Old versions of psutil must have had these Process() items as
  properties, they are functions now so we weren't properly evaluating
  them.  With this change we are and things are back to working normally
2015-09-30 15:56:31 -04:00
Matthew Jones acc974289f Unit test for AWS STS token support 2015-09-30 13:42:16 -04:00
Matthew Jones 5ee3c78e7f Update ec2 module to latest ansible version 2015-09-30 13:40:06 -04:00
Matthew Jones 34e028b8c7 Adding security token field to support ec2 sts
And any future credential that might want to use "security_token"
2015-09-30 13:39:36 -04:00
Matthew Jones 29b4865af8 Ability to pause pexpect output with env var
Since inventory updates don't support extra vars
2015-09-29 11:36:31 -04:00
Matthew Jones 5be53d4a79 Add a sleep step to job runs if configured
If the extra var PEXPECT_SLEEP is given to a job then it will
artificially delay the job run by that number of seconds allowing QA to
hook in and cancel the job
2015-09-28 15:43:46 -04:00
Matthew Jones a3410920a9 Remove management job schedule count restriction 2015-09-25 16:00:19 -04:00
Matthew Jones 3d7f25218a Add api side support for pendo
Also adds setup playbook support for pendo.  This change anticipates
that the default for new installations will be 'detailed'
2015-09-25 15:52:42 -04:00
Matthew Jones a7f1e69352 Fix an issue with default schedules
These weren't being created correctly, the logic meant an extra schedule
would be created on cleanup facts erroneously selected to be cleanup
activity stream
2015-09-25 14:17:31 -04:00
Matthew Jones 2135a6651b Hash the license key to show a deployment key
This can be used by pendo and other things that need to identify an
individual deployment without exposing the actual license key
2015-09-25 13:21:08 -04:00
Matthew Jones 3a6807c5b4 Add environment variable that sets proot's tmp dir
Only really useful with patched proot containing tmpdir fix
2015-09-25 11:08:03 -04:00
Matthew Jones 256af567de Merge branch 'release_2.3' into devel
* release_2.3: (24 commits)
  Updated package changelogs
  Rephrase task name
  Make purge supervisor.conf conditional on 2.2 el6
  Fix another name typo.
  Update python-ldap license text.
  Add LGPL source directly so it gets shipped.
  Update font-awesome licenses per legal feedback
  Remove bundled_licenses - we are shipping the source for bundled items, and therefore do not need to provide this separately.
  Add more license texts.
  Add full Apache licenses to files, per Pam.
  Attempt to harden mongodb tgz download
  Correct DJRF/DJRF-mongoengine licenses, rename qsstats license to match pkg name.
  Fix some typos in file names, and add licenses for some things we have modified in our own repos.
  Update Ubuntu depends and ppa's
  Include source for bundled packages in bundle.
  Include license information in packaging
  Add READMEs for the license directories.
  vendored python licenses
  Add bundled licenses documentation
  Revert to stock libzmq3 for deb depends
  ...
2015-09-22 15:57:32 -04:00
Matthew Jones 66168fb6dc Merge branch 'release_2.3' into stable
* release_2.3: (169 commits)
  Updated package changelogs
  Rephrase task name
  Make purge supervisor.conf conditional on 2.2 el6
  Fix another name typo.
  Update python-ldap license text.
  Add LGPL source directly so it gets shipped.
  Update font-awesome licenses per legal feedback
  Remove bundled_licenses - we are shipping the source for bundled items, and therefore do not need to provide this separately.
  Add more license texts.
  Add full Apache licenses to files, per Pam.
  Attempt to harden mongodb tgz download
  Correct DJRF/DJRF-mongoengine licenses, rename qsstats license to match pkg name.
  Fix some typos in file names, and add licenses for some things we have modified in our own repos.
  Update Ubuntu depends and ppa's
  Include source for bundled packages in bundle.
  Include license information in packaging
  Add READMEs for the license directories.
  vendored python licenses
  Add bundled licenses documentation
  Revert to stock libzmq3 for deb depends
  ...
2015-09-22 15:37:31 -04:00
Matthew Jones 4cf2f32451 Remove the contents of tmp/ on clean 2015-09-22 11:04:40 -04:00
Matthew Jones 077819c4c5 Add some default schedules for cleanup jobs 2015-09-21 14:53:53 -04:00
Matthew Jones 5fa0ce9d58 Include apt-get update with install
This forces the Docker apt-get update to not attempt to re-use the cache
2015-09-21 14:52:43 -04:00
Matthew Jones 519b0e8eef Merge branch 'release_2.3' into devel
* release_2.3: (54 commits)
  Upgrade changelog for 2.3
  Purge superlance
  Purge an old supervisor config
  Require chris-lea libzmq3
  Use the htpasswd command, not the module
  Fix a playbook syntax error for postgres
  Ensure postgres is started earlier in setup role
  Allow customizing npm path
  Include RPM-GPG-KEY-ansible-release for all releases
  Simplify GPG keys
  Correct broken RPM-GPG-KEY
  Use gpg --passphrase for signing CHECKSUM
  Handle rpm --addsign pasphrase prompts
  Adding docker-compose development workflow
  Fix license in spec file.
  Updates to selinux policy for some munin plugins
  ansible 1.8.4 requires sudo:true when using sudo_user
  Fix expect script timeout
  Disable timeout and correct sign.exp error
  Fix expect script hang
  ...
2015-09-11 16:03:52 -04:00
Matthew Jones 0ac4359bec Purge superlance
We no longer get memmon with our package vendoring changes.  Don't think
we need it anyway as we've got the socket service fixed.
2015-09-11 14:43:28 -04:00
Matthew Jones 8785af996d Purge an old supervisor config
Apparently awx_supervisor.conf was still hanging around in the debian
install.   We'll make sure we won't lay that file down and bump the
supervisor migration to make sure the file is removed permanently
2015-09-11 14:43:28 -04:00
Matthew Jones a2b6ffb237 Put down a file to track make develop in compose 2015-09-10 11:03:45 -04:00
Matthew Jones 97f85d2344 Rev django auth ldap to version 1.2.6
This fixes (probably among other things) an issue where we wouldn't get
any logging messages out of django for misconfigured ldap.
2015-09-10 10:59:24 -04:00
Matthew Jones f61a01b504 Switch to using ansible wait_for instead of sleep
In the startup script for docker-compose
2015-09-10 09:32:01 -04:00
Matthew Jones 940910b9a3 Adding docker-compose development workflow 2015-09-09 17:17:48 -04:00
Matthew Jones 7263367c6d Adding docker-compose development workflow 2015-09-09 17:16:35 -04:00
Matthew Jones 5727d722b6 Merge remote-tracking branch 'upstream/release_2.3' into devel
* upstream/release_2.3: (91 commits)
  Include python-{paramiko,ecdsa} dependencies
  Remove extra epel testing stanzas
  Unit test for ec2 credentialless inventory
  Fix issue with ec2 iam sync with no credential.
  Use the htpasswd command instead the ansible module
  Pip is no longer needed
  check local user root or not in ./configure
  Remove unneeded when check for super user addition
  Improve distro detection in setup.sh
  Fix superuser check on upgrade
  Minor improvements to setup.sh
  Remove ansible prerequisite check from configure
  Attempt to install ansible within setup.sh
  Allow munin processes to access postgres
  Move up base package dependency install
  fixes jenkins failures
  Proper flake8 fix
  fixes executing processes with correct PYTHONPATH will pickup .pth files
  Show the repo for bundled package file dump
  Proper flake8 fix
  ...
2015-09-03 15:46:10 -04:00
Matthew Jones 7774b17960 Unit test for ec2 credentialless inventory 2015-09-03 14:05:17 -04:00
Matthew Jones 15005d3e6b Fix issue with ec2 iam sync with no credential.
When checking if an inventory sync can start allow an ec2 sync to run
even if credentials are not supplied
2015-09-03 13:37:38 -04:00
Matthew Jones 5f6f16b5ff Rev version to 2.4.0 2015-09-03 09:44:20 -04:00
Matthew Jones c37716a2e7 Proper flake8 fix 2015-09-01 18:35:12 -04:00
Matthew Jones f0a23b7ed3 Proper flake8 fix 2015-09-01 16:15:39 -04:00
Matthew Jones 4a5111308f Fix flake8 warning from tests 2015-09-01 15:23:35 -04:00
Matthew Jones 09f4c9fbbe Fixed job redaction for projects and unit tests 2015-08-31 16:24:38 -04:00
Matthew Jones bd3faea671 Fix path check in start_development docker script 2015-08-31 15:15:49 -04:00
Matthew Jones 2f39393cf3 Implement fact receiver thread worker
Optionally allow processing of fact receiver messages in a worker
thread.  This works around an issue where data could take a while to
page into Mongo and cross the zmq socket timeout.
2015-08-28 10:59:52 -04:00
Matthew Jones 549809dfa4 Fix chunked stdout display issue
* We removed stdout redaction from jobs and job templates but only for
  the full stdout dump, this extends it to the limited display also
2015-08-25 16:05:03 -04:00
Matthew Jones 896b0e18f3 Merge remote-tracking branch 'chrismeyers/feature-configure_offline' into release_2.3
* chrismeyers/feature-configure_offline:
  configure support inventory file
  retain existing behavior with added --inventory-file param
2015-08-24 14:38:30 -04:00
Matthew Jones 1ead738f96 Updates to offline packager docker environment 2015-08-21 16:40:35 -04:00
Matthew Jones 1471a3bb3e Allow proot's base tmp path to be configurable 2015-08-21 15:28:39 -04:00
Matthew Jones 7080996670 Cleanup stdout dump during 2.2 migration
postgres is adding extra newline/carriage return escapes to the stdout
output.  Here we'll use sed to fix those so they can be read correctly
2015-08-21 13:28:34 -04:00
Matthew Jones 4ce2300d27 Bump version number for 2.3.0 release 2015-08-21 11:55:19 -04:00
Matthew Jones c5ce9cdc12 Fix stdout plaintext render
* Was rendering as json (though text/plain)
* Switched to rendering it as normal text with stripped ansi
* Fixes: https://trello.com/c/TMyOak0H/142-api-v1-jobs-n-stdout-format-txt-emits-json-output
2015-08-21 10:20:57 -04:00
Matthew Jones 230a1f3be5 Merge remote-tracking branch 'upstream/release_2.2.3' into upstream_devel
* upstream/release_2.2.3: (33 commits)
  Bump version to 2.2.3
  Optimize inventory read check for Job Templates
  Updating changelog for 2.2 release
  Bump version to 2.2.2
  Use smart_str instead of .encode on passwords
  Change default sensitive redaction behavior
  Update changelogs for 2.2.1
  Add an error message when running a job and trying to use an OpenSSH formatted key on an older version of OpenSSH.
  Revert "Add sudo: true to the backup playbook"
  Handle Ubuntu 12.04 psutil recursive cancel
  fixed log viewer modal partial
  fixed alignment of download standard out button in modals
  About Tower version number fix
  Pin package version for older release
  add standard out download button to various places in the UI
  Bump 2.2 branch to version 2.2.1
  Don't create a group that is its own parent when an EC2 tag has an empty value.  Fixes https://trello.com/c/2zc0odvX
  Limit max depth when building mapping of group depths to avoid hitting recursion limit.  Fixes https://trello.com/c/2zc0odvX
  Fix .ini web links for v2
  Add support for detecting encrypted openssh format private keys. Fixes https://trello.com/c/ZeVOXN5U
  ...
2015-08-20 11:47:07 -04:00
Matthew Jones a76b1a0432 Merge branch 'release_2.2.3' into stable
* release_2.2.3:
  Bump version to 2.2.3
  Optimize inventory read check for Job Templates
2015-08-20 11:15:48 -04:00
Matthew Jones f66ed43788 Bump version to 2.2.3 2015-08-19 13:26:55 -04:00
Matthew Jones 2bdc79f3ba Optimize inventory read check for Job Templates
Our old check used an extremely inefficient boolean logic AND and
generated a bad query.   This does a simpler check by querying the
inventories that the user has access to and using that as a simple
condition when performing the job template permission query
2015-08-19 13:26:10 -04:00
Matthew Jones 26f942a593 Merge remote-tracking branch 'upstream/release_2.2' into stable
* upstream/release_2.2: (31 commits)
  Updating changelog for 2.2 release
  Bump version to 2.2.2
  Use smart_str instead of .encode on passwords
  Change default sensitive redaction behavior
  Update changelogs for 2.2.1
  Add an error message when running a job and trying to use an OpenSSH formatted key on an older version of OpenSSH.
  Revert "Add sudo: true to the backup playbook"
  Handle Ubuntu 12.04 psutil recursive cancel
  fixed log viewer modal partial
  fixed alignment of download standard out button in modals
  About Tower version number fix
  Pin package version for older release
  add standard out download button to various places in the UI
  Bump 2.2 branch to version 2.2.1
  Don't create a group that is its own parent when an EC2 tag has an empty value.  Fixes https://trello.com/c/2zc0odvX
  Limit max depth when building mapping of group depths to avoid hitting recursion limit.  Fixes https://trello.com/c/2zc0odvX
  Fix .ini web links for v2
  Add support for detecting encrypted openssh format private keys. Fixes https://trello.com/c/ZeVOXN5U
  Fix psutil usage on el6 for job cancel
  Set recursive on child process canceling
  ...
2015-08-19 10:39:54 -04:00
Matthew Jones 35ffb37492 Add cleaning site-packages in the Makefile 2015-08-17 11:33:45 -04:00
Matthew Jones ee8a76f32b Use smart_str instead of .encode on passwords
We originally tried to prune these .encode() calls out of the tree in
favor of smart_str but we must have missed this one.   This allows
migration 0066 to work if utf-8 characters are used in the password
2015-08-13 17:00:46 -04:00
Matthew Jones e221097a37 Use smart_str instead of .encode on passwords
We originally tried to prune these .encode() calls out of the tree in
favor of smart_str but we must have missed this one.   This allows
migration 0066 to work if utf-8 characters are used in the password
2015-08-13 16:55:39 -04:00
Matthew Jones d4dccff20c Change default sensitive redaction behavior
* Only project updates will contain sensitive data redaction logic when
  displaying stdout
2015-08-13 15:48:56 -04:00
Matthew Jones 6c2d6a63e7 Change default sensitive redaction behavior
* Only project updates will contain sensitive data redaction logic when
  displaying stdout
2015-08-13 15:48:16 -04:00
Matthew Jones 4968848958 Merge pull request #371 from cchurch/openssh_key_check
Add error message when OpenSSH private keys aren't supported
2015-08-11 16:53:08 -04:00