Commit Graph
100 Commits
Author SHA1 Message Date
Matthew Jones 549809dfa4 Fix chunked stdout display issue
* We removed stdout redaction from jobs and job templates but only for
  the full stdout dump, this extends it to the limited display also
2015-08-25 16:05:03 -04:00
Matthew Jones 896b0e18f3 Merge remote-tracking branch 'chrismeyers/feature-configure_offline' into release_2.3
* chrismeyers/feature-configure_offline:
  configure support inventory file
  retain existing behavior with added --inventory-file param
2015-08-24 14:38:30 -04:00
Matthew Jones 1ead738f96 Updates to offline packager docker environment 2015-08-21 16:40:35 -04:00
Matthew Jones 1471a3bb3e Allow proot's base tmp path to be configurable 2015-08-21 15:28:39 -04:00
Matthew Jones 7080996670 Cleanup stdout dump during 2.2 migration
postgres is adding extra newline/carriage return escapes to the stdout
output.  Here we'll use sed to fix those so they can be read correctly
2015-08-21 13:28:34 -04:00
Matthew Jones 4ce2300d27 Bump version number for 2.3.0 release 2015-08-21 11:55:19 -04:00
Matthew Jones c5ce9cdc12 Fix stdout plaintext render
* Was rendering as json (though text/plain)
* Switched to rendering it as normal text with stripped ansi
* Fixes: https://trello.com/c/TMyOak0H/142-api-v1-jobs-n-stdout-format-txt-emits-json-output
2015-08-21 10:20:57 -04:00
Matthew Jones a76b1a0432 Merge branch 'release_2.2.3' into stable
* release_2.2.3:
  Bump version to 2.2.3
  Optimize inventory read check for Job Templates
2015-08-20 11:15:48 -04:00
Matthew Jones f66ed43788 Bump version to 2.2.3 2015-08-19 13:26:55 -04:00
Matthew Jones 2bdc79f3ba Optimize inventory read check for Job Templates
Our old check used an extremely inefficient boolean logic AND and
generated a bad query.   This does a simpler check by querying the
inventories that the user has access to and using that as a simple
condition when performing the job template permission query
2015-08-19 13:26:10 -04:00
Matthew Jones 26f942a593 Merge remote-tracking branch 'upstream/release_2.2' into stable
* upstream/release_2.2: (31 commits)
  Updating changelog for 2.2 release
  Bump version to 2.2.2
  Use smart_str instead of .encode on passwords
  Change default sensitive redaction behavior
  Update changelogs for 2.2.1
  Add an error message when running a job and trying to use an OpenSSH formatted key on an older version of OpenSSH.
  Revert "Add sudo: true to the backup playbook"
  Handle Ubuntu 12.04 psutil recursive cancel
  fixed log viewer modal partial
  fixed alignment of download standard out button in modals
  About Tower version number fix
  Pin package version for older release
  add standard out download button to various places in the UI
  Bump 2.2 branch to version 2.2.1
  Don't create a group that is its own parent when an EC2 tag has an empty value.  Fixes https://trello.com/c/2zc0odvX
  Limit max depth when building mapping of group depths to avoid hitting recursion limit.  Fixes https://trello.com/c/2zc0odvX
  Fix .ini web links for v2
  Add support for detecting encrypted openssh format private keys. Fixes https://trello.com/c/ZeVOXN5U
  Fix psutil usage on el6 for job cancel
  Set recursive on child process canceling
  ...
2015-08-19 10:39:54 -04:00
Matthew Jones 35ffb37492 Add cleaning site-packages in the Makefile 2015-08-17 11:33:45 -04:00
Matthew Jones ee8a76f32b Use smart_str instead of .encode on passwords
We originally tried to prune these .encode() calls out of the tree in
favor of smart_str but we must have missed this one.   This allows
migration 0066 to work if utf-8 characters are used in the password
2015-08-13 17:00:46 -04:00
Matthew Jones d4dccff20c Change default sensitive redaction behavior
* Only project updates will contain sensitive data redaction logic when
  displaying stdout
2015-08-13 15:48:56 -04:00
Matthew Jones 21acaa999d Handle Ubuntu 12.04 psutil recursive cancel
Ubuntu has a crazy old version of psutil, we'll fall back to sigkill for
that platform
2015-08-11 10:32:29 -04:00
Matthew Jones 7484267186 Bump 2.2 branch to version 2.2.1 2015-08-07 11:19:09 -04:00
Matthew Jones 3b96c3ca52 Fix psutil usage on el6 for job cancel
psutil will fail to import on el6 due to not being able to access a
pseudo terminal.  This issues a SIGKILL to the proot process in order to
force the stop
2015-08-05 22:01:44 -04:00
Matthew Jones 31b8491d53 Set recursive on child process canceling
Sometimes ansible spawns many subprocesses that can get orphaned and
stuck if we only kill the direct descendent child processes
2015-08-05 22:00:27 -04:00
Matthew Jones 57778eb429 mock stdout unit test patch failure fix
Adjust some mock.patch behavior to match the new stdout behavior where
we need to check a file's size as well as its existence
2015-08-05 21:55:02 -04:00
Matthew Jones b1c12ca120 Fix empty standard out behavior
Previously we could just check for the absence of the stdout file to
know we didn't yet/wouldn't ever have any stdout content.  Now that we
are creating the stdout file ahead of time and persisting it we need to
also check to see if the file contains any data.   This is also
necessary for some unit tests.
2015-08-05 21:54:23 -04:00
Matthew Jones dc0d732ad4 Fix merge issues on stdout branch
The act of committing a PR that including part of these changes and then
reverting it meant that some of the changes from the original branch
didn't land in this new PR.   This commit adds the missing bits.

Lesson learned:  Create a new branch when submitting a PR on a
previously reverted PR
2015-08-05 21:53:46 -04:00
Matthew Jones c0ea174e93 Rework stdout display for file storage only
* Cleanup old code related to stdout download using temporary files
* Remove copy-into-database code
* Modify stdout download code to reference stdout file
2015-08-05 21:52:47 -04:00
Matthew Jones 7fd4613523 Remove uses_mongo redirection from service script 2015-07-13 15:44:58 -04:00
Matthew Jones 9a4b19bd11 Update start/stop service script ordering
Mongo needs to be last when starting and first when stopping if enabled
2015-07-13 14:05:22 -04:00
Matthew Jones 08ec0c132e Merge pull request #306 from matburt/fix_restore_playbook
Fix the restore playbook procedure
2015-07-09 16:17:17 -04:00
Matthew Jones 874c97f748 Purge some unneeded HA unit tests 2015-07-08 14:31:02 -04:00
Matthew Jones 5605ec9754 Adjust usage of is_ha_environment()
Limit it to just instance count and make sure we use it for the mongo check
2015-07-08 14:18:04 -04:00
Matthew Jones d5e948890c Stricter control of mongo in setup playbook
Detect if this is an HA setup and if so we won't attempt to start mongo
during the setup process
2015-07-08 13:45:59 -04:00
Matthew Jones 9e6c604fc1 Remove extra output from doing a hard mongo shutdown. 2015-07-06 14:38:19 -04:00
Matthew Jones 4fd0fbda08 Invert the conditional checking for whether or not mongo is running 2015-07-06 14:28:27 -04:00
Matthew Jones 26af43dab6 Remove superflous sleep when shutting mongo down 2015-07-06 14:19:12 -04:00
Matthew Jones 9b03d22d75 Fixes to conditionally invoking mongo shutdown
* Make sure we are waiting on the service script
* Improve sudo configuration
* Check pidof before attempting to invoke a hard mongo shutdown
2015-07-06 14:15:41 -04:00
Matthew Jones 10f5308bd8 Fix version parsing of ansible to exclude newlines 2015-07-06 12:16:17 -04:00
Matthew Jones 5a77d1f0d4 Fix up mongo service handline and task logging
* Use -f instead of -c for mongod when refernecing config file
  for shutdown behavior in the stop task
* Fix up task logging to use new supervisor configuration syntax
2015-07-06 11:49:24 -04:00
Matthew Jones cd41d99843 Merge pull request #298 from matburt/fix_ha_setup_logic
Fix ha setup logic
2015-06-26 16:16:07 -04:00
Matthew Jones 414394afa0 can not -> cannot (even though they are both correct) 2015-06-26 15:35:33 -04:00
Matthew Jones 05f56c805a Logic should check for the condition where HA is NOT enabled 2015-06-26 15:28:41 -04:00
Matthew Jones 80a6f22c0c Move HA license check logic to the promotion step and allow registering
HA instances.   Registration is allowed but promotion/demotion is not
allowed without the HA feature
2015-06-26 15:23:07 -04:00
Matthew Jones 237a661912 Fix verbage around why we are disallowing removing a primary 2015-06-26 15:22:35 -04:00
Matthew Jones 97bfa32b44 Merge pull request #296 from matburt/extricate_service_script_playbooks
Extricate service script playbooks
2015-06-25 13:29:23 -04:00
Matthew Jones 4d84a603ad Add missing fact receiver logfile in production settings 2015-06-24 11:05:19 -04:00
Matthew Jones b45ea4f1f4 Force shutdown of mongo after requesting a service stop. Just in case. 2015-06-23 12:32:43 -04:00
Matthew Jones d01e93535d Fixing flake8 issue 2015-06-15 09:36:04 -04:00
Matthew Jones bb7af4e916 Merge pull request #277 from matburt/fix_inventory_read_jt_rbac
Check inventory access for normal users when deciding what job templates show up in the queryset
2015-06-12 16:04:34 -04:00
Matthew Jones 5d1b27e520 Adding some job template listing unit tests and permissions to actually
make those work
2015-06-12 14:43:24 -04:00
Matthew Jones df61fd6ab8 Check inventory access for normal users when deciding what job templates
show up in the job template queryset
2015-06-11 16:24:54 -04:00
Matthew Jones d011a87bb0 Support cancel on system jobs 2015-06-11 15:19:27 -04:00
Matthew Jones f945719794 Fix a few more copyright statements 2015-06-11 14:53:25 -04:00
Matthew Jones bcc18aa689 Make using named pipe for adding passwords conditional on the version
of ssh used.
2015-06-11 14:48:10 -04:00
Matthew Jones 322fdc37a4 Remove some spurious print statements I left previously 2015-06-11 14:48:09 -04:00
Matthew Jones f9ca5159e7 Fix up more copyright headers 2015-06-10 16:11:26 -04:00
Matthew Jones 3c2f3f323a Fix some flake8 2015-06-09 16:07:06 -04:00
Matthew Jones ab5c4b5f20 Check connection for scan jobs before actually running the job, fail
early if the system tracking database isn't available
2015-06-09 15:31:23 -04:00
Matthew Jones c6c80447a6 Fix a spelling error in the setup script that's causing rpm build failures 2015-06-09 10:57:38 -04:00
Matthew Jones 62e16929d0 Merge pull request #274 from matburt/add_mongo_munin_stats
Add munin monitors for mongo
2015-06-08 20:35:54 -04:00
Matthew Jones 712861b829 Remove mongo_{btree,lock} as worthless monitoring points (and broken at that) 2015-06-08 16:24:33 -04:00
Matthew Jones 848bff4220 Add munin monitors for mongo 2015-06-08 16:23:37 -04:00
Matthew Jones 074e66219d Add a docker development container build make target 2015-06-08 16:00:35 -04:00
Matthew Jones e471798918 Merge pull request #268 from matburt/support_DELETE_license
Support DELETE of the license on the config endpoint
2015-06-05 16:52:23 -04:00
Matthew Jones 23eaf9ae42 Support DELETE of the license on the config endpoint 2015-06-05 15:53:35 -04:00
Matthew Jones fbe82d9348 Allow AWS ami license type to support the new license type scheme. Also
allows new ami licenses to be created at different license type levels
while defaulting to legacy
2015-06-05 12:39:36 -04:00
Matthew Jones a8d75783a3 Some launch changes and configuration changes to the Dockerfile 2015-06-05 11:18:27 -04:00
Matthew Jones 4d2fba15ab Some minor fixes for the dockerfile container image build process 2015-06-05 11:12:23 -04:00
Matthew Jones 715e12ba98 Merge pull request #264 from matburt/system_job_template_wording
Update doc template for system job launching
2015-06-05 09:56:35 -04:00
Matthew Jones 80dddfddc5 Update doc template for system job launching 2015-06-04 14:16:08 -04:00
Matthew Jones 01fc6ff8c6 Merge pull request #263 from matburt/check_low_var_space
Add a task to the preflight check to verify a minimum amount of space on
2015-06-04 13:44:51 -04:00
Matthew Jones d76ee309c6 Allo the file fact scanner to take a list of paths instead of just one path 2015-06-03 11:36:50 -04:00
Matthew Jones 7d8edd9617 Check survey license enabled when creating, updating, and starting job
templates with surveys enabled
2015-06-01 17:01:49 -04:00
Matthew Jones 5bd25d408a Generate sane errors if the mongo database is down when a request for
fact versions is made
2015-06-01 16:22:11 -04:00
Matthew Jones e392add46f Catch exceptions if there are issues communicating with mongo 2015-06-01 16:00:11 -04:00
Matthew Jones db5af80daa Conditionals on official builds for rpm-build 2015-06-01 16:00:11 -04:00
Matthew Jones 742a2fd265 Adding documentation templates for endpoints 2015-06-01 16:00:11 -04:00
Matthew Jones 06464333a6 Check license before launching job template and disallow scan job
template launch if license is unsupported
2015-06-01 14:15:42 -04:00
Matthew Jones 82ac560cf2 Remove related single fact link on the group view 2015-06-01 14:12:39 -04:00
Matthew Jones 9d419820d5 Remove the single fact view link from the inventory serializer 2015-06-01 14:11:36 -04:00
Matthew Jones 22bbf21c09 Documenting new system tracking endpoints 2015-06-01 13:39:24 -04:00
Matthew Jones 3375460a94 Unwire the single_fact endpoints from the api for this release since
they aren't implemented on the front end and we still need to do some
work on them
2015-06-01 13:39:24 -04:00
Matthew Jones 8006066609 Disable cleanup_facts if the user does not have system tracking enabled
in their license file
2015-06-01 10:30:41 -04:00
Matthew Jones 35fd2addc6 Remove runas from the list of become method choices since it's not
implemented in ansible yet (although it is listed in their help docs)
2015-06-01 09:48:16 -04:00
Matthew Jones 22ecb62179 Perform type checking on module_name and args for ad-hoc commands to
satisfy qa.
2015-05-29 14:55:42 -04:00
Matthew Jones 31d0342d41 More copyright headers for api side stuff 2015-05-29 12:10:40 -04:00
Matthew Jones b3da3b34a3 Changing some legal headers for python source files 2015-05-29 12:10:39 -04:00
Matthew Jones 609ded80e2 Check system tracking enabled before trying to fetch fact versions 2015-05-29 10:53:34 -04:00
Matthew Jones 8795f06801 Capitalize the first letters of the scan modules for the UI 2015-05-29 10:47:43 -04:00
Matthew Jones 20e85a6d34 Unit test for disallowing scan job with survey 2015-05-29 10:43:54 -04:00
Matthew Jones c644934afc Disallow creating a survey with a scan job template 2015-05-29 10:43:54 -04:00
Matthew Jones 10da862ab1 Lower the cleanup_deleted batch size to 50 to reduce overall memory
usage during the cleanup operation
2015-05-28 16:37:34 -04:00
Matthew Jones 094072f9dc Fix an issue where the single_fact view could still generate a 500 error
if mongo wasn't running and system tracking was disabled by the license
2015-05-28 16:19:55 -04:00
Matthew Jones 5b3b4b48c0 Fix an issue when creating scan job templates where we weren't obeying
the license flag, so folks could still create scan jobs even if they
weren't enabled by the license.  Plus Unit Tests
2015-05-28 15:59:49 -04:00
Matthew Jones f5391cab11 Fix an issue where passing an empty yaml file (or ---) would cause an
error if including a port specifier on a hostname
2015-05-28 09:42:41 -04:00
Matthew Jones 6d3bd2500a Remove spuriously added keystone client package info file 2015-05-26 13:46:07 -04:00
Matthew Jones c930b7759a Add 'finished' property to recent jobs 2015-05-26 13:08:26 -04:00
Matthew Jones b2b05d9212 Import dist-info directories for various openstack libs, otherwise pbr
can't find the versions and that causes errors
2015-05-26 10:42:51 -04:00
Matthew Jones fdaf9bcd52 Add psutil to the package deps for the dockerfile 2015-05-26 09:59:53 -04:00
Matthew Jones f9291940dd Implement the api side system job template migration for the fact
cleanup job
2015-05-22 11:12:27 -04:00
Matthew Jones 54c9a13f33 Merge pull request #238 from matburt/fix_centos7_service_script
Fix an issue with centos 7 after adding mongo as a service dependency
2015-05-22 10:44:53 -04:00
Matthew Jones eb42214d90 Fix an issue with centos 7 after adding mongo as a service dependency
* Move the ansible-tower service script to a normal bin utility
* Modify the playbook to not call the old meta init script but to use
      the specific services that are needed
2015-05-22 10:15:16 -04:00
Matthew Jones f09ef53a6c Merge pull request #226 from matburt/add_extra_vars_to_callback_jobs
Add the ability to pass extra_vars when launching callback jobs.
2015-05-20 13:18:28 -04:00
Matthew Jones 582842f54f Add the ability to pass extra_vars when launching callback jobs.
Update the docs to reflect passing json for extra_vars and the host
config key
2015-05-19 15:48:45 -04:00
Matthew Jones e4936e4b80 Fix supervisor restart behavior for ubuntu, and adjust timeouts *way*
down on when supervisor can harikiri it's child processes
2015-05-18 12:06:29 -04:00