Commit Graph
100 Commits
Author SHA1 Message Date
Matthew Jones 3b96c3ca52 Fix psutil usage on el6 for job cancel
psutil will fail to import on el6 due to not being able to access a
pseudo terminal.  This issues a SIGKILL to the proot process in order to
force the stop
2015-08-05 22:01:44 -04:00
Matthew Jones 31b8491d53 Set recursive on child process canceling
Sometimes ansible spawns many subprocesses that can get orphaned and
stuck if we only kill the direct descendent child processes
2015-08-05 22:00:27 -04:00
Matthew Jones 57778eb429 mock stdout unit test patch failure fix
Adjust some mock.patch behavior to match the new stdout behavior where
we need to check a file's size as well as its existence
2015-08-05 21:55:02 -04:00
Matthew Jones b1c12ca120 Fix empty standard out behavior
Previously we could just check for the absence of the stdout file to
know we didn't yet/wouldn't ever have any stdout content.  Now that we
are creating the stdout file ahead of time and persisting it we need to
also check to see if the file contains any data.   This is also
necessary for some unit tests.
2015-08-05 21:54:23 -04:00
Matthew Jones dc0d732ad4 Fix merge issues on stdout branch
The act of committing a PR that including part of these changes and then
reverting it meant that some of the changes from the original branch
didn't land in this new PR.   This commit adds the missing bits.

Lesson learned:  Create a new branch when submitting a PR on a
previously reverted PR
2015-08-05 21:53:46 -04:00
Matthew Jones c0ea174e93 Rework stdout display for file storage only
* Cleanup old code related to stdout download using temporary files
* Remove copy-into-database code
* Modify stdout download code to reference stdout file
2015-08-05 21:52:47 -04:00
Matthew Jones 7fd4613523 Remove uses_mongo redirection from service script 2015-07-13 15:44:58 -04:00
Matthew Jones 9a4b19bd11 Update start/stop service script ordering
Mongo needs to be last when starting and first when stopping if enabled
2015-07-13 14:05:22 -04:00
Matthew Jones 08ec0c132e Merge pull request #306 from matburt/fix_restore_playbook
Fix the restore playbook procedure
2015-07-09 16:17:17 -04:00
Matthew Jones 874c97f748 Purge some unneeded HA unit tests 2015-07-08 14:31:02 -04:00
Matthew Jones 5605ec9754 Adjust usage of is_ha_environment()
Limit it to just instance count and make sure we use it for the mongo check
2015-07-08 14:18:04 -04:00
Matthew Jones d5e948890c Stricter control of mongo in setup playbook
Detect if this is an HA setup and if so we won't attempt to start mongo
during the setup process
2015-07-08 13:45:59 -04:00
Matthew Jones 9e6c604fc1 Remove extra output from doing a hard mongo shutdown. 2015-07-06 14:38:19 -04:00
Matthew Jones 4fd0fbda08 Invert the conditional checking for whether or not mongo is running 2015-07-06 14:28:27 -04:00
Matthew Jones 26af43dab6 Remove superflous sleep when shutting mongo down 2015-07-06 14:19:12 -04:00
Matthew Jones 9b03d22d75 Fixes to conditionally invoking mongo shutdown
* Make sure we are waiting on the service script
* Improve sudo configuration
* Check pidof before attempting to invoke a hard mongo shutdown
2015-07-06 14:15:41 -04:00
Matthew Jones 10f5308bd8 Fix version parsing of ansible to exclude newlines 2015-07-06 12:16:17 -04:00
Matthew Jones 5a77d1f0d4 Fix up mongo service handline and task logging
* Use -f instead of -c for mongod when refernecing config file
  for shutdown behavior in the stop task
* Fix up task logging to use new supervisor configuration syntax
2015-07-06 11:49:24 -04:00
Matthew Jones cd41d99843 Merge pull request #298 from matburt/fix_ha_setup_logic
Fix ha setup logic
2015-06-26 16:16:07 -04:00
Matthew Jones 414394afa0 can not -> cannot (even though they are both correct) 2015-06-26 15:35:33 -04:00
Matthew Jones 05f56c805a Logic should check for the condition where HA is NOT enabled 2015-06-26 15:28:41 -04:00
Matthew Jones 80a6f22c0c Move HA license check logic to the promotion step and allow registering
HA instances.   Registration is allowed but promotion/demotion is not
allowed without the HA feature
2015-06-26 15:23:07 -04:00
Matthew Jones 237a661912 Fix verbage around why we are disallowing removing a primary 2015-06-26 15:22:35 -04:00
Matthew Jones 97bfa32b44 Merge pull request #296 from matburt/extricate_service_script_playbooks
Extricate service script playbooks
2015-06-25 13:29:23 -04:00
Matthew Jones 4d84a603ad Add missing fact receiver logfile in production settings 2015-06-24 11:05:19 -04:00
Matthew Jones b45ea4f1f4 Force shutdown of mongo after requesting a service stop. Just in case. 2015-06-23 12:32:43 -04:00
Matthew Jones d01e93535d Fixing flake8 issue 2015-06-15 09:36:04 -04:00
Matthew Jones bb7af4e916 Merge pull request #277 from matburt/fix_inventory_read_jt_rbac
Check inventory access for normal users when deciding what job templates show up in the queryset
2015-06-12 16:04:34 -04:00
Matthew Jones 5d1b27e520 Adding some job template listing unit tests and permissions to actually
make those work
2015-06-12 14:43:24 -04:00
Matthew Jones df61fd6ab8 Check inventory access for normal users when deciding what job templates
show up in the job template queryset
2015-06-11 16:24:54 -04:00
Matthew Jones d011a87bb0 Support cancel on system jobs 2015-06-11 15:19:27 -04:00
Matthew Jones f945719794 Fix a few more copyright statements 2015-06-11 14:53:25 -04:00
Matthew Jones bcc18aa689 Make using named pipe for adding passwords conditional on the version
of ssh used.
2015-06-11 14:48:10 -04:00
Matthew Jones 322fdc37a4 Remove some spurious print statements I left previously 2015-06-11 14:48:09 -04:00
Matthew Jones f9ca5159e7 Fix up more copyright headers 2015-06-10 16:11:26 -04:00
Matthew Jones 3c2f3f323a Fix some flake8 2015-06-09 16:07:06 -04:00
Matthew Jones ab5c4b5f20 Check connection for scan jobs before actually running the job, fail
early if the system tracking database isn't available
2015-06-09 15:31:23 -04:00
Matthew Jones c6c80447a6 Fix a spelling error in the setup script that's causing rpm build failures 2015-06-09 10:57:38 -04:00
Matthew Jones 62e16929d0 Merge pull request #274 from matburt/add_mongo_munin_stats
Add munin monitors for mongo
2015-06-08 20:35:54 -04:00
Matthew Jones 712861b829 Remove mongo_{btree,lock} as worthless monitoring points (and broken at that) 2015-06-08 16:24:33 -04:00
Matthew Jones 848bff4220 Add munin monitors for mongo 2015-06-08 16:23:37 -04:00
Matthew Jones 074e66219d Add a docker development container build make target 2015-06-08 16:00:35 -04:00
Matthew Jones e471798918 Merge pull request #268 from matburt/support_DELETE_license
Support DELETE of the license on the config endpoint
2015-06-05 16:52:23 -04:00
Matthew Jones 23eaf9ae42 Support DELETE of the license on the config endpoint 2015-06-05 15:53:35 -04:00
Matthew Jones fbe82d9348 Allow AWS ami license type to support the new license type scheme. Also
allows new ami licenses to be created at different license type levels
while defaulting to legacy
2015-06-05 12:39:36 -04:00
Matthew Jones a8d75783a3 Some launch changes and configuration changes to the Dockerfile 2015-06-05 11:18:27 -04:00
Matthew Jones 4d2fba15ab Some minor fixes for the dockerfile container image build process 2015-06-05 11:12:23 -04:00
Matthew Jones 715e12ba98 Merge pull request #264 from matburt/system_job_template_wording
Update doc template for system job launching
2015-06-05 09:56:35 -04:00
Matthew Jones 80dddfddc5 Update doc template for system job launching 2015-06-04 14:16:08 -04:00
Matthew Jones 01fc6ff8c6 Merge pull request #263 from matburt/check_low_var_space
Add a task to the preflight check to verify a minimum amount of space on
2015-06-04 13:44:51 -04:00
Matthew Jones d76ee309c6 Allo the file fact scanner to take a list of paths instead of just one path 2015-06-03 11:36:50 -04:00
Matthew Jones 7d8edd9617 Check survey license enabled when creating, updating, and starting job
templates with surveys enabled
2015-06-01 17:01:49 -04:00
Matthew Jones 5bd25d408a Generate sane errors if the mongo database is down when a request for
fact versions is made
2015-06-01 16:22:11 -04:00
Matthew Jones e392add46f Catch exceptions if there are issues communicating with mongo 2015-06-01 16:00:11 -04:00
Matthew Jones db5af80daa Conditionals on official builds for rpm-build 2015-06-01 16:00:11 -04:00
Matthew Jones 742a2fd265 Adding documentation templates for endpoints 2015-06-01 16:00:11 -04:00
Matthew Jones 06464333a6 Check license before launching job template and disallow scan job
template launch if license is unsupported
2015-06-01 14:15:42 -04:00
Matthew Jones 82ac560cf2 Remove related single fact link on the group view 2015-06-01 14:12:39 -04:00
Matthew Jones 9d419820d5 Remove the single fact view link from the inventory serializer 2015-06-01 14:11:36 -04:00
Matthew Jones 22bbf21c09 Documenting new system tracking endpoints 2015-06-01 13:39:24 -04:00
Matthew Jones 3375460a94 Unwire the single_fact endpoints from the api for this release since
they aren't implemented on the front end and we still need to do some
work on them
2015-06-01 13:39:24 -04:00
Matthew Jones 8006066609 Disable cleanup_facts if the user does not have system tracking enabled
in their license file
2015-06-01 10:30:41 -04:00
Matthew Jones 35fd2addc6 Remove runas from the list of become method choices since it's not
implemented in ansible yet (although it is listed in their help docs)
2015-06-01 09:48:16 -04:00
Matthew Jones 22ecb62179 Perform type checking on module_name and args for ad-hoc commands to
satisfy qa.
2015-05-29 14:55:42 -04:00
Matthew Jones 31d0342d41 More copyright headers for api side stuff 2015-05-29 12:10:40 -04:00
Matthew Jones b3da3b34a3 Changing some legal headers for python source files 2015-05-29 12:10:39 -04:00
Matthew Jones 609ded80e2 Check system tracking enabled before trying to fetch fact versions 2015-05-29 10:53:34 -04:00
Matthew Jones 8795f06801 Capitalize the first letters of the scan modules for the UI 2015-05-29 10:47:43 -04:00
Matthew Jones 20e85a6d34 Unit test for disallowing scan job with survey 2015-05-29 10:43:54 -04:00
Matthew Jones c644934afc Disallow creating a survey with a scan job template 2015-05-29 10:43:54 -04:00
Matthew Jones 10da862ab1 Lower the cleanup_deleted batch size to 50 to reduce overall memory
usage during the cleanup operation
2015-05-28 16:37:34 -04:00
Matthew Jones 094072f9dc Fix an issue where the single_fact view could still generate a 500 error
if mongo wasn't running and system tracking was disabled by the license
2015-05-28 16:19:55 -04:00
Matthew Jones 5b3b4b48c0 Fix an issue when creating scan job templates where we weren't obeying
the license flag, so folks could still create scan jobs even if they
weren't enabled by the license.  Plus Unit Tests
2015-05-28 15:59:49 -04:00
Matthew Jones f5391cab11 Fix an issue where passing an empty yaml file (or ---) would cause an
error if including a port specifier on a hostname
2015-05-28 09:42:41 -04:00
Matthew Jones 6d3bd2500a Remove spuriously added keystone client package info file 2015-05-26 13:46:07 -04:00
Matthew Jones c930b7759a Add 'finished' property to recent jobs 2015-05-26 13:08:26 -04:00
Matthew Jones b2b05d9212 Import dist-info directories for various openstack libs, otherwise pbr
can't find the versions and that causes errors
2015-05-26 10:42:51 -04:00
Matthew Jones fdaf9bcd52 Add psutil to the package deps for the dockerfile 2015-05-26 09:59:53 -04:00
Matthew Jones f9291940dd Implement the api side system job template migration for the fact
cleanup job
2015-05-22 11:12:27 -04:00
Matthew Jones 54c9a13f33 Merge pull request #238 from matburt/fix_centos7_service_script
Fix an issue with centos 7 after adding mongo as a service dependency
2015-05-22 10:44:53 -04:00
Matthew Jones eb42214d90 Fix an issue with centos 7 after adding mongo as a service dependency
* Move the ansible-tower service script to a normal bin utility
* Modify the playbook to not call the old meta init script but to use
      the specific services that are needed
2015-05-22 10:15:16 -04:00
Matthew Jones f09ef53a6c Merge pull request #226 from matburt/add_extra_vars_to_callback_jobs
Add the ability to pass extra_vars when launching callback jobs.
2015-05-20 13:18:28 -04:00
Matthew Jones 582842f54f Add the ability to pass extra_vars when launching callback jobs.
Update the docs to reflect passing json for extra_vars and the host
config key
2015-05-19 15:48:45 -04:00
Matthew Jones e4936e4b80 Fix supervisor restart behavior for ubuntu, and adjust timeouts *way*
down on when supervisor can harikiri it's child processes
2015-05-18 12:06:29 -04:00
Matthew Jones 472f086862 Fix an issue where a well timed cancel could try to cancel a job right
after it has finished causing an error.
2015-05-18 10:19:03 -04:00
Matthew Jones b07803d2b8 Switch tower_warnings.log to tower.log 2015-05-05 16:53:06 -04:00
Matthew Jones cdf6905bca Update Tools Dockerfile to install and configure the mongodb dependencies 2015-05-05 16:52:42 -04:00
Matthew Jones e784595119 Initial implementation of fact api endpoints 2015-05-05 14:47:58 -04:00
Matthew Jones 2e040e9de3 Update scan facts to include the service scanner which was inexplicably
missing, update scan_packages to match the footprint of
scan_services (makes searching easier)
2015-05-05 14:46:28 -04:00
Matthew Jones 1bd2c99171 Import mongoengine rest framework module, document this and mongoengine
in the readme
2015-05-05 14:45:44 -04:00
Matthew Jones a081614c9a Merge branch 'mongo_ancillary_services' into upstream_master
* mongo_ancillary_services:
  Adding the fact cache receiver to the supervisor config
  Implementing tower cleanup task for cleaning up facts
2015-04-27 09:49:35 -04:00
Matthew Jones 22acd51650 Implementing tower cleanup task for cleaning up facts 2015-04-24 14:15:25 -04:00
Matthew Jones 3f4aafa501 Merge remote-tracking branch 'refs/remotes/chrismeyers/fix-cloud_credentials2' into upstream_master
* refs/remotes/chrismeyers/fix-cloud_credentials2:
  multiple credentials implementation style more inline with existing code
  allow machine and cloud credentials to co-exist.
2015-04-23 16:09:14 -04:00
Matthew Jones 19901ba7cf Turns out "hostId" is not a good unique host identifier in openstack.
Switching to use "id" instead.
2015-04-23 16:02:44 -04:00
Matthew Jones c45a422590 Update "make server" endpoint and Makefile to include the new fact cache
receiver. Upgrade docker tool to install mongo and pymongo
2015-04-23 13:34:56 -04:00
Matthew Jones 405be7edd8 Merge branch 'openstack_inventory_support' into upstream_master
* openstack_inventory_support:
  Use inventory_source source_vars to control what address we use for ansible_ssh_host
  Some small changes to tower openstack work
2015-04-23 11:09:41 -04:00
Matthew Jones abdfb26b3d Use inventory_source source_vars to control what address we use for ansible_ssh_host 2015-04-23 11:07:31 -04:00
Matthew Jones 5a401c31aa Handle any exception that could come from sending a packet to a client 2015-04-22 16:50:37 -04:00
Matthew Jones 36512d74c2 Unused variable to make pyflakes happy 2015-04-21 16:13:37 -04:00
Matthew Jones 0fc753046d This fixes an issue where various parts of the system could get stuck
waiting to emit a socketio event if there was a problem with the
websocket service.  Instead of crashing and hanging the system it will
now emit an error and continue.
2015-04-21 15:29:37 -04:00