Commit Graph

290 Commits

Author SHA1 Message Date
Chris Church
8e61d17cb4 Updated zeromq callback to receive callback port via environment variable. Changed production, development and unit tests to all use different ports/queues for the callback. 2014-02-26 14:11:59 -05:00
Matthew Jones
3231f966db More small cleanup for zeromq work. Switch back to single-path
writing of job events
2014-02-19 13:57:13 -05:00
Matthew Jones
2c694e5e07 Some cleanup and documentation for zeromq implementation 2014-02-17 11:11:48 -05:00
Matthew Jones
66e9e2310c Initial 0mq implementation 2014-02-11 05:40:31 -05:00
Chris Church
cb8b58b0ae AC-1015 Added retry count for saving to database, minor retry refactor for publishing job events. 2014-02-09 13:51:40 -05:00
Chris Church
a3ee83258c Re-enable debug prints from saving job events. 2014-02-09 06:07:00 -05:00
Chris Church
a4ae6567dc AC-1015 Update queue names so that job events are only received by the right save job events task. Add database retry to save job events task. 2014-02-09 05:58:33 -05:00
Chris Church
818f235f72 AC-507 Allow forcefully marking a job canceled if we can detect it isn't running via Celery, make sure a job canceled before it is started doesn't attempt to run at all, raise an exception for canceled jobs to interrupt the task chain. 2014-02-09 01:50:15 -05:00
Chris Church
f02a93c333 AC-1012 Open a new RabbitMQ connection for each forked process to prevent intermittent hang, update debug logging for job event callback. 2014-02-07 17:12:52 -05:00
Chris Church
e9d308c927 AC-1015 Changed where save_job_events task is started so that job events don't appear to be missing when they're stuck in the queue. 2014-02-06 17:44:17 -05:00
Chris Church
91cc144e87 AC-990 Updated callback plugin and related task to prevent missed/duplicate job events, catch exceptions and retry. Fixed task run_pexect method so that canceling a job will work. 2014-02-04 17:38:38 -05:00
Chris Church
32364ad055 AC-990 Add new task for saving all job events from a queue, updated callback plugin to send to queue, work on optimizing SQL that runs when saving a job event. 2014-02-03 17:05:03 -05:00
Matthew Jones
bc6ec06d8f Rollback and retry the task update status. Disable default idle timeouts on certain tasks 2014-01-30 15:09:49 -05:00
Matthew Jones
b226737ec5 Handle database errors and retry 2014-01-30 14:00:49 -05:00
Matthew Jones
28359e16a1 Fix spelling mistake 2014-01-30 11:41:06 -05:00
Matthew Jones
bf8c4b289a Don't raise an exception at the end of a task if we are running unit tests 2014-01-30 11:36:54 -05:00
Matthew Jones
280527f993 Enable canceling on certain levels.... fix up some unit tests 2014-01-30 10:54:54 -05:00
Matthew Jones
6c81d497de Fix some bugs and show more error detail on a current task when a previous task fails 2014-01-29 15:11:55 -05:00
Matthew Jones
47950f28a7 Complete the new task job dependency system and add post-run error handler 2014-01-29 14:04:07 -05:00
Matthew Jones
4a598d7c0a Initial work towards the celery refactor... adjusting logic to allow building a worker chain... temporarily relax requirements on status checks 2014-01-27 12:20:40 -05:00
Chris Church
8aa9fe9d7e AC-932 Support accept_hostkey option to git module when using ansible >= 1.5. 2014-01-23 04:28:20 -05:00
Matthew Jones
b9cde9cc42 Fix issue AC-935... make sure we exclude certain regions by default. cn-north-1 was added to our dependency 'boto' here: https://github.com/boto/boto/pull/1939/files but is inaccessible from outside of China 2014-01-17 16:11:50 -05:00
Chris Church
2b7af0a2ec Happy new year!!! 2014-01-02 11:51:43 -05:00
Matthew Jones
ca35419dee Fix AC-699 by using the spawnu interface on pexpect3 and making sure we use the right encoding on passwords passed to the cipher 2013-12-20 07:01:01 -05:00
Chris Church
5bf3197680 AC-752 Hide password in BROKER_URL environment variable, show other variables that are known not to contain sensitive information. 2013-12-11 15:17:18 -05:00
Chris Church
4abb595a1f Fix to use awx/lib/site-packages for all tasks, avoid using amqp broker for unit tests. 2013-12-11 10:45:54 -05:00
Chris Church
c850379222 AC-752 Work on using celery with rabbitmq, posting job events via celery. 2013-12-11 00:18:39 -05:00
Chris Church
6ec1160b0f AC-620 Change to minimize queries when adding a new job event, post process events after job has completed. 2013-11-25 11:17:47 -05:00
Chris Church
fc5c97d9ea AC-620 Continue to update status while a task is running, so that long running tasks don't get inadvertently canceled. 2013-11-21 17:58:36 -05:00
Chris Church
b59d9b766f AC-620 Updates to tests to create temp job output root, update tasks to write to stdout file directly instead of storing any stdout in memory. 2013-11-21 17:42:37 -05:00
Matthew Jones
bf07c55273 Initial task status to file implementation 2013-11-21 13:53:59 -05:00
Chris Church
f7081074d0 AC-629 Fix password field used to respond to ansible-playbooks prompts. 2013-11-19 16:21:48 -05:00
Chris Church
216ab5cf41 AC-672 Fixed responding to passphrase prompts for project updates, re-added tests removed in earlier update. 2013-11-19 13:18:38 -05:00
Chris Church
11d2f76546 AC-537 Add remaining API/field validation for credentials and other objects using credentials.
AC-630 Added validation of cloud_credential kind on job template and job, set environment variables based on cloud credential.
AC-610 Require a credential for a cloud inventory source.
AC-457 Do not set password when using hg over ssh.
2013-11-19 02:36:36 -05:00
Chris Church
621cbb9f66 AC-626 Removed support for prompting for password and ssh_key_unlock for scm/cloud credentials. 2013-11-16 17:59:51 -05:00
Chris Church
f254f8bc92 AC-613 Change rackspace to rax for inventory source field value. 2013-11-16 16:48:27 -05:00
Chris Church
902c7c2d72 AC-613 Change rackspace to rax for inventory source field value. 2013-11-16 16:47:32 -05:00
Chris Church
40b0608586 AC-632 Fix escaping for ansible-playbook command line when also using ssh-agent. 2013-11-16 16:15:35 -05:00
Chris Church
2c4062e58b AC-641 Added pattern to respond to key unlock prompt for project update. 2013-11-15 01:22:47 -05:00
Chris Church
2c4d583f3e AC-589 Update host enabled flag from inventory import. 2013-11-07 19:02:05 -05:00
Chris Church
475c0d87c2 AC-615 Handle Rackspace inventory import when source_regions is empty string. 2013-11-06 22:47:52 -05:00
Chris Church
0727a2ffa3 Update rax inventory script from Ansible. 2013-11-04 10:16:55 -05:00
Chris Church
40b56c5175 AC-537 Fixes to get unit tests to pass. 2013-11-04 10:16:55 -05:00
Chris Church
f946026ca7 AC-537 Fix syntax error. 2013-11-04 10:16:54 -05:00
Chris Church
6815905882 AC-537 Even more updates following database changes. 2013-11-04 10:16:54 -05:00
Chris Church
710d55d82d AC-575 Updated logging/output for inventory_import command. 2013-10-24 02:09:49 -04:00
Chris Church
432ed60a1f Update EC2 inventory import to use any variables defined in source_vars. Fix AC-565 by setting default regions_exclude to us-gov-west1 (same as default ec2.ini). Fix AC-566 by stripping extra whitespace from comma-separated region names. 2013-10-16 23:05:51 -04:00
Chris Church
2f3409db08 AC-558 When importing from Rackspace, add environment variable to make vendored package happy. 2013-10-16 12:42:46 -04:00
Chris Church
52d8fb5b5c AC-556 Renaming the inventory script to hopefully fix the import error. 2013-10-15 17:35:43 -04:00
Chris Church
b8ad8184ef AC-553 Added test, fixed extra_vars for passing to jobs. 2013-10-12 01:53:52 -04:00