Commit Graph
100 Commits
Author SHA1 Message Date
Matthew Jones 799e8d30ba Integrate main schedules resource
Integrated scheduled jobs list
Implement updating ancillary details on dependent models
Further cleanup
2014-03-28 12:50:35 -04:00
Matthew Jones c1d314ed6f Running scheduled items now works 2014-03-27 22:45:51 -04:00
Matthew Jones b665345070 Support passing the schedule when signaling start so we record which
schedule this came from
2014-03-27 22:45:51 -04:00
Matthew Jones 65bb42c2f2 Make dtstart field somewhat optional 2014-03-27 16:01:09 -04:00
Matthew Jones 107fc85110 Initial scheduler integration 2014-03-27 15:53:45 -04:00
Matthew Jones 74602f1009 Check project and inventory source update cache timeout when deciding
whether or not to spawn an instance of either one as a dependency
2014-03-25 16:21:46 -04:00
Matthew Jones 1dc3aa8ab1 Relax job dependency conflicts raised by customer support
If both jobs are callbacks whose limits are different allow them to
not conflict with each other when deciding launch dependencies
2014-03-25 16:20:27 -04:00
Matthew Jones 03249e59f3 Fix up job run types so that we aren't auto-starting new jobs. Fix up
job dependency generator to call the right new methods for generating
inventory and project updates
2014-03-25 15:21:30 -04:00
Matthew Jones bb630fddbc Fix up error handler callback to include the task that actually failed 2014-03-25 15:01:54 -04:00
Matthew Jones 7196262987 Update graph generator to look right 2014-03-25 15:01:54 -04:00
Matthew Jones 61ab197b3a If we fail the prestart check on a job, record the conditions by which we fail 2014-03-24 14:57:53 -04:00
Matthew Jones ec2dfa3c74 Rename link for unified jobs list 2014-03-24 12:01:01 -04:00
Matthew Jones 2d443bad26 Change the api v1 resource for unified jobs 2014-03-24 11:58:05 -04:00
Matthew Jones b35cee7b72 Eliminate the 'pending' status and remove dependency checks that
necessitated it during pre-run... tighten the transaction wrapper
to just be used when actually updating model details
2014-03-24 11:48:28 -04:00
Matthew Jones 0f1fc77be3 Switch up the api end point for unified jobs 2014-03-24 11:48:04 -04:00
Matthew Jones af231cc8b7 Resolve can_start from the client side and the signaler side 2014-03-24 09:47:36 -04:00
Matthew Jones 6941d89502 Tasks are only 'can_start' if they are in the 'new' state 2014-03-23 19:56:28 -04:00
Matthew Jones 3e88894f85 Temporarily relax task notification and rely on polling 2014-03-23 18:37:51 -04:00
Matthew Jones bec301c2a8 Shift task start signal into an asynchronous task so we don't deadlock trying to update the same record from the task runner while waiting for the signal to be received from the signaler 2014-03-22 11:18:25 -04:00
Matthew Jones 4b9059388e Switch to using a network socket instead of an ipc socket, closes issue AC-1088 2014-03-21 14:44:22 -04:00
Matthew Jones e66fa7cead Fix up some bugs for the UI's dummy endpoints 2014-03-20 22:09:21 -04:00
Matthew Jones f3e9be636c Add some dummy api end points for House 2014-03-20 17:59:58 -04:00
Matthew Jones 6f11502528 Emit log messages by default on the task runner 2014-03-20 11:46:58 -04:00
Matthew Jones f1ac2ff899 Bug fixes for CentOS 2014-03-20 11:22:19 -04:00
Matthew Jones c9340cf5f1 Add a new mechanism for automagically creating a tmux session, splitting it into panes, and starting each Tower needed tower service... This is so you don't have to start each one manually 2014-03-19 13:51:55 -04:00
Matthew Jones bf19b76d5a Merge remote-tracking branch 'origin/task-system-rework'
* origin/task-system-rework: (36 commits)
  Need to grab just the first item for the scm test project update
  Revert a project unit test
  Make sure we are calling signal_start in unit tests
  Make sure we are calling signal_start in unit tests
  Bypass task runner system in normal job start tests... we'll test it another way so assume we want to just start the job right away
  Fixing up unit tests
  Missing line-end comma
  Prevent deadlocks on unit tests in a very specific scenario
  Ignore checking celery task list during some unit tests, triggered by UNIT_TEST_IGNORE_TASK_WAIT
  Missing semicolon
  Remove update on launch, we'll test this another way
  Make sure we ignore the wait update for tasks under dependency situations in the unit tests
  Fix up run task manager script to handle signals, fix up task cancel job, add restart handler for ubuntu
  Fix some bugs found from unit tests
  More unit test rework
  Some job tests can't run in their current state
  Make sure we check arguments passed to signal start before allowing it to proceed.
  No need to replace original build_args
  Unit test updates for task system... remove old monkeypatch procedure for getting job args in favor of using the job info from the database. Can't do this anymore anyway since the job is running in another process
  Changes to tasks unit tests
  ...
2014-03-19 13:14:21 -04:00
Matthew Jones d3d84706a4 Need to grab just the first item for the scm test project update 2014-03-19 12:53:11 -04:00
Matthew Jones e24538865f Revert a project unit test 2014-03-19 12:49:13 -04:00
Matthew Jones 0548126e33 Make sure we are calling signal_start in unit tests 2014-03-19 11:56:30 -04:00
Matthew Jones 77e4d33770 Make sure we are calling signal_start in unit tests 2014-03-19 11:26:22 -04:00
Matthew Jones 14e138a7bd Bypass task runner system in normal job start tests... we'll test it another way so assume we want to just start the job right away 2014-03-19 11:09:14 -04:00
Matthew Jones 1093b00e2a Fixing up unit tests 2014-03-18 14:58:45 -04:00
Matthew Jones 7ac58dead3 Missing line-end comma 2014-03-18 12:04:27 -04:00
Matthew Jones 7fe474aec5 Prevent deadlocks on unit tests in a very specific scenario 2014-03-18 12:02:14 -04:00
Matthew Jones fe625785c7 Ignore checking celery task list during some unit tests, triggered by UNIT_TEST_IGNORE_TASK_WAIT 2014-03-17 14:53:38 -04:00
Matthew Jones 57fff65577 Missing semicolon 2014-03-17 12:55:59 -04:00
Matthew Jones 1243e044a0 Remove update on launch, we'll test this another way 2014-03-17 12:52:23 -04:00
Matthew Jones e0b72ff452 Make sure we ignore the wait update for tasks under dependency
situations in the unit tests
2014-03-17 11:24:44 -04:00
Matthew Jones f6ac7fb6d0 Fix up run task manager script to handle signals, fix up task cancel job, add restart handler for ubuntu 2014-03-17 11:05:53 -04:00
Matthew Jones 28c9d77f29 Fix some bugs found from unit tests 2014-03-14 15:54:27 -04:00
Matthew Jones 382e1e96c7 More unit test rework 2014-03-14 15:25:06 -04:00
Matthew Jones f3ea7d68cc Some job tests can't run in their current state 2014-03-14 13:00:33 -04:00
Matthew Jones e6209d4d4f Make sure we check arguments passed to signal start before allowing it
to proceed.
2014-03-13 14:43:47 -04:00
Matthew Jones 20285e18e5 No need to replace original build_args 2014-03-13 13:27:21 -04:00
Matthew Jones c2950fdbdf Unit test updates for task system... remove old monkeypatch procedure
for getting job args in favor of using the job info from the database.
Can't do this anymore anyway since the job is running in another process
2014-03-13 13:25:45 -04:00
Matthew Jones fe4b4043db Changes to tasks unit tests 2014-03-13 10:56:15 -04:00
Matthew Jones 16f0373766 Properly hand arguments on the base task 2014-03-13 10:53:38 -04:00
Matthew Jones 3fe31828a8 Cleanup for unit tests, working command unit test 2014-03-13 10:48:01 -04:00
Matthew Jones c8534055ef Do not return from the graph building routine if we are in celery debug mode. 2014-03-12 17:54:34 -04:00
Matthew Jones fc4f256723 Signal finished tasks to the task management system 2014-03-12 17:52:55 -04:00
Matthew Jones 99d42dc3fa Cleaning up unit tests to call signal_start 2014-03-12 17:01:23 -04:00
Matthew Jones c0382f78bb Include a newline on the debug generated graph visualization
fix some import bugs and clear some whitespace from the command test
2014-03-12 16:32:21 -04:00
Matthew Jones fbafa22a5a Make sure we are passing arguments down for inventory and project update
actions. Fix up some unit tests.
2014-03-12 16:24:13 -04:00
Matthew Jones 3c82085b93 Handle the situation where we could not communiate with celery 2014-03-12 16:11:56 -04:00
Matthew Jones 93e68009a7 Modifications to launch the task manager during unit tests 2014-03-12 15:06:28 -04:00
Matthew Jones 5ae324960e Add migration for including encrypted start args in the task tables 2014-03-12 14:29:27 -04:00
Matthew Jones 2224382caa More docs and fix a bug where we could crash attempting to mark a job as
failed when it wasn't running in celery
2014-03-12 14:26:15 -04:00
Matthew Jones 06cc5ffb4a Docs and setup details for the task manager 2014-03-12 14:09:00 -04:00
Matthew Jones d176466ccc Fix a customer issue in HEAD. We should catch OSError here instead of IOError 2014-03-04 15:43:49 -05:00
Matthew Jones 78bba13bbb Merge pull request #8 from jlaska/rhel7_support
Add rhel7 support to setup playbook
2014-02-26 11:37:15 -05:00
Matthew Jones e4d860e3dc Fix issue AC-977 by including job_template in summary fields for job
activity stream events
2014-02-14 09:48:34 -05:00
Matthew Jones 770947d18d Pull results off zeromq and distribute to workers 2014-02-12 16:09:57 -05:00
Matthew Jones 063380304a Manage the zeromq connection per-pid 2014-02-11 05:56:51 -05:00
Matthew Jones 66e9e2310c Initial 0mq implementation 2014-02-11 05:40:31 -05:00
Matthew Jones 2a88d3cb07 Close issue AC-905... refactor RBAC to handle inactive and deleted items 2014-02-07 09:37:59 -05:00
Matthew Jones fb1bff54ca Fix an issue where we were checking object existence
In the new to_native methods on serializers
2014-02-07 05:56:26 -05:00
Matthew Jones 57030390c0 Fix AC-975... filter inactive permissions in some of the access code. 2014-02-06 08:47:00 -05:00
Matthew Jones 00156a5518 Updating AC-984... only conditionally recompute inventory fields in group delete if it isn't a part of an inventory delete 2014-02-04 09:55:55 -05:00
Matthew Jones e911bdc3da Updating AC-984... delay field computation until after the group has been removed 2014-02-04 09:29:28 -05:00
Matthew Jones 9b67b575f1 Fix issue AC-1002, make sure we return a count of the number of inventories with active failed jobs 2014-02-03 06:11:51 -05:00
Matthew Jones a21332a2d4 Fix AC-969, Convert variables element in changes dictionary from json representation 2014-01-31 10:59:06 -05:00
Matthew Jones 77e77d905a Fix AC-1004, Instead of using serializers.Field() which will force a repr() of the object... use serializers.PrimaryKeyField() which will use the expected field type for the response 2014-01-31 10:34:02 -05:00
Matthew Jones 867c22c36c Fix AC-981, mark last_job* fields as read only on the host serializer so activity stream will ignore them when processing events 2014-01-31 09:04:07 -05:00
Matthew Jones bb0a2887d5 Fix AC-998, Don't set created_by on the object when updating the object (only when creating). activity stream will save modifications and who made them 2014-01-31 07:00:21 -05:00
Matthew Jones 380f6c6d6f Fix AC-1001, hide BROKER_URL from the job_env section of task api data 2014-01-31 05:17:26 -05:00
Matthew Jones bc6ec06d8f Rollback and retry the task update status. Disable default idle timeouts on certain tasks 2014-01-30 15:09:49 -05:00
Matthew Jones b226737ec5 Handle database errors and retry 2014-01-30 14:00:49 -05:00
Matthew Jones a85e109da7 Merge remote-tracking branch 'origin/celery-refactor'
* origin/celery-refactor: (33 commits)
  Fix spelling mistake
  Jobs begin in the waiting state
  Don't raise an exception at the end of a task if we are running unit tests
  Enable canceling on certain levels.... fix up some unit tests
  Check for invalid tasks and mark created tasks as failed when constructing task chains
  Fix merge spacing from conflicted merge
  Fix some bugs and show more error detail on a current task when a previous task fails
  Leave another TODO on the job runner, fix a misspelling on the project update hook
  Initial work towards the celery refactor... adjusting logic to allow building a worker chain... temporarily relax requirements on status checks
  Remove 'awx-' prefix when reporting version
  Explicitly include the egg-info in rpm packaging
  Fixing store references to point to http://www.ansible.com/ansible-pricing
  Update make develop command, version check after package rename.
  AC-992 Fix inventory import tests.
  AC-967 Fixed job name in the host status fly-out. Text now wraps rather than extending beyond boundaries of pop-over. Removed status label- just show red/green dot. Clicking on ID or red/green dot shows the status dialog. When dialog closes the window.resize() watcher is restored.
  AC-976 now using custom javascript to apply ellipsis to long group and host names. Fixed indes.html title.
  Fix ansible-tower deb build
  Rename package awx to ansible-tower
  AC-976 add job template name to activity stream
  AC-979 using activity stream object arrays correctly. AC-980 fixed Action label on detail dialog.
  ...
2014-01-30 11:59:17 -05:00
Matthew Jones 28359e16a1 Fix spelling mistake 2014-01-30 11:41:06 -05:00
Matthew Jones 32220405de Jobs begin in the waiting state 2014-01-30 11:40:20 -05:00
Matthew Jones bf8c4b289a Don't raise an exception at the end of a task if we are running unit tests 2014-01-30 11:36:54 -05:00
Matthew Jones 280527f993 Enable canceling on certain levels.... fix up some unit tests 2014-01-30 10:54:54 -05:00
Matthew Jones 6afc584a4f Check for invalid tasks and mark created tasks as failed when constructing task chains 2014-01-30 01:19:49 -05:00
Matthew Jones 6ff98d87e9 Fix merge spacing from conflicted merge 2014-01-30 01:04:17 -05:00
Matthew Jones 82b692be9c Merge remote-tracking branch 'origin/master' into celery-refactor
* origin/master: (28 commits)
  AC-995 fixed typo and added extra error handling in case we actually cannot parse inventory variables. If that does happen, we now alert the user and keep the application stable and running.
  Use supervisorctl when restarting celeryd on Ubuntu
  Revert custom supervisor initscript
  fix for the small viewport issue (https://www.dropbox.com/s/dmf4aixfv7k67cm/Screenshot%202014-01-29%2015.19.52.png) where group name div gets pushed to a new line.
  Fixed AS widget breadcrumb links
  AC-977 Fixed raw html showing up in Action field on detail dialog. Added a subtitle on the AS widget. On inventory groups/host page the subtitle explains what activities are being displayed, and only activities realted to the selected group (on the inventory page) are displayed. If All Hosts selected, then all activities for all groups related to the current inventory are displayed. Also, brought back activity stream button for inventory hosts.
  During AMI boot, use custom initscript name
  Update tower-setup filename used in AMI build
  AC-578 - Add custom supervisor initscript on ubuntu
  Remove 'awx-' prefix when reporting version
  Explicitly include the egg-info in rpm packaging
  Fixing store references to point to http://www.ansible.com/ansible-pricing
  Update make develop command, version check after package rename.
  AC-992 Fix inventory import tests.
  AC-967 Fixed job name in the host status fly-out. Text now wraps rather than extending beyond boundaries of pop-over. Removed status label- just show red/green dot. Clicking on ID or red/green dot shows the status dialog. When dialog closes the window.resize() watcher is restored.
  AC-976 now using custom javascript to apply ellipsis to long group and host names. Fixed indes.html title.
  Fix ansible-tower deb build
  Rename package awx to ansible-tower
  AC-976 add job template name to activity stream
  AC-979 using activity stream object arrays correctly. AC-980 fixed Action label on detail dialog.
  ...

Conflicts:
	awx/ui/static/js/controllers/Inventories.js
	awx/ui/static/js/lists/InventoryHosts.js
	awx/ui/static/js/widgets/Stream.js
2014-01-30 01:00:00 -05:00
Matthew Jones 6c81d497de Fix some bugs and show more error detail on a current task when a previous task fails 2014-01-29 15:11:55 -05:00
Matthew Jones db14daf5e5 Leave another TODO on the job runner, fix a misspelling on the project update hook 2014-01-29 14:23:57 -05:00
Matthew Jones 5c076529c0 Initial work towards the celery refactor... adjusting logic to allow building a worker chain... temporarily relax requirements on status checks 2014-01-29 14:23:57 -05:00
Matthew Jones 47950f28a7 Complete the new task job dependency system and add post-run error handler 2014-01-29 14:04:07 -05:00
Matthew Jones 2514a3dd9a Merge branch 'celery-refactor' of github.com:ansible/ansible-commander into celery-refactor
* 'celery-refactor' of github.com:ansible/ansible-commander:
  Leave another TODO on the job runner, fix a misspelling on the project update hook
  Initial work towards the celery refactor... adjusting logic to allow building a worker chain... temporarily relax requirements on status checks
2014-01-27 12:21:26 -05:00
Matthew Jones 654a7e6d07 Leave another TODO on the job runner, fix a misspelling on the project update hook 2014-01-27 12:20:40 -05:00
Matthew Jones 4a598d7c0a Initial work towards the celery refactor... adjusting logic to allow building a worker chain... temporarily relax requirements on status checks 2014-01-27 12:20:40 -05:00
Matthew Jones 6f069f6ff0 Leave another TODO on the job runner, fix a misspelling on the project update hook 2014-01-27 12:20:21 -05:00
Matthew Jones d4426d88c4 Initial work towards the celery refactor... adjusting logic to allow building a worker chain... temporarily relax requirements on status checks 2014-01-27 11:37:18 -05:00
Matthew Jones 3d228b2955 Fix a bug where we would treat the new model value like the old one when comparing activity stream changes 2014-01-23 20:49:50 -05:00
Matthew Jones bb6c34f4a4 Implement AC-911, use the proper type relative to json serialization for the stored changes dict on an activity stream object 2014-01-23 16:19:14 -05:00
Matthew Jones 2712643c62 Implement AC-667... user serializer to determine read-only fields and use those to decide what to populate in activity stream create instances AND when to create active stream update instances 2014-01-23 15:44:36 -05:00
Matthew Jones 9bbeeb90a8 Fix AC-955, disable task prefetching by celery. 2014-01-22 16:05:26 -05:00
Matthew Jones b9cde9cc42 Fix issue AC-935... make sure we exclude certain regions by default. cn-north-1 was added to our dependency 'boto' here: https://github.com/boto/boto/pull/1939/files but is inaccessible from outside of China 2014-01-17 16:11:50 -05:00
Matthew Jones a0affa90d4 Change label on recent jobs for host to use 'status' 2014-01-16 12:24:09 -05:00