Commit Graph
100 Commits
Author SHA1 Message Date
Matthew Jones feb1bb6e8a Wrap up schedule rrule documentation 2014-04-02 14:54:53 -04:00
Matthew Jones 8659eab1d3 Include dependent file in schedules list docs 2014-04-02 14:34:08 -04:00
Matthew Jones 5f7ea664f2 Adding some Schedule documentation 2014-04-02 14:30:13 -04:00
Matthew Jones d190aa3001 Wrap up rrule validation for scheduler 2014-04-02 11:44:49 -04:00
Matthew Jones 3e2e682658 Re-do the way we perform dtend calculation by parsing the until value
instead of attempting to read the last item from the list in cases where
the list is very long
2014-04-02 11:44:49 -04:00
Matthew Jones 4069a33ab0 Scheduler unit tests 2014-04-01 17:12:46 -04:00
Matthew Jones 306544dca0 Fix up schedule access control by referencing the right base object 2014-04-01 16:48:45 -04:00
Matthew Jones 54599578a0 Fix up ScheduleAccess queryset to fit between schedules and unified jobs 2014-04-01 13:13:53 -04:00
Matthew Jones 49f6bd3e1c Fix imports for using Job in some models 2014-04-01 13:02:33 -04:00
Matthew Jones 7bc7362299 Complete rrule validation 2014-04-01 11:22:42 -04:00
Matthew Jones 2e6457b887 Recalculate dtstart and dtend on every save now that it is idempotwhatever 2014-04-01 10:09:52 -04:00
Matthew Jones 2913ce21d2 Make sure we store the real start value for a schedule 2014-03-31 17:35:49 -04:00
Matthew Jones 4a535e5404 Updating dependency check for jobs, project updates, and inventory updates 2014-03-31 17:16:49 -04:00
Matthew Jones 60b399409a Update old schedules if we missed them 2014-03-31 15:33:25 -04:00
Matthew Jones 43ae60d2f4 Fix up issue associating type of unified job template summary fields 2014-03-31 15:29:44 -04:00
Matthew Jones 8c020ddd0b Add type to unified_job_template summary fields 2014-03-31 14:58:34 -04:00
Matthew Jones 9e898953dd Revert start_args when launching job 2014-03-31 12:45:57 -04:00
Matthew Jones 7e5ac7b3fa Make sure we shoehorn start args to empty string 2014-03-31 11:38:54 -04:00
Matthew Jones 96a4752f2f Be more strict when verifying dtstart 2014-03-31 11:33:49 -04:00
Matthew Jones a3ca786758 Fix some import errors and filter errors when updating unified_jobs with
schedule information
2014-03-31 10:26:12 -04:00
Matthew Jones 9b440c5209 Fix an issue where POST to schedules would no longer work. Populate
some more summary fields
2014-03-28 22:11:02 -04:00
Matthew Jones c46f1de347 Some initial validation logic and documentation on what we require/reject 2014-03-28 14:37:50 -04:00
Matthew Jones c1734d74cf Use unified job set for joining the schedule and unified jobs 2014-03-28 12:52:28 -04:00
Matthew Jones 799e8d30ba Integrate main schedules resource
Integrated scheduled jobs list
Implement updating ancillary details on dependent models
Further cleanup
2014-03-28 12:50:35 -04:00
Matthew Jones c1d314ed6f Running scheduled items now works 2014-03-27 22:45:51 -04:00
Matthew Jones b665345070 Support passing the schedule when signaling start so we record which
schedule this came from
2014-03-27 22:45:51 -04:00
Matthew Jones 65bb42c2f2 Make dtstart field somewhat optional 2014-03-27 16:01:09 -04:00
Matthew Jones 107fc85110 Initial scheduler integration 2014-03-27 15:53:45 -04:00
Matthew Jones 74602f1009 Check project and inventory source update cache timeout when deciding
whether or not to spawn an instance of either one as a dependency
2014-03-25 16:21:46 -04:00
Matthew Jones 1dc3aa8ab1 Relax job dependency conflicts raised by customer support
If both jobs are callbacks whose limits are different allow them to
not conflict with each other when deciding launch dependencies
2014-03-25 16:20:27 -04:00
Matthew Jones 03249e59f3 Fix up job run types so that we aren't auto-starting new jobs. Fix up
job dependency generator to call the right new methods for generating
inventory and project updates
2014-03-25 15:21:30 -04:00
Matthew Jones bb630fddbc Fix up error handler callback to include the task that actually failed 2014-03-25 15:01:54 -04:00
Matthew Jones 7196262987 Update graph generator to look right 2014-03-25 15:01:54 -04:00
Matthew Jones 61ab197b3a If we fail the prestart check on a job, record the conditions by which we fail 2014-03-24 14:57:53 -04:00
Matthew Jones ec2dfa3c74 Rename link for unified jobs list 2014-03-24 12:01:01 -04:00
Matthew Jones 2d443bad26 Change the api v1 resource for unified jobs 2014-03-24 11:58:05 -04:00
Matthew Jones b35cee7b72 Eliminate the 'pending' status and remove dependency checks that
necessitated it during pre-run... tighten the transaction wrapper
to just be used when actually updating model details
2014-03-24 11:48:28 -04:00
Matthew Jones 0f1fc77be3 Switch up the api end point for unified jobs 2014-03-24 11:48:04 -04:00
Matthew Jones af231cc8b7 Resolve can_start from the client side and the signaler side 2014-03-24 09:47:36 -04:00
Matthew Jones 6941d89502 Tasks are only 'can_start' if they are in the 'new' state 2014-03-23 19:56:28 -04:00
Matthew Jones 3e88894f85 Temporarily relax task notification and rely on polling 2014-03-23 18:37:51 -04:00
Matthew Jones bec301c2a8 Shift task start signal into an asynchronous task so we don't deadlock trying to update the same record from the task runner while waiting for the signal to be received from the signaler 2014-03-22 11:18:25 -04:00
Matthew Jones 4b9059388e Switch to using a network socket instead of an ipc socket, closes issue AC-1088 2014-03-21 14:44:22 -04:00
Matthew Jones e66fa7cead Fix up some bugs for the UI's dummy endpoints 2014-03-20 22:09:21 -04:00
Matthew Jones f3e9be636c Add some dummy api end points for House 2014-03-20 17:59:58 -04:00
Matthew Jones 6f11502528 Emit log messages by default on the task runner 2014-03-20 11:46:58 -04:00
Matthew Jones f1ac2ff899 Bug fixes for CentOS 2014-03-20 11:22:19 -04:00
Matthew Jones c9340cf5f1 Add a new mechanism for automagically creating a tmux session, splitting it into panes, and starting each Tower needed tower service... This is so you don't have to start each one manually 2014-03-19 13:51:55 -04:00
Matthew Jones bf19b76d5a Merge remote-tracking branch 'origin/task-system-rework'
* origin/task-system-rework: (36 commits)
  Need to grab just the first item for the scm test project update
  Revert a project unit test
  Make sure we are calling signal_start in unit tests
  Make sure we are calling signal_start in unit tests
  Bypass task runner system in normal job start tests... we'll test it another way so assume we want to just start the job right away
  Fixing up unit tests
  Missing line-end comma
  Prevent deadlocks on unit tests in a very specific scenario
  Ignore checking celery task list during some unit tests, triggered by UNIT_TEST_IGNORE_TASK_WAIT
  Missing semicolon
  Remove update on launch, we'll test this another way
  Make sure we ignore the wait update for tasks under dependency situations in the unit tests
  Fix up run task manager script to handle signals, fix up task cancel job, add restart handler for ubuntu
  Fix some bugs found from unit tests
  More unit test rework
  Some job tests can't run in their current state
  Make sure we check arguments passed to signal start before allowing it to proceed.
  No need to replace original build_args
  Unit test updates for task system... remove old monkeypatch procedure for getting job args in favor of using the job info from the database. Can't do this anymore anyway since the job is running in another process
  Changes to tasks unit tests
  ...
2014-03-19 13:14:21 -04:00
Matthew Jones d3d84706a4 Need to grab just the first item for the scm test project update 2014-03-19 12:53:11 -04:00
Matthew Jones e24538865f Revert a project unit test 2014-03-19 12:49:13 -04:00
Matthew Jones 0548126e33 Make sure we are calling signal_start in unit tests 2014-03-19 11:56:30 -04:00
Matthew Jones 77e4d33770 Make sure we are calling signal_start in unit tests 2014-03-19 11:26:22 -04:00
Matthew Jones 14e138a7bd Bypass task runner system in normal job start tests... we'll test it another way so assume we want to just start the job right away 2014-03-19 11:09:14 -04:00
Matthew Jones 1093b00e2a Fixing up unit tests 2014-03-18 14:58:45 -04:00
Matthew Jones 7ac58dead3 Missing line-end comma 2014-03-18 12:04:27 -04:00
Matthew Jones 7fe474aec5 Prevent deadlocks on unit tests in a very specific scenario 2014-03-18 12:02:14 -04:00
Matthew Jones fe625785c7 Ignore checking celery task list during some unit tests, triggered by UNIT_TEST_IGNORE_TASK_WAIT 2014-03-17 14:53:38 -04:00
Matthew Jones 57fff65577 Missing semicolon 2014-03-17 12:55:59 -04:00
Matthew Jones 1243e044a0 Remove update on launch, we'll test this another way 2014-03-17 12:52:23 -04:00
Matthew Jones e0b72ff452 Make sure we ignore the wait update for tasks under dependency
situations in the unit tests
2014-03-17 11:24:44 -04:00
Matthew Jones f6ac7fb6d0 Fix up run task manager script to handle signals, fix up task cancel job, add restart handler for ubuntu 2014-03-17 11:05:53 -04:00
Matthew Jones 28c9d77f29 Fix some bugs found from unit tests 2014-03-14 15:54:27 -04:00
Matthew Jones 382e1e96c7 More unit test rework 2014-03-14 15:25:06 -04:00
Matthew Jones f3ea7d68cc Some job tests can't run in their current state 2014-03-14 13:00:33 -04:00
Matthew Jones e6209d4d4f Make sure we check arguments passed to signal start before allowing it
to proceed.
2014-03-13 14:43:47 -04:00
Matthew Jones 20285e18e5 No need to replace original build_args 2014-03-13 13:27:21 -04:00
Matthew Jones c2950fdbdf Unit test updates for task system... remove old monkeypatch procedure
for getting job args in favor of using the job info from the database.
Can't do this anymore anyway since the job is running in another process
2014-03-13 13:25:45 -04:00
Matthew Jones fe4b4043db Changes to tasks unit tests 2014-03-13 10:56:15 -04:00
Matthew Jones 16f0373766 Properly hand arguments on the base task 2014-03-13 10:53:38 -04:00
Matthew Jones 3fe31828a8 Cleanup for unit tests, working command unit test 2014-03-13 10:48:01 -04:00
Matthew Jones c8534055ef Do not return from the graph building routine if we are in celery debug mode. 2014-03-12 17:54:34 -04:00
Matthew Jones fc4f256723 Signal finished tasks to the task management system 2014-03-12 17:52:55 -04:00
Matthew Jones 99d42dc3fa Cleaning up unit tests to call signal_start 2014-03-12 17:01:23 -04:00
Matthew Jones c0382f78bb Include a newline on the debug generated graph visualization
fix some import bugs and clear some whitespace from the command test
2014-03-12 16:32:21 -04:00
Matthew Jones fbafa22a5a Make sure we are passing arguments down for inventory and project update
actions. Fix up some unit tests.
2014-03-12 16:24:13 -04:00
Matthew Jones 3c82085b93 Handle the situation where we could not communiate with celery 2014-03-12 16:11:56 -04:00
Matthew Jones 93e68009a7 Modifications to launch the task manager during unit tests 2014-03-12 15:06:28 -04:00
Matthew Jones 5ae324960e Add migration for including encrypted start args in the task tables 2014-03-12 14:29:27 -04:00
Matthew Jones 2224382caa More docs and fix a bug where we could crash attempting to mark a job as
failed when it wasn't running in celery
2014-03-12 14:26:15 -04:00
Matthew Jones 06cc5ffb4a Docs and setup details for the task manager 2014-03-12 14:09:00 -04:00
Matthew Jones d176466ccc Fix a customer issue in HEAD. We should catch OSError here instead of IOError 2014-03-04 15:43:49 -05:00
Matthew Jones 78bba13bbb Merge pull request #8 from jlaska/rhel7_support
Add rhel7 support to setup playbook
2014-02-26 11:37:15 -05:00
Matthew Jones e4d860e3dc Fix issue AC-977 by including job_template in summary fields for job
activity stream events
2014-02-14 09:48:34 -05:00
Matthew Jones 770947d18d Pull results off zeromq and distribute to workers 2014-02-12 16:09:57 -05:00
Matthew Jones 063380304a Manage the zeromq connection per-pid 2014-02-11 05:56:51 -05:00
Matthew Jones 66e9e2310c Initial 0mq implementation 2014-02-11 05:40:31 -05:00
Matthew Jones 2a88d3cb07 Close issue AC-905... refactor RBAC to handle inactive and deleted items 2014-02-07 09:37:59 -05:00
Matthew Jones fb1bff54ca Fix an issue where we were checking object existence
In the new to_native methods on serializers
2014-02-07 05:56:26 -05:00
Matthew Jones 57030390c0 Fix AC-975... filter inactive permissions in some of the access code. 2014-02-06 08:47:00 -05:00
Matthew Jones 00156a5518 Updating AC-984... only conditionally recompute inventory fields in group delete if it isn't a part of an inventory delete 2014-02-04 09:55:55 -05:00
Matthew Jones e911bdc3da Updating AC-984... delay field computation until after the group has been removed 2014-02-04 09:29:28 -05:00
Matthew Jones 9b67b575f1 Fix issue AC-1002, make sure we return a count of the number of inventories with active failed jobs 2014-02-03 06:11:51 -05:00
Matthew Jones a21332a2d4 Fix AC-969, Convert variables element in changes dictionary from json representation 2014-01-31 10:59:06 -05:00
Matthew Jones 77e77d905a Fix AC-1004, Instead of using serializers.Field() which will force a repr() of the object... use serializers.PrimaryKeyField() which will use the expected field type for the response 2014-01-31 10:34:02 -05:00
Matthew Jones 867c22c36c Fix AC-981, mark last_job* fields as read only on the host serializer so activity stream will ignore them when processing events 2014-01-31 09:04:07 -05:00
Matthew Jones bb0a2887d5 Fix AC-998, Don't set created_by on the object when updating the object (only when creating). activity stream will save modifications and who made them 2014-01-31 07:00:21 -05:00
Matthew Jones 380f6c6d6f Fix AC-1001, hide BROKER_URL from the job_env section of task api data 2014-01-31 05:17:26 -05:00
Matthew Jones bc6ec06d8f Rollback and retry the task update status. Disable default idle timeouts on certain tasks 2014-01-30 15:09:49 -05:00
Matthew Jones b226737ec5 Handle database errors and retry 2014-01-30 14:00:49 -05:00