Matthew Jones
feb1bb6e8a
Wrap up schedule rrule documentation
2014-04-02 14:54:53 -04:00
Matthew Jones
8659eab1d3
Include dependent file in schedules list docs
2014-04-02 14:34:08 -04:00
Matthew Jones
5f7ea664f2
Adding some Schedule documentation
2014-04-02 14:30:13 -04:00
Matthew Jones
d190aa3001
Wrap up rrule validation for scheduler
2014-04-02 11:44:49 -04:00
Matthew Jones
3e2e682658
Re-do the way we perform dtend calculation by parsing the until value
...
instead of attempting to read the last item from the list in cases where
the list is very long
2014-04-02 11:44:49 -04:00
Matthew Jones
4069a33ab0
Scheduler unit tests
2014-04-01 17:12:46 -04:00
Matthew Jones
306544dca0
Fix up schedule access control by referencing the right base object
2014-04-01 16:48:45 -04:00
Matthew Jones
54599578a0
Fix up ScheduleAccess queryset to fit between schedules and unified jobs
2014-04-01 13:13:53 -04:00
Matthew Jones
49f6bd3e1c
Fix imports for using Job in some models
2014-04-01 13:02:33 -04:00
Matthew Jones
7bc7362299
Complete rrule validation
2014-04-01 11:22:42 -04:00
Matthew Jones
2e6457b887
Recalculate dtstart and dtend on every save now that it is idempotwhatever
2014-04-01 10:09:52 -04:00
Matthew Jones
2913ce21d2
Make sure we store the real start value for a schedule
2014-03-31 17:35:49 -04:00
Matthew Jones
4a535e5404
Updating dependency check for jobs, project updates, and inventory updates
2014-03-31 17:16:49 -04:00
Matthew Jones
60b399409a
Update old schedules if we missed them
2014-03-31 15:33:25 -04:00
Matthew Jones
43ae60d2f4
Fix up issue associating type of unified job template summary fields
2014-03-31 15:29:44 -04:00
Matthew Jones
8c020ddd0b
Add type to unified_job_template summary fields
2014-03-31 14:58:34 -04:00
Matthew Jones
9e898953dd
Revert start_args when launching job
2014-03-31 12:45:57 -04:00
Matthew Jones
7e5ac7b3fa
Make sure we shoehorn start args to empty string
2014-03-31 11:38:54 -04:00
Matthew Jones
96a4752f2f
Be more strict when verifying dtstart
2014-03-31 11:33:49 -04:00
Matthew Jones
a3ca786758
Fix some import errors and filter errors when updating unified_jobs with
...
schedule information
2014-03-31 10:26:12 -04:00
Matthew Jones
9b440c5209
Fix an issue where POST to schedules would no longer work. Populate
...
some more summary fields
2014-03-28 22:11:02 -04:00
Matthew Jones
c46f1de347
Some initial validation logic and documentation on what we require/reject
2014-03-28 14:37:50 -04:00
Matthew Jones
c1734d74cf
Use unified job set for joining the schedule and unified jobs
2014-03-28 12:52:28 -04:00
Matthew Jones
799e8d30ba
Integrate main schedules resource
...
Integrated scheduled jobs list
Implement updating ancillary details on dependent models
Further cleanup
2014-03-28 12:50:35 -04:00
Matthew Jones
c1d314ed6f
Running scheduled items now works
2014-03-27 22:45:51 -04:00
Matthew Jones
b665345070
Support passing the schedule when signaling start so we record which
...
schedule this came from
2014-03-27 22:45:51 -04:00
Matthew Jones
65bb42c2f2
Make dtstart field somewhat optional
2014-03-27 16:01:09 -04:00
Matthew Jones
107fc85110
Initial scheduler integration
2014-03-27 15:53:45 -04:00
Matthew Jones
74602f1009
Check project and inventory source update cache timeout when deciding
...
whether or not to spawn an instance of either one as a dependency
2014-03-25 16:21:46 -04:00
Matthew Jones
1dc3aa8ab1
Relax job dependency conflicts raised by customer support
...
If both jobs are callbacks whose limits are different allow them to
not conflict with each other when deciding launch dependencies
2014-03-25 16:20:27 -04:00
Matthew Jones
03249e59f3
Fix up job run types so that we aren't auto-starting new jobs. Fix up
...
job dependency generator to call the right new methods for generating
inventory and project updates
2014-03-25 15:21:30 -04:00
Matthew Jones
bb630fddbc
Fix up error handler callback to include the task that actually failed
2014-03-25 15:01:54 -04:00
Matthew Jones
7196262987
Update graph generator to look right
2014-03-25 15:01:54 -04:00
Matthew Jones
61ab197b3a
If we fail the prestart check on a job, record the conditions by which we fail
2014-03-24 14:57:53 -04:00
Matthew Jones
ec2dfa3c74
Rename link for unified jobs list
2014-03-24 12:01:01 -04:00
Matthew Jones
2d443bad26
Change the api v1 resource for unified jobs
2014-03-24 11:58:05 -04:00
Matthew Jones
b35cee7b72
Eliminate the 'pending' status and remove dependency checks that
...
necessitated it during pre-run... tighten the transaction wrapper
to just be used when actually updating model details
2014-03-24 11:48:28 -04:00
Matthew Jones
0f1fc77be3
Switch up the api end point for unified jobs
2014-03-24 11:48:04 -04:00
Matthew Jones
af231cc8b7
Resolve can_start from the client side and the signaler side
2014-03-24 09:47:36 -04:00
Matthew Jones
6941d89502
Tasks are only 'can_start' if they are in the 'new' state
2014-03-23 19:56:28 -04:00
Matthew Jones
3e88894f85
Temporarily relax task notification and rely on polling
2014-03-23 18:37:51 -04:00
Matthew Jones
bec301c2a8
Shift task start signal into an asynchronous task so we don't deadlock trying to update the same record from the task runner while waiting for the signal to be received from the signaler
2014-03-22 11:18:25 -04:00
Matthew Jones
4b9059388e
Switch to using a network socket instead of an ipc socket, closes issue AC-1088
2014-03-21 14:44:22 -04:00
Matthew Jones
e66fa7cead
Fix up some bugs for the UI's dummy endpoints
2014-03-20 22:09:21 -04:00
Matthew Jones
f3e9be636c
Add some dummy api end points for House
2014-03-20 17:59:58 -04:00
Matthew Jones
6f11502528
Emit log messages by default on the task runner
2014-03-20 11:46:58 -04:00
Matthew Jones
f1ac2ff899
Bug fixes for CentOS
2014-03-20 11:22:19 -04:00
Matthew Jones
c9340cf5f1
Add a new mechanism for automagically creating a tmux session, splitting it into panes, and starting each Tower needed tower service... This is so you don't have to start each one manually
2014-03-19 13:51:55 -04:00
Matthew Jones
bf19b76d5a
Merge remote-tracking branch 'origin/task-system-rework'
...
* origin/task-system-rework: (36 commits)
Need to grab just the first item for the scm test project update
Revert a project unit test
Make sure we are calling signal_start in unit tests
Make sure we are calling signal_start in unit tests
Bypass task runner system in normal job start tests... we'll test it another way so assume we want to just start the job right away
Fixing up unit tests
Missing line-end comma
Prevent deadlocks on unit tests in a very specific scenario
Ignore checking celery task list during some unit tests, triggered by UNIT_TEST_IGNORE_TASK_WAIT
Missing semicolon
Remove update on launch, we'll test this another way
Make sure we ignore the wait update for tasks under dependency situations in the unit tests
Fix up run task manager script to handle signals, fix up task cancel job, add restart handler for ubuntu
Fix some bugs found from unit tests
More unit test rework
Some job tests can't run in their current state
Make sure we check arguments passed to signal start before allowing it to proceed.
No need to replace original build_args
Unit test updates for task system... remove old monkeypatch procedure for getting job args in favor of using the job info from the database. Can't do this anymore anyway since the job is running in another process
Changes to tasks unit tests
...
2014-03-19 13:14:21 -04:00
Matthew Jones
d3d84706a4
Need to grab just the first item for the scm test project update
2014-03-19 12:53:11 -04:00
Matthew Jones
e24538865f
Revert a project unit test
2014-03-19 12:49:13 -04:00
Matthew Jones
0548126e33
Make sure we are calling signal_start in unit tests
2014-03-19 11:56:30 -04:00
Matthew Jones
77e4d33770
Make sure we are calling signal_start in unit tests
2014-03-19 11:26:22 -04:00
Matthew Jones
14e138a7bd
Bypass task runner system in normal job start tests... we'll test it another way so assume we want to just start the job right away
2014-03-19 11:09:14 -04:00
Matthew Jones
1093b00e2a
Fixing up unit tests
2014-03-18 14:58:45 -04:00
Matthew Jones
7ac58dead3
Missing line-end comma
2014-03-18 12:04:27 -04:00
Matthew Jones
7fe474aec5
Prevent deadlocks on unit tests in a very specific scenario
2014-03-18 12:02:14 -04:00
Matthew Jones
fe625785c7
Ignore checking celery task list during some unit tests, triggered by UNIT_TEST_IGNORE_TASK_WAIT
2014-03-17 14:53:38 -04:00
Matthew Jones
57fff65577
Missing semicolon
2014-03-17 12:55:59 -04:00
Matthew Jones
1243e044a0
Remove update on launch, we'll test this another way
2014-03-17 12:52:23 -04:00
Matthew Jones
e0b72ff452
Make sure we ignore the wait update for tasks under dependency
...
situations in the unit tests
2014-03-17 11:24:44 -04:00
Matthew Jones
f6ac7fb6d0
Fix up run task manager script to handle signals, fix up task cancel job, add restart handler for ubuntu
2014-03-17 11:05:53 -04:00
Matthew Jones
28c9d77f29
Fix some bugs found from unit tests
2014-03-14 15:54:27 -04:00
Matthew Jones
382e1e96c7
More unit test rework
2014-03-14 15:25:06 -04:00
Matthew Jones
f3ea7d68cc
Some job tests can't run in their current state
2014-03-14 13:00:33 -04:00
Matthew Jones
e6209d4d4f
Make sure we check arguments passed to signal start before allowing it
...
to proceed.
2014-03-13 14:43:47 -04:00
Matthew Jones
20285e18e5
No need to replace original build_args
2014-03-13 13:27:21 -04:00
Matthew Jones
c2950fdbdf
Unit test updates for task system... remove old monkeypatch procedure
...
for getting job args in favor of using the job info from the database.
Can't do this anymore anyway since the job is running in another process
2014-03-13 13:25:45 -04:00
Matthew Jones
fe4b4043db
Changes to tasks unit tests
2014-03-13 10:56:15 -04:00
Matthew Jones
16f0373766
Properly hand arguments on the base task
2014-03-13 10:53:38 -04:00
Matthew Jones
3fe31828a8
Cleanup for unit tests, working command unit test
2014-03-13 10:48:01 -04:00
Matthew Jones
c8534055ef
Do not return from the graph building routine if we are in celery debug mode.
2014-03-12 17:54:34 -04:00
Matthew Jones
fc4f256723
Signal finished tasks to the task management system
2014-03-12 17:52:55 -04:00
Matthew Jones
99d42dc3fa
Cleaning up unit tests to call signal_start
2014-03-12 17:01:23 -04:00
Matthew Jones
c0382f78bb
Include a newline on the debug generated graph visualization
...
fix some import bugs and clear some whitespace from the command test
2014-03-12 16:32:21 -04:00
Matthew Jones
fbafa22a5a
Make sure we are passing arguments down for inventory and project update
...
actions. Fix up some unit tests.
2014-03-12 16:24:13 -04:00
Matthew Jones
3c82085b93
Handle the situation where we could not communiate with celery
2014-03-12 16:11:56 -04:00
Matthew Jones
93e68009a7
Modifications to launch the task manager during unit tests
2014-03-12 15:06:28 -04:00
Matthew Jones
5ae324960e
Add migration for including encrypted start args in the task tables
2014-03-12 14:29:27 -04:00
Matthew Jones
2224382caa
More docs and fix a bug where we could crash attempting to mark a job as
...
failed when it wasn't running in celery
2014-03-12 14:26:15 -04:00
Matthew Jones
06cc5ffb4a
Docs and setup details for the task manager
2014-03-12 14:09:00 -04:00
Matthew Jones
d176466ccc
Fix a customer issue in HEAD. We should catch OSError here instead of IOError
2014-03-04 15:43:49 -05:00
Matthew Jones
78bba13bbb
Merge pull request #8 from jlaska/rhel7_support
...
Add rhel7 support to setup playbook
2014-02-26 11:37:15 -05:00
Matthew Jones
e4d860e3dc
Fix issue AC-977 by including job_template in summary fields for job
...
activity stream events
2014-02-14 09:48:34 -05:00
Matthew Jones
770947d18d
Pull results off zeromq and distribute to workers
2014-02-12 16:09:57 -05:00
Matthew Jones
063380304a
Manage the zeromq connection per-pid
2014-02-11 05:56:51 -05:00
Matthew Jones
66e9e2310c
Initial 0mq implementation
2014-02-11 05:40:31 -05:00
Matthew Jones
2a88d3cb07
Close issue AC-905... refactor RBAC to handle inactive and deleted items
2014-02-07 09:37:59 -05:00
Matthew Jones
fb1bff54ca
Fix an issue where we were checking object existence
...
In the new to_native methods on serializers
2014-02-07 05:56:26 -05:00
Matthew Jones
57030390c0
Fix AC-975... filter inactive permissions in some of the access code.
2014-02-06 08:47:00 -05:00
Matthew Jones
00156a5518
Updating AC-984... only conditionally recompute inventory fields in group delete if it isn't a part of an inventory delete
2014-02-04 09:55:55 -05:00
Matthew Jones
e911bdc3da
Updating AC-984... delay field computation until after the group has been removed
2014-02-04 09:29:28 -05:00
Matthew Jones
9b67b575f1
Fix issue AC-1002, make sure we return a count of the number of inventories with active failed jobs
2014-02-03 06:11:51 -05:00
Matthew Jones
a21332a2d4
Fix AC-969, Convert variables element in changes dictionary from json representation
2014-01-31 10:59:06 -05:00
Matthew Jones
77e77d905a
Fix AC-1004, Instead of using serializers.Field() which will force a repr() of the object... use serializers.PrimaryKeyField() which will use the expected field type for the response
2014-01-31 10:34:02 -05:00
Matthew Jones
867c22c36c
Fix AC-981, mark last_job* fields as read only on the host serializer so activity stream will ignore them when processing events
2014-01-31 09:04:07 -05:00
Matthew Jones
bb0a2887d5
Fix AC-998, Don't set created_by on the object when updating the object (only when creating). activity stream will save modifications and who made them
2014-01-31 07:00:21 -05:00
Matthew Jones
380f6c6d6f
Fix AC-1001, hide BROKER_URL from the job_env section of task api data
2014-01-31 05:17:26 -05:00
Matthew Jones
bc6ec06d8f
Rollback and retry the task update status. Disable default idle timeouts on certain tasks
2014-01-30 15:09:49 -05:00
Matthew Jones
b226737ec5
Handle database errors and retry
2014-01-30 14:00:49 -05:00