Commit Graph
100 Commits
Author SHA1 Message Date
Chris Meyers 241019568c use jsonfield instead of django-jsonfield 2016-11-11 15:47:41 -05:00
Chris Meyers 5b4892250d fix partial test
* We shouldn't care what order the inventory updates for the inventory
sources are returned in.
2016-11-11 15:13:28 -05:00
Chris Meyers 0efe8e9cfb fix license test
so that the license file on dev machines isn't accidentally picked up
2016-11-11 14:43:00 -05:00
Chris Meyers 9aaf694acf always allow running at least 1 job
* Regardless of capacity
* Add unit tests around this logic
2016-11-10 11:07:05 -05:00
Chris Meyers 697ff11e3b move python dep git repos to ansible org 2016-11-10 09:27:44 -05:00
Chris Meyers b9462bfad6 remove, not used, gevent-socketio 2016-11-10 09:10:26 -05:00
Chris Meyers 5d205f1e1b remove deprecated mongo fact code and deps
* We have the requirements that users with Tower < 3.0.x must upgrade to
3.0.x before > 3.0.x. Thus, we are save to delete all mongo migration
code and deps.
2016-11-09 16:25:27 -05:00
Chris Meyers 766e4af38e low hanging fruit requirements spring cleaning
* django-jsonfield PR accepted upstream
* django-rest-framework-mongoengine legacy system tracking dep
* python-social-auth PR accepted upstream
2016-11-09 16:12:27 -05:00
Chris Meyers adcf0af2a0 on host callback, upate dynamic inv only once
* During a job template launch via the host callback launch feature,
when the host launching the job template is not found; we try to launch
associated dyn inv updates to pick up the host. Then the inv is searched
again for the host. If the host is found, then the jt is launched. This
fix carries forward the feature that prevents the dyn inv update with
cache timeout of 0 from being re-launched with the new task manager.
2016-11-08 15:06:47 -05:00
Chris Meyers b66256eb98 fixes test_settings unit tests 2016-11-08 11:10:52 -05:00
Chris Meyers dcb8789fd9 fix job blocking job with allow simultaneous
related to #3911
2016-11-08 11:00:52 -05:00
Chris Meyers 1fc34a9f41 mock capacity 2016-11-08 10:19:14 -05:00
Chris Meyers 1aa6ab72d6 fixes multiple proj updates running for single job
related to #3906
2016-11-08 09:07:27 -05:00
Chris Meyers 5c71f1d6f7 allow all hosts during development 2016-11-02 10:45:42 -05:00
Chris Meyers cc7949f040 update docs 2016-11-02 10:00:05 -05:00
Chris Meyers 250a71907d update for commit hook 2016-11-02 08:25:51 -05:00
Chris Meyers 25b85c4a0b rename scheduler config singleton 2016-11-01 14:07:00 -05:00
Chris Meyers e1a84f4c85 bump migrations 2016-11-01 13:55:37 -05:00
Chris Meyers 13c89ab78c HAify job schedules and more task_manager renaming 2016-11-01 13:50:42 -05:00
Chris Meyers 87dd91e849 rename Scheduler to TaskManager 2016-11-01 13:50:42 -05:00
Chris Meyers 6efa468f29 init task manager architecture docs 2016-11-01 13:50:42 -05:00
Chris Meyers c4a3b604f8 add back in alan's workflow fail detection 2016-11-01 13:50:42 -05:00
Chris Meyers ed37e68c53 run dependencies when capacity is available 2016-11-01 13:50:42 -05:00
Chris Meyers 0f98e1edec remove todo's 2016-11-01 13:50:42 -05:00
Chris Meyers 03a484a6a6 remove old task manager code 2016-11-01 13:50:42 -05:00
Chris Meyers 454b3edb7c rectify celery<->db inconsistent running job 2016-11-01 13:50:42 -05:00
Chris Meyers 4ef4b4709b workflow execution added 2016-11-01 13:50:42 -05:00
Chris Meyers fd8c641fa5 flake8 fixes 2016-11-01 13:50:42 -05:00
Chris Meyers 9802b1f379 AdHocCommand support added to task manager 2016-11-01 13:50:42 -05:00
Chris Meyers 46faeffbb3 added task manager system job support 2016-11-01 13:50:42 -05:00
Chris Meyers 5fa5d4b34b support distributed project updates 2016-11-01 13:50:42 -05:00
Chris Meyers 306562cd67 inventory updates running correctly 2016-11-01 13:50:42 -05:00
Chris Meyers 555f0bb90f project and jobs running correctly 2016-11-01 13:50:42 -05:00
Chris Meyers 7050c4e09e Revert "no one knows wtf the files in this dir a for, so don't serve them"
This reverts commit b3cccea70368ba1550366380e583751df1df061b.
2016-10-21 10:04:50 -04:00
Chris Meyers 5b60b14227 bump shade version 2016-10-19 14:18:00 -04:00
Chris Meyers 49c90b8f2d Revert "bump shade version"
This reverts commit 0125d114fdf8be5f3a5fdab856c92d82a2988607.
2016-10-19 14:17:04 -04:00
Chris Meyers 8a4d6b6f35 bump shade version 2016-10-19 14:07:20 -04:00
Chris Meyers b43945b0f2 Revert "bump shade version"
This reverts commit d0a7313a4ccb1cfca3c7655b34b61c6cb6861909.
2016-10-19 12:33:53 -04:00
Chris Meyers 54683cbff4 fix amqp dep 2016-10-18 18:42:12 -04:00
Chris Meyers 6d07699b29 bump shade version 2016-10-18 18:02:30 -04:00
Chris Meyers cbffb23d41 no one knows wtf the files in this dir a for, so don't serve them 2016-10-18 17:27:23 -04:00
Chris Meyers 87ea864466 sendfail syscall bad with crappy filesystems 2016-10-18 17:21:14 -04:00
Chris Meyers 64a15db91b fix nginx static files using 2016-10-18 15:51:01 -04:00
Chris Meyers 47495b4ea6 fix mime type issues 2016-10-18 14:38:24 -04:00
Chris Meyers ad2bee1f57 sym link nginx config by popular demand 2016-10-18 14:23:33 -04:00
Chris Meyers 4f6d966bab put nginx into honcho flow
* allows for make docker-compose-test then make honcho flow
2016-10-18 14:19:18 -04:00
Chris Meyers 9e3528de31 change migration name to align with version semantic 2016-10-03 11:15:33 -04:00
Chris Meyers b4c852cf53 change migration name to align with version semantic 2016-10-03 10:06:50 -04:00
Chris Meyers 203df91a5d more robust test mode checking 2016-10-03 09:28:44 -04:00
Chris Meyers 649bf08edf add workflow root endpoints 2016-10-03 08:15:39 -04:00
Chris Meyers 9cafebd8db remove job to jt allow_simultaneous dependency
* Foreshadowing of what's to come with the task manager. When deciding
on what job to run in our task manager, we can't depend on job template
fields. Otherwise, this would cost us a query.
2016-09-29 16:19:19 -04:00
Chris Meyers 1a60dd89bd add back in removed method 2016-09-29 16:01:51 -04:00
Chris Meyers ec2b0ac90d add back in removed method 2016-09-29 16:01:15 -04:00
Chris Meyers dd3c3c9f29 Merge branch 'feature-ha_task_manager' into devel 2016-09-29 10:27:17 -04:00
Chris Meyers fbc1dff4de flake8 fixes 2016-09-29 10:23:00 -04:00
Chris Meyers bdd444fb44 removed print 2016-09-29 09:53:36 -04:00
Chris Meyers 0d538f8b0f Revert "removed wait_task look restriction"
This reverts commit f159fd45406c6af2aacc48a44e2a3993bfa19ce8.
2016-09-28 10:23:45 -04:00
Chris Meyers d65120538d scheduler messages need not be durable 2016-09-27 16:05:30 -04:00
Chris Meyers 89250dcf36 removed wait_task look restriction 2016-09-27 16:04:00 -04:00
Chris Meyers 3a8033dec4 cheesy global lock 2016-09-27 14:16:18 -04:00
Chris Meyers 04f69727f2 fully message driven job execution
TODO:
* Need a distributed lock (leverage postgres)
* Less memory-intensive graph representation
* Maybe serializer/deserializer graph to database
  * Iterative graph building instead of full rebuild.
2016-09-27 14:16:18 -04:00
Chris Meyers cdb65ccac9 replace task manager with event driven scheduler 2016-09-27 14:16:18 -04:00
Chris Meyers cc90204b0f task manager using messages
* First pass, adapt singleton task manager to process messages and run
jobs based on events instead of a busy loop.
* Still need to make message handing run in celery, not in a consumption
loop
2016-09-27 14:05:29 -04:00
Chris Meyers 64c91e1c1d remove stupid scripts 2016-09-16 08:52:54 -04:00
Chris Meyers 7f614a53db flake8 fix 2016-09-15 15:28:55 -04:00
Chris Meyers 77cc7f9d00 functional workflow test for issue #3498 2016-09-15 15:03:08 -04:00
Chris Meyers c35c2d9331 fix class method 2016-09-15 13:51:23 -04:00
Chris Meyers f06b212266 flake8 fixes 2016-09-15 10:25:36 -04:00
Chris Meyers cb8b6ea29f fix flake8 2016-09-15 10:24:45 -04:00
Chris Meyers 0a24a4f9b7 ignore import splat 2016-09-15 10:18:10 -04:00
Chris Meyers 46da83b87f fix flake8 2016-09-15 08:52:12 -04:00
Chris Meyers 3969cfa2a0 Revert "use flake8 inside tower env"
This reverts commit 90cdc5c83cb495e0d448f8e9eb7381d5fd84e9d4.
2016-09-15 08:45:13 -04:00
Chris Meyers 32461574ae add unit tests 2016-09-13 15:24:20 -04:00
Chris Meyers c91b10e62d use flake8 inside tower env 2016-09-12 14:06:20 -04:00
Chris Meyers 0dfe3b197a bump pyflakes version 2016-09-12 12:45:01 -04:00
Chris Meyers 9c12b234b1 remove workflow_job_template from workflow job node serializer 2016-09-12 12:26:07 -04:00
Chris Meyers 4dc5c33442 refactor to be more testable 2016-09-12 12:19:36 -04:00
Chris Meyers cea5ebadb7 split Node in job and job template node 2016-09-12 11:04:20 -04:00
Chris Meyers e4025a7eff flake8 fixes 2016-09-08 14:26:30 -04:00
Chris Meyers 28ec68e91b workflow dependency tests 2016-09-08 13:08:54 -04:00
Chris Meyers cae48cfb77 instantiate db with sample workflows 2016-09-08 13:04:56 -04:00
Chris Meyers 0e68481a85 consolidate workflow migration 2016-09-08 12:57:54 -04:00
Chris Meyers 83c5b3323f add workflow to unified endpoints 2016-09-02 09:04:49 -04:00
Chris Meyers 39ac2c047b launch workflows 2016-09-01 14:11:20 -04:00
Chris Meyers ac2f0bdf57 handle mime svg in devel 2016-09-01 12:53:26 -04:00
Chris Meyers 2cfdee3b21 turn job templates in jobs via launch 2016-08-31 09:00:25 -04:00
Chris Meyers 4c876b40e4 initial models and endpoints added for workflows 2016-08-30 15:05:28 -04:00
Chris Meyers 27b9fb8dab refactor notifications 2016-08-30 14:36:18 -04:00
Chris Meyers c7524892c0 fixes network cred failure in travis 2016-07-22 15:36:08 -04:00
Chris Meyers 37ddf2a4d9 fix unit test on travis 2016-07-22 14:00:28 -04:00
Chris Meyers e5b031e533 use existing logging infrastructure 2016-07-22 12:52:25 -04:00
Chris Meyers c42af3c61a forgot to remove label cleanup periodic task 2016-07-22 10:33:30 -04:00
Chris Meyers eb89cf98cc Always create fact cleanup job 2016-07-22 10:05:00 -04:00
Chris Meyers 811d6dfe3d add missed log and fix dev env 2016-07-22 10:04:02 -04:00
Chris Meyers fd098e64dc log migration to standard tower log dir 2016-07-22 09:29:07 -04:00
Chris Meyers 4cf7344dc4 check license permission on host create 2016-07-21 16:53:25 -04:00
Chris Meyers d886d07364 do not cache mongo read data on migration 2016-07-21 15:11:16 -04:00
Chris Meyers 5a9af010bf fix label docs 2016-07-11 13:32:53 -04:00
Chris Meyers 735a75729f Revert "fixes Save with update_fields did not affect any rows"
This reverts commit c6d282fce27d23317d2649ccf00b75799dad1a86.

This didn't fix the underlying issue. The issue is that the inventory
object may have been deleted by the time save is called.
2016-07-07 12:09:16 -04:00
Chris Meyers 1aca42ae93 fixes Save with update_fields did not affect any rows 2016-07-05 11:46:46 -04:00