Commit Graph
100 Commits
Author SHA1 Message Date
Chris Meyers 88d6552b86 artifact data comes in as a dict 2016-11-30 16:25:27 -05:00
Chris Meyers 6c0b97675a handle special case pkg_name[pkg_subname] 2016-11-29 10:17:07 -05:00
Chris Meyers bd78ff0a42 bump ansible requirements 2016-11-21 17:33:36 -05:00
Chris Meyers 1049b0bfd5 removed, seemingly, uneeded base packages 2016-11-21 17:33:36 -05:00
Chris Meyers f2fac1fa91 factored out base python requirements
* use pip-tools to programatically build requirements.txt
2016-11-21 17:33:35 -05:00
Chris Meyers 4ec8a2f429 selectively bump base requirements 2016-11-21 17:33:14 -05:00
Chris Meyers 9f56d39644 factored out base requirements
* bumped all dependent packages that are not base
2016-11-21 17:33:14 -05:00
Chris Meyers ddd41e77be fixes fact jsonbfield for unit tests 2016-11-21 17:25:18 -05:00
Chris Meyers 1a96b66f00 update inventory field, name, not unique 2016-11-21 14:42:11 -05:00
Chris Meyers 01ec443380 inventory is unique on <name, org>
* was unique on name because we were inheriting from a Model that had it
defined as such. Thus our expression of uniqueness in the Inventory
Model was meaningless.
2016-11-21 14:34:17 -05:00
Chris Meyers b6b1f4205c flake8 fixes 2016-11-18 14:49:31 -05:00
Chris Meyers ba6ab6f746 forgot to add new fixtures for jsonbfield fact 2016-11-18 11:37:06 -05:00
Chris Meyers 4a1a3bd1e8 do not coerce jsonbfield to string in db
* functional tests do coerce because they assume they are running on
sqlite
2016-11-18 11:29:42 -05:00
Chris Meyers ef0df1fefd more j -> workflow_job renaming 2016-11-17 10:51:06 -05:00
Chris Meyers 07996abf64 in the api, finish renaming wfjt -> job relation
related to #4052
related to #3976
2016-11-17 10:40:28 -05:00
Chris Meyers df5e3288c4 Revert "in the api, finish renaming wfjt -> job relation"
This reverts commit 8ee469ceeb0d9e7514f930c6325d1577bf5505c8.
2016-11-17 10:39:17 -05:00
Chris Meyers d9821dbb6c in the api, finish renaming wfjt -> job relation
related to #4052
related to #3976
2016-11-17 10:29:34 -05:00
Chris Meyers edaf018f2c Revert "factored out base requirements"
This reverts commit c5129a054c272a5e59008b3dc4d8a2f287f310a6.
2016-11-16 13:39:44 -05:00
Chris Meyers 827b4e1537 factored out base requirements
* bumped all dependent packages that are not base
2016-11-16 13:35:35 -05:00
Chris Meyers e7b9410361 fix up python requirements test 2016-11-15 09:19:29 -05:00
Chris Meyers 1883485724 towards virtualenv being exactly requirements.txt
* Ignore already installed (usually global) packages when installing
requirements.txt into the virtualenv.
2016-11-15 09:19:29 -05:00
Chris Meyers 81720a6a2a bump cellery billiard requirement 2016-11-15 08:43:51 -05:00
Chris Meyers 9f40e7ef70 fix notification unit test mock 2016-11-14 16:29:34 -05:00
Chris Meyers f1f92deb1f bump up django-jsonfield 2016-11-14 14:34:46 -05:00
Chris Meyers 0c2d9e09b9 use known working django-jsonfield 2016-11-14 13:26:24 -05:00
Chris Meyers ec83a1cb47 use django-jsonfield not jsonfield 2016-11-14 12:18:29 -05:00
Chris Meyers 356b0af3cd bump channels version 2016-11-14 11:11:29 -05:00
Chris Meyers 1d513252e4 fix up requirements 2016-11-14 09:16:26 -05:00
Chris Meyers 545412a6b5 remove inline requirements comment 2016-11-14 08:46:46 -05:00
Chris Meyers c95ef4dc07 add requirements unit test 2016-11-11 17:19:52 -05:00
Chris Meyers 3d4f359cbc Revert "Read the branch name"
This reverts commit e38bfbce6adc0e94a72bd3eda908263aa6cc651a.
2016-11-11 16:01:45 -05:00
Chris Meyers 5f10c849fa Read the branch name 2016-11-11 16:00:53 -05:00
Chris Meyers 241019568c use jsonfield instead of django-jsonfield 2016-11-11 15:47:41 -05:00
Chris Meyers 5b4892250d fix partial test
* We shouldn't care what order the inventory updates for the inventory
sources are returned in.
2016-11-11 15:13:28 -05:00
Chris Meyers 0efe8e9cfb fix license test
so that the license file on dev machines isn't accidentally picked up
2016-11-11 14:43:00 -05:00
Chris Meyers 9aaf694acf always allow running at least 1 job
* Regardless of capacity
* Add unit tests around this logic
2016-11-10 11:07:05 -05:00
Chris Meyers 697ff11e3b move python dep git repos to ansible org 2016-11-10 09:27:44 -05:00
Chris Meyers b9462bfad6 remove, not used, gevent-socketio 2016-11-10 09:10:26 -05:00
Chris Meyers 5d205f1e1b remove deprecated mongo fact code and deps
* We have the requirements that users with Tower < 3.0.x must upgrade to
3.0.x before > 3.0.x. Thus, we are save to delete all mongo migration
code and deps.
2016-11-09 16:25:27 -05:00
Chris Meyers 766e4af38e low hanging fruit requirements spring cleaning
* django-jsonfield PR accepted upstream
* django-rest-framework-mongoengine legacy system tracking dep
* python-social-auth PR accepted upstream
2016-11-09 16:12:27 -05:00
Chris Meyers adcf0af2a0 on host callback, upate dynamic inv only once
* During a job template launch via the host callback launch feature,
when the host launching the job template is not found; we try to launch
associated dyn inv updates to pick up the host. Then the inv is searched
again for the host. If the host is found, then the jt is launched. This
fix carries forward the feature that prevents the dyn inv update with
cache timeout of 0 from being re-launched with the new task manager.
2016-11-08 15:06:47 -05:00
Chris Meyers b66256eb98 fixes test_settings unit tests 2016-11-08 11:10:52 -05:00
Chris Meyers dcb8789fd9 fix job blocking job with allow simultaneous
related to #3911
2016-11-08 11:00:52 -05:00
Chris Meyers 1fc34a9f41 mock capacity 2016-11-08 10:19:14 -05:00
Chris Meyers 1aa6ab72d6 fixes multiple proj updates running for single job
related to #3906
2016-11-08 09:07:27 -05:00
Chris Meyers 5c71f1d6f7 allow all hosts during development 2016-11-02 10:45:42 -05:00
Chris Meyers cc7949f040 update docs 2016-11-02 10:00:05 -05:00
Chris Meyers 250a71907d update for commit hook 2016-11-02 08:25:51 -05:00
Chris Meyers 25b85c4a0b rename scheduler config singleton 2016-11-01 14:07:00 -05:00
Chris Meyers e1a84f4c85 bump migrations 2016-11-01 13:55:37 -05:00
Chris Meyers 13c89ab78c HAify job schedules and more task_manager renaming 2016-11-01 13:50:42 -05:00
Chris Meyers 87dd91e849 rename Scheduler to TaskManager 2016-11-01 13:50:42 -05:00
Chris Meyers 6efa468f29 init task manager architecture docs 2016-11-01 13:50:42 -05:00
Chris Meyers c4a3b604f8 add back in alan's workflow fail detection 2016-11-01 13:50:42 -05:00
Chris Meyers ed37e68c53 run dependencies when capacity is available 2016-11-01 13:50:42 -05:00
Chris Meyers 0f98e1edec remove todo's 2016-11-01 13:50:42 -05:00
Chris Meyers 03a484a6a6 remove old task manager code 2016-11-01 13:50:42 -05:00
Chris Meyers 454b3edb7c rectify celery<->db inconsistent running job 2016-11-01 13:50:42 -05:00
Chris Meyers 4ef4b4709b workflow execution added 2016-11-01 13:50:42 -05:00
Chris Meyers fd8c641fa5 flake8 fixes 2016-11-01 13:50:42 -05:00
Chris Meyers 9802b1f379 AdHocCommand support added to task manager 2016-11-01 13:50:42 -05:00
Chris Meyers 46faeffbb3 added task manager system job support 2016-11-01 13:50:42 -05:00
Chris Meyers 5fa5d4b34b support distributed project updates 2016-11-01 13:50:42 -05:00
Chris Meyers 306562cd67 inventory updates running correctly 2016-11-01 13:50:42 -05:00
Chris Meyers 555f0bb90f project and jobs running correctly 2016-11-01 13:50:42 -05:00
Chris Meyers 7050c4e09e Revert "no one knows wtf the files in this dir a for, so don't serve them"
This reverts commit b3cccea70368ba1550366380e583751df1df061b.
2016-10-21 10:04:50 -04:00
Chris Meyers 5b60b14227 bump shade version 2016-10-19 14:18:00 -04:00
Chris Meyers 49c90b8f2d Revert "bump shade version"
This reverts commit 0125d114fdf8be5f3a5fdab856c92d82a2988607.
2016-10-19 14:17:04 -04:00
Chris Meyers 8a4d6b6f35 bump shade version 2016-10-19 14:07:20 -04:00
Chris Meyers b43945b0f2 Revert "bump shade version"
This reverts commit d0a7313a4ccb1cfca3c7655b34b61c6cb6861909.
2016-10-19 12:33:53 -04:00
Chris Meyers 54683cbff4 fix amqp dep 2016-10-18 18:42:12 -04:00
Chris Meyers 6d07699b29 bump shade version 2016-10-18 18:02:30 -04:00
Chris Meyers cbffb23d41 no one knows wtf the files in this dir a for, so don't serve them 2016-10-18 17:27:23 -04:00
Chris Meyers 87ea864466 sendfail syscall bad with crappy filesystems 2016-10-18 17:21:14 -04:00
Chris Meyers 64a15db91b fix nginx static files using 2016-10-18 15:51:01 -04:00
Chris Meyers 47495b4ea6 fix mime type issues 2016-10-18 14:38:24 -04:00
Chris Meyers ad2bee1f57 sym link nginx config by popular demand 2016-10-18 14:23:33 -04:00
Chris Meyers 4f6d966bab put nginx into honcho flow
* allows for make docker-compose-test then make honcho flow
2016-10-18 14:19:18 -04:00
Chris Meyers 9e3528de31 change migration name to align with version semantic 2016-10-03 11:15:33 -04:00
Chris Meyers b4c852cf53 change migration name to align with version semantic 2016-10-03 10:06:50 -04:00
Chris Meyers 203df91a5d more robust test mode checking 2016-10-03 09:28:44 -04:00
Chris Meyers 649bf08edf add workflow root endpoints 2016-10-03 08:15:39 -04:00
Chris Meyers 9cafebd8db remove job to jt allow_simultaneous dependency
* Foreshadowing of what's to come with the task manager. When deciding
on what job to run in our task manager, we can't depend on job template
fields. Otherwise, this would cost us a query.
2016-09-29 16:19:19 -04:00
Chris Meyers 1a60dd89bd add back in removed method 2016-09-29 16:01:51 -04:00
Chris Meyers ec2b0ac90d add back in removed method 2016-09-29 16:01:15 -04:00
Chris Meyers dd3c3c9f29 Merge branch 'feature-ha_task_manager' into devel 2016-09-29 10:27:17 -04:00
Chris Meyers fbc1dff4de flake8 fixes 2016-09-29 10:23:00 -04:00
Chris Meyers bdd444fb44 removed print 2016-09-29 09:53:36 -04:00
Chris Meyers 0d538f8b0f Revert "removed wait_task look restriction"
This reverts commit f159fd45406c6af2aacc48a44e2a3993bfa19ce8.
2016-09-28 10:23:45 -04:00
Chris Meyers d65120538d scheduler messages need not be durable 2016-09-27 16:05:30 -04:00
Chris Meyers 89250dcf36 removed wait_task look restriction 2016-09-27 16:04:00 -04:00
Chris Meyers 3a8033dec4 cheesy global lock 2016-09-27 14:16:18 -04:00
Chris Meyers 04f69727f2 fully message driven job execution
TODO:
* Need a distributed lock (leverage postgres)
* Less memory-intensive graph representation
* Maybe serializer/deserializer graph to database
  * Iterative graph building instead of full rebuild.
2016-09-27 14:16:18 -04:00
Chris Meyers cdb65ccac9 replace task manager with event driven scheduler 2016-09-27 14:16:18 -04:00
Chris Meyers cc90204b0f task manager using messages
* First pass, adapt singleton task manager to process messages and run
jobs based on events instead of a busy loop.
* Still need to make message handing run in celery, not in a consumption
loop
2016-09-27 14:05:29 -04:00
Chris Meyers 64c91e1c1d remove stupid scripts 2016-09-16 08:52:54 -04:00
Chris Meyers 7f614a53db flake8 fix 2016-09-15 15:28:55 -04:00
Chris Meyers 77cc7f9d00 functional workflow test for issue #3498 2016-09-15 15:03:08 -04:00
Chris Meyers c35c2d9331 fix class method 2016-09-15 13:51:23 -04:00
Chris Meyers f06b212266 flake8 fixes 2016-09-15 10:25:36 -04:00