Chris Meyers
49a5c136dd
add vmware deps to ansible venv
2016-12-06 13:29:53 -05:00
Chris Meyers
a5b1c7b579
use more precise exception
2016-12-05 13:54:33 -05:00
Chris Meyers
f47f8abe42
finished fixing job through workflow node
...
related to #4182
2016-12-05 13:35:34 -05:00
Chris Meyers
88d6552b86
artifact data comes in as a dict
2016-11-30 16:25:27 -05:00
Chris Meyers
6c0b97675a
handle special case pkg_name[pkg_subname]
2016-11-29 10:17:07 -05:00
Chris Meyers
bd78ff0a42
bump ansible requirements
2016-11-21 17:33:36 -05:00
Chris Meyers
1049b0bfd5
removed, seemingly, uneeded base packages
2016-11-21 17:33:36 -05:00
Chris Meyers
f2fac1fa91
factored out base python requirements
...
* use pip-tools to programatically build requirements.txt
2016-11-21 17:33:35 -05:00
Chris Meyers
4ec8a2f429
selectively bump base requirements
2016-11-21 17:33:14 -05:00
Chris Meyers
9f56d39644
factored out base requirements
...
* bumped all dependent packages that are not base
2016-11-21 17:33:14 -05:00
Chris Meyers
ddd41e77be
fixes fact jsonbfield for unit tests
2016-11-21 17:25:18 -05:00
Chris Meyers
1a96b66f00
update inventory field, name, not unique
2016-11-21 14:42:11 -05:00
Chris Meyers
01ec443380
inventory is unique on <name, org>
...
* was unique on name because we were inheriting from a Model that had it
defined as such. Thus our expression of uniqueness in the Inventory
Model was meaningless.
2016-11-21 14:34:17 -05:00
Chris Meyers
b6b1f4205c
flake8 fixes
2016-11-18 14:49:31 -05:00
Chris Meyers
ba6ab6f746
forgot to add new fixtures for jsonbfield fact
2016-11-18 11:37:06 -05:00
Chris Meyers
4a1a3bd1e8
do not coerce jsonbfield to string in db
...
* functional tests do coerce because they assume they are running on
sqlite
2016-11-18 11:29:42 -05:00
Chris Meyers
ef0df1fefd
more j -> workflow_job renaming
2016-11-17 10:51:06 -05:00
Chris Meyers
07996abf64
in the api, finish renaming wfjt -> job relation
...
related to #4052
related to #3976
2016-11-17 10:40:28 -05:00
Chris Meyers
df5e3288c4
Revert "in the api, finish renaming wfjt -> job relation"
...
This reverts commit 8ee469ceeb0d9e7514f930c6325d1577bf5505c8.
2016-11-17 10:39:17 -05:00
Chris Meyers
d9821dbb6c
in the api, finish renaming wfjt -> job relation
...
related to #4052
related to #3976
2016-11-17 10:29:34 -05:00
Chris Meyers
edaf018f2c
Revert "factored out base requirements"
...
This reverts commit c5129a054c272a5e59008b3dc4d8a2f287f310a6.
2016-11-16 13:39:44 -05:00
Chris Meyers
827b4e1537
factored out base requirements
...
* bumped all dependent packages that are not base
2016-11-16 13:35:35 -05:00
Chris Meyers
e7b9410361
fix up python requirements test
2016-11-15 09:19:29 -05:00
Chris Meyers
1883485724
towards virtualenv being exactly requirements.txt
...
* Ignore already installed (usually global) packages when installing
requirements.txt into the virtualenv.
2016-11-15 09:19:29 -05:00
Chris Meyers
81720a6a2a
bump cellery billiard requirement
2016-11-15 08:43:51 -05:00
Chris Meyers
9f40e7ef70
fix notification unit test mock
2016-11-14 16:29:34 -05:00
Chris Meyers
f1f92deb1f
bump up django-jsonfield
2016-11-14 14:34:46 -05:00
Chris Meyers
0c2d9e09b9
use known working django-jsonfield
2016-11-14 13:26:24 -05:00
Chris Meyers
ec83a1cb47
use django-jsonfield not jsonfield
2016-11-14 12:18:29 -05:00
Chris Meyers
356b0af3cd
bump channels version
2016-11-14 11:11:29 -05:00
Chris Meyers
1d513252e4
fix up requirements
2016-11-14 09:16:26 -05:00
Chris Meyers
545412a6b5
remove inline requirements comment
2016-11-14 08:46:46 -05:00
Chris Meyers
c95ef4dc07
add requirements unit test
2016-11-11 17:19:52 -05:00
Chris Meyers
3d4f359cbc
Revert "Read the branch name"
...
This reverts commit e38bfbce6adc0e94a72bd3eda908263aa6cc651a.
2016-11-11 16:01:45 -05:00
Chris Meyers
5f10c849fa
Read the branch name
2016-11-11 16:00:53 -05:00
Chris Meyers
241019568c
use jsonfield instead of django-jsonfield
2016-11-11 15:47:41 -05:00
Chris Meyers
5b4892250d
fix partial test
...
* We shouldn't care what order the inventory updates for the inventory
sources are returned in.
2016-11-11 15:13:28 -05:00
Chris Meyers
0efe8e9cfb
fix license test
...
so that the license file on dev machines isn't accidentally picked up
2016-11-11 14:43:00 -05:00
Chris Meyers
9aaf694acf
always allow running at least 1 job
...
* Regardless of capacity
* Add unit tests around this logic
2016-11-10 11:07:05 -05:00
Chris Meyers
697ff11e3b
move python dep git repos to ansible org
2016-11-10 09:27:44 -05:00
Chris Meyers
b9462bfad6
remove, not used, gevent-socketio
2016-11-10 09:10:26 -05:00
Chris Meyers
5d205f1e1b
remove deprecated mongo fact code and deps
...
* We have the requirements that users with Tower < 3.0.x must upgrade to
3.0.x before > 3.0.x. Thus, we are save to delete all mongo migration
code and deps.
2016-11-09 16:25:27 -05:00
Chris Meyers
766e4af38e
low hanging fruit requirements spring cleaning
...
* django-jsonfield PR accepted upstream
* django-rest-framework-mongoengine legacy system tracking dep
* python-social-auth PR accepted upstream
2016-11-09 16:12:27 -05:00
Chris Meyers
adcf0af2a0
on host callback, upate dynamic inv only once
...
* During a job template launch via the host callback launch feature,
when the host launching the job template is not found; we try to launch
associated dyn inv updates to pick up the host. Then the inv is searched
again for the host. If the host is found, then the jt is launched. This
fix carries forward the feature that prevents the dyn inv update with
cache timeout of 0 from being re-launched with the new task manager.
2016-11-08 15:06:47 -05:00
Chris Meyers
b66256eb98
fixes test_settings unit tests
2016-11-08 11:10:52 -05:00
Chris Meyers
dcb8789fd9
fix job blocking job with allow simultaneous
...
related to #3911
2016-11-08 11:00:52 -05:00
Chris Meyers
1fc34a9f41
mock capacity
2016-11-08 10:19:14 -05:00
Chris Meyers
1aa6ab72d6
fixes multiple proj updates running for single job
...
related to #3906
2016-11-08 09:07:27 -05:00
Chris Meyers
5c71f1d6f7
allow all hosts during development
2016-11-02 10:45:42 -05:00
Chris Meyers
cc7949f040
update docs
2016-11-02 10:00:05 -05:00
Chris Meyers
250a71907d
update for commit hook
2016-11-02 08:25:51 -05:00
Chris Meyers
25b85c4a0b
rename scheduler config singleton
2016-11-01 14:07:00 -05:00
Chris Meyers
e1a84f4c85
bump migrations
2016-11-01 13:55:37 -05:00
Chris Meyers
13c89ab78c
HAify job schedules and more task_manager renaming
2016-11-01 13:50:42 -05:00
Chris Meyers
87dd91e849
rename Scheduler to TaskManager
2016-11-01 13:50:42 -05:00
Chris Meyers
6efa468f29
init task manager architecture docs
2016-11-01 13:50:42 -05:00
Chris Meyers
c4a3b604f8
add back in alan's workflow fail detection
2016-11-01 13:50:42 -05:00
Chris Meyers
ed37e68c53
run dependencies when capacity is available
2016-11-01 13:50:42 -05:00
Chris Meyers
0f98e1edec
remove todo's
2016-11-01 13:50:42 -05:00
Chris Meyers
03a484a6a6
remove old task manager code
2016-11-01 13:50:42 -05:00
Chris Meyers
454b3edb7c
rectify celery<->db inconsistent running job
2016-11-01 13:50:42 -05:00
Chris Meyers
4ef4b4709b
workflow execution added
2016-11-01 13:50:42 -05:00
Chris Meyers
fd8c641fa5
flake8 fixes
2016-11-01 13:50:42 -05:00
Chris Meyers
9802b1f379
AdHocCommand support added to task manager
2016-11-01 13:50:42 -05:00
Chris Meyers
46faeffbb3
added task manager system job support
2016-11-01 13:50:42 -05:00
Chris Meyers
5fa5d4b34b
support distributed project updates
2016-11-01 13:50:42 -05:00
Chris Meyers
306562cd67
inventory updates running correctly
2016-11-01 13:50:42 -05:00
Chris Meyers
555f0bb90f
project and jobs running correctly
2016-11-01 13:50:42 -05:00
Chris Meyers
7050c4e09e
Revert "no one knows wtf the files in this dir a for, so don't serve them"
...
This reverts commit b3cccea70368ba1550366380e583751df1df061b.
2016-10-21 10:04:50 -04:00
Chris Meyers
5b60b14227
bump shade version
2016-10-19 14:18:00 -04:00
Chris Meyers
49c90b8f2d
Revert "bump shade version"
...
This reverts commit 0125d114fdf8be5f3a5fdab856c92d82a2988607.
2016-10-19 14:17:04 -04:00
Chris Meyers
8a4d6b6f35
bump shade version
2016-10-19 14:07:20 -04:00
Chris Meyers
b43945b0f2
Revert "bump shade version"
...
This reverts commit d0a7313a4ccb1cfca3c7655b34b61c6cb6861909.
2016-10-19 12:33:53 -04:00
Chris Meyers
54683cbff4
fix amqp dep
2016-10-18 18:42:12 -04:00
Chris Meyers
6d07699b29
bump shade version
2016-10-18 18:02:30 -04:00
Chris Meyers
cbffb23d41
no one knows wtf the files in this dir a for, so don't serve them
2016-10-18 17:27:23 -04:00
Chris Meyers
87ea864466
sendfail syscall bad with crappy filesystems
2016-10-18 17:21:14 -04:00
Chris Meyers
64a15db91b
fix nginx static files using
2016-10-18 15:51:01 -04:00
Chris Meyers
47495b4ea6
fix mime type issues
2016-10-18 14:38:24 -04:00
Chris Meyers
ad2bee1f57
sym link nginx config by popular demand
2016-10-18 14:23:33 -04:00
Chris Meyers
4f6d966bab
put nginx into honcho flow
...
* allows for make docker-compose-test then make honcho flow
2016-10-18 14:19:18 -04:00
Chris Meyers
9e3528de31
change migration name to align with version semantic
2016-10-03 11:15:33 -04:00
Chris Meyers
b4c852cf53
change migration name to align with version semantic
2016-10-03 10:06:50 -04:00
Chris Meyers
203df91a5d
more robust test mode checking
2016-10-03 09:28:44 -04:00
Chris Meyers
649bf08edf
add workflow root endpoints
2016-10-03 08:15:39 -04:00
Chris Meyers
9cafebd8db
remove job to jt allow_simultaneous dependency
...
* Foreshadowing of what's to come with the task manager. When deciding
on what job to run in our task manager, we can't depend on job template
fields. Otherwise, this would cost us a query.
2016-09-29 16:19:19 -04:00
Chris Meyers
1a60dd89bd
add back in removed method
2016-09-29 16:01:51 -04:00
Chris Meyers
ec2b0ac90d
add back in removed method
2016-09-29 16:01:15 -04:00
Chris Meyers
dd3c3c9f29
Merge branch 'feature-ha_task_manager' into devel
2016-09-29 10:27:17 -04:00
Chris Meyers
fbc1dff4de
flake8 fixes
2016-09-29 10:23:00 -04:00
Chris Meyers
bdd444fb44
removed print
2016-09-29 09:53:36 -04:00
Chris Meyers
0d538f8b0f
Revert "removed wait_task look restriction"
...
This reverts commit f159fd45406c6af2aacc48a44e2a3993bfa19ce8.
2016-09-28 10:23:45 -04:00
Chris Meyers
d65120538d
scheduler messages need not be durable
2016-09-27 16:05:30 -04:00
Chris Meyers
89250dcf36
removed wait_task look restriction
2016-09-27 16:04:00 -04:00
Chris Meyers
3a8033dec4
cheesy global lock
2016-09-27 14:16:18 -04:00
Chris Meyers
04f69727f2
fully message driven job execution
...
TODO:
* Need a distributed lock (leverage postgres)
* Less memory-intensive graph representation
* Maybe serializer/deserializer graph to database
* Iterative graph building instead of full rebuild.
2016-09-27 14:16:18 -04:00
Chris Meyers
cdb65ccac9
replace task manager with event driven scheduler
2016-09-27 14:16:18 -04:00
Chris Meyers
cc90204b0f
task manager using messages
...
* First pass, adapt singleton task manager to process messages and run
jobs based on events instead of a busy loop.
* Still need to make message handing run in celery, not in a consumption
loop
2016-09-27 14:05:29 -04:00
Chris Meyers
64c91e1c1d
remove stupid scripts
2016-09-16 08:52:54 -04:00
Chris Meyers
7f614a53db
flake8 fix
2016-09-15 15:28:55 -04:00