Commit Graph
100 Commits
Author SHA1 Message Date
Matthew Jones 1c8bc62e38 Merge branch 'release_3.1.2' into devel
* release_3.1.2: (33 commits)
  updating changelog for 3.1.2
  Add back SRC_ONLY_PKGS
  Fix ubuntu 14 restart service list pt 2
  Make sure the insight playbook fetch doesn't quote user and pass
  Add requirements/vendor to gitignore
  Conditionally install from local python dependencies in spec file
  Remove requirements/vendor on make clean.
  Update brew-srpm target to generate local requirements files
  Get offline pip installs working
  Add clean-dist target
  Navigate back to the jobDetails state when the user clicks outside the host event modal.
  Don't use jinja quote filter on insights username or password
  fix legacy standard out
  Fixed permissions typo
  add test, restore old behavior in api test
  create _survey_element_validation and use it for updating extra_vars
  Do not set the default if the field was not passed in to kwargs_extra_vars
  Remove log aggregator port required mark.
  Modify according to review feedback.
  Host Event json should be read-only
  ...
2017-03-31 10:36:02 -04:00
Matthew Jones 4ff732bc5e Merge branch 'release_3.1.2' into stable
* release_3.1.2: (149 commits)
  updating changelog for 3.1.2
  Add back SRC_ONLY_PKGS
  Fix ubuntu 14 restart service list pt 2
  Make sure the insight playbook fetch doesn't quote user and pass
  Add requirements/vendor to gitignore
  Conditionally install from local python dependencies in spec file
  Remove requirements/vendor on make clean.
  Update brew-srpm target to generate local requirements files
  Get offline pip installs working
  Add clean-dist target
  Navigate back to the jobDetails state when the user clicks outside the host event modal.
  Don't use jinja quote filter on insights username or password
  fix legacy standard out
  Fixed permissions typo
  add test, restore old behavior in api test
  create _survey_element_validation and use it for updating extra_vars
  Do not set the default if the field was not passed in to kwargs_extra_vars
  Remove log aggregator port required mark.
  Modify according to review feedback.
  Host Event json should be read-only
  ...
2017-03-30 22:43:54 -04:00
Matthew Jones eeed969a56 Make sure the insight playbook fetch doesn't quote user and pass 2017-03-29 16:42:15 -04:00
Matthew Jones 536a3b1647 Don't use jinja quote filter on insights username or password
This fixes an issue where a user was trying to use an exclamation mark
in the password. Historically we've used the quote filter but more and
more we're seeing conflicts with special characters
2017-03-27 15:40:43 -04:00
Matthew Jones eb2e7c38b0 Bring up logstash as part of the development cluster 2017-03-21 10:42:32 -04:00
Matthew Jones 03593b957b Parse the mercurial revision correctly in setup playbook
Originally the value was coming out as:

xxxxxx default tip

When we want

xxxxxx

In order for the subsequent revision request to work correctly
2017-03-17 10:45:55 -04:00
Matthew Jones 47a894a339 Fix up cloudforms license unit test 2017-03-13 21:02:36 -04:00
Matthew Jones 5270b830c9 Fixing CloudForms branding 2017-03-13 16:27:30 -04:00
Matthew Jones 071f84d224 Skip requirements test, until it gets some love 2017-03-07 16:48:52 -05:00
Matthew Jones 576e3bfc1a Adding logstash to default compose file 2017-03-07 16:48:51 -05:00
Matthew Jones 50ccd1b003 Fix validation error grammar 2017-03-07 16:48:48 -05:00
Matthew Jones 123756468d Bump version for 3.1.2 release 2017-03-07 16:48:48 -05:00
Matthew Jones 95a2ed6336 Updates to insights playbook project syncing based on feedback
* Support "name" if given, else use a more reasonable file name for
  the playbook file
* Fix an issue where we wouldn't populate the playbooks correctly in
  the database
* Force downloading the playbooks every time since we can't tell when
  the file might change
2017-03-07 16:48:48 -05:00
Matthew Jones 2656e3f3fa Insights project api side integration
* Extend scm credential type to support username and password for
  redhat portal accounts
* Update project update playbook to work with remote insights server
2017-03-07 16:48:44 -05:00
Matthew Jones b6444d7b86 Merge branch 'release_3.1.1' into stable
* release_3.1.1:
  Filter on reason also when logging in via sso and picking authtoken
2017-03-07 15:58:28 -05:00
Matthew Jones 2c7dd8497b Filter on reason also when logging in via sso and picking authtoken 2017-03-07 13:54:52 -05:00
Matthew Jones 2b2c947ac5 Merge branch 'release_3.1.1' into stable
* release_3.1.1:
  Updating changelog for 3.1.1 release
  Fix an issue where notifications might not always be triggered
  give a default other than None
  Respect the user provided rabbitmq vhost value
  Changes to improve the AMI publish process
  Add unsupported primary pre-flight check
  Removed console
  Fixed bug where typing in scm credential when adding/editing project wouldn't work
  Encode default search param
  update asgi_amqp version
  remove uneeded post commit wrapper
  all job status change websockets events should happen after the job hits the database
  Revert "emit job status over socket after database commit"
  emit job status over socket after database commit
  requeue websocket messages that don't (yet) have an established user
  Force setting the password of the rabbitmq user
  rabbit_mq_password required
  host event stdout changes
  Bump version for 3.1.1 release
2017-03-07 10:29:47 -05:00
Matthew Jones 90a26de180 Fix an issue where notifications might not always be triggered
In the case where a notification template were assigned to "failed"
events but not "success" or "any" events.
2017-03-06 15:41:43 -05:00
Matthew Jones 1fefa4cfdd Merge branch 'stable' into devel
* stable: (275 commits)
  Install correct rpm-sign package in RPM builder
  Updating changelog for 3.1 release
  Switch job_type to check from sync when detecting delete_on_update
  use Unicode apostrophes - not single quotes - for French i18n strings
  pin appdirs==1.4.2
  only cancel deps if we can cancel the inv update
  fixing module_name check and adding support for the debug module
  cancel jobs dependent on inv update
  update tests
  CSS tweaks to workflow results panels
  like inventory updates, check if project update deps already processed
  Revert "Merge pull request #5553 from chrismeyersfsu/fix-waiting_blocked"
  Add awx/ui/client/languages to .gitignore
  Delete awx/ui/client/languages/*.json
  refactor based on review
  Add missing permission check.
  Make current_groups a set to easily avoid duplicates, update asgi-amqp requirement
  avoid duplicated related search fields
  Fix workflow audit items
  fixing module name, json blob, and stdout-for-yum-module on host event
  ...
2017-02-28 11:37:05 -05:00
Matthew Jones cdb757503e Bump version for 3.1.1 release 2017-02-27 21:17:51 -05:00
Matthew Jones fc66bb1e42 Merge branch 'release_3.1.0' into stable
* release_3.1.0: (2069 commits)
  Updating changelog for 3.1 release
  Switch job_type to check from sync when detecting delete_on_update
  use Unicode apostrophes - not single quotes - for French i18n strings
  pin appdirs==1.4.2
  only cancel deps if we can cancel the inv update
  fixing module_name check and adding support for the debug module
  cancel jobs dependent on inv update
  update tests
  CSS tweaks to workflow results panels
  like inventory updates, check if project update deps already processed
  Revert "Merge pull request #5553 from chrismeyersfsu/fix-waiting_blocked"
  Add awx/ui/client/languages to .gitignore
  Delete awx/ui/client/languages/*.json
  refactor based on review
  Add missing permission check.
  Make current_groups a set to easily avoid duplicates, update asgi-amqp requirement
  avoid duplicated related search fields
  Fix workflow audit items
  fixing module name, json blob, and stdout-for-yum-module on host event
  just like we fail running tasks fail waiting tasks
  ...
2017-02-27 16:27:16 -05:00
Matthew Jones 98daaece73 Switch job_type to check from sync when detecting delete_on_update 2017-02-27 16:22:05 -05:00
Matthew Jones fd7c2550ee Fix a potential security issue in revision storage path name
It's too stable and could lead to a race condition
2017-02-23 16:21:13 -05:00
Matthew Jones b43a354bca Merge branch 'improve_ujt_filter_aliases' into release_3.1.0
* improve_ujt_filter_aliases:
  Alias unified job template search fields for presentation
2017-02-22 16:59:56 -05:00
Matthew Jones b14336bdff Alias unified job template search fields for presentation
The polymorphic accessors have a name that is different than our
normal presentation name for these types. This aliases them for the
presentation layer and then handles processing them when they are
given as filters.
2017-02-22 15:33:47 -05:00
Matthew Jones 9e2e119022 Make polymorphic_ctype aliasing work in filters
Previousy this would fall through and get caught by the type checker
2017-02-21 21:32:33 -05:00
Matthew Jones 0a5b43acae Make unit test valid
Failed after recent changed that exposed the invalidity
2017-02-21 12:50:41 -05:00
Matthew Jones 46605eb591 Fix an issue filtering with non ints against foreign keys
I feel like this probably worked at one time but no longer does. It
makes me wonder if ForeignObjectRel was meant to be the catchall but
no longer is.
2017-02-21 12:33:15 -05:00
Matthew Jones 6f84849f1a Disable retry files on ansible runs 2017-02-17 09:55:52 -05:00
Matthew Jones 785a8d0789 Fix an issue where smtplib can't handle unicode strings
We probably do get this value as unicode originally but when we store
it, due to a recently fixed bug it will come out as *not* unicode.

So things were accidentally working because py2 smtplib uses hmac
which won't accept unicode.

This change adds a flag to encrypt_field that forces it to skip the
utf8 fixup from before for narrow use cases.
2017-02-15 14:07:30 -05:00
Matthew Jones 8553b8eda6 Ignore hipchat certificate verification 2017-02-14 14:21:51 -05:00
Matthew Jones 8c4d4a0543 Protect Tower from Ansible core making changes to the event uuids 2017-02-13 11:55:08 -05:00
Matthew Jones aeee6db868 Trigger rabbitmq cluster node removal from deprovisioning 2017-02-09 13:36:59 -05:00
Matthew Jones 986ef9e2eb Merge branch 'release_3.1.0' into devel
* release_3.1.0: (186 commits)
  check related credential for inventory source
  Fixed org jt's smart status
  Show the data that would have been a problem sending payload
  Implement optional message persistence on callback events
  changing the related tab on an edit of an organization to be for users, instead of users & teams
  fixing cancel function for workflow results
  Handle deleting root node while adding a child to that root node
  Skip sending task to process cache changes when migrating to database settings.
  only loop over project OPTIONS response if the response is valid
  Added the ability to pass in a maximum number of pages shown to pagination directive.  This is useful for narrow lists particularly in modals.
  fix a CTinT bug in static config parsing
  Recursively fetch workflow nodes when there is more than 1 page of nodes
  enforce a sane default OPT_NETWORK_TIMEOUT for LDAP connections
  Labels expects the iterator to be `template` not `job_template`
  Disable workflow editor save when currently adding a node
  Fixed up organizations/job templates list
  surface dry_run option for system jobs through the API
  fix bugs with system auditors and orphan JTs
  incorporating organization into the custom inv script option selection for a group
  catch and log LDAP auth plugin misconfigurations
  ...
2017-02-08 14:01:39 -05:00
Matthew Jones ebc1d95233 Don't perform last job run calculation for sync project updates 2017-02-06 16:22:38 -05:00
Matthew Jones 5eff937f5c Fix location of the uwsgi fifo for dev environment 2017-02-06 16:22:38 -05:00
Matthew Jones 8d643dc459 Fix an issue not properly parsing the url port of the tower host
When attempting to determine the proper url for URLField
2017-02-06 14:00:57 -05:00
Matthew Jones 1cbbb6a87c Make full queue writes silent unless we can't write to any of them
This will still keep general queue errors other than Queue.Full
2017-02-06 13:53:41 -05:00
Matthew Jones 1fc69038a6 Propogate stdout change to mgmt jobs 2017-02-03 15:46:16 -05:00
Matthew Jones 0139bccde3 Make sure stdout always lines up with what is expected out ansible
Also, strip superflous extra newlines at the end of job events, this
helps downloaded stdout line up.
2017-02-03 15:37:35 -05:00
Matthew Jones a9621d579d Make sure the workflow link is included in the notification 2017-02-03 12:57:59 -05:00
Matthew Jones b2bef69f7f Remove stray print 2017-02-03 12:06:17 -05:00
Matthew Jones ca87c4f83b Implement logout semantics by support DELETE on authtoken 2017-02-02 16:32:09 -05:00
Matthew Jones d469ef2385 Add in localization setup to the container image
This should fix up utf8 question marks
2017-02-02 15:51:50 -05:00
Matthew Jones 2621f48189 We specifically need to convert the ansible included file type
for include events
2017-02-01 15:30:22 -05:00
Matthew Jones a98db65d4a Documenting process isolation for acceptance 2017-02-01 13:44:05 -05:00
Matthew Jones e389084298 Add a periodic celery task to clean up local stdout files
This works in tandem with the on-demand stdout file generator and
decouples stdout locally from the persistent database representation
ob the job itself
2017-01-31 15:52:45 -05:00
Matthew Jones 4c61449f89 Generate stdout from database if not present on disk
Useful for download stdout when not available on all cluster nodes
2017-01-31 14:29:08 -05:00
Matthew Jones 4a015da982 Purge old mongo Makefile targets, update psql target for new docker 2017-01-31 14:28:48 -05:00
Matthew Jones 53256f4c2d Integrate proper cleanup for tmp paths for inventory updates 2017-01-31 11:31:44 -05:00
Matthew Jones 587a843acd Shorten the default control persist path
Customer needed a few more characters, this should give a bit more breathingroom
2017-01-30 13:49:20 -05:00
Matthew Jones d9a7f2fadb Silently ignore psutil errors when the process is already gone
During ssh CP cleanuip
2017-01-30 13:39:05 -05:00
Matthew Jones 829552f81a Merge branch 'release_3.1.0' into devel
* release_3.1.0: (633 commits)
  query for failed projects to include canceled
  Style Audit of Host Event Modal
  Remove npm hacks in RPM builder
  Update po files
  Update pot files
  Make sure to delete any nodes that need to be deleted before attempting to associate
  super-user requests to HostDetail go through rbac
  Launch job with prompts fixes
  add notifications to cleanup_jobs
  allow can_add to be called for permission info
  Elaborate on system job default
  i accidentally removed the "-1" from this check, adding it back in
  remove job_event text filters, tweaked RBAC see issue 4958 for the RBAC details
  fixing jshint
  Adding tags was creating this nested array structure which was causing buggy behavior.  This should fix that.
  bump vmware inventory script
  Fix up some unit tests
  moving appendToBottom function elsewhere
  rearranging logic to match integrity of existing logic
  Fixed location of sub-category dropdowns
  ...
2017-01-27 20:52:59 -05:00
Matthew Jones 66426aa7dd Store project update and inventory update stdout in the database
So things work across the cluster
2017-01-27 16:51:03 -05:00
Matthew Jones bfda6ff8b5 Fix up some unit tests 2017-01-26 16:01:54 -05:00
Matthew Jones 6388e9b055 Putting back the inadvertantly removed job_events 2017-01-26 12:00:13 -05:00
Matthew Jones 37d8e57c4f These old endpoints are hacky, ugly, and no longer used
They were strictly shortcuts for UI querying which can be performed
more efficiently on `/job_events` without any special processing
2017-01-26 11:55:44 -05:00
Matthew Jones e15273c993 Fixes some issues where Tower would not emit the password on prompts
Carat seems to only want to match newlines or the beginning of the
string, since we seem to get CR+LF this seems to keep the carat from
matching so here we're expanding the regex matches.

This also extends support for DZDO where it was only originally added
on ad-hoc commands inadvertantly.

Remove PMRUN support since that was never merged into core
2017-01-26 11:19:23 -05:00
Matthew Jones 4771b2efc0 Merge branch 'remove_jobevent_parent_usage' into release_3.1.0
* remove_jobevent_parent_usage:
  Don't iterate over parents, perform a final update at the end
  Drop assignment of job event parent in favor of parent_uuid
2017-01-24 21:07:58 -05:00
Matthew Jones 22a3e87720 Don't iterate over parents, perform a final update at the end 2017-01-24 16:21:50 -05:00
Matthew Jones 2af98e5f58 Drop assignment of job event parent in favor of parent_uuid
* This eliminates the save lookup of the parent job event and
  associated memcached call(s)
* Removes some other legacy parent determination mechanisms
* Alternate way to query for the parent/child relationship
2017-01-24 15:40:33 -05:00
Matthew Jones b3f4f3bea5 Fix issue reassembling ad-hoc event partials 2017-01-23 16:30:44 -05:00
Matthew Jones abdd91bd1f Fixes for data corruption/exception in cache usage
Specifically as it relates to serializers and job event writing at
high speeds
2017-01-23 14:39:03 -05:00
Matthew Jones 8a9b2fcaea Implement alternate ports for nginx
* This also allows disabling https mode in the nginx configuration
* Reconfigure the development container to not specifically require
  https, so the haproxy cluster configuration can work
2017-01-23 14:34:15 -05:00
Matthew Jones df249eda2e Raise default job event worker queue size 2017-01-23 10:47:47 -05:00
Matthew Jones 47efe8c2e8 Add deprecation warning to job start 2017-01-19 11:01:31 -05:00
Matthew Jones a06b44ae38 Add sync launch type 2017-01-19 09:47:10 -05:00
Matthew Jones 94ffce07a4 Fix an issue processing job events when uuid isn't present 2017-01-19 09:47:10 -05:00
Matthew Jones 6ed86e1934 Revert "bump pkg info tower version to 3.1.0"
This reverts commit dea4c873e8d89f3e2ed5e74f8d3eb480e57f927d.
2017-01-18 14:30:06 -05:00
Matthew Jones 73f92bba5d Integrate multiprocessing writer worker in callback receiver 2017-01-18 12:05:29 -05:00
Matthew Jones 1cdeb4d2af Refactor event emitter to not use event partials
event emitter now caches to memcache where it is eventually picked up
by the stdout event emitter. This obviates event reassembly in the
callback receiver.
2017-01-17 15:59:43 -05:00
Matthew Jones 0d4d872a76 Import translation files 2017-01-12 15:15:13 -05:00
Matthew Jones 23f4898eea Re-wirte ad-hoc notification templates to organization to match docs 2017-01-11 11:25:08 -05:00
Matthew Jones 8796af7e28 Make session and csrf cookies secure by default 2017-01-11 10:39:46 -05:00
Matthew Jones 974fe1d244 Fix an issue with set_stats for unsupported Ansible versions 2017-01-11 10:24:17 -05:00
Matthew Jones e594a3ee3e Implement a worker-based callback receiver system 2017-01-10 14:25:41 -05:00
Matthew Jones 3006e357f6 Add a hint header for max job events for the UI 2017-01-05 15:16:36 -05:00
Matthew Jones 89304b2ee0 Don't ignore ANSIBLE_NET env items when hiding sensitive information 2017-01-05 12:35:50 -05:00
Matthew Jones 60fa34e8cc Fix a redis reference issue
We are no longer using redis for Celery
2017-01-04 14:40:40 -05:00
Matthew Jones 415c7166b6 Adding source for LGPL deps 2017-01-04 14:26:53 -05:00
Matthew Jones f9d9196270 Adding deprecation warnings
Also updating New in/Added in text
2017-01-04 14:23:43 -05:00
Matthew Jones 6188f2d9b5 Update third party licenses 2017-01-04 12:39:39 -05:00
Matthew Jones e45201aa87 Added scm_type to project summary fields 2017-01-03 15:37:38 -05:00
Matthew Jones 9d289e4349 Fix some issues related to purging the old paging decorator 2017-01-03 15:31:30 -05:00
Matthew Jones 9f777f6153 Add some provisions for https into haproxy and the cluster 2017-01-03 13:59:29 -05:00
Matthew Jones 888ec25c3c Adding new privilege escalation methods from core 2016-12-15 16:22:21 -05:00
Matthew Jones a25853a3a5 Updating translation artifacts
* also installing translation tools into dev environment
* Removing fedora install instructions, no one here uses fedora
2016-12-14 15:58:47 -05:00
Matthew Jones 1cd2a762be Reset max bytes display 2016-12-14 15:20:04 -05:00
Matthew Jones a61e729ebb Purge event res dict if it is over a certain size
Also purge/update some old settings values
2016-12-14 15:05:28 -05:00
Matthew Jones f89bd15bf5 Show started and finished on job summary fields 2016-12-13 15:27:48 -05:00
Matthew Jones e1942083e3 Remove sneeringer's old unused decorator code 2016-12-12 16:14:22 -05:00
Matthew Jones 93ce2a5dfd Set proot/bubblewrap enabled by default 2016-12-12 15:26:31 -05:00
Matthew Jones 8b8c29b9dc Purge has_schedules
Also... migration for big field docs updates
2016-12-12 12:33:09 -05:00
Matthew Jones bb7a201c2f Add missing field to ad-hoc command partial 2016-12-12 12:25:19 -05:00
Matthew Jones 349d497bb4 Make max page size tunable 2016-12-12 12:10:33 -05:00
Matthew Jones 08edbb1b72 Set an upper limit of 200 on the max page size 2016-12-12 12:01:48 -05:00
Matthew Jones 2d6dff1a3b Better error handling on deprovision_node management command 2016-12-12 10:55:03 -05:00
Matthew Jones ee38be85d4 Better error handling on deprovision_node management command 2016-12-12 10:54:00 -05:00
Matthew Jones 4e10d55501 Updating clustering acceptance docs 2016-12-07 11:08:39 -05:00
Matthew Jones 24b858c6fb Switch away from deepcopy to improve performance 2016-12-06 13:33:14 -05:00