Configure Tower in Tower:

* Add separate Django app for configuration: awx.conf.
* Migrate from existing main.TowerSettings model to conf.Setting.
* Add settings wrapper to allow get/set/del via django.conf.settings.
* Update existing references to tower_settings to use django.conf.settings.
* Add a settings registry to allow for each Django app to register configurable settings.
* Support setting validation and conversion using Django REST Framework fields.
* Add /api/v1/settings/ to display a list of setting categories.
* Add /api/v1/settings/<slug>/ to display all settings in a category as a single object.
* Allow PUT/PATCH to update setting singleton, DELETE to reset to defaults.
* Add "all" category to display all settings across categories.
* Add "changed" category to display only settings configured in the database.
* Support per-user settings via "user" category (/api/v1/settings/user/).
* Support defaults for user settings via "user-defaults" category (/api/v1/settings/user-defaults/).
* Update serializer metadata to support category, category_slug and placeholder on OPTIONS responses.
* Update serializer metadata to handle child fields of a list/dict.
* Hide raw data form in browsable API for OPTIONS and DELETE.
* Combine existing licensing code into single "TaskEnhancer" class.
* Move license helper functions from awx.api.license into awx.conf.license.
* Update /api/v1/config/ to read/verify/update license using TaskEnhancer and settings wrapper.
* Add support for caching settings accessed via settings wrapper.
* Invalidate cached settings when Setting model changes or is deleted.
* Preload all database settings into cache on first access via settings wrapper.
* Add support for read-only settings than can update their value depending on other settings.
* Use setting_changed signal whenever a setting changes.
* Register configurable authentication, jobs, system and ui settings.
* Register configurable LDAP, RADIUS and social auth settings.
* Add custom fields and validators for URL, LDAP, RADIUS and social auth settings.
* Rewrite existing validator for Credential ssh_private_key to support validating private keys, certs or combinations of both.
* Get all unit/functional tests working with above changes.
* Add "migrate_to_database_settings" command to determine settings to be migrated into the database and comment them out when set in Python settings files.
* Add support for migrating license key from file to database.
* Remove database-configuable settings from local_settings.py example files.
* Update setup role to no longer install files for database-configurable settings.

f 94ff6ee More settings work.
f af4c4e0 Even more db settings stuff.
f 96ea9c0 More settings, attempt at singleton serializer for settings.
f 937c760 More work on singleton/category views in API, add code to comment out settings in Python files, work on command to migrate settings to database.
f 425b0d3 Minor fixes for sprint demo.
f ea402a4 Add support for read-only settings, cleanup license engine, get license support working with DB settings.
f ec289e4 Rename migration, minor fixmes, update setup role.
f 603640b Rewrite key/cert validator, finish adding social auth fields, hook up signals for setting_changed, use None to imply a setting is not set.
f 67d1b5a Get functional/unit tests passing.
f 2919b62 Flake8 fixes.
f e62f421 Add redbaron to requirements, get file to database migration working (except for license).
f c564508 Add support for migrating license file.
f 982f767 Add support for regex in social map fields.

awx/conf/migrations/0001_initial.py

@@ -0,0 +1,30 @@
+# -*- coding: utf-8 -*-
+from __future__ import unicode_literals
+
+from django.db import migrations, models
+import jsonfield.fields
+from django.conf import settings
+
+
+class Migration(migrations.Migration):
+
+    dependencies = [
+        migrations.swappable_dependency(settings.AUTH_USER_MODEL),
+    ]
+
+    operations = [
+        migrations.CreateModel(
+            name='Setting',
+            fields=[
+                ('id', models.AutoField(verbose_name='ID', serialize=False, auto_created=True, primary_key=True)),
+                ('created', models.DateTimeField(default=None, editable=False)),
+                ('modified', models.DateTimeField(default=None, editable=False)),
+                ('key', models.CharField(max_length=255)),
+                ('value', jsonfield.fields.JSONField(null=True)),
+                ('user', models.ForeignKey(related_name='settings', default=None, editable=False, to=settings.AUTH_USER_MODEL, null=True)),
+            ],
+            options={
+                'abstract': False,
+            },
+        ),
+    ]

awx/conf/migrations/0002_v310_copy_tower_settings.py

@@ -0,0 +1,79 @@
+# -*- coding: utf-8 -*-
+from __future__ import unicode_literals
+import json
+
+from django.db import migrations
+
+
+def copy_tower_settings(apps, schema_editor):
+    TowerSettings = apps.get_model('main', 'TowerSettings')
+    Setting = apps.get_model('conf', 'Setting')
+    for tower_setting in TowerSettings.objects.all().iterator():
+        try:
+            value = tower_setting.value
+            # LICENSE is stored as a string; convert it to a dict.
+            if tower_setting.key == 'LICENSE':
+                value = json.loads(value)
+            # Anything else (e.g. TOWER_URL_BASE) that is stored as a string
+            # needs to be converted to a JSON-encoded string to work with the
+            # JSON field.
+            elif tower_setting.value_type == 'string':
+                value = json.dumps(value)
+            setting, created = Setting.objects.get_or_create(
+                key=tower_setting.key,
+                user=tower_setting.user,
+                defaults=dict(value=value),
+            )
+            if not created and setting.value != value:
+                setting.value = value
+                setting.save(update_fields=['value'])
+        except Setting.MultipleObjectsReturned:
+            pass
+
+
+def revert_tower_settings(apps, schema_editor):
+    TowerSettings = apps.get_model('main', 'TowerSettings')
+    Setting = apps.get_model('conf', 'Setting')
+    for setting in Setting.objects.all().iterator():
+        value = setting.value
+        # LICENSE is stored as a JSON object; convert it back to a string.
+        if setting.key == 'LICENSE':
+            value = json.dumps(value)
+        defaults = dict(
+            value=value,
+            value_type='string',
+            description='',
+            category='',
+        )
+        try:
+            tower_setting, created = TowerSettings.objects.get_or_create(
+                key=setting.key,
+                user=setting.user,
+                defaults=defaults,
+            )
+            if not created:
+                update_fields = []
+                for k, v in defaults.items():
+                    if getattr(tower_setting, k) != v:
+                        setattr(tower_setting, k, v)
+                        update_fields.append(k)
+                if update_fields:
+                    tower_setting.save(update_fields=update_fields)
+        except TowerSettings.MultipleObjectsReturned:
+            pass
+
+
+class Migration(migrations.Migration):
+
+    dependencies = [
+        ('conf', '0001_initial'),
+        ('main', '0035_v310_jobevent_uuid'),
+    ]
+
+    run_before = [
+        ('main', '0036_v310_remove_tower_settings'),
+    ]
+
+    operations = [
+        migrations.RunPython(copy_tower_settings, revert_tower_settings),
+    ]