commit 4fac3aff6d5ba75f6820ab3c74bfb65d354fb926
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Thu Nov 2 17:27:40 2017 -0500
Add HEAD list functions that return object counts and
filters counts. Include the headers in the list
return messages as well.
M frontend/bootenvs.go
M frontend/frontend.go
M frontend/jobs.go
M frontend/leases.go
M frontend/machines.go
M frontend/params.go
M frontend/plugins.go
M frontend/profiles.go
M frontend/reservations.go
M frontend/stages.go
M frontend/subnets.go
M frontend/tasks.go
M frontend/templates.go
M frontend/users.go
commit 831fa89ba644e36cfafb2ed88c93692614d1289f
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Tue Oct 31 14:53:18 2017 -0500
Allow machine task list modification to the part that has not been run yet.
This loosens the rules around machine task list modification, and
cleans up some cruift we had around how the job runner frontend
interacted with the machine backend code.
M backend/machines.go
M frontend/jobs.go
commit 88a58c3707b2c98f857c9bf86efd9a4ba2099fab
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Tue Oct 31 15:30:31 2017 -0500
Fix 5min-drp to use new tip content names
Backend jobs should not send an error on rendering without a return
code.
Make the job running immediately so that failed jobs have a good start
time.
M backend/jobs.go
commit e468c0ddb3013984f8b0029ecd555726cdc375c7
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Tue Oct 31 14:05:49 2017 -0500
Fix canary naming for sledgehammer, and make explode_iso asynchronus again
M backend/bootenv.go
M backend/dataTracker.go
M embedded/assets/explode_iso.sh
commit 623a92d9ced707be3c88cae9aa46cec0101105d1
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Mon Oct 30 09:38:54 2017 -0500
Make sure content is filled before handing it out.
Content objects were not having their Fill() methods called on them in
buildContent, leading to nulls showing up in the API responses. This
contravenes our "no NULLs unless you really mean it" policy.
M frontend/content.go
commit 542854bcb848c7d32c0848da9b64b0cd3d56066d
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Fri Oct 27 16:53:24 2017 -0500
Add functional unit tests for job functions, including a basic agent
M frontend/info.go
commit 43f2c6cdf58bf4e2c0d74fc4e509ae644fd27e52
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Wed Oct 25 10:40:19 2017 -0500
Fix error reporting on task list changes to machines
M backend/machines.go
commit 4e57cb7fbede7828887ca5d4e499d7c260fa71a1
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Wed Oct 25 14:56:59 2017 -0500
Make sure we always say we plugin content type
M midlayer/controller.go
commit 8e2321e03d48d13befd41337dae7d7861fa8e5d8
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Wed Oct 25 14:55:34 2017 -0500
If content version is unspecified, use pp version
M midlayer/controller.go
commit 12745de8e93017c351b36bc23844b7c1d68bee93
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Wed Oct 25 13:37:42 2017 -0500
Allow the plugins to provide full content.
Also allow old and new plugins to work.
To use this, you will need to do a full build before
running tests.
M .gitignore
M frontend/content.go
M midlayer/controller.go
commit 4e4cd350db7d1bd7f0393d68923f609d94fd1ce4
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Tue Oct 24 17:11:45 2017 -0500
Add protection to only allow json and yaml files in the
saas directory. Protect from yq and bak files. :-)
M midlayer/stack.go
commit 104445b519c199381ca6d829fab9bf41187bf267
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Tue Oct 24 16:13:57 2017 -0500
Add the stage-change-map feature flag to indicate which
method workflow is currently using.
M frontend/info.go
commit aba4cd39e440642cdabfc862980e54b693492209
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Tue Oct 24 16:13:42 2017 -0500
Make the error for loading a saas-content more specific.
M midlayer/stack.go
commit e8f904e30b8ced26812a96f7744d07f00d18c1b4
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Mon Oct 23 13:30:35 2017 -0500
Fix timing issue in remove of plugin providers
M midlayer/controller.go
commit b11a59060191aadec0f6d099bbd69f6fd50febec
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Mon Oct 23 11:34:18 2017 -0500
Fix use of raw HTTP status constant in the frontend
M frontend/content.go
commit 98693ff2ff22c35759048e28485a66458f1ef9a4
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Mon Oct 23 10:54:44 2017 -0500
Add appropriate locking around melody interactions
M frontend/websocket.go
commit 41bfd2f9dd4be7535c5d440a2468530689e7bfac
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Mon Oct 23 10:21:51 2017 -0500
Make sure we do noy allow content layers that do not have a name
M midlayer/stack.go
commit b5774b547afa1c9ccb07a8853eab71b4ce355028
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Sat Oct 21 13:53:07 2017 -0500
Add Fill() for ContentSummary and use it as appropriate
M frontend/content.go
M midlayer/controller.go
commit d8e8f6599accfd53f719445e8b1204a42008584c
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Fri Oct 20 14:43:53 2017 -0500
Final fixups to make current CLI work with new API enhancements
M backend/dataTracker.go
M frontend/frontend.go
M frontend/plugin_providers.go
M frontend/prefs.go
M frontend/profiles.go
M frontend/users.go
commit 43446388427f0fec35de56c74b6519e5eee1852b
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Thu Oct 19 17:17:43 2017 -0500
CLI machines test fixed checkpoint
M frontend/files.go
M frontend/frontend.go
M frontend/info.go
M frontend/isos.go
M frontend/leases.go
M frontend/machines.go
commit 13a2d2ab2e69d0678b41f57f2cc77077671602af
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Thu Oct 19 09:24:31 2017 -0500
Only CLI test failures are changed error messages
M backend/dataTracker.go
M frontend/frontend.go
M frontend/machines.go
M frontend/plugins.go
M midlayer/controller.go
commit 94bcae9e93cee6dc5f60c09449e45790057a9b75
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Wed Oct 18 13:26:05 2017 -0500
Pull in the new API bits
M backend/dataTracker.go
M backend/index/index.go
M backend/plugins.go
M frontend/bootenvs.go
M frontend/content.go
M frontend/files.go
M frontend/frontend.go
M frontend/indexes.go
M frontend/interfaces.go
M frontend/isos.go
M frontend/jobs.go
M frontend/leases.go
M frontend/machines.go
M frontend/params.go
M frontend/plugins.go
M frontend/profiles.go
M frontend/reservations.go
M frontend/stages.go
M frontend/subnets.go
M frontend/tasks.go
M frontend/templates.go
M frontend/users.go
commit f54e4437edf573951c037a0ceaddacecbc60f9ff
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Sat Oct 21 14:16:54 2017 -0500
Fix user onload post-validation update code
M backend/user.go
commit 14a8352681fd00ceb1b83fd3b8cd377beb682585
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Fri Oct 20 14:59:47 2017 -0500
Add types to basic and plugin content layers
M frontend/content.go
commit f511a9df18edb7f0073e5d4777fa25cbda1cb0f1
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Fri Oct 20 14:02:24 2017 -0500
But names should match on add and remove
M midlayer/controller.go
commit f93b390473362d519becd5658554d0fb73685cd1
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Fri Oct 20 13:44:39 2017 -0500
Make sure name doesn't conflict for plugin provider content.
M midlayer/controller.go
commit 8d11829d453f57eb847d55e89568d9840617c382
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Fri Oct 20 13:24:52 2017 -0500
Update the fixup routines to remove through the stack
layer. Relies on fix in store that cleans key cache.
M midlayer/controller.go
M midlayer/stack.go
commit 7f427756bc902048f2f35d7771229f43b4982edb
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Fri Oct 20 12:01:08 2017 -0500
Lock stuff because it is the right thing to do
M midlayer/controller.go
commit 85d14a3db5c807edbaff6e909e771c430555c189
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Fri Oct 20 11:19:05 2017 -0500
Have the plugin providers had their own content
stores and remove them as they come and go.
Fix-up existing stores to remove already added
params from plugins before this feature.
M midlayer/controller.go
M midlayer/stack.go
commit 90ccdf4e25f4790c03c3e71036c6f9d908858075
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Thu Oct 19 17:40:45 2017 -0500
Fix jobs to keep from resetting end time all the time.
M backend/jobs.go
commit bd420d153b194606656ccb16bf2c9cdbe872d4e7
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Thu Oct 19 17:28:39 2017 -0500
Add meta data for the base objects so they have icons too.
M backend/dataTracker.go
commit ba5a89122d56c0698a416b0865565aac1a0c59e5
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Thu Oct 19 16:41:28 2017 -0500
Fix infinite time test
M backend/renderData_test.go
commit 2ee98046e3e3804a148f50b331f1dfb4c17f9273
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Thu Oct 19 16:12:53 2017 -0500
Forgot the frontend
M frontend/users.go
commit ac8052e2801efd84276e86e53badf099cb8a00c5
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Thu Oct 19 16:08:28 2017 -0500
Make sure the infinite token doesn't break time
M backend/jwt-utils.go
M backend/renderData.go
commit 07e2eb0ccea8b5dee354abe3af0d525bcb0b278f
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Thu Oct 19 14:35:20 2017 -0500
Make sure that the internal drpcli has a version in it.
M server/assets.go
commit f829e258fc937b036bd096f8b863448d1917209e
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Wed Oct 18 16:16:47 2017 -0500
Include infinite and finite tokens (as well as info data)
M backend/renderData.go
commit 4f578f192e5e345b7d748c6ccb97170381be4009
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Wed Oct 18 16:13:18 2017 -0500
All machines to get tasks.
Runner should not crash if task not found.
M backend/renderData.go
commit 163f1126c83ec366e03bcf66221b60c8cfa2c191
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Wed Oct 18 10:33:22 2017 -0500
Need to follow the rules to this game of save, load, and create.
Add validation save and restore helpers.
Clear the validation before saving to the store to prevent
saving validations. Restore them when the save is finished.
This is an issue for the OnLoad path because it is not actually
saving the object. The additional save needs to be in this
manner. Also, add a test to make sure we don't save all the objects
on all loads all the time.
M backend/machines.go
M backend/user.go
commit c5dc4454f1e7c6cb2137818e37bc7370053304b3
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Wed Oct 18 09:36:47 2017 -0500
Don't save the objects with validation warnings.
Fix missing features test.
M backend/machines.go
M backend/user.go
commit 5248f20282c7573c69fcd24466552e5089860966
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Tue Oct 17 17:36:52 2017 -0500
Add sane-exit-codes as a drp feature.
M frontend/info.go
commit a0a338f1d2de988198707767720a8b865196f253
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Tue Oct 17 17:20:46 2017 -0500
Fix an issue with the secret not be persisted if created on existing
systems. This is migration case.
M backend/machines.go
M backend/user.go
commit c44a49eab5bf7626c4df3eb5a86476d2a929a326
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Tue Oct 17 12:04:44 2017 -0500
Fix missing change in midlayer and remove extra function
M backend/jwt-utils.go
M midlayer/dhcp_test.go
commit 3900160546678e0d7d84d28e62b54cd1bb1dd255
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Tue Oct 17 00:20:35 2017 -0500
Persist the token validate/encryption key across restarts.
This is now a pref and follows those semantics.
With the inclusion of the other secrets, token rotation
can be done programatically. This will allow long running
tokens for long running runners.
M backend/dataTracker.go
M backend/jwt-utils.go
M backend/preference_test.go
M frontend/prefs.go
M midlayer/dhcp_test.go
M server/server.go
commit 41aa21b6e50d568167607ddf48188c7addc51a1a
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Mon Oct 16 22:49:55 2017 -0500
Fix issue #486 - add validation errors on delete.
M frontend/bootenvs.go
M frontend/files.go
M frontend/isos.go
M frontend/leases.go
M frontend/machines.go
M frontend/params.go
M frontend/plugin_providers.go
M frontend/plugins.go
M frontend/profiles.go
M frontend/reservations.go
M frontend/stages.go
M frontend/subnets.go
M frontend/tasks.go
M frontend/templates.go
M frontend/users.go
commit dd4403a6a8d661104d1ade18712d36a4348a7edc
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Mon Oct 16 16:43:45 2017 -0500
This patch adds three secret keys to the JWT auth token.
User, Grantor, and Machine secrets.
These secrets are include in the token when sealed.
When validated, the secrets are checked to make sure
that the value hasn't changed. If secrets don't match,
the auth is not granted. This allows for revocation.
The GenerateToken and new GenerateInfiniteToken commands
use the pref 'systemGrantorSecert' and the machine's
specific secret included in the token.
The Generate user token API method uses the secret on
the granting user's object and the authorized user's object
to populate their secrets.
The new secret fields are generated for existing objects
as well.
M backend/dataTracker.go
M backend/dataTracker_test.go
M backend/jwt-utils.go
M backend/jwt_utils_test.go
M backend/machines.go
M backend/renderData.go
M backend/renderData_test.go
M backend/user.go
M frontend/content.go
M frontend/events.go
M frontend/files.go
M frontend/frontend.go
M frontend/indexes.go
M frontend/info.go
M frontend/interfaces.go
M frontend/isos.go
M frontend/jobs.go
M frontend/machines.go
M frontend/plugin_providers.go
M frontend/plugins.go
M frontend/prefs.go
M frontend/users.go
M server/server.go
commit d06c23f07113cec9fe1e2f91e736f6f9545bbd1d
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Mon Oct 16 11:14:30 2017 -0500
Always have an empty task list
M backend/machines.go
commit d76e3d3b970b1e67b16d42e354c09ae2e06bf12d
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Fri Oct 13 11:58:07 2017 -0500
Add content feature flags, and use that to add new exit states for tasks.
All content layers and items in DRP can now specify a meta item called
"feature-flags", which must contain s comma-seperated list of tags
that will be interpreted as feature flags. The first use for these
feature flags is to allow content laters and individual tasks to
specify which exit code scheme the task runner should use for
interpreting task exit codes.
The original scheme (signalled by the original-exit-codes feature
flag, or by the lack of a sane-exit-codes feature flag) retains the
meaning of the original exit codes:
0: success
1: reboot
2: incomplete
3: reboot+incomplete
4 and up: fail
If an individual task does not have a meta elememt called
"feature-flags", then one will be created for it and the
"original-exit-codes" feature flag will be added to it.
The new scheme (indicated by the "sane-exit-codes") feature flag uses
bits 5, 6, and 7 of the exit status to indicate to the task runner the
following special actions to take:
To set that the job is incomplete, exit $(($? | 128)). This sets bit
7 of the exit code.
To set that the runner should reboot the system, exit $(($? | 64)).
This sets bit 6 of the exit code.
To set that the runner should shut the system down, exit $(($? |
32)). This sets bit 5 of the exit code.
If the reboot and the shutdown bits are both set, the system will
reboot.
If any of the lower bits are set, we will consider the task to have
failed, otherwise we will conside rthe task to have succeeded.
In particular, exit 1 is now just a standard fail exit code, not a
success with reboot code.
M backend/dataTracker.go
M backend/machines.go
M backend/task.go
M frontend/info.go
commit ad5973dc49ca7daf6d054db944bc7b4302991292
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Thu Oct 12 15:26:35 2017 -0500
Fix up parameter tests to allow null schema
M backend/param_test.go
commit fec8764d50621ec49c2d18c82e4273528da22553
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Thu Oct 12 09:53:58 2017 -0500
Fix up midlayer and backend tests to use a proper StackedStore
M backend/dataTracker_test.go
M midlayer/dhcp_test.go
commit 1e6655a1fac997fdda88c2bf841965fc6805919c
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Thu Oct 12 09:31:35 2017 -0500
Fix up layer handling to include a method of resolving layer conflicts.
The AddReplaceFoo methods for the DataStack now take a function that
is responsible for resolving any layering conflicts or throwing an
error if those conflicts cannot be automatically resovled.
Part of that functionality was used to make the basic layer work.
M backend/dataTracker.go
M frontend/content.go
M midlayer/stack.go
commit e9505722b035667ec2a9a4f88d28405311c3cff4
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Wed Oct 11 15:41:21 2017 -0500
Remove double events on websocket.
M server/server.go
commit c83dbefda17845381a9905c9dbdac3814f2796f6
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Wed Oct 11 11:45:34 2017 -0500
Make ignore and local bootenvs immutable, and add a none stage by default
M backend/dataTracker.go
M backend/dataTracker_test.go
M backend/machines.go
M backend/stage_test.go
M frontend/content.go
M midlayer/stack.go
M server/server.go
commit 15fd37a96eafa63a1720bb08d0737db9c896e9b7
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Wed Oct 11 13:55:42 2017 -0500
Fix potential fail when revalidating stages from bootenvs and tasks
M backend/bootenv.go
M backend/task.go
commit 27f74bcddcfb3c86358b9b2e806787af14018eca
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Tue Oct 10 15:54:57 2017 -0500
Update jobs to auto-fail more jobs whose machines have vanished.
M backend/jobs.go
commit bd77e578efa8b6ab182de50e2f05071103e6401c
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Tue Oct 10 10:39:53 2017 -0500
Add stage checking to validations where appropriate
M backend/bootenv.go
M backend/dataTracker.go
M backend/task.go
M backend/task_test.go
M backend/template.go
M backend/template_test.go
commit ef24f0e0e4faed3658752cd7a0d7a439fcda0983
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Fri Oct 6 10:14:16 2017 -0500
Address issues with / in parameter names.
First, make sure that all objects return errors when
a slash or backslash is used in their names (except
params).
Second, update the name parsing of parameter api
calls to enable a / in the name. This will allow
the objects to be picked up and manipulated again.
M backend/bootenv.go
M backend/bootenv_test.go
M backend/machines.go
M backend/machines_test.go
M backend/plugins.go
M backend/stage.go
M backend/stage_test.go
M backend/subnet.go
M backend/subnet_test.go
M backend/task.go
M backend/task_test.go
M backend/template.go
M backend/template_test.go
M backend/user.go
M backend/user_test.go
M frontend/frontend.go
M frontend/machines.go
M frontend/params.go
M frontend/profiles.go
commit 78e6801907482149b29e5b6bc7b01213226463be
Author: Shane Gibson <shane@rackn.com>
Date: Wed Oct 4 15:31:49 2017 -0700
fix "restorecon" to point to "$tftproot" - not "$tftpboot"
M embedded/assets/explode_iso.sh
commit 14e6353595536ce4810fca8885f98b8185cbf5ac
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Wed Sep 27 11:27:08 2017 -0500
Add a CallTemplate routine that will call template
with a dynamic template name.
It functions like template.
M backend/renderData.go
commit c8942ff6b06a40e27b1f65f62276d03ad8fa3ab2
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Mon Sep 25 15:55:15 2017 -0500
Add a plugins specific error field that is persisted.
Use that to prevent loops and craziness.
M midlayer/controller.go
commit 57ac034b81dc48e620bc597c592389bb53345875
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Thu Sep 21 16:13:04 2017 -0500
Add frontend API endpoints to get and set individual Params on Profiles and Machines
M backend/machines.go
M backend/param.go
M backend/profiles.go
M frontend/frontend.go
M frontend/machines.go
M frontend/profiles.go
commit 76ba08a20c1989bf62e3c4cbcc549d669952cee4
Author: Greg Althaus <galthaus@austin.rr.com>
Date: Thu Sep 21 16:01:35 2017 -0500
Make missing stage a hard error for machine.
M backend/machines.go
commit 3593c56ca4630ed9b8bd4e2dd13af1449455b2b3
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Thu Sep 21 08:48:45 2017 -0500
Swagger-ize the rest of the HEAD routes
M frontend/subnets.go
M frontend/tasks.go
M frontend/templates.go
M frontend/users.go
commit d5d0d6cb01dd719b7c6bad374f7cc05d28f2e69f
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Wed Sep 20 16:17:02 2017 -0500
WIP fixing up HEAD routes
M frontend/bootenvs.go
M frontend/jobs.go
M frontend/leases.go
M frontend/machines.go
M frontend/params.go
M frontend/plugins.go
M frontend/profiles.go
M frontend/reservations.go
M frontend/stages.go
commit d356ee2d26767308c2c8c0b85ca23361e2510400
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Wed Sep 20 13:57:04 2017 -0500
Add HEAD endpoints for various models
M frontend/bootenvs.go
M frontend/frontend.go
M frontend/jobs.go
M frontend/leases.go
M frontend/machines.go
M frontend/params.go
M frontend/plugins.go
M frontend/profiles.go
M frontend/reservations.go
M frontend/stages.go
M frontend/subnets.go
M frontend/tasks.go
M frontend/templates.go
M frontend/users.go
commit df0078ae99948ca3a09e5351f110ce91ff2e90b4
Author: Victor Lowther <victor.lowther@gmail.com>
Date: Wed Sep 20 11:52:48 2017 -0500
Rearrange the frontend to split userAuth into its own method
M frontend/frontend.go
End of Note