Current deployment has a number of blockers (found whilst migrating the scenarios instance):
- Model servers are closely tied to server
docker-compose.yml files which makes it difficult to swap models in and out.
- The UI config is baked into the UI docker images, meaning things like the pages shown are difficult to configure.
- Ports used are baked into the instances as well, hard to adapt to existing security groups.
install.sh has a number of drawbacks, it always rebuilds the UI docker image AND always pulls the image down. Also the scripting for pulling the models is built into this script when it really should be model agnostic.
Also there a couple of bugfixes that are required due to updates in streamlit.
Current deployment has a number of blockers (found whilst migrating the scenarios instance):
docker-compose.ymlfiles which makes it difficult to swap models in and out.install.shhas a number of drawbacks, it always rebuilds the UI docker image AND always pulls the image down. Also the scripting for pulling the models is built into this script when it really should be model agnostic.Also there a couple of bugfixes that are required due to updates in
streamlit.