As it is today, if one does a change which does not effect the model MSE then the "evaluate model" step cancels the job, and the whole pipeline fails. This feels a bit unfortunate when one is doing code-changes which does not change the model, e.g. modify the ACI configuration or change the serve script in some way. The two latter are examples where I would still want the "Deploy to ACI" step to continue. I know I can set ALLOW_RUN_CANCEL to false, but this has the effect of registering the model, which is not really what I want. What I would want is for the model to not be registered if its equal, but proceed with the deployment steps.

Any thoughts?