Deeploy AWS Marketplace customers have to allow the AWS marketplace to register usage of the bought container images. This integration is explained in the article below, because it isn't very well explained well in the AWS documentation. In this article, we assume you already have created an EKS cluster to which you have access.
During the creation of the EKS cluster you attached a
role) to the cluster. You can use this IAM role in this section or create a dedicated new role.
Step 1: Attach policies to the role required by the AWS Marketplace
AWS Managed Policies:
Step 2: Create an IAM OIDC provider for the EKS cluster
For this step, use the Enable IAM roles for service accounts doc.
Make sure to check if the OpenID Connect Provider URL matches with your Cluster (details in EKS configuration)
aws iam list-open-id-connect-providers | grep
Step 3: Create Trusted Entity for the NodeInstance Role
For this step, use the Technical overview of IAM roles for service accounts doc.
Step 4: Allow pods to assume the NodeIstance Role
Add the following annotation to the
kserve-deploy Kubernetes Service Accounts in the Deeploy namespace:
As described here.
Please make sure to check whether the ENV variables are present in the AWS managed pods.
Next, Step 7: Configure DNS