Create modelrepotest.mdx by lavanya-gunreddi · Pull Request #696 · runpod/docs

lavanya-gunreddi · 2026-07-07T12:37:16Z

No description provided.

mintlify · 2026-07-07T12:43:46Z

Preview deployment for your docs. Learn more about Mintlify Previews.

Project	Status	Preview	Updated (UTC)
runpod-docs	🟢 Ready	View Preview	Jul 7, 2026, 12:44 PM

💡 Tip: Enable Workflows to automatically generate PRs for you.

lavanya-gunreddi · 2026-07-08T15:26:53Z

@Promptless add this as step one in the doc: Install Go (and the command is: brew install go)

promptless · 2026-07-08T15:31:03Z

Done — added Install Go (brew install go) as the new Step 1 and renumbered the remaining steps (Build runpodctl is now Step 2, and so on). The change is committed to this PR branch, so it should appear in the updated preview shortly.

brosenpod · 2026-07-13T19:25:17Z

+export RUNPOD_GRAPHQL_URL="https://api.runpod.io/graphql"
+export RUNPOD_API_KEY="your-api-key"   # replace with your actual API key
+
+export MODEL_NAME="$(whoami)-test-$(date +%s)"   # unique name per test run — reusing the same name uploads a new version, not a new model


This can probably be changed to:

export MODEL_NAME="model_name" # unique name per test run — reusing the same name uploads a new version, not a new model

@Promptless

brosenpod · 2026-07-13T19:26:16Z

+
+---
+
+## Scripted testing


We should just remove this section, as it was just for internal testing

@Promptless

brosenpod · 2026-07-13T19:28:19Z

+
+```bash
+runpodctl model add \
+  --name "$MODEL_NAME" \          # the name to register the model under in your repo


There can't be comments after the \. The \ needs to be the last character on the line. The comments can go before or after.

@Promptless

brosenpod · 2026-07-13T19:29:06Z

+```bash
+export USER_ID="$(runpodctl user | jq -r '.id')"        # your Runpod user ID
+export MODEL_HASH="$(runpodctl model list --name "$MODEL_NAME" | jq -r '.[0].versions[0].hash')"   # the hash from step 3
+export MODEL_URL="https://local/${USER_ID}/${MODEL_NAME}:${MODEL_HASH}"   # the full model reference URL


Let's get rid of this line, as we will build the Model URL and also the reference below

@Promptless

brosenpod · 2026-07-13T19:29:15Z

+export MODEL_URL="https://local/${USER_ID}/${MODEL_NAME}:${MODEL_HASH}"   # the full model reference URL
+```
+
+The resulting `MODEL_URL` will look like:


Get rid of this too, as we are no longer using this variable

@Promptless

brosenpod · 2026-07-13T19:29:55Z

+
+```bash
+runpodctl serverless create \
+  --name "$(whoami)_ctl_test" \          # name for the endpoint


This could be something more generic. whoami was confusing some users. It could be changed to:

--name "my_worker" \

@Promptless

brosenpod · 2026-07-13T19:30:10Z

+  --gpu-id "AMPERE_24" \                 # GPU type
+  --workers-max 3 \                      # maximum number of active workers
+  --workers-min 1 \                      # minimum number of workers kept warm
+  --model-reference "$MODEL_URL"         # attaches your model to the endpoint


Let's change this line to these two lines:

--model-reference "https://local/$USER_ID/$MODEL_NAME:$MODEL_HASH" \ --env MODEL_NAME="/runpod/model-store/modelrepo-local/models/$USER_ID/$MODEL_NAME/$MODEL_HASH"

Also need to add the following to work around a bug in runpodctl:

--min-cuda-version "13.0"

@Promptless

brosenpod · 2026-07-13T19:30:39Z

+```bash
+runpodctl serverless create \
+  --name "$(whoami)_ctl_test" \          # name for the endpoint
+  --template-id "mockworker" \           # worker template to use


Let's change this line to:

--hub-id "cm8h09d9n000008jvh2rqdsmb" \

As that will actually do something if they use it, rather than being the mockworker which doesn't do anything

@Promptless

brosenpod · 2026-07-13T19:31:08Z

+---
+
+### Step 6: Verify the model is working
+


We should also mention that they can use the Web UI to send requests to the worker, if they like

@Promptless

brosenpod · 2026-07-13T19:31:54Z

I added some comments in line, but generically, for all of the shell script code blocks, there can't be comments after the last \ on a line. The comments need to either go before or after the command. If they are copied as-is, they will fail.

lavanya-gunreddi · 2026-07-14T14:44:32Z

@Promptless can you address all the pending comments from brosenpod ?

- Simplify MODEL_NAME example to a placeholder - Remove internal-only scripted testing section - Move inline comments off line-continuation (\) lines in shell blocks - Drop unused MODEL_URL variable and its example - Use generic --name, real --hub-id, and split model reference into --model-reference and --env, plus --min-cuda-version workaround - Mention the web UI as an alternative for sending test requests

promptless · 2026-07-14T14:54:11Z

Done — I've addressed all of @brosenpod's pending review comments and pushed the changes to this PR branch. Summary of what changed in serverless/modelrepotest.mdx:

MODEL_NAME export — updated to export MODEL_NAME="model_name" with the clarifying note that reusing a name uploads a new version, not a new model.
Internal-only section — removed the section that was only for internal testing.
Trailing comments after \ — audited every shell code block and moved inline comments off any line-continuation, so each \ is the last character on its line. Multi-line commands now carry their explanatory comments in a block above the command.
Unused Model URL line — removed; the Model URL is now built inline below.
Unused variable — removed the leftover variable line.
whoami → --name "my_worker" — replaced with a generic worker name to avoid confusion.
--hub-id "cm8h09d9n000008jvh2rqdsmb" — swapped in for the mockworker so the flag actually does something.
--model-reference split — now --model-reference "https://local/$USER_ID/$MODEL_NAME:$MODEL_HASH" plus --env MODEL_NAME=..., and added --min-cuda-version "13.0" to work around the runpodctl bug.
Web UI — added a note that requests can also be sent to the worker from the web UI.

One additional cleanup: since --template-id was replaced with --hub-id, I updated the nearby note that referenced --template-id so it stays accurate.

The updated preview should refresh shortly.

Create modelrepotest.mdx

d945e75

mintlify Bot deployed to staging July 7, 2026 12:44 View deployment

Update docs.json

f0f0a00

mintlify Bot deployed to staging July 7, 2026 13:12 View deployment

Add Install Go as step one in Model Repo testing guide

a3d9215

mintlify Bot deployed to staging July 8, 2026 15:30 View deployment

Update modelrepotest.mdx

6ff93f5

mintlify Bot deployed to staging July 13, 2026 15:05 View deployment

brosenpod reviewed Jul 13, 2026

View reviewed changes

Merge branch 'main' into lg-modelrepotest

c4019e6

mintlify Bot deployed to staging July 14, 2026 14:45 View deployment

mintlify Bot deployed to staging July 14, 2026 14:54 View deployment

Uh oh!

Conversation

lavanya-gunreddi commented Jul 7, 2026

Uh oh!

mintlify Bot commented Jul 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

lavanya-gunreddi commented Jul 8, 2026

Uh oh!

promptless Bot commented Jul 8, 2026

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

brosenpod commented Jul 13, 2026

Uh oh!

lavanya-gunreddi commented Jul 14, 2026

Uh oh!

promptless Bot commented Jul 14, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

mintlify Bot commented Jul 7, 2026 •

edited

Loading