GenAI Files and Batches - ModRouter

Endpoint

import os
from google import genai
from google.genai.types import HttpOptions

base_url = os.environ["MODROUTER_BASE_URL"].rstrip("/")
api_key = os.environ["MODROUTER_API_KEY"]

client = genai.Client(
    api_key=api_key,
    http_options=HttpOptions(base_url=f"{base_url}/genai"),
)

Files

ModRouter registers GenAI file routes:

Operation	ModRouter route
upload	`POST /genai/upload/v1beta/files`
list	`GET /genai/v1beta/files`
retrieve	`GET /genai/v1beta/files/{file_id}`
delete	`DELETE /genai/v1beta/files/{file_id}`

Batches

ModRouter registers GenAI batch routes:

Operation	ModRouter route
create	`POST /genai/v1beta/models/{model}:batchGenerateContent`
list	`GET /genai/v1beta/batches`
retrieve	`GET /genai/v1beta/batches/{batch_id}`
cancel	`POST /genai/v1beta/batches/{batch_id}:cancel`
delete	`DELETE /genai/v1beta/batches/{batch_id}`

The GenAI SDK has changed batch surfaces across versions. Keep examples aligned with the SDK version you support and verify against ModRouter’s registered routes.

Cached Content

ModRouter registers cached-content lifecycle routes:

Operation	ModRouter route
create	`POST /genai/v1beta/cachedContents`
list	`GET /genai/v1beta/cachedContents`
retrieve	`GET /genai/v1beta/cachedContents/{cached_id}`
update	`PATCH /genai/v1beta/cachedContents/{cached_id}`
delete	`DELETE /genai/v1beta/cachedContents/{cached_id}`

Provider Notes

Gemini-native file IDs commonly use files/...; ModRouter normalizes IDs where required by a compatibility route.
Bedrock batch jobs have a different S3-backed shape. Use /bedrock for Bedrock-native batch jobs.
OpenAI file and batch routes are available under /openai, not /genai.