Bedrock SDK - ModRouter

Endpoint

https://api.modrouter.online/bedrock

For S3-compatible file operations used by the Bedrock integration:

https://api.modrouter.online/bedrock/files

Python

import os
import boto3

base_url = os.environ["MODROUTER_BASE_URL"].rstrip("/")

bedrock = boto3.client(
    "bedrock-runtime",
    endpoint_url=f"{base_url}/bedrock",
    region_name="us-east-1",
    aws_access_key_id="placeholder-access-key",
    aws_secret_access_key="placeholder-secret-key",
)

response = bedrock.converse(
    modelId="bedrock/anthropic.claude-3-5-sonnet-20240620-v1:0",
    messages=[
        {
            "role": "user",
            "content": [{"text": "Hello"}],
        }
    ],
)

The dummy AWS credentials satisfy the SDK’s signer. ModRouter uses provider keys configured on the server side.

Supported Route Groups

ModRouter’s Bedrock integration includes:

POST /bedrock/model/{modelId}/converse
POST /bedrock/model/{modelId}/converse-stream
POST /bedrock/model/{modelId}/invoke
POST /bedrock/model/{modelId}/invoke-with-response-stream
POST /bedrock/model/{modelId}/count-tokens
POST /bedrock/rerank
Bedrock model invocation job routes
S3-compatible file routes under /bedrock/files

Custom Headers

If you need ModRouter headers with boto3, attach them through botocore events before signing:

def add_modrouter_headers(request, **kwargs):
    request.headers["x-bf-vk"] = os.environ["MODROUTER_API_KEY"]

bedrock.meta.events.register(
    "before-sign.bedrock-runtime.*",
    add_modrouter_headers,
)

Notes

Bedrock SDK routes use Bedrock request and response shapes, not OpenAI shapes.
For OpenAI SDK files and batches, use /openai.
For Anthropic inline message batches, use /anthropic.

​Endpoint

​Python

​Supported Route Groups

​Custom Headers

​Notes

Endpoint

Python

Supported Route Groups

Custom Headers

Notes