Prompt Cache

[miaoche7963]

Describe the issue

I saw the 'cachePoint' feature in the official website introduction, applied for it, but encountered the following error during use: Reason: Parameter validation failed: Unknown parameter in system[1]: 'cachePoint', must be one of: text, guardContent.

Links

I want to know if there is an special boto3 versiton to user this feature

[RyanFitzSimmonsAK]

Hi @miaoche7963, thanks for reaching out. Could you provide the following information?

1. Could you link to the post you saw?
2. What version of Boto3 are you using?
3. What operation are you using? Debug logs would be helpful here. You can get debug logs by adding boto3.set_stream_logger('') to the top of your script, and redacting any sensitive information.

I want to know if there is an special boto3 versiton to user this feature

Boto3 does not have any special versions for specific features.

[miaoche7963]

1.Environment
boto3==1.36.13
2.Code
The model id is anthropic.claude-3-5-haiku-20241022-v1:0

client = boto3.client("bedrock-runtime",
region_name="us-east-1", aws_access_key_id='XXX', aws_secret_access_key='XXX')

streaming_response = client.converse_stream(
modelId=model_id,
messages=conversation,
inferenceConfig={"maxTokens": 256, "temperature": 0.5, "topP": 0.9},
system=[
{"text": system_prompt},
{
"cachePoint": {
"type": "default"
}
}
],
performanceConfig = {
"latency" : "optimized"
}
3.Error
Reason: Parameter validation failed:
Unknown parameter in system[1]: "cachePoint", must be one of: text, guardContent
4.Question
I saw the 'cachePoint' feature in the official website introduction, applied for it, but encountered the following error during use: Reason: Parameter validation failed: Unknown parameter in system[1]: 'cachePoint', must be one of: text, guardContent.