Skip to content

Commit b08a0c5

Browse files
DennisTraubDennisTraub
authored
Python: Bedrock Runtime document understanding examples (#7446)
1 parent 9a9e028 commit b08a0c5

File tree

11 files changed

+475
-3
lines changed

11 files changed

+475
-3
lines changed

‎.doc_gen/metadata/bedrock-runtime_metadata.yaml

Lines changed: 103 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1522,6 +1522,109 @@ bedrock-runtime_InvokeModelWithResponseStream_TitanTextEmbeddings:
15221522
services:
15231523
bedrock-runtime: {InvokeModel}
15241524

1525+
# Document understanding
1526+
bedrock-runtime_DocumentUnderstanding_AmazonNova:
1527+
title: Send and process a document with Amazon Nova on &BR;
1528+
title_abbrev: "Document understanding"
1529+
synopsis: send and process a document with Amazon Nova on &BR;.
1530+
category: Amazon Nova
1531+
languages:
1532+
Python:
1533+
versions:
1534+
- sdk_version: 3
1535+
github: python/example_code/bedrock-runtime
1536+
excerpts:
1537+
- description: Send and process a document with Amazon Nova on &BR;.
1538+
snippet_tags:
1539+
- python.example_code.bedrock-runtime.DocumentUnderstanding_AmazonNovaText
1540+
services:
1541+
bedrock-runtime: {Converse}
1542+
1543+
bedrock-runtime_DocumentUnderstanding_AnthropicClaude:
1544+
title: Send and process a document with Anthropic Claude on &BR;
1545+
title_abbrev: "Document understanding"
1546+
synopsis: send and process a document with Anthropic Claude on &BR;.
1547+
category: Anthropic Claude
1548+
languages:
1549+
Python:
1550+
versions:
1551+
- sdk_version: 3
1552+
github: python/example_code/bedrock-runtime
1553+
excerpts:
1554+
- description: Send and process a document with Anthropic Claude on &BR;.
1555+
snippet_tags:
1556+
- python.example_code.bedrock-runtime.DocumentUnderstanding_AnthropicClaude
1557+
services:
1558+
bedrock-runtime: {Converse}
1559+
1560+
bedrock-runtime_DocumentUnderstanding_CohereCommand:
1561+
title: Send and process a document with Cohere Command models on &BR;
1562+
title_abbrev: "Document understanding"
1563+
synopsis: send and process a document with Cohere Command models on &BR;.
1564+
category: Cohere Command
1565+
languages:
1566+
Python:
1567+
versions:
1568+
- sdk_version: 3
1569+
github: python/example_code/bedrock-runtime
1570+
excerpts:
1571+
- description: Send and process a document with Cohere Command models on &BR;.
1572+
snippet_tags:
1573+
- python.example_code.bedrock-runtime.DocumentUnderstanding_CohereCommand
1574+
services:
1575+
bedrock-runtime: {Converse}
1576+
1577+
bedrock-runtime_DocumentUnderstanding_DeepSeek:
1578+
title: Send and process a document with DeepSeek on &BR;
1579+
title_abbrev: "Document understanding"
1580+
synopsis: send and process a document with DeepSeek on &BR;.
1581+
category: DeepSeek
1582+
languages:
1583+
Python:
1584+
versions:
1585+
- sdk_version: 3
1586+
github: python/example_code/bedrock-runtime
1587+
excerpts:
1588+
- description: Send and process a document with DeepSeek on &BR;.
1589+
snippet_tags:
1590+
- python.example_code.bedrock-runtime.DocumentUnderstanding_DeepSeek
1591+
services:
1592+
bedrock-runtime: {Converse}
1593+
1594+
bedrock-runtime_DocumentUnderstanding_MetaLlama:
1595+
title: Send and process a document with Llama on &BR;
1596+
title_abbrev: "Document understanding"
1597+
synopsis: send and process a document with Llama on &BR;.
1598+
category: Meta Llama
1599+
languages:
1600+
Python:
1601+
versions:
1602+
- sdk_version: 3
1603+
github: python/example_code/bedrock-runtime
1604+
excerpts:
1605+
- description: Send and process a document with Llama on &BR;.
1606+
snippet_tags:
1607+
- python.example_code.bedrock-runtime.DocumentUnderstanding_MetaLlama
1608+
services:
1609+
bedrock-runtime: {Converse}
1610+
1611+
bedrock-runtime_DocumentUnderstanding_Mistral:
1612+
title: Send and process a document with Mistral models on &BR;
1613+
title_abbrev: "Document understanding"
1614+
synopsis: send and process a document with Mistral models on &BR;.
1615+
category: Mistral AI
1616+
languages:
1617+
Python:
1618+
versions:
1619+
- sdk_version: 3
1620+
github: python/example_code/bedrock-runtime
1621+
excerpts:
1622+
- description: Send and process a document with Mistral models on &BR;.
1623+
snippet_tags:
1624+
- python.example_code.bedrock-runtime.DocumentUnderstanding_Mistral
1625+
services:
1626+
bedrock-runtime: {Converse}
1627+
15251628
# Tool use scenarios
15261629
bedrock-runtime_Scenario_ToolUseDemo_AmazonNova:
15271630
title: "A tool use demo illustrating how to connect AI models on &BR; with a custom tool or API"

‎python/example_code/bedrock-runtime/README.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -60,6 +60,7 @@ functions within the same service.
6060

6161
- [Converse](models/amazon_nova/amazon_nova_text/converse.py#L4)
6262
- [ConverseStream](models/amazon_nova/amazon_nova_text/converse_stream.py#L4)
63+
- [Document understanding](models/amazon_nova/amazon_nova_text/document_understanding.py#L4)
6364

6465
### Amazon Nova Canvas
6566

@@ -88,6 +89,7 @@ functions within the same service.
8889

8990
- [Converse](models/anthropic_claude/converse.py#L4)
9091
- [ConverseStream](models/anthropic_claude/converse_stream.py#L4)
92+
- [Document understanding](models/anthropic_claude/document_understanding.py#L4)
9193
- [InvokeModel](models/anthropic_claude/invoke_model.py#L4)
9294
- [InvokeModelWithResponseStream](models/anthropic_claude/invoke_model_with_response_stream.py#L4)
9395
- [Scenario: Tool use with the Converse API](cross-model-scenarios/tool_use_demo/tool_use_demo.py)
@@ -96,23 +98,30 @@ functions within the same service.
9698

9799
- [Converse](models/cohere_command/converse.py#L4)
98100
- [ConverseStream](models/cohere_command/converse_stream.py#L4)
101+
- [Document understanding](models/cohere_command/document_understanding.py#L4)
99102
- [InvokeModel: Command R and R+](models/cohere_command/command_r_invoke_model.py#L4)
100103
- [InvokeModel: Command and Command Light](models/cohere_command/command_invoke_model.py#L4)
101104
- [InvokeModelWithResponseStream: Command R and R+](models/cohere_command/command_r_invoke_model_with_response_stream.py#L4)
102105
- [InvokeModelWithResponseStream: Command and Command Light](models/cohere_command/command_invoke_model_with_response_stream.py#L4)
103106
- [Scenario: Tool use with the Converse API](cross-model-scenarios/tool_use_demo/tool_use_demo.py)
104107

108+
### DeepSeek
109+
110+
- [Document understanding](models/deepseek/document_understanding.py#L4)
111+
105112
### Meta Llama
106113

107114
- [Converse](models/meta_llama/converse.py#L4)
108115
- [ConverseStream](models/meta_llama/converse_stream.py#L4)
116+
- [Document understanding](models/meta_llama/document_understanding.py#L4)
109117
- [InvokeModel](models/meta_llama/llama3_invoke_model.py#L4)
110118
- [InvokeModelWithResponseStream](models/meta_llama/llama3_invoke_model_with_response_stream.py#L4)
111119

112120
### Mistral AI
113121

114122
- [Converse](models/mistral_ai/converse.py#L4)
115123
- [ConverseStream](models/mistral_ai/converse_stream.py#L4)
124+
- [Document understanding](models/mistral_ai/document_understanding.py#L4)
116125
- [InvokeModel](models/mistral_ai/invoke_model.py#L4)
117126
- [InvokeModelWithResponseStream](models/mistral_ai/invoke_model_with_response_stream.py#L4)
118127

‎python/example_code/bedrock-runtime/example-data/amazon-nova-service-cards.pdf

325 KB
Binary file not shown.

‎python/example_code/bedrock-runtime/models/amazon_nova/amazon_nova_text/document_understanding.py

Lines changed: 54 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
1+
# Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.
2+
# SPDX-License-Identifier: Apache-2.0
3+
4+
# snippet-start:[python.example_code.bedrock-runtime.DocumentUnderstanding_AmazonNovaText]
5+
# Send and process a document with Amazon Nova on Amazon Bedrock.
6+
7+
import boto3
8+
from botocore.exceptions import ClientError
9+
10+
# Create a Bedrock Runtime client in the AWS Region you want to use.
11+
client = boto3.client("bedrock-runtime", region_name="us-east-1")
12+
13+
# Set the model ID, e.g. Amazon Nova Lite.
14+
model_id = "amazon.nova-lite-v1:0"
15+
16+
# Load the document
17+
with open("example-data/amazon-nova-service-cards.pdf", "rb") as file:
18+
document_bytes = file.read()
19+
20+
# Start a conversation with a user message and the document
21+
conversation = [
22+
{
23+
"role": "user",
24+
"content": [
25+
{"text": "Briefly compare the models described in this document"},
26+
{
27+
"document": {
28+
# Available formats: html, md, pdf, doc/docx, xls/xlsx, csv, and txt
29+
"format": "pdf",
30+
"name": "Amazon Nova Service Cards",
31+
"source": {"bytes": document_bytes},
32+
}
33+
},
34+
],
35+
}
36+
]
37+
38+
try:
39+
# Send the message to the model, using a basic inference configuration.
40+
response = client.converse(
41+
modelId=model_id,
42+
messages=conversation,
43+
inferenceConfig={"maxTokens": 500, "temperature": 0.3},
44+
)
45+
46+
# Extract and print the response text.
47+
response_text = response["output"]["message"]["content"][0]["text"]
48+
print(response_text)
49+
50+
except (ClientError, Exception) as e:
51+
print(f"ERROR: Can't invoke '{model_id}'. Reason: {e}")
52+
exit(1)
53+
54+
# snippet-end:[python.example_code.bedrock-runtime.DocumentUnderstanding_AmazonNovaText]

‎python/example_code/bedrock-runtime/models/anthropic_claude/document_understanding.py

Lines changed: 54 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
1+
# Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.
2+
# SPDX-License-Identifier: Apache-2.0
3+
4+
# snippet-start:[python.example_code.bedrock-runtime.DocumentUnderstanding_AnthropicClaude]
5+
# Send and process a document with Anthropic Claude on Amazon Bedrock.
6+
7+
import boto3
8+
from botocore.exceptions import ClientError
9+
10+
# Create a Bedrock Runtime client in the AWS Region you want to use.
11+
client = boto3.client("bedrock-runtime", region_name="us-east-1")
12+
13+
# Set the model ID, e.g. Claude 3 Haiku.
14+
model_id = "anthropic.claude-3-haiku-20240307-v1:0"
15+
16+
# Load the document
17+
with open("example-data/amazon-nova-service-cards.pdf", "rb") as file:
18+
document_bytes = file.read()
19+
20+
# Start a conversation with a user message and the document
21+
conversation = [
22+
{
23+
"role": "user",
24+
"content": [
25+
{"text": "Briefly compare the models described in this document"},
26+
{
27+
"document": {
28+
# Available formats: html, md, pdf, doc/docx, xls/xlsx, csv, and txt
29+
"format": "pdf",
30+
"name": "Amazon Nova Service Cards",
31+
"source": {"bytes": document_bytes},
32+
}
33+
},
34+
],
35+
}
36+
]
37+
38+
try:
39+
# Send the message to the model, using a basic inference configuration.
40+
response = client.converse(
41+
modelId=model_id,
42+
messages=conversation,
43+
inferenceConfig={"maxTokens": 500, "temperature": 0.3},
44+
)
45+
46+
# Extract and print the response text.
47+
response_text = response["output"]["message"]["content"][0]["text"]
48+
print(response_text)
49+
50+
except (ClientError, Exception) as e:
51+
print(f"ERROR: Can't invoke '{model_id}'. Reason: {e}")
52+
exit(1)
53+
54+
# snippet-end:[python.example_code.bedrock-runtime.DocumentUnderstanding_AnthropicClaude]

‎python/example_code/bedrock-runtime/models/cohere_command/document_understanding.py

Lines changed: 54 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
1+
# Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.
2+
# SPDX-License-Identifier: Apache-2.0
3+
4+
# snippet-start:[python.example_code.bedrock-runtime.DocumentUnderstanding_CohereCommand]
5+
# Send and process a document with Cohere Command models on Amazon Bedrock.
6+
7+
import boto3
8+
from botocore.exceptions import ClientError
9+
10+
# Create a Bedrock Runtime client in the AWS Region you want to use.
11+
client = boto3.client("bedrock-runtime", region_name="us-east-1")
12+
13+
# Set the model ID, e.g. Command R+.
14+
model_id = "cohere.command-r-plus-v1:0"
15+
16+
# Load the document
17+
with open("example-data/amazon-nova-service-cards.pdf", "rb") as file:
18+
document_bytes = file.read()
19+
20+
# Start a conversation with a user message and the document
21+
conversation = [
22+
{
23+
"role": "user",
24+
"content": [
25+
{"text": "Briefly compare the models described in this document"},
26+
{
27+
"document": {
28+
# Available formats: html, md, pdf, doc/docx, xls/xlsx, csv, and txt
29+
"format": "pdf",
30+
"name": "Amazon Nova Service Cards",
31+
"source": {"bytes": document_bytes},
32+
}
33+
},
34+
],
35+
}
36+
]
37+
38+
try:
39+
# Send the message to the model, using a basic inference configuration.
40+
response = client.converse(
41+
modelId=model_id,
42+
messages=conversation,
43+
inferenceConfig={"maxTokens": 500, "temperature": 0.3},
44+
)
45+
46+
# Extract and print the response text.
47+
response_text = response["output"]["message"]["content"][0]["text"]
48+
print(response_text)
49+
50+
except (ClientError, Exception) as e:
51+
print(f"ERROR: Can't invoke '{model_id}'. Reason: {e}")
52+
exit(1)
53+
54+
# snippet-end:[python.example_code.bedrock-runtime.DocumentUnderstanding_CohereCommand]

‎python/example_code/bedrock-runtime/models/deepseek/document_understanding.py

Lines changed: 62 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
# Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved.
2+
# SPDX-License-Identifier: Apache-2.0
3+
4+
# snippet-start:[python.example_code.bedrock-runtime.DocumentUnderstanding_DeepSeek]
5+
# Send and process a document with DeepSeek on Amazon Bedrock.
6+
7+
import boto3
8+
from botocore.exceptions import ClientError
9+
10+
# Create a Bedrock Runtime client in the AWS Region you want to use.
11+
client = boto3.client("bedrock-runtime", region_name="us-east-1")
12+
13+
# Set the model ID, e.g. DeepSeek-R1
14+
model_id = "us.deepseek.r1-v1:0"
15+
16+
# Load the document
17+
with open("example-data/amazon-nova-service-cards.pdf", "rb") as file:
18+
document_bytes = file.read()
19+
20+
# Start a conversation with a user message and the document
21+
conversation = [
22+
{
23+
"role": "user",
24+
"content": [
25+
{"text": "Briefly compare the models described in this document"},
26+
{
27+
"document": {
28+
# Available formats: html, md, pdf, doc/docx, xls/xlsx, csv, and txt
29+
"format": "pdf",
30+
"name": "Amazon Nova Service Cards",
31+
"source": {"bytes": document_bytes},
32+
}
33+
},
34+
],
35+
}
36+
]
37+
38+
try:
39+
# Send the message to the model, using a basic inference configuration.
40+
response = client.converse(
41+
modelId=model_id,
42+
messages=conversation,
43+
inferenceConfig={"maxTokens": 2000, "temperature": 0.3},
44+
)
45+
46+
# Extract and print the reasoning and response text.
47+
reasoning, response_text = "", ""
48+
for item in response["output"]["message"]["content"]:
49+
for key, value in item.items():
50+
if key == "reasoningContent":
51+
reasoning = value["reasoningText"]["text"]
52+
elif key == "text":
53+
response_text = value
54+
55+
print(f"\nReasoning:\n{reasoning}")
56+
print(f"\nResponse:\n{response_text}")
57+
58+
except (ClientError, Exception) as e:
59+
print(f"ERROR: Can't invoke '{model_id}'. Reason: {e}")
60+
exit(1)
61+
62+
# snippet-end:[python.example_code.bedrock-runtime.DocumentUnderstanding_DeepSeek]

0 commit comments

Comments
 (0)