Black Friday sale: an extra 40% off every course until Monday, November 30.New Year sale: an extra 30% off every course until Friday, January 1.Memorial Day sale: an extra 25% off every course until Monday, May 31.SysAdmin Day sale: an extra 25% off every course until Sunday, August 1.Back to School sale: an extra 25% off every course until Sunday, August 22.Labor Day sale: an extra 25% off every course until Monday, September 6.Black Friday sale: an extra 40% off every course until Monday, November 29.New Year sale: an extra 30% off every course until Saturday, January 1.Choose your certification →

Copyright (c) 2026 MindMesh Academy. All rights reserved. This content is proprietary and may not be reproduced or distributed without permission.

3.6.2. Retrieval-Augmented Generation with Amazon Bedrock Knowledge Bases

💡 First Principle: RAG grounds a general model in private, current data at query time instead of changing the model. Answer quality is decided by ingestion (parsing, chunking, embeddings, metadata) and retrieval (search type, filters, reranking) as much as by the model.

Scenario: An insurer wants an assistant that answers from 2 million policy PDFs and claims manuals. Users often search for exact form numbers such as HO-3 2019, each business unit may see only its own documents, and the budget for the vector store is tight because queries are infrequent.

Ingestion. "Amazon Bedrock Knowledge Bases" connects to data sources (Amazon S3, a web crawler, Confluence, SharePoint, Salesforce and others), parses documents, splits them into chunks, converts each chunk to a vector with an embeddings model and writes it to a vector store. Syncing the data source re-ingests what changed. Advanced parsing (Bedrock Data Automation or a foundation model as parser) handles tables, figures and scanned pages that plain text extraction mangles. A "Bedrock Managed Knowledge Base" option (GA June 2026) also runs the vector storage for you.

ChunkingBehaviorUse when
Default / fixed-size~300-token chunks, or a size and overlap you setGeneral documents
HierarchicalSearches small child chunks, returns their larger parentPrecise matching but answers need surrounding context
SemanticSplits where meaning changes (uses a model, extra cost)Long documents with uneven structure
None + custom LambdaYou pre-split or transform content yourselfSpecialized formats
Vector storeStrengthLimitation to remember
OpenSearch ServerlessDefault quick-create, hybrid search, metadata filtersCapacity-based cost even when idle
Aurora PostgreSQL (pgvector)Hybrid search, reuse existing relational skillsMust be in the same account as the knowledge base
Neptune AnalyticsGraphRAG for relationship-heavy contentGraph capacity to size
Amazon S3 VectorsLowest cost, durable, sub-second queries for infrequent workloadsSemantic search only, float embeddings only, 1 KB / 35 keys of metadata per vector, hierarchical chunking not recommended
Pinecone, Redis Enterprise Cloud, MongoDB AtlasReuse an existing third-party storeCredentials in Secrets Manager, third-party terms

Retrieval. Retrieve returns ranked chunks for your own prompt; RetrieveAndGenerate also generates a cited answer. Hybrid search combines vector similarity with keyword matching, so exact identifiers are found; it is supported only on Aurora/RDS, OpenSearch Serverless and MongoDB Atlas stores with a filterable text field. Metadata filtering (from .metadata.json files next to S3 objects) scopes results by business unit, tenant or date, and is how a pooled multi-tenant knowledge base keeps tenants apart. Reranking reorders the top results with a reranker model, and query decomposition splits a multi-part question into sub-queries.

⚠️ Exam Trap: When users search for exact codes, part numbers or error IDs, pure semantic search is the weak point. S3 Vectors is the cheapest store but semantic-only, so the right design for that requirement is a hybrid-capable store (OpenSearch Serverless or Aurora PostgreSQL). Picking S3 Vectors there trades away the stated requirement for cost.

See how it connects
Alvin Varughese
Written byAlvin Varughese
Founder•26 professional certifications earned