# Crawl4AI and Amazon Bedrock Knowledge Bases prepare web content for RAG ingestion

> Original title: Prepare web content for Amazon Bedrock Knowledge Bases with Crawl4AI

- Source: AWS Machine Learning Blog
- Published: 2026-11-02T17:11:21.000Z
- Bad Influence: https://badinfluence.news/items/j3ye9su7jf2oihykiqgqtzl4r
- Original: https://aws.amazon.com/blogs/machine-learning/prepare-web-content-for-amazon-bedrock-knowledge-bases-with-crawl4ai/

## Summary

AWS Machine Learning Blog describes a Crawl4AI preparation path that writes Markdown and metadata sidecars for each crawled page to Amazon S3, which Amazon Bedrock Knowledge Bases ingests through its S3 data source. The path suits sources needing main-content extraction, boilerplate removal, or custom metadata, while the Amazon Bedrock Web Crawler remains the starting point for most public websites. The companion aws-samples repository provides the complete workflow.