brainsteam.co.uk/brainsteam/content/replies/2022/11/23/1669199260.md

date	hypothesis-meta	in-reply-to	tags	type	url
2022-11-23T10:27:40	created document flagged group hidden id links permissions tags target text updated uri user user_info 2022-11-23T10:27:40.587505+00:00 title How to architect the perfect Data Warehouse false __world__ false dWHZzGsZEe25P7NsRpHeAg html incontext json https://hypothes.is/a/dWHZzGsZEe25P7NsRpHeAg https://hyp.is/dWHZzGsZEe25P7NsRpHeAg/scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e https://hypothes.is/api/annotations/dWHZzGsZEe25P7NsRpHeAg admin delete read update acct:ravenscroftj@hypothes.is acct:ravenscroftj@hypothes.is group:__world__ acct:ravenscroftj@hypothes.is ELT data-engineering selector source endContainer endOffset startContainer startOffset type /article[1]/section[1]/p[7] 216 /article[1]/section[1]/p[7] 0 RangeSelector end start type 1816 1600 TextPositionSelector exact prefix suffix type One example could be putting all files into an Amazon S3 bucket. It’s versatile, cheap and integrates with many technologies. If you are using Redshift for your data warehouse, it has great integration with that too. loading into the data warehouse. StagingThe staging area is the b TextQuoteSelector https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e Essentially the raw data needs to be vaguely homogenised and put into a single place 2022-11-23T10:27:40.587505+00:00 https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e acct:ravenscroftj@hypothes.is display_name James Ravenscroft	https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e	ELT data-engineering hypothesis	reply	/replies/2022/11/23/1669199260

One example could be putting all files into an Amazon S3 bucket. It’s versatile, cheap and integrates with many technologies. If you are using Redshift for your data warehouse, it has great integration with that too.

Essentially the raw data needs to be vaguely homogenised and put into a single place