--- date: '2022-11-23T10:27:40' hypothesis-meta: created: '2022-11-23T10:27:40.587505+00:00' document: title: - How to architect the perfect Data Warehouse flagged: false group: __world__ hidden: false id: dWHZzGsZEe25P7NsRpHeAg links: html: https://hypothes.is/a/dWHZzGsZEe25P7NsRpHeAg incontext: https://hyp.is/dWHZzGsZEe25P7NsRpHeAg/scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e json: https://hypothes.is/api/annotations/dWHZzGsZEe25P7NsRpHeAg permissions: admin: - acct:ravenscroftj@hypothes.is delete: - acct:ravenscroftj@hypothes.is read: - group:__world__ update: - acct:ravenscroftj@hypothes.is tags: - ELT - data-engineering target: - selector: - endContainer: /article[1]/section[1]/p[7] endOffset: 216 startContainer: /article[1]/section[1]/p[7] startOffset: 0 type: RangeSelector - end: 1816 start: 1600 type: TextPositionSelector - exact: "One example could be putting all files into an Amazon S3 bucket. It\u2019\ s versatile, cheap and integrates with many technologies. If you are using\ \ Redshift for your data warehouse, it has great integration with that too." prefix: loading into the data warehouse. suffix: StagingThe staging area is the b type: TextQuoteSelector source: https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e text: Essentially the raw data needs to be vaguely homogenised and put into a single place updated: '2022-11-23T10:27:40.587505+00:00' uri: https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e user: acct:ravenscroftj@hypothes.is user_info: display_name: James Ravenscroft in-reply-to: https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e tags: - ELT - data-engineering - hypothesis type: reply url: /replies/2022/11/23/1669199260 ---
One example could be putting all files into an Amazon S3 bucket. It’s versatile, cheap and integrates with many technologies. If you are using Redshift for your data warehouse, it has great integration with that too.
Essentially the raw data needs to be vaguely homogenised and put into a single place