brainsteam.co.uk/brainsteam/content/replies/2022/11/23/1669199260.md

64 lines
2.2 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

---
date: '2022-11-23T10:27:40'
hypothesis-meta:
created: '2022-11-23T10:27:40.587505+00:00'
document:
title:
- How to architect the perfect Data Warehouse
flagged: false
group: __world__
hidden: false
id: dWHZzGsZEe25P7NsRpHeAg
links:
html: https://hypothes.is/a/dWHZzGsZEe25P7NsRpHeAg
incontext: https://hyp.is/dWHZzGsZEe25P7NsRpHeAg/scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e
json: https://hypothes.is/api/annotations/dWHZzGsZEe25P7NsRpHeAg
permissions:
admin:
- acct:ravenscroftj@hypothes.is
delete:
- acct:ravenscroftj@hypothes.is
read:
- group:__world__
update:
- acct:ravenscroftj@hypothes.is
tags:
- ELT
- data-engineering
target:
- selector:
- endContainer: /article[1]/section[1]/p[7]
endOffset: 216
startContainer: /article[1]/section[1]/p[7]
startOffset: 0
type: RangeSelector
- end: 1816
start: 1600
type: TextPositionSelector
- exact: "One example could be putting all files into an Amazon S3 bucket. It\u2019\
s versatile, cheap and integrates with many technologies. If you are using\
\ Redshift for your data warehouse, it has great integration with that too."
prefix: loading into the data warehouse.
suffix: StagingThe staging area is the b
type: TextQuoteSelector
source: https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e
text: Essentially the raw data needs to be vaguely homogenised and put into a single
place
updated: '2022-11-23T10:27:40.587505+00:00'
uri: https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e
user: acct:ravenscroftj@hypothes.is
user_info:
display_name: James Ravenscroft
in-reply-to: https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e
tags:
- ELT
- data-engineering
- hypothesis
type: reply
url: /replies/2022/11/23/1669199260
---
<blockquote>One example could be putting all files into an Amazon S3 bucket. Its versatile, cheap and integrates with many technologies. If you are using Redshift for your data warehouse, it has great integration with that too.</blockquote>Essentially the raw data needs to be vaguely homogenised and put into a single place