brainsteam.co.uk/brainsteam/content/replies/2022/11/23/1669199260.md

2.2 KiB
Raw Blame History

date hypothesis-meta in-reply-to tags type url
2022-11-23T10:27:40
created document flagged group hidden id links permissions tags target text updated uri user user_info
2022-11-23T10:27:40.587505+00:00
title
How to architect the perfect Data Warehouse
false __world__ false dWHZzGsZEe25P7NsRpHeAg
html incontext json
https://hypothes.is/a/dWHZzGsZEe25P7NsRpHeAg https://hyp.is/dWHZzGsZEe25P7NsRpHeAg/scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e https://hypothes.is/api/annotations/dWHZzGsZEe25P7NsRpHeAg
admin delete read update
acct:ravenscroftj@hypothes.is
acct:ravenscroftj@hypothes.is
group:__world__
acct:ravenscroftj@hypothes.is
ELT
data-engineering
selector source
endContainer endOffset startContainer startOffset type
/article[1]/section[1]/p[7] 216 /article[1]/section[1]/p[7] 0 RangeSelector
end start type
1816 1600 TextPositionSelector
exact prefix suffix type
One example could be putting all files into an Amazon S3 bucket. Its versatile, cheap and integrates with many technologies. If you are using Redshift for your data warehouse, it has great integration with that too. loading into the data warehouse. StagingThe staging area is the b TextQuoteSelector
https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e
Essentially the raw data needs to be vaguely homogenised and put into a single place 2022-11-23T10:27:40.587505+00:00 https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e acct:ravenscroftj@hypothes.is
display_name
James Ravenscroft
https://scribe.rip/how-to-architect-the-perfect-data-warehouse-b3af2e01342e
ELT
data-engineering
hypothesis
reply /replies/2022/11/23/1669199260
One example could be putting all files into an Amazon S3 bucket. Its versatile, cheap and integrates with many technologies. If you are using Redshift for your data warehouse, it has great integration with that too.
Essentially the raw data needs to be vaguely homogenised and put into a single place