brainsteam.co.uk/brainsteam/content/replies/2022/11/20/1668944146.md

3.5 KiB
Raw Blame History

date hypothesis-meta in-reply-to tags type url
2022-11-20T11:35:46
created document flagged group hidden id links permissions tags target text updated uri user user_info
2022-11-20T11:35:46.410564+00:00
title
Data Engineering in 2022: ELT tools
false __world__ false eYCrpGjHEe2hEkur1Ic5ww
html incontext json
https://hypothes.is/a/eYCrpGjHEe2hEkur1Ic5ww https://hyp.is/eYCrpGjHEe2hEkur1Ic5ww/rmoff.net/2022/11/08/data-engineering-in-2022-elt-tools/ https://hypothes.is/api/annotations/eYCrpGjHEe2hEkur1Ic5ww
admin delete read update
acct:ravenscroftj@hypothes.is
acct:ravenscroftj@hypothes.is
group:__world__
acct:ravenscroftj@hypothes.is
ELT
data-engineering
selector source
endContainer endOffset startContainer startOffset type
/main[1]/article[1]/div[5]/div[1]/div[4]/p[1] 521 /main[1]/article[1]/div[5]/div[1]/div[4]/p[1] 0 RangeSelector
end start type
4166 3645 TextPositionSelector
exact prefix suffix type
It took me a while to grok where dbt comes in the stack but now that I (think) I have it, it makes a lot of sense. I can also see why, with my background, I had trouble doing so. Just as Apache Kafka isnt easily explained as simply another database, another message queue, etc, dbt isnt just another Informatica, another Oracle Data Integrator. Its not about ETL or ELT - its about T alone. With that understood, things slot into place. This isnt just my take on it either - dbt themselves call it out on their blog: t could fail…but not for now. dbt is the T in ELT TextQuoteSelector
https://rmoff.net/2022/11/08/data-engineering-in-2022-elt-tools/
Also - just because their "pricing" page caught me off guard and their website isn't that clear (until you click through to the technical docs) - I thought it's worth calling out that DBT appears to be an open-core platform. They have a SaaS offering and also an open source python command-line tool - it seems that these articles are about the latter 2022-11-20T11:35:46.410564+00:00 https://rmoff.net/2022/11/08/data-engineering-in-2022-elt-tools/ acct:ravenscroftj@hypothes.is
display_name
James Ravenscroft
https://rmoff.net/2022/11/08/data-engineering-in-2022-elt-tools/
ELT
data-engineering
hypothesis
reply /replies/2022/11/20/1668944146
It took me a while to grok where dbt comes in the stack but now that I (think) I have it, it makes a lot of sense. I can also see why, with my background, I had trouble doing so. Just as Apache Kafka isnt easily explained as simply another database, another message queue, etc, dbt isnt just another Informatica, another Oracle Data Integrator. Its not about ETL or ELT - its about T alone. With that understood, things slot into place. This isnt just my take on it either - dbt themselves call it out on their blog:
Also - just because their "pricing" page caught me off guard and their website isn't that clear (until you click through to the technical docs) - I thought it's worth calling out that DBT appears to be an open-core platform. They have a SaaS offering and also an open source python command-line tool - it seems that these articles are about the latter