brainsteam.co.uk/brainsteam/content/replies/2022/11/20/1668944146.md

87 lines
3.5 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

---
date: '2022-11-20T11:35:46'
hypothesis-meta:
created: '2022-11-20T11:35:46.410564+00:00'
document:
title:
- 'Data Engineering in 2022: ELT tools'
flagged: false
group: __world__
hidden: false
id: eYCrpGjHEe2hEkur1Ic5ww
links:
html: https://hypothes.is/a/eYCrpGjHEe2hEkur1Ic5ww
incontext: https://hyp.is/eYCrpGjHEe2hEkur1Ic5ww/rmoff.net/2022/11/08/data-engineering-in-2022-elt-tools/
json: https://hypothes.is/api/annotations/eYCrpGjHEe2hEkur1Ic5ww
permissions:
admin:
- acct:ravenscroftj@hypothes.is
delete:
- acct:ravenscroftj@hypothes.is
read:
- group:__world__
update:
- acct:ravenscroftj@hypothes.is
tags:
- ELT
- data-engineering
target:
- selector:
- endContainer: /main[1]/article[1]/div[5]/div[1]/div[4]/p[1]
endOffset: 521
startContainer: /main[1]/article[1]/div[5]/div[1]/div[4]/p[1]
startOffset: 0
type: RangeSelector
- end: 4166
start: 3645
type: TextPositionSelector
- exact: "It took me a while to grok where dbt comes in the stack but now that\
\ I (think) I have it, it makes a lot of sense. I can also see why, with my\
\ background, I had trouble doing so. Just as Apache Kafka isn\u2019t easily\
\ explained as simply another database, another message queue, etc, dbt isn\u2019\
t just another Informatica, another Oracle Data Integrator. It\u2019s not\
\ about ETL or ELT - it\u2019s about T alone. With that understood, things\
\ slot into place. This isn\u2019t just my take on it either - dbt themselves\
\ call it out on their blog:"
prefix: "t could fail\u2026but not for now.\n\n\n"
suffix: '
dbt is the T in ELT
'
type: TextQuoteSelector
source: https://rmoff.net/2022/11/08/data-engineering-in-2022-elt-tools/
text: Also - just because their "pricing" page caught me off guard and their website
isn't that clear (until you click through to the technical docs) - I thought it's
worth calling out that DBT appears to be an open-core platform. They have a SaaS
offering and also an open source python command-line tool - it seems that these
articles are about the latter
updated: '2022-11-20T11:35:46.410564+00:00'
uri: https://rmoff.net/2022/11/08/data-engineering-in-2022-elt-tools/
user: acct:ravenscroftj@hypothes.is
user_info:
display_name: James Ravenscroft
in-reply-to: https://rmoff.net/2022/11/08/data-engineering-in-2022-elt-tools/
tags:
- ELT
- data-engineering
- hypothesis
type: reply
url: /replies/2022/11/20/1668944146
---
<blockquote>It took me a while to grok where dbt comes in the stack but now that I (think) I have it, it makes a lot of sense. I can also see why, with my background, I had trouble doing so. Just as Apache Kafka isnt easily explained as simply another database, another message queue, etc, dbt isnt just another Informatica, another Oracle Data Integrator. Its not about ETL or ELT - its about T alone. With that understood, things slot into place. This isnt just my take on it either - dbt themselves call it out on their blog:</blockquote>Also - just because their "pricing" page caught me off guard and their website isn't that clear (until you click through to the technical docs) - I thought it's worth calling out that DBT appears to be an open-core platform. They have a SaaS offering and also an open source python command-line tool - it seems that these articles are about the latter