home.social
Sign in Create account

#analyticsengineering — Public Fediverse posts

Live and recent posts from across the Fediverse tagged #analyticsengineering, aggregated by home.social.

  1. Data Dave @[email protected] ·

    I hosted the PipeRider Community Office Hours yesterday and one cool feature we demoed was this online dbt manifest viewer.

    Generate a Lineage Diff from just your dbt project's manifest files.

    Try it out for yourself here:

    staging.cloud.piperider.io/onl

    Watch it in action on Youtube:

    youtube.com/watch?v=LHuTb3e_4O

    #DataEngineering #DataViz #dbt #DataTools #AnalyticsEngineering #OpenSource #PipeRider

    #dataengineering #dataviz #dbt #datatools #analyticsengineering #opensource
  2. Data Dave @[email protected] ·

    Looking for interesting datasets to practice with?
    (and full end-to-end data pipelines to investigate)

    Here are 5 (and a few extras) from the recent DataTalksClub Data Engineering Zoomcamp:

    medium.com/inthepipeline/5-int

    Datasets Include:

    - Daily data on Berlin bike thefts
    - Air quality
    - SF Eviction data
    - Minneapolis 311
    - NYC Restaurant Inspection

    #DataEngineering #DataOps #Datasets #DataProjects #AnalyticsEngineering #DataPipelines #dbt #elt #DataViz

    #dataengineering #dataops #datasets #dataprojects #analyticsengineering #datapipelines
  3. mariah @[email protected] ·
    CW: dbt model materialization patterns

    Do you materialize as table by default? View? How much do you use ephemeral materialization? When is a view better than a table?

    My team has pretty small data and we use tables for everything except event streams (incremental) and some intermediate (ephemeral) models.

    I'm really curious what other teams' materialization patterns are like.

    #datadon #dbt #DataModeling #AnalyticsEngineering #DataWarehousing

    #datawarehousing #analyticsengineering #datamodeling #dbt #datadon