#dataengineers — Public Fediverse posts

🚀 Ah, the brave nerds have done it again—PRQL, pronounced #PREQUEL, because who doesn't love a good Jedi reference when discussing #SQL replacements? 🧘‍♂️ Unveiled as a "modern language" 💻, it's just SQL with a fancy hat, trying to impress data engineers by being as concise as their attention spans. 🙄
https://prql-lang.org/ #PRQL #DataEngineers #ModernLanguage #HackerNews #ngated

Pyspark Cheat Sheet #bigdata #programming #database #coding #dataengineering #python #dataengineers

This PySpark Cheat Sheet image provides a quick and powerful reference for anyone working with big data, ETL pipelines, ... source

https://quadexcel.com/wp/pyspark-cheat-sheet-bigdata-programming-database-coding-dataengineering-python-dataengineers/

Python Cheat sheet #python #pythoncoding #pythonprogramming #dataengineers #coding #programming

Python is a powerful, versatile, and beginner-friendly programming language used in automation, backend development, data ... source

https://quadexcel.com/wp/python-cheat-sheet-python-pythoncoding-pythonprogramming-dataengineers-coding-programming/

🔎🔥Summoning all #dataengineers, #AI enthusiasts, and #RAG masterminds - join us at #VSCON25 June 6th to expand your knowledge and network with global developers from #Google, #Oracle, and #Microsoft!

Sign up at: http://vsearchcon.com

#tech #vectorsearch #postgresql #pgvector #LLMs #MySQL #Vespa #Couchbase

Have you heard "it works on my machine"? Enter: containers. Learn how Docker, Inc ensures consistent ML models, data pipelines, and environments across any system in this article :blobcoffee: https://towardsdatascience.com/why-data-scientists-should-care-about-containers-and-stand-out-with-this-knowledge/

#docker #container #kubernetes #datascientist #dataengineering #dataengineers #datascience #virtualmachines

Over 30 stars already on my CSV editor for #dataengineers #opensource project !

Thanks for the support! :heart_fire:

https://github.com/CedricBonjour/nanocell-csv

Looking to connect with #dataengineers to keep up to date with #tech trends in the field 🤓

🚀 🚀 🚀Just published a comprehensive new blog post on dockerizing your #Python-based ETL pipelines!

Delve into the varied benefits and detailed instructions of Docker packaging with us.

⚡ Learn how to create a virtual environment, and package a Python pipeline.
⚡ Learn about procedure of building and running Docker images while emphasizing the importance of distinct virtual environments for each project.

🔗 https://ploomber-sql.readthedocs.io/en/latest/packaging-your-sql-project/containerizing-etl-with-docker.html

#Docker #ETLPipelines #DataEngineers #DevOps

another good quick comparison among data professionals 👇 💡
credit: Hamidreza haddad

#data #dataanalysis #dataengineers #graphs

@BM_DataDowntime

1. more companies moving to serverless if they aren't already
2. data contracts taking precedence just like ethics for data science folks
3. a little more education around batch vs streaming architectures
4. more jobs in #dataengineering - more specializations as well in #data teams
5. #Dataengineers being a key part of the founding team than just an engineer to support #datascience workflow