#dataops — Public Fediverse posts

AI tools give a flash of speed, but only a system of linked layers delivers lasting motion. When a persona, automated pipeline, and analytics loop converse without manual hand-off, the workflow becomes a self-sustaining gear train that tolerates API changes and scales with market growth. Build the infrastructure, not the hype. 🚀 #AIMarketing #Automation #SystemsDesign #DataOps - Powered by FG

Strong data catalogs transform the way teams think. They shift work from guesswork to clear action. What’s your take? #DataCatalogs #SingleSourceOfTruth #DataQuality #DataTrust #DataOps #DataStrategy #AIReadyData #DataFuture
https://www.linkedin.com/pulse/building-data-catalogs-quiet-power-behind-single-truth-mohindroo--icosc

Bad data breaks business. Data observability builds trust. Are you ready? #DataObservability #DataQuality #DataReliability #DataOps #CIO #CDO #CTO #DataTrust #DigitalTransformation #AI
https://www.linkedin.com/pulse/data-observability-next-frontier-quality-management-mohindroo--lpgtc

FlinkSQL в Авито: что внутри и как нам это помогает

Привет! Меня зовут Артемий, я инженер в команде Processing и веду фичатрек по развитию FlinkSQL в Авито . Сегодня я расскажу про инструмент, который мы развиваем в Avito — FlinkSQL. Он использует потоковые данные для аналитики в реальном времени: метрики, временные срезы, A/B-расчеты, поиск аномалий. Все это на привычном SQL, чтобы команда видела картину и могла действовать сразу.

https://habr.com/ru/companies/avito/articles/959382/

#Flink #kubernetes #bigdata #k8s #operator #kubernetes_operator #flink_kubernetes_operator #Apache_Flink #DataOps #dataops_platform

Bad data breaks business. Data observability builds trust. Are you ready? #DataObservability #DataQuality #DataReliability #DataOps #CIO #CDO #CTO #DataTrust #DigitalTransformation #AI
https://medium.com/@sanjay.mohindroo66/data-observability-the-next-frontier-in-data-quality-management-d5d75ea375c7

Do you know of any #rstats teams who could use some help in 2025?

I'm a freelance consultant with 10yrs of experience in #DataSci, #DataEng, #DataOps, and providing #SysAdmin for related tools. I primarily work with R, but I have enough SQL and Python knowledge to get by. I know my way around a linux terminal and docker-compose file. I'm also handy as an interpreter between IT and analytics teams. Open to many types of engagements (project-based, temp staff, etc).

If you have a need or a lead, I'd love to chat!

boosts welcome :-)

It's that times of the week for All Hands on #data 🥳

Whether you are trying to escape the summer heat, or hang out with Python's favorite bear 🐼 - this week's articles from across the data space have something for you!

Full articles 👇

(Subscribe to stay up to date 😊)

#dataorchestration #mlops #dataops #dataengineering

https://allhandsondata.substack.com/p/all-hands-on-data-61

🔥⏲️ Fudge Sunday "Shock the Chaos Monkey" A look at chaos engineering adoption within platform engineering teams

#chaos #chaosengineering #faulttolerance #faultfinding #faultinjection #securityengineering #dataops #dataoperations #ai #resiliency #devx #devops #devsecops #platformengineering #platformengineer #cloudinfrastructure #securityautomation #securitybydesign #shiftleft #shiftup #newsletter #newsletters

https://fudge.org/archive/shock-the-chaos-monkey/

Looking for interesting datasets to practice with?
(and full end-to-end data pipelines to investigate)

Here are 5 (and a few extras) from the recent DataTalksClub Data Engineering Zoomcamp:

https://medium.com/inthepipeline/5-interesting-datasets-from-the-data-engineering-zoomcamp-f0d6dd4d5e15

Datasets Include:

- Daily data on Berlin bike thefts
- Air quality
- SF Eviction data
- Minneapolis 311
- NYC Restaurant Inspection

#DataEngineering #DataOps #Datasets #DataProjects #AnalyticsEngineering #DataPipelines #dbt #elt #DataViz

#SPASQL is how our #VirtuosoRDBMS enables declarative operations on data organized as tables or graphs via #SPARQL inside #SQL.

What are the benefits?

[1] Ubiquitous Data Source Names (#DSNs), courtesy of #HTTP

[2] Fine-grained entity relationship graph comprising clickable edges and nodes that function as #SuperKeys

#ChatGPT knows SPASQL too!

https://community.openlinksw.com/t/howto-using-chat-gpt-to-generate-enhanced-sql-and-sparql-cheatsheets/3818/2#sparql-inside-sql-spasql-example-1

#SemanticWeb #LinkedData #GraphDatabase #DBMS #RDBMS #CDO #CIO #CTO #DataOps #DBpedia #LODCloud #KnowledgeGraph #HowTo

#SPASQL is how our #VirtuosoRDBMS enables declarative operations on data organized as tables or graphs via #SPARQL inside #SQL.

What are the benefits?

[1] Ubiquitous Data Source Names (#DSNs), courtesy of #HTTP

[2] Fine-grained entity relationship graph comprising clickable edges and nodes that function as #SuperKeys

#ChatGPT knows SPASQL too!

https://community.openlinksw.com/t/howto-using-chat-gpt-to-generate-enhanced-sql-and-sparql-cheatsheets/3818/2#sparql-inside-sql-spasql-example-1

#SemanticWeb #LinkedData #GraphDatabase #DBMS #RDBMS #CDO #CIO #CTO #DataOps #DBpedia #LODCloud #KnowledgeGraph #HowTo

#SPASQL is how our #VirtuosoRDBMS enables declarative operations on data organized as tables or graphs via #SPARQL inside #SQL.

What are the benefits?

[1] Ubiquitous Data Source Names (#DSNs), courtesy of #HTTP

[2] Fine-grained entity relationship graph comprising clickable edges and nodes that function as #SuperKeys

#ChatGPT knows SPASQL too!

https://community.openlinksw.com/t/howto-using-chat-gpt-to-generate-enhanced-sql-and-sparql-cheatsheets/3818/2#sparql-inside-sql-spasql-example-1

#SemanticWeb #LinkedData #GraphDatabase #DBMS #RDBMS #CDO #CIO #CTO #DataOps #DBpedia #LODCloud #KnowledgeGraph #HowTo

#SPASQL is how our #VirtuosoRDBMS enables declarative operations on data organized as tables or graphs via #SPARQL inside #SQL.

What are the benefits?

[1] Ubiquitous Data Source Names (#DSNs), courtesy of #HTTP

[2] Fine-grained entity relationship graph comprising clickable edges and nodes that function as #SuperKeys

#ChatGPT knows SPASQL too!

https://community.openlinksw.com/t/howto-using-chat-gpt-to-generate-enhanced-sql-and-sparql-cheatsheets/3818/2#sparql-inside-sql-spasql-example-1

#SemanticWeb #LinkedData #GraphDatabase #DBMS #RDBMS #CDO #CIO #CTO #DataOps #DBpedia #LODCloud #KnowledgeGraph #HowTo

#SPASQL is how our #VirtuosoRDBMS enables declarative operations on data organized as tables or graphs via #SPARQL inside #SQL.

What are the benefits?

[1] Ubiquitous Data Source Names (#DSNs), courtesy of #HTTP

[2] Fine-grained entity relationship graph comprising clickable edges and nodes that function as #SuperKeys

#ChatGPT knows SPASQL too!

https://community.openlinksw.com/t/howto-using-chat-gpt-to-generate-enhanced-sql-and-sparql-cheatsheets/3818/2#sparql-inside-sql-spasql-example-1

#SemanticWeb #LinkedData #GraphDatabase #DBMS #RDBMS #CDO #CIO #CTO #DataOps #DBpedia #LODCloud #KnowledgeGraph #HowTo

📝 What kind of MLOps team are you? [Part 3/3]
#mlops #productionml #dataops #mlsystems

In early starts-ups & even at the Small/Med Size business, teams are often a combination of the different modes & that's totally fine!

You don't always need a specialized team!

💡What's important to recognize is to know this framework exists for organziational alignment, as well as to know when teams can be spun out.

📝 What kind of MLOps team are you? [Part2/3]
#mlops #productionml #dataops #mlsystems

🔍 Zeroing in on the ones that oftentimes constitute the ML Org or the Data org:

⛑ Enabling teams - Help the DS & Product folks get those models out the door using the internal plateforms & capabilities provided by the CST

⚙️ Complicated Subsystem team - Focused on maintaining & expanding the extremely technical solution they own

👷🏻‍♀️The Platform Team - Owns unified & integrated experience.

📝 What kind of MLOps team are you? [Part1/3]

🗺️ In the world of "team Topologies" there are 4 types of teams.

🌊 Stream-aligned teams (ST) ---------> Data science & Product (for example)

⛑ Enabling teams (ET) ---------> ML Engineering

⚙️ Complicated Subsystem team (CST) ---------> The Kubernetes Team, the GCP team, the Terraform team, the Redis team, etc

👷🏻‍♀️The Platform Team (PT) ---------> The ML Platform Team, The Data Platform Team, etc

#mlops #productionml #dataops #mlsystems

🔥Hot off the press "Buf.build Your REST" This week we take a look at the history of protocol buffers as well as the rise of buf cli and Buf Technologies.

#protocolbuffers #protobuf #gRPC #api #restful #restfulapi #restfulapis #venturecapital #devops #devsecops #dataops #schema #devex #developertools #developerexperience #platformengineering #digitalplatforms #paradigmshift #newsletter #newsletters

https://fudge.org/archive/bufbuild-your-rest/

🔥Hot off the press "IDP Wasn't Built in a Day" This week we look at similarities in platform engineering, data operations (DataOps), and revenue operations (RevOps) teams.

#platformengineering #revops #dataops #idp #toolchains #dataoperations #revenueoperations #devsecops #finops #cloudcostoptimization #newsletter

https://fudge.org/archive/idp-wasnt-built-in-a-day/

My team at #aifi will be #hiring a #dataengineer and #dataops soon! If you are interested in working in the space of autonomous shopping, geel free to ping me.

There's no current website with openings, but you can send me your cv and I'll pass it on internally.

This is a remote position, so apply from wherever!

Boosts are appreciated!

One note: for anywhere but US, this would become a contractor position instead a FTE.

#jobs #software #remote

The round up of post-data day hangouts! With @sophiamyang , #ViniJaiswal, John Bohannon, Santona Tulli, Shirshanka Das at #ddtx23 #DataDayTexas2023 #dataday talking about #datascience #nlp #monitoring #python #dataops #dataengineering

Catching an excellent seafood dinner w/folks like @joereis, Matt Housley, Juan Sequenda, Bill Inmon, Chris Tabb, Ryan Dolley, Tim Gasper and more folks!

#DataDayTexas2023 #ddtx23 #dataengineering #dataops #datawarehousing

Key takeaways from #chadsanderson ’s Data Quality talk #datacontracts #dataengineering #dataops

Data is complicated, esp. at scale & w/ lots of ppl in the mixture. A data platform needs to meet so many diff needs, esp. for enterprises - From @adipolak #datadaytexas #ddtx2023 #dataops #dataengineering

Data is complicated, esp. at scale & w/ lots of ppl in the mixture. A data platform needs to meet so many diff needs, esp. for enterprises - From @adipolak #datadaytexas #ddtx2023 #dataops #dataengineering

Data is complicated, esp. at scale & w/ lots of ppl in the mixture. A data platform needs to meet so many diff needs, esp. for enterprises - From @adipolak #datadaytexas #ddtx2023 #dataops #dataengineering

Data is complicated, esp. at scale & w/ lots of ppl in the mixture. A data platform needs to meet so many diff needs, esp. for enterprises - From @adipolak #datadaytexas #ddtx2023 #dataops #dataengineering

Data is complicated, esp. at scale & w/ lots of ppl in the mixture. A data platform needs to meet so many diff needs, esp. for enterprises - From @adipolak #datadaytexas #ddtx2023 #dataops #dataengineering

🦅 The eagle has landed! Excited for tomorrow's Data Day Texas lineup & events!

🤯 The caliber of speakers is absolutely phenomenal, if you're in the Austin area definitely consider dropping by & checking it out!

👏🏻 Congrats to Lynn Bender & team for an incredible line-up!

To see the latest schedule of sessions, check this link: https://datadaytexas.com/2023/schedule

#mlops #dataops #datacentricai #dataengineering #machinelearning #datamodeling #nlp

What Wildfires Taught Me About Data Ops - As my family evacuated in the face of the monster fires raging around us in the hi... - https://readwrite.com/2021/05/03/what-wildfires-taught-me-about-data-ops/ #fundadministration #dataoperations #fundstech #culture #fintech #dataops #cloud

What Makes Enterprise AI Different From Any Other AI? - Has enterprise artificial intelligence (AI) lived up to the hype generated at a de... - https://readwrite.com/2021/05/02/what-makes-enterprise-ai-different-from-any-other-ai/ #dataoperations #enterpriseai #fundstech #fintech #dataops #fund #ai