#datavalidation — Public Fediverse posts

marmelab web developer Thiery Michel shares in this article his use of PostgreSQL features that allow us to draw certain data validation logic away from the application layer, and into the database. The proposed solutions in some instances can be more elegant than a purely application layer data validation approach.

"9 Advanced PostgreSQL Features I Wish I Knew Sooner"

https://marmelab.com/blog/2026/02/23/do-you-know-psql.html

#programming #sql #postgresql #database #datavalidation

Learn how developers use data validation APIs to verify emails, addresses, phone numbers, and identities to improve data quality, security, and app performance. https://hackernoon.com/apis-for-data-validation-a-developers-practical-guide #datavalidation

Just finished watching @rich_i 's great workshop about hist {pointblank} R package / python module, presented at @rinpharma 2025. Highly recommended if you deal with tabular data and need validation or beautiful summary HTML tables: https://youtu.be/abvgK9VU7z0 #RStats #python #DataValidation

Khi làm dự án nhỏ tổng hợp dữ liệu từ API, mình học được:
- Đường dẫn thành công thì dễ, mọi thứ khác thì không
- Những giả định nhỏ về phản hồi API gây ra hầu hết sự cố
- Kiểm tra dữ liệu quan trọng hơn hiệu năng lúc bắt đầu
Dữ liệu thực tế khác xa tutorial!

Bạn từng làm dự án liên quan dữ liệu, điều gì khiến bạn bất ngờ?
#sideproject #apidevelopment #datavalidation #lessonslearned #lậptrình #dựánphụ #xửlýdữliệu

https://www.reddit.com/r/SideProject/comments/1qipi23/what_surprised_

Kochava fixes the MMM data problem marketers didn't know they had: Measurement company releases data validation tool addressing broken spend tracking, naming inconsistencies, and revenue gaps that derail marketing mix modeling. https://ppc.land/kochava-fixes-the-mmm-data-problem-marketers-didnt-know-they-had/ #Marketing #DataAnalytics #MarketingMixModeling #DataValidation #Measurement

Blog alert!

This time, on my first testing of regular expressions within SQL Server 2025!

#SQLServer2025
#Regex
#SQLServer
#ETL
#DataValidation

http://sqlreitse.com/2025/09/12/sql-server-2025-simplifying-data-checks-with-regex/

🚀 A practical data efficiency tip for software developers & tech leaders:

✅ Treat your data like you treat your code!

Instead of waiting for data problems to surface in production — or worse, in your ML models or analytics — you can catch them earlier by integrating data checks into your development workflow.

Here’s how:
💡 Add data validation tests to your CI/CD pipeline — just like unit tests for code.
💡 Define and enforce data contracts (expected schemas & rules) between teams or systems.
💡 Run automated change impact analysis when modifying data pipelines to see what breaks before deploying.

By shifting these checks left — into your CI/CD pipeline — you avoid expensive downstream failures, reduce debugging time, and deliver more reliable ML and analytics outcomes.

Start small: pick one critical dataset or pipeline and add basic schema validation to your PR checks. You’ll thank yourself later.

💻📊 #SoftwareDevelopment #DataValidation #CI/CD #TechLeadership #ML #Analytics

Oh, the irony! Oracle, the self-proclaimed fortress of cybersecurity, gets "allegedly" breached, and their customers are left validating the stolen data. 🚀 Meanwhile, the article demands cookies and JavaScript like a petulant toddler demanding snacks. 🍪🤦‍♂️
https://www.bleepingcomputer.com/news/security/oracle-customers-confirm-data-stolen-in-alleged-cloud-breach-is-valid/ #OracleBreached #CybersecurityIrony #DataValidation #CookiesJavaScript #HackerNews #ngated

Transform Your Family History: Introducing gedcom2wiki for Effortless Genealogy Sharing

Tired of clunky family tree websites? Meet gedcom2wiki, a Python tool that converts your GEDCOM files into a user-friendly, Wikipedia-style family tree, complete with data validation. Say goodbye to o...

https://news.lavx.hu/article/transform-your-family-history-introducing-gedcom2wiki-for-effortless-genealogy-sharing

#news #tech #Genealogy #GEDCOM #DataValidation

Well, that's a convenient pick up point for your pacel if you're sailing to the UK, I guess?
#DataValidation #GoogleMaps

Discover how to implement advanced data validation using Marshmallow in Flask applications. This comprehensive guide covers essential techniques to ensure data integrity, improve security, and build more robust web applications. #DataValidation #Flask

https://teguhteja.id/advanced-data-validation-marshmallow-flask/

👀 ODE helps you find errors in your datasets and correct them in no time – a process called #datavalidation in industry jargon. It also checks that your dataset has all the necessary information for others to use, guaranteeing, again in technical jargon, data #interoperability.

#Development #Approaches
Valibot · A new approach to data validation in JavaScript https://ilo.im/15z8qe

_____
#Programming #Library #OpenSource #Valibot #Zod #DataValidation #JavaScript #Typescript #WebDev

Data Manipulation Initial Planning Is A Crucial Aspect Of Any Project, & It's One Of My Favourite Parts!

I still prefer to do this phase 'old school', with a large piece of (portable) paper, pencil, and eraser, revisiting and adjusting as needed, often the next day as it has percolated overnight...
During this phase, I list constraints, data validation needs, design a broad framework, and determine interactions while trying to future-proof as much as possible. I bring in my requirements and questions from my initial JIRA ticket(s) - and then use these to develop and evolve business rules, along with a process diagram construction.
From there, it's all on to SQL and manual testing in PostgreSQL + PostGIS and finally prototype app construction - for the devs to then take and make it work fast and well!
#datamanipulation #projectplanning #SQL #PostgreSQL #PostGIS #gis #spatial #mapping #datavalidation #requirements #businessrules #futureproofing #futureproof #app #development #oldschool

Data Manipulation Initial Planning Is A Crucial Aspect Of Any Project, & It's One Of My Favourite Parts!

I still prefer to do this phase 'old school', with a large piece of (portable) paper, pencil, and eraser, revisiting and adjusting as needed, often the next day as it has percolated overnight...
During this phase, I list constraints, data validation needs, design a broad framework, and determine interactions while trying to future-proof as much as possible. I bring in my requirements and questions from my initial JIRA ticket(s) - and then use these to develop and evolve business rules, along with a process diagram construction.
From there, it's all on to SQL and manual testing in PostgreSQL + PostGIS and finally prototype app construction - for the devs to then take and make it work fast and well!
#datamanipulation #projectplanning #SQL #PostgreSQL #PostGIS #gis #spatial #mapping #datavalidation #requirements #businessrules #futureproofing #futureproof #app #development #oldschool

Data Manipulation Initial Planning Is A Crucial Aspect Of Any Project, & It's One Of My Favourite Parts!

I still prefer to do this phase 'old school', with a large piece of (portable) paper, pencil, and eraser, revisiting and adjusting as needed, often the next day as it has percolated overnight...
During this phase, I list constraints, data validation needs, design a broad framework, and determine interactions while trying to future-proof as much as possible. I bring in my requirements and questions from my initial JIRA ticket(s) - and then use these to develop and evolve business rules, along with a process diagram construction.
From there, it's all on to SQL and manual testing in PostgreSQL + PostGIS and finally prototype app construction - for the devs to then take and make it work fast and well!
#datamanipulation #projectplanning #SQL #PostgreSQL #PostGIS #gis #spatial #mapping #datavalidation #requirements #businessrules #futureproofing #futureproof #app #development #oldschool

Data Manipulation Initial Planning Is A Crucial Aspect Of Any Project, & It's One Of My Favourite Parts!

I still prefer to do this phase 'old school', with a large piece of (portable) paper, pencil, and eraser, revisiting and adjusting as needed, often the next day as it has percolated overnight...
During this phase, I list constraints, data validation needs, design a broad framework, and determine interactions while trying to future-proof as much as possible. I bring in my requirements and questions from my initial JIRA ticket(s) - and then use these to develop and evolve business rules, along with a process diagram construction.
From there, it's all on to SQL and manual testing in PostgreSQL + PostGIS and finally prototype app construction - for the devs to then take and make it work fast and well!
#datamanipulation #projectplanning #SQL #PostgreSQL #PostGIS #gis #spatial #mapping #datavalidation #requirements #businessrules #futureproofing #futureproof #app #development #oldschool

Data Manipulation Initial Planning Is A Crucial Aspect Of Any Project, & It's One Of My Favourite Parts!

I still prefer to do this phase 'old school', with a large piece of (portable) paper, pencil, and eraser, revisiting and adjusting as needed, often the next day as it has percolated overnight...
During this phase, I list constraints, data validation needs, design a broad framework, and determine interactions while trying to future-proof as much as possible. I bring in my requirements and questions from my initial JIRA ticket(s) - and then use these to develop and evolve business rules, along with a process diagram construction.
From there, it's all on to SQL and manual testing in PostgreSQL + PostGIS and finally prototype app construction - for the devs to then take and make it work fast and well!
#datamanipulation #projectplanning #SQL #PostgreSQL #PostGIS #gis #spatial #mapping #datavalidation #requirements #businessrules #futureproofing #futureproof #app #development #oldschool

Introduction

From OSM Beginner to Validation Fellow

Fellowship Experience:

My Learnings:

My Achievement

📣 Announcing #Elixir Drops 0.2.0 with support for custom types! 🎉

#MyElixirStatus #OpenSource #ElixirLibrary #DataValidation #Validation #JSON #Schemas

https://solnic.dev/elixir-drops-020-with-support-for-custom-types-was-released

Introduction

From OSM Beginner to Validation Fellow

Fellowship Experience:

My Learnings:

My Achievement

Introduction

From OSM Beginner to Validation Fellow

Fellowship Experience:

My Learnings:

My Achievement

Introduction

From OSM Beginner to Validation Fellow

Fellowship Experience:

My Learnings:

My Achievement

Introduction

From OSM Beginner to Validation Fellow

Fellowship Experience:

My Learnings:

My Achievement

RT Samuel Colvin #samue_lcolvin

I'VE MERGED THE MONSTER.🚀

After 7 weeks work, +7,782 −11,105 changes; the main switch in #pydantic to use #pydantic_core is merged.

It should now be much easier for others to contribute to the effort to get pydantic V2 out. 🙏

#datavalidation #dataparsing #python #typeannotations #rust

https://github.com/pydantic/pydantic/pull/4516

RT Samuel Colvin #samue_lcolvin

I'VE MERGED THE MONSTER.🚀

After 7 weeks work, +7,782 −11,105 changes; the main switch in #pydantic to use #pydantic_core is merged.

It should now be much easier for others to contribute to the effort to get pydantic V2 out. 🙏

#datavalidation #dataparsing #python #typeannotations #rust

https://github.com/pydantic/pydantic/pull/4516

RT Samuel Colvin #samue_lcolvin

I'VE MERGED THE MONSTER.🚀

After 7 weeks work, +7,782 −11,105 changes; the main switch in #pydantic to use #pydantic_core is merged.

It should now be much easier for others to contribute to the effort to get pydantic V2 out. 🙏

#datavalidation #dataparsing #python #typeannotations #rust

https://github.com/pydantic/pydantic/pull/4516

RT Samuel Colvin #samue_lcolvin

I'VE MERGED THE MONSTER.🚀

After 7 weeks work, +7,782 −11,105 changes; the main switch in #pydantic to use #pydantic_core is merged.

It should now be much easier for others to contribute to the effort to get pydantic V2 out. 🙏

#datavalidation #dataparsing #python #typeannotations #rust

https://github.com/pydantic/pydantic/pull/4516

RT Samuel Colvin #samue_lcolvin

I'VE MERGED THE MONSTER.🚀

After 7 weeks work, +7,782 −11,105 changes; the main switch in #pydantic to use #pydantic_core is merged.

It should now be much easier for others to contribute to the effort to get pydantic V2 out. 🙏

#datavalidation #dataparsing #python #typeannotations #rust

https://github.com/pydantic/pydantic/pull/4516

A flight to “‘; drop table flights;” anyone? Maybe a lay-over in “💩”? 🤣. #DataValidation #SloppyCode https://www.bbc.co.uk/news/uk-66644369