#datawrangling — Public Fediverse posts

Missing [Survey, etc] Data Can Be A Geographic Phenomenon
--
https://doi.org/10.1080/24694452.2026.2640220 <-- shared paper
--
#GIS #mapping #spatial #DataScience #missing #data #spatial #AAG #autocorrelation #geographicallyweightedregression #GWR #imputation #missingdata #survey #surveynonresponse #incomplete #surveyquestions #ethnicity #income #spatialdata #alldataisspatial #UK #FinancialLives #geography #spatialanalysis #geostatistics #location #imputing #statistics #dataset #DataImputation #MissingData #DataCleaning #DataPreprocessing #DataWrangling #DataQuality #DataEngineering #FinancialData #FinancialAnalytics #FinincialModeling #FinDataScience

Missing [Survey, etc] Data Can Be A Geographic Phenomenon
--
https://doi.org/10.1080/24694452.2026.2640220 <-- shared paper
--
#GIS #mapping #spatial #DataScience #missing #data #spatial #AAG #autocorrelation #geographicallyweightedregression #GWR #imputation #missingdata #survey #surveynonresponse #incomplete #surveyquestions #ethnicity #income #spatialdata #alldataisspatial #UK #FinancialLives #geography #spatialanalysis #geostatistics #location #imputing #statistics #dataset #DataImputation #MissingData #DataCleaning #DataPreprocessing #DataWrangling #DataQuality #DataEngineering #FinancialData #FinancialAnalytics #FinincialModeling #FinDataScience

Missing [Survey, etc] Data Can Be A Geographic Phenomenon
--
https://doi.org/10.1080/24694452.2026.2640220 <-- shared paper
--
#GIS #mapping #spatial #DataScience #missing #data #spatial #AAG #autocorrelation #geographicallyweightedregression #GWR #imputation #missingdata #survey #surveynonresponse #incomplete #surveyquestions #ethnicity #income #spatialdata #alldataisspatial #UK #FinancialLives #geography #spatialanalysis #geostatistics #location #imputing #statistics #dataset #DataImputation #MissingData #DataCleaning #DataPreprocessing #DataWrangling #DataQuality #DataEngineering #FinancialData #FinancialAnalytics #FinincialModeling #FinDataScience

Missing [Survey, etc] Data Can Be A Geographic Phenomenon
--
https://doi.org/10.1080/24694452.2026.2640220 <-- shared paper
--
#GIS #mapping #spatial #DataScience #missing #data #spatial #AAG #autocorrelation #geographicallyweightedregression #GWR #imputation #missingdata #survey #surveynonresponse #incomplete #surveyquestions #ethnicity #income #spatialdata #alldataisspatial #UK #FinancialLives #geography #spatialanalysis #geostatistics #location #imputing #statistics #dataset #DataImputation #MissingData #DataCleaning #DataPreprocessing #DataWrangling #DataQuality #DataEngineering #FinancialData #FinancialAnalytics #FinincialModeling #FinDataScience

Missing [Survey, etc] Data Can Be A Geographic Phenomenon
--
https://doi.org/10.1080/24694452.2026.2640220 <-- shared paper
--
#GIS #mapping #spatial #DataScience #missing #data #spatial #AAG #autocorrelation #geographicallyweightedregression #GWR #imputation #missingdata #survey #surveynonresponse #incomplete #surveyquestions #ethnicity #income #spatialdata #alldataisspatial #UK #FinancialLives #geography #spatialanalysis #geostatistics #location #imputing #statistics #dataset #DataImputation #MissingData #DataCleaning #DataPreprocessing #DataWrangling #DataQuality #DataEngineering #FinancialData #FinancialAnalytics #FinincialModeling #FinDataScience

I'm reviewing the content and computational skills taught in a Research Data Skills module.
#data #DataWrangling

Apparently my knowledge of perl is pretty outdated nowadays.
#perl #perl4datascience

But am I crazy to want to teach them to use the *nix command line, and grep, awk and sed???
#DataScience #ChangeMyMind

I'm reviewing the content and computational skills taught in a Research Data Skills module.
#data #DataWrangling

Apparently my knowledge of perl is pretty outdated nowadays.
#perl #perl4datascience

But am I crazy to want to teach them to use the *nix command line, and grep, awk and sed???
#DataScience #ChangeMyMind

I'm reviewing the content and computational skills taught in a Research Data Skills module.
#data #DataWrangling

Apparently my knowledge of perl is pretty outdated nowadays.
#perl #perl4datascience

But am I crazy to want to teach them to use the *nix command line, and grep, awk and sed???
#DataScience #ChangeMyMind

I'm reviewing the content and computational skills taught in a Research Data Skills module.
#data #DataWrangling

Apparently my knowledge of perl is pretty outdated nowadays.
#perl #perl4datascience

But am I crazy to want to teach them to use the *nix command line, and grep, awk and sed???
#DataScience #ChangeMyMind

I'm reviewing the content and computational skills taught in a Research Data Skills module.
#data #DataWrangling

Apparently my knowledge of perl is pretty outdated nowadays.
#perl #perl4datascience

But am I crazy to want to teach them to use the *nix command line, and grep, awk and sed???
#DataScience #ChangeMyMind

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Turns out, quick coding tasks are not actually quick but can eat up all day. Who would have thought... Not me, apparently... And why is this model so slow? #R #stats #DataWrangling

Turns out, quick coding tasks are not actually quick but can eat up all day. Who would have thought... Not me, apparently... And why is this model so slow? #R #stats #DataWrangling

Turns out, quick coding tasks are not actually quick but can eat up all day. Who would have thought... Not me, apparently... And why is this model so slow? #R #stats #DataWrangling

These six Pandas functions power most data wrangling: read_csv to load data, info to inspect, isnull for missing values, drop to clean, groupby to summarize, and apply to customize logic. Master these and you control your dataset.

📕 https://ebokify.com/python

#Python #Pandas #DataWrangling #DataAnalytics #MachineLearning #DataScience #CodingTips

These six Pandas functions power most data wrangling: read_csv to load data, info to inspect, isnull for missing values, drop to clean, groupby to summarize, and apply to customize logic. Master these and you control your dataset.

📕 https://ebokify.com/python

#Python #Pandas #DataWrangling #DataAnalytics #MachineLearning #DataScience #CodingTips

These six Pandas functions power most data wrangling: read_csv to load data, info to inspect, isnull for missing values, drop to clean, groupby to summarize, and apply to customize logic. Master these and you control your dataset.

📕 https://ebokify.com/python

#Python #Pandas #DataWrangling #DataAnalytics #MachineLearning #DataScience #CodingTips

These six Pandas functions power most data wrangling: read_csv to load data, info to inspect, isnull for missing values, drop to clean, groupby to summarize, and apply to customize logic. Master these and you control your dataset.

📕 https://ebokify.com/python

#Python #Pandas #DataWrangling #DataAnalytics #MachineLearning #DataScience #CodingTips

These six Pandas functions power most data wrangling: read_csv to load data, info to inspect, isnull for missing values, drop to clean, groupby to summarize, and apply to customize logic. Master these and you control your dataset.

📕 https://ebokify.com/python

#Python #Pandas #DataWrangling #DataAnalytics #MachineLearning #DataScience #CodingTips

#TIL about #querychat (https://posit-dev.github.io/querychat/), it is simply amazing to get quickly a #Shiny app that allows people to explore data using a chatbot interface. There are #Python and #RStats implementations.

#LLM #AI #Data #EDA #DataWrangling

#TIL about #querychat (https://posit-dev.github.io/querychat/), it is simply amazing to get quickly a #Shiny app that allows people to explore data using a chatbot interface. There are #Python and #RStats implementations.

#LLM #AI #Data #EDA #DataWrangling

#TIL about #querychat (https://posit-dev.github.io/querychat/), it is simply amazing to get quickly a #Shiny app that allows people to explore data using a chatbot interface. There are #Python and #RStats implementations.

#LLM #AI #Data #EDA #DataWrangling

#TIL about #querychat (https://posit-dev.github.io/querychat/), it is simply amazing to get quickly a #Shiny app that allows people to explore data using a chatbot interface. There are #Python and #RStats implementations.

#LLM #AI #Data #EDA #DataWrangling

#TIL about #querychat (https://posit-dev.github.io/querychat/), it is simply amazing to get quickly a #Shiny app that allows people to explore data using a chatbot interface. There are #Python and #RStats implementations.

#LLM #AI #Data #EDA #DataWrangling

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

Say goodbye to the frustrations of copying and pasting data to and from R with Datapasta from @milesmcbain! Get the package now: https://milesmcbain.github.io/datapasta/ #DataWrangling #Rstats

@datadon

Unfilled cells influence models.
"Handling Missing Data in Machine Learning": https://ml-nn.eu/a1/51.html by Calin Sandu @mlnn

#missingData #bias #wealth #dataQuality #complexity #dataDev #machineLearning #dataPrep #EDA #dataWrangling

Turning NASA Wake-up Calls into data

by @beet_keeper

For a while back then I was into space flight again. Scientists, science communicators, and engineers were all excited for a new era of rocket launches and the potential unification of the human race as we look towards the future.

During that time I discovered Colin Fries’ work in the NASA History Division to document all NASA “Wake-up calls”. A wake-up call is simply a piece of music used to wake astronauts on missions, a different piece of music, daily, for the duration of the flight.

Take, for example, the last Space Shuttle mission (Space Transportation System) STS-135; it was in flight for 13 days, and the wake-up call on day one was Coldplay’s Viva la Vida, while on day 13 it was Kate Smith singing God Bless America.

As a huge music buff who has the radio or music television on 18 hours a day, I really wanted to delve into this further. While Colin’s work is great, it’s just a PDF file (@wtfpdf). A PDF is not an ideal file format for querying data and gleaning new insights. So, while I wanted to explore it, I first decided to turn it into a true dataset. The result was a set of resources, a website, a JSON, a CSV, and an SQLite database which are each more functional and more maintainable over time.

Lets take a look at the results and https://nasawakeupcalls.github.io below!

#ApacheTika #Code #Coding #DataWrangling #Datasette #DatasetteLite #DH #DigitalHumanities #glam #harkive #NASA #NASAWakeUpCall #NASAWakeUpCalls #OpenData #PersonalProjects #Science #Space #SpaceHistory #Twitter #WakeUpCall

It's not hard to bill-lief that our technically-inclined volunteers stay afloat using @duckdb.org for their #DataWrangling needs

It's not hard to bill-lief that our technically-inclined volunteers stay afloat using @duckdb.org for their #DataWrangling needs

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Sometimes you get data in less than optimal format, e.g. as a png of a figure 😭... In that case https://cran.r-project.org/web/packages/metaDigitise/vignettes/metaDigitise.html might be the rescue. #rstats #ohno #datawrangling

Turning NASA Wake-up Calls into data

by @beet_keeper

For a while back then I was into space flight again. Scientists, science communicators, and engineers were all excited for a new era of rocket launches and the potential unification of the human race as we look towards the future.

During that time I discovered Colin Fries’ work in the NASA History Division to document all NASA “Wake-up calls”. A wake-up call is simply a piece of music used to wake astronauts on missions, a different piece of music, daily, for the duration of the flight.

Take, for example, the last Space Shuttle mission (Space Transportation System) STS-135; it was in flight for 13 days, and the wake-up call on day one was Coldplay’s Viva la Vida, while on day 13 it was Kate Smith singing God Bless America.

As a huge music buff who has the radio or music television on 18 hours a day, I really wanted to delve into this further. While Colin’s work is great, it’s just a PDF file (@wtfpdf). A PDF is not an ideal file format for querying data and gleaning new insights. So, while I wanted to explore it, I first decided to turn it into a true dataset. The result was a set of resources, a website, a JSON, a CSV, and an SQLite database which are each more functional and more maintainable over time.

Lets take a look at the results and https://nasawakeupcalls.github.io below!

#ApacheTika #Code #Coding #DataWrangling #Datasette #DatasetteLite #DH #DigitalHumanities #glam #harkive #NASA #NASAWakeUpCall #NASAWakeUpCalls #OpenData #PersonalProjects #Science #Space #SpaceHistory #Twitter #WakeUpCall