#pythonpandas — Public Fediverse posts

Setting Up a Python 3.10 Virtual Environment with Pyenv and PyO3 on Macbook pro Silicon M1: A Step-by-Step Guide
In preparation for the PyData Amsterdam 2024 workshop on writing Python modules in Rust, I set up my development environment to ensure smooth sailing. If you
https://www.hylkerozema.nl/2024/09/17/setting-up-a-python-3-10-virtual-environment-with-pyenv-and-pyo3-on-macbook-pro-silicon-m1-a-step-by-step-guide/
#PythonPandas #PyDataAmsterdam2024 #pyenv #pyenvvirtualenv #pyo3 #Rust

Setting Up a Python 3.10 Virtual Environment with Pyenv and PyO3 on Macbook pro Silicon M1: A Step-by-Step Guide
In preparation for the PyData Amsterdam 2024 workshop on writing Python modules in Rust, I set up my development environment to ensure smooth sailing. If you
https://www.hylkerozema.nl/2024/09/17/setting-up-a-python-3-10-virtual-environment-with-pyenv-and-pyo3-on-macbook-pro-silicon-m1-a-step-by-step-guide/
#PythonPandas #PyDataAmsterdam2024 #pyenv #pyenvvirtualenv #pyo3 #Rust

Unlock the power of financial data analysis with Python Pandas! Learn essential techniques for inspecting stock market data, understanding data structures, and generating key statistics. #FinancialAnalysis #PythonPandas #DataScience

https://teguhteja.id/mastering-financial-data-analysis-python-pandas/

Unlock the power of financial data analysis with Python Pandas! Learn essential techniques for inspecting stock market data, understanding data structures, and generating key statistics. #FinancialAnalysis #PythonPandas #DataScience

https://teguhteja.id/mastering-financial-data-analysis-python-pandas/

Setting Up a Python Streamlit Environment on a Synology NAS
In this post, I will walk you through the process of setting up an environment for running Python Streamlit scripts on a Synology NAS as part of my exper
https://www.hylkerozema.nl/2024/05/26/setting-up-a-python-streamlit-environment-on-a-synology-nas/
#Database #LiveUpdates #PythonPandas #BashScripting #DataEngineer #DevOpsEngineer #mongodb #NAS #PackageManagement #Python #SSH #SSHManagement #Streamlit #Synology #SystemEngineer

Setting Up a Python Streamlit Environment on a Synology NAS
In this post, I will walk you through the process of setting up an environment for running Python Streamlit scripts on a Synology NAS as part of my exper
https://www.hylkerozema.nl/2024/05/26/setting-up-a-python-streamlit-environment-on-a-synology-nas/
#Database #LiveUpdates #PythonPandas #BashScripting #DataEngineer #DevOpsEngineer #mongodb #NAS #PackageManagement #Python #SSH #SSHManagement #Streamlit #Synology #SystemEngineer

Raspberry Pi controlled kiln (part 2)
In my previous post on making a raspberry pi controlled kiln I reached the point with a script running on my Raspberry PI to measure the temperature and manually switch on and off the kiln. On a first attempt I wasn't able to make the master repo
https://www.hylkerozema.nl/2024/05/04/raspberry-pi-controlled-kiln-part-2/
#Ceramic #LiveUpdates #PythonPandas #blinka #ceramic #kilncontroller #MAX31856 #Python #raspberrypi #Solidstaterelay #thermocouple

Raspberry Pi controlled kiln (part 2)
In my previous post on making a raspberry pi controlled kiln I reached the point with a script running on my Raspberry PI to measure the temperature and manually switch on and off the kiln. On a first attempt I wasn't able to make the master repo
https://www.hylkerozema.nl/2024/05/04/raspberry-pi-controlled-kiln-part-2/
#Ceramic #LiveUpdates #PythonPandas #blinka #ceramic #kilncontroller #MAX31856 #Python #raspberrypi #Solidstaterelay #thermocouple

I need to make a fixed-width text file from a Pandas DataFrame.

I followed a suggestion to use to_string method. I built out my solution only to find it adds a space between the columns in the output. A fixed-width file means each column must be an exact number of characters. I literally can't make the file I need with to_string.

Making a fixed-width text file is a very easy task in SAS. Trying to do this with Pandas has been extremely frustrating.

#PythonPandas #SASProgramming

I need to make a fixed-width text file from a Pandas DataFrame.

I followed a suggestion to use to_string method. I built out my solution only to find it adds a space between the columns in the output. A fixed-width file means each column must be an exact number of characters. I literally can't make the file I need with to_string.

Making a fixed-width text file is a very easy task in SAS. Trying to do this with Pandas has been extremely frustrating.

#PythonPandas #SASProgramming

Okay this is kind of absurd but I guess a learning experience. Merging lots of data in #Python using #PythonPandas and a couple hundred frames in, it slows to a crawl. 15+ min and I abort.

Instead do batch processing of a hundred files a piece, then merge the resulting Parquet files again. Less than five minutes.

#TIL

Okay this is kind of absurd but I guess a learning experience. Merging lots of data in #Python using #PythonPandas and a couple hundred frames in, it slows to a crawl. 15+ min and I abort.

Instead do batch processing of a hundred files a piece, then merge the resulting Parquet files again. Less than five minutes.

#TIL