Python Read Parquet File
Read Parquet file and write it to an SQL or ClickHouse database.
# Linux/macOS
python3 -m venv venv
source venv/bin/activate
# Windows
python -m venv venv
venv\Scripts\activate
# Conda
conda create --name myenv python=3.11
conda activate myenv
pip install pandas pyarrow sqlalchemy
For ClickHouse:
pip install clickhouse-connect
Update config.py
file. Keep parquet
or any gz.parquet
files in the data
directory.
python read.py
python write.py
python query.py