Merging Parquet files with Python
source link: https://gist.github.com/l1x/76dab6445b6d55396c622f915c755a17
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
Merging Parquet files with Python · GitHub
Instantly share code, notes, and snippets.
Hi,
How do you explain that when I run this method once it produces a file with a lets say 20kb size.
When I run the same method only the file from the previous run, I got a file which is 10kb size.
The file content is identical, but the schema is different.
Recommend
About Joyk
Aggregate valuable and interesting links.
Joyk means Joy of geeK