CSV

• Splitting CSV file
• Remove duplicates

Splitting CSV file

Splits the provided file into parts with chunk size.

Script: split-csv.py

Usage:

python split-csv.py <csv_file_path> <rows_per_file>

Example:

python split-csv.py file.csv 10000

Remove duplicates

Generates a new file without duplicates, but keeps empty cells.

Script: rdups.py

Usage:

python rdups.py <csv_file_path> <column_name>

Example:

python rdups.py /path/to/file.csv "phone number"