There are 2 posts filed in Linux administration (this is page 1 of 1).
This is just some notes for myself that may be useful for other people.
Scenario: As a server administrator I want to keep the backups secure so only myself can restore them.
OSX hostname: earth.local
Ubuntu Server hostname: mars.local
I want to load the following dataset Education statics from the world bank into MySQL to generate some reports without using phpmyadmin.
Let’s introduce this dataset:
|
1 2 3 4 5 6 |
374B Sep 11 15:24 .. 44K Sep 10 14:52 EDStat_Country-Series.csv 123K Sep 10 14:51 EDStat_Country.csv 156M Sep 10 14:49 EDStat_Data.csv 33M Sep 10 14:52 EDStat_FootNote.csv 2.7M Sep 10 14:50 EDStat_Series.csv |
The biggest CSV file it is 156MB so I can not use phpmyadmin or MysqlWorkbench another reason to do not use that kind of tools is to be able to automate the process of data loading. I can use mysql LOAD DATA INFILE but then I have to provide the table with the right structure.
In this scenario I choose a python package called csvkit that allow me to transform between different data formats to SQL and insert it into the database. Continue reading
