For the access and storage of data access, as well as the establishment of post statistical analysis database storage process, the development of scripts in the server. Related project completed:
1. Based on the construction of Clouder Manager on contos7 and the construction of HADOOP, HIVE, and SPARK on the Clouder Manager platform, debugging, maintenance.
2. The modification of the statistical analysis process and data cleaning process in the MySQL database, creating an independent statistical analysis process in subdatabase.
3. Developing some statistical analysis, python script and shell script, and operating Linux system to ensure automation of data processing.
4. The service docking of the third-party platform ensures the progress of data access through communication and negotiation between the two parties, and proofreads the data accessed by the other party, and communicates with the other party in time for different data problems and solves the data quality.
5.Data visualization skills of using powerBI to present data. Report writing and presentation ability.