Develop a parser for the social network LinkedIn
The parser must collect data for all users in a social network and store them in MySQL.
The parser does not have to collect data users who do not have avatars or not the normal name (bots).
The data that must be collected from one profile page:
-Photo (avatar)
-Name (first name last name or username)
-Location (if any)
-Link to profile
Options for connecting to mysql should be moved to a separate property file.
The program should be multi-threaded, number of threads should configured in a separate property file.
If you need to run a proxy servers, you need to make a separate file, which you can write a list of proxy servers.
If you need to run separate accounts, you need to make a separate file, which you can write a list of these accounts for social network.
The database consists of several simple tables. With the agreement to participate in the work, I will send database schema and init-scripts via email.
It does not matter in what language will be written the program, it is important that it runs on linux.
Preferably, that it was written in java.
The result of the work should be a program running that can collect data for all users in a social network for short time.