Job Description

About Interviews Master

We help students prepare for software engineering interviews. We are a rapidly growing stealth mode education/interviews preparation startup.

Activity on Internshala

Hiring since May 2022

10 opportunities posted

About the work from home job/internship

Job description:

1. Gather and process raw data at scale (including writing scripts, web scraping, calling/creating APIs, etc.) from the web/internet
2. Develop the capability to efficiently scrape data from the web from multiple sources
3. Scrape difficult websites by deploying anti-blocking and anti-captcha tools
4. Develop various RestFul APIs & Integrate them with various data sources
5. Develop tools & techniques related to data extraction from web or PDF files and other process automation
6. Develop frameworks for automating and maintaining a constant flow of data from multiple sources
7. Optimize the scraping capability to ensure the data is scrapped efficiently with the minimum usage of server bandwidth

Skill(s) required

CSS Django GitHub HTML Java JSON Linux Microsoft Azure SQL

Learn these skills on Internshala Trainings

Who can apply

Only those candidates can apply who:

1. are available for the work from home job/internship

2. can start the work from home job/internship between 17th Sep'22 and 22nd Oct'22

3. are available for duration of 6 months

4. have relevant skills and interests

Other requirements

1. Bachelor's or master's degree in Computer Science or a related discipline

2. Good experience in web scraping frameworks Scrapy, Selenium, SQLAlchemy, Pandas, Beautiful Soup, or other frameworks and related libraries

3. Experience in creating scrapy spiders for websites with Captcha, IP ban, Geolocation ban, Cloudflare/Imperva firewalls, sites requiring a login to access data, dynamic websites loading through JS/REST API/Graphql, etc.

4. Good knowledge of various Python Libraries, Web Scraping, Automations, APIs, and toolkits

5. Basic understanding of front-end technologies, such as JavaScript, HTML5, and CSS3