Job Description

Company Description
Foresiet is an AI-enabled SaaS-based Cybersecurity company that provides a comprehensive solution for Digital Risk Prevention. Leveraging the Cyber Digital Investigator platform, Foresiet proactively detects, monitors, and secures identity, data, and asset threats. Our unique combination of Human Intelligence (HUMINT) and Applied Research (HUMAN+TECHNOLOGY) protects individuals, enterprises, and the Federal Government.
Role Description
The specialist will be responsible for developing and maintaining automation processes.

• Develop and maintain sophisticated web scraping and automation scripts, troubleshooting issues,
• Understanding of CAPTCHA-solving approaches and working with proxy services, anti-blocking strategies: IP rotation, session management, fingerprinting/stealth, polite crawling (rate limiting, backoff), distributed workers & queueing.
• Social Media Scraping
• Integrate scalable captcha handling (human + automated fallbacks) and robust retry logic.
• Make the solution deployable (Docker + orchestration) and include monitoring, logging, and clear operational documentation.
• Creating and executing test cases, and ensuring quality assurance.
• Collaborate with the team to identify automation opportunities and implement solutions.
• Troubleshoot and debug technical issues related to scripts and data extraction.
• Stay updated with the latest trends in web technologies, anti-scraping measures, and AI tools.

Requirements

• Process Automation, Automation skills
• Expert with web scraping libraries and tools such as Beautiful Soup and Scrapy
• Anti Blocking Strategy- Captcha Bypass, IP rotation, session management, fingerprinting/stealth, polite crawling (rate limiting, backoff), distributed workers & queueing.
• Social Media Scraping
• Troubleshooting skills
• Experience with creating and executing Test Cases
• Quality Assurance skills
• Proficiency in Python programming
• Familiarity with web scraping libraries and tools such as Beautiful Soup and Scrapy
• Excellent problem-solving and analytical skills
• Ability to work independently and remotely

Skills Required