Web Scraping Data Engineering Manager

May 9

COMPLY

WebsiteLinkedInAll Job Openings

At COMPLY, we pride ourselves on being the champion for compliance professionals$1. .$1

201 - 500

Description

• Develop and refine advanced web scraping tools and services • Implement comprehensive monitoring systems • Conduct rigorous testing partnering with QA • Lead a team of data engineers • Quickly identify and resolve technical issues • Continuously evaluate and improve scraping processes • Collaborate with cross-functional teams • Ensure timely execution of project deliverables • Proactively stay current with advancements in web scraping technologies

Requirements

• Bachelor’s or higher in Computer science, engineering, analytics, or information technology or similar • 10+ years in data engineering with 2+ years focused on web scraping • 3+ years managing a team • High Proficiency in Python a must • Experience with Celery, RabbitMQ, and Django • Deep knowledge in Scrapy, Beautiful Soup, Selenium or similar framework • Thorough understanding of HTML, CSS, and JavaScript

Benefits

• 11 paid holidays • Generous Accrued Time Off increasing with years of service • Generous paid sick time • Annual day of service