Data Engineer/Web Scraper
VALUES VALUE, Опубликовано 1 месяц назад
На постоянной основе
VALUES VALUE, the main expert in game dev is looking for a Data Engineer for one of the clients.
Our client is a new-generation games partner for top independent development studios, with a focus on the rapidly growing mobile and tablet markets. The company empowers elite developers with expert resources, operational support, and funding to give carefully selected games mainstream success.
You will work on collecting, storing, processing, and analyzing huge sets of data. The primary focus will be to oversee the extraction and transformation of web data for ingestion in the company's data store. You will work with Spark-based ETL/pipelines and Airflow. You will interface with various internal teams to understand their data needs and provide high-quality data and insights which drive business value.
На какие задачи (обязанности)?
Work with data analysts, game producers, and customer service to help extract data from websites for analysis and machine learning
Design, implement, maintain and improve ETL/DDL processes
Work with various internal teams to satisfy analytical needs by building both large systematic reports and small custom pieces
Build data expertise and own data quality for a variety of products
Какого профессионала ищем?
Minimum bachelor’s in Computer Science;
You are fluent in English (written and oral), additional languages a plus;
Proficient with Mac/Linux programming environment;
2+ years of experience with Python and SQL;
Excellent knowledge of HTML/JS, JQuery, and XPath;
Working experience with web scraping frameworks like Scrapy;
Ability to collaborate with colleagues across different disciplines/locations.
Nice to have:
Experience with Apache Airflow;
Comfortable with AWS cloud (S3, EC2, Redshift, EKS(Kubernetes));
Knowledge of streaming platforms (Kafka, Kinesis);
Knowledge of existing third party analytics visualization software (Amplitude, Looker, Tableau);
Experience in a free-2-play mobile game company is a definite plus.
Почему у нас приятно работать?
Startup environment — where each individual makes a large impact;
Ability to own technical direction of various products and systems;
Work with great people on great games that reach millions of people each month;
Competitive compensation and benefits package.