Data Engineer/Web Scraper

VALUES VALUE, the main expert in game dev is looking for a Data Engineer for one of the clients.

Our client is a new-generation games partner for top independent development studios, with a focus on the rapidly growing mobile and tablet markets. The company empowers elite developers with expert resources, operational support, and funding to give carefully selected games mainstream success.

You will work on collecting, storing, processing, and analyzing huge sets of data. The primary focus will be to oversee the extraction and transformation of web data for ingestion in the company's data store. You will work with Spark-based ETL/pipelines and Airflow. You will interface with various internal teams to understand their data needs and provide high-quality data and insights which drive business value.

На які завдання (обов'язки)?

• Work with data analysts, game producers, and customer service to help extract data from websites for analysis and machine learning

• Design, implement, maintain and improve ETL/DDL processes

• Work with various internal teams to satisfy analytical needs by building both large systematic reports and small custom pieces
  Build data expertise and own data quality for a variety of products

Якого професіонала шукаємо?

• Minimum bachelor’s in Computer Science;

• You are fluent in English (written and oral), additional languages a plus;

• Proficient with Mac/Linux programming environment;

• 2+ years of experience with Python and SQL;

• Excellent knowledge of HTML/JS, JQuery, and XPath;

• Working experience with web scraping frameworks like Scrapy;

• Ability to collaborate with colleagues across different disciplines/locations.

Nice to have:

• Spark/Databricks experience;

• Experience with Apache Airflow;

• Comfortable with AWS cloud (S3, EC2, Redshift, EKS(Kubernetes));

• Knowledge of streaming platforms (Kafka, Kinesis);

• Knowledge of existing third party analytics visualization software (Amplitude, Looker, Tableau);

• Experience in a free-2-play mobile game company is a definite plus.

Чому у нас приємно працювати?

• Startup environment — where each individual makes a large impact;

• Ability to own technical direction of various products and systems;

• Work with great people on great games that reach millions of people each month;

• Competitive compensation and benefits package.