Senior Data Engineer

On behalf of Ciklum Digital, Ciklum is looking for a Senior Data Engineer to join our team on a full-time basis.

You will join a highly motivated team and will be working on a modern solution for our existing client. We are looking for technology experts who want to make an impact on new business by applying best practices and taking ownership.

Responsibilities:

• Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process terabytes of data quickly at big data scales
• Contributes design, code, configurations, manage data ingestion, real time streaming, batch processing, ETL across multiple data storages
• Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
• Responsible for performing performance tuning of complicated SQL queries and Data flows
• Identify gaps and improving the platform’s quality, robustness, maintainability, and speed
• Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members
• Contribute in CoE activities and community building, participate in conferences, provide excellence in exercise and best practices

Requirements:

• 3+ years of experience coding in one of Python or Java, with SQL and solid CS fundamentals including data structure and algorithm design
• 2+ years contributing to production deployments of large backend data processing and analysis systems
• 1+ years of hands-on implementation experience working with a combination of the following technologies: Spark, and NoSQL data warehouses such as Cassandra, ScyllaDB, HBase or Redis, and as a plus Kafka,Hadoop, Map Reduce, Pig, Hive, Impala, Storm, SQL
• 1+ years of experience in cloud data platforms – AWS
• Knowledge of SQL and MPP databases (e.g. Redshift)
• Knowledge of professional software engineering best practices for the full software
• Knowledge of Data Warehousing, design, implementation and optimization
• Knowledge of Data Quality testing, automation and results visualization
• Knowledge of BI reports and dashboards design and implementation
• Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Experience participating in an Agile software development team, e.g. SCRUM
• Experience designing, documenting, and defending designs for key components in large distributed computing systems
• A consistent track record of delivering exceptionally high quality software on large, complex, cross-functional projects
• Demonstrated ability to learn new technologies quickly and independently
• Ability to handle multiple competing priorities in a fast-paced environment
• Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred
• Experience with supporting data scientists and complex statistical usecases highly desirable

Desirable:

• Understanding of cloud infrastructure design and implementation
• Experience in data science and machine learning
• Experience in backend development and deployment
• Experience in CI/CD configuration
• Good knowledge of data analysis in enterprises

Personal skills:

• Collaborative, willing to help, talkative, able to clearly express and discuss ideas
• Curious mind and willingness to work with client in consultative manner to find areas to improve
• Upper-Intermediate or Advanced English
• Good analytical skills
• Good team player, motivated to develop and solve complex tasks
• Self-motivated, self-disciplined and result-oriented
• Strong attention to details and accuracy

What’s in it for you?

• A Centre of Excellence is ultimately a community that allows you to improve yourself and have fun. Our centres of excellence (CoE) bring together all Ciklumers from across the organization to share best practices, support, advice, industry knowledge and to create a strong community
• Close cooperation with client
• Dynamic and challenging tasks
• Ability to influence project technologies
• Projects from scratch
• Team of professionals: learn from colleagues and gain recognition of your skills
• European management style
• Continuous self-improvement

Project description:

Our client is a cutting edge ML & AI imaging company, who want to help the automotive sector and the public sector use data solutions to keep up to date with, e.g., road changes and construction works. They are hiring for their solutions team who will take some of the standard solutions and insights offered by the existing product teams, and customize (e.g. the information being extracted) out for specific vertical requirements.

Technology Stack: Python / Java, Spark, AWS, NoSQL