Experienced Data Engineer
Momentum IO, United States
Job Description
From FinTech and Retail to AI, Health Tech, and Transportation there is virtually no domain or industry that can’t vastly benefit from Data Science. The possibilities that this field offers are almost limitless and Momentum/HTEC is on the lookout for Data Engineers eager to tap into that potential. Some of our success stories in this domain include building a maritime intelligence platform, an AI-powered expert search engine, a data platform that leverages Lakehouse architecture, and many more. If you would like to become a part of our team, check out the description below and apply.
This is a remote position. However, you must be available during working hours EST or PST, aligned with our New York or Silicon Valley offices. Working out of one of our offices is also a possibility. We are looking for FTE. Travel to customer or other work-related locations is expected and is expected to be lt;20%.
Requirements
Key responsibilities:
- Designing and implementing systems that depend on diverse data sources
- Designing and implementing data processing pipelines and ETL processes
- Designing and implementing fault-tolerant workflows
- Scheduling and planning of job executions
- Understanding and advocating the importance of high data accuracy throughout the system
- Spreading the culture of maintaining high data quality to support building data-driven products
- Making informed decisions about storage systems when designing and implementing data engineering/warehousing solutions
Required qualifications:
- In-depth knowledge of at least one big data processing framework (preferably Spark)
- Knowledge of ETL principles
- Experience with SQL and concepts of Data Warehousing
- Experience with at least one of the following: Scala, Java, or Python
- Experience with cloud computing and serverless paradigms, building data processing pipelines, and complex workflows
- Experience with streaming technologies
- Knowledge of Unix-like operating systems
- English language proficiency
Nice to have:
- Strong knowledge of relational and non-relational databases
- Experience with streaming technologies
- Experience with workflow scheduling and/or specific job scheduling tools
- Experience with CQRS and event sourcing approaches
- Experience with distributed storage and distributed computing
- Experience with virtualization and containerized applications (Docker, Kubernetes)
- A desire to build valuable data assets and help business decision-makers
Benefits
You get to shape the products of the future, your actionable insights drive key business decisions, and better product experiences globally for the millions, if not billions, that our work touches. Start-ups, scale-ups, unicorns, and $b companies all need your insights. No year is the same.
The Perks
- Core ContributionSmall team means big impact. Every team member’s contribution has a tremendous impact on the project and our clients
- AutonomyOur staff own their work, and you will have autonomy over how to get it done
- Project DiversityIn a months span, you may work on the next mobile social network, internet of things product, ad platform, or financial services product
- Occasional travel to clients from around the world, we often conduct our project kick-offs on-site.
- Competitive salary amp; benefits!