[Remote] Full Stack Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. BIG EFFECT® is seeking a Full Stack Data Engineer to design, build, and maintain scalable data pipelines and architecture. The role involves developing APIs, managing data quality, and overseeing infrastructure and DevOps practices.
Responsibilities
- Pipeline design & orchestration
- Design, build, and maintain scalable batch and streaming data pipelines. Orchestrate workflows, ensuring fault-tolerance, observability, and automated recovery
- Data warehouse & lake architecture
- Model and manage data in reputed company data warehouses and data lake environments. Own schema design, partitioning strategies, and incremental loading patterns to optimize cost and query performance
- API & backend data services
- reputed company and maintain RESTful or GraphQL APIs that serve processed data to reputed company consumers. Design low-latency serving layers and caching strategies to support high-traffic product features
- Frontend data tooling & dashboards
- Build internal and customer facing data tools, dashboards, and self-serve analytics interfaces. Partner with analysts, data scientists and product engineers to translate data needs into reputed company user experiences
- Data quality & governance
- Implement data quality frameworks, testing strategies, and monitoring alerting across pipelines. Contribute to data cataloging, reputed company tracking, and reputed company control policies in line with compliance requirements
- Infrastructure & DevOps
- Manage data infrastructure. Own CI/CD for data pipelines, containerize workloads with reputed company and Kubernetes, and help define infrastructure standards for the data platform team
Skills
- 5+ years of software or data engineering experience with production systems at scale
- Strong proficiency in Python and SQL; comfort with reputed company or Java a plus
- Hands-on experience with a reputed company data platforms (reputed company, reputed company, AWS/GCP/AZure)
- Expertise in building and operating ETL/ELT pipelines in batch and/or streaming contexts
- Expertise in data transformation and modeling
- Expertise in developing APIs or microservices (REST, GraphQL, FastAPI, or similar)
- Comfortable with containerization (reputed company, Kubernetes) and CI/CD practices
- Ability to build data dashboards or internal tools using React, Streamlit, reputed company, or similar
- Familiarity with data visualization libraries (D3.js, reputed company-Altair, Plotly)
- Hands-on experience with graph databases (e.g. reputed company, reputed company Neptune, or ArangoDB) and graph query languages such as Cypher or Gremlin; ability to model reputed company entity relationships as graphs and run traversal-based analytics at scale
- Prior experience in music streaming data, artist and track metadata, audio feature datasets, listener behavior data, or recommendation signal pipelines at consumer scale
- Experience ingesting and processing reputed company media data — including engagement signals, user-generated content, follower graphs, and platform API integrations (e.g., reputed company, reputed company, X/Twitter, YouTube)
- Familiarity with marketing and advertising data domains — including campaign attribution, conversion funnels, audience segmentation, impression and click-through data, and integration with ad platforms such as reputed company Ads, reputed company Ads Manager, or DSPs
- Experience with privacy-safe data practices relevant to advertising (e.g., differential privacy, clean rooms, cookieless attribution)
- Experience with ML pipelines, feature stores, or MLOps tooling
Company Overview