Title: Data Engineer <\/b>
<\/b>
<\/div>
Location: Remote <\/b>
Visa Sponsorship: No <\/b>
â<\/b>
Role Summary
<\/b> We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining scalable data infrastructure that drives business intelligence, advanced analytics, and machine learning initiatives. You must be comfortable working autonomously, navigating complex challenges, and driving projects to successful completion in a dynamic cloud environment. <\/span>
<\/div>
Key Responsibilities
<\/b> ⢠Design and Optimization: Design, implement, and optimize clean, well\-structured, and performant analytical datasets to support high\-volume reporting, business analysis, and data science model development. <\/span>
<\/div>
⢠Pipeline Development: Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence, advanced analytics <\/span>
⢠Big Data & Streaming: Implement and support Big Data solutions for both batch (scheduled) and real\-time\/streaming analytics. <\/span>
⢠Collaboration: Work closely with product managers and business teams to understand data requirements and translate them into technical solutions. <\/span>
Required Skills and Experience
<\/b> ⢠Cloud Platform Expertise (GCP Focus): Extensive hands\-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically: <\/span>
<\/div>
? BigQuery: Expert\-level skills in data ingestion, performance optimization, and data modeling within a petabyte\-scale environment. <\/span>
? Experience with other relevant GCP services like Cloud Storage, Cloud Dataflow\/Beam, or Pub\/Sub <\/span>
⢠Programming & Querying: <\/span>
? Python: Expert\-level programming proficiency in Python, including experience with relevant data engineering libraries <\/span>
? SQL: A solid command of advanced SQL for complex querying, data processing, and performance tuning. <\/span>
⢠Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Airflow,Dagster, or similar). <\/span>
⢠DevOps\/CI\/CD: Experience with version control (Git) and familiarity with CI\/CD practices and tools (e.g., GitLab, GitHub Actions) to automate deployment and testing processes. <\/span>
...Administrative Assistant At HDR, our employee-owners are fully engaged in creating a welcoming environment where each of us is valued and... ...experience working on DOT (specifically KYTC) or municipal construction project, including experience working with construction materials...
...Contracts Administrator Associate Apply your expertise to advance the mission and optimize our business strategy as a Contracts Administrator Associate at GDIT. Here, you'll support solving some of our clients' biggest challenges and help us grow the business. At GDIT...
...Commercial Lending Business Analyst Local to MA or New Hampshire. No relocation candidates Required Experience:... ...individual, not necessarily on years of experience. Salesforce and nCino Integration: Salesforce is used for CRM, and nCino...
...Job Description Skyline Med Staff Allied is seeking a travel Certified Occupational Therapy Assistant for a travel job in Willows,... ...free stipend amount to be determined. Posted job title: Therapy:COTA,07:00:00-15:00:00 About Skyline Med Staff Allied Join the Top...
...Thursday.Job Type & LocationThis is a Contract position based out of Atlanta, GA.Pay and... ...to specific elections, plan, or program terms. If eligible, the benefits available for... ...AD&D for the employee and dependents) - Short and long-term disability - Health Spending...