Big Data Engineer : Dell Job at ShiftCode Analytics, Austin, TX

Nkw5ak1OUTNhR0xSNlpESVl2dXdTRkVWRVE9PQ==
  • ShiftCode Analytics
  • Austin, TX

Job Description

Interview : Video

Visa : All apart from H1b , cpt and TN

This is hybrid from day-1.

Description :

Requirements:
  • 5+ years' experience in data engineering work
  • Previous experience as a Big Data Engineer
  • In-depth knowledge of Hadoop, Spark, Airflow
  • Technical expertise with data models, data mining, and segmentation techniques
  • Hands-on experience with SQL database, Redis
  • Familiarity with Kubernetes and Docker tools
  • Familiarity with S3, Apache Parquet and Apache Iceberg
  • Understand how to extract data
  • Experience with Graph databases
  • Knowledge of programming languages (e.g. Python)
  • Experience with Streaming - Kafka or RMQ
  • Experience with Gitlab based CI/CD
  • Experience with Data catalog

Added advantage:
  • AI/Client Engineer
  • Client Pipelines

Responsibilities:
  • Analyze and organize raw data
  • Build data systems and pipelines
  • Interpret trends and patterns in enterprise data
  • Conduct complex data analysis and report on results
  • Prepare data for prescriptive and predictive modeling
  • Combine raw information from different sources
  • Explore ways to enhance data quality and reliability
  • Identify opportunities for data acquisition
  • Collaborate with data scientists and architects on several projects
  • Work independently with different data owners and design data flows

Job Tags

H1b,

Similar Jobs

SLAM

Construction Management - Project Manager Job at SLAM

 ...The S/L/A/M Collaborative is searching for a Project Manager to join our Construction Management & Design Build Team in Glastonbury, CT to manage construction projects from the preconstruction phase through its completion. This position is responsible for ensuring... 

In House Jobs | JDHuntr

In House Counsel Jobs California | JDHuntr 53749 Assistant General Counsel, Sports, New York, NY Job at In House Jobs | JDHuntr

 ...Counsel Jobs California | JDHuntr 53749 Assistant General Counsel, Sports, New York, NY To apply go to JDHuntr.com *Administration...  ...jobs, legal jobs Los Angeles, legal jobs New York, legal jobs, law jobs, corporate counsel jobs, corporate lawyer jobs, lawyer jobs... 

Next City

Policy Analyst Job at Next City

 ...Job Title: Policy Analyst Anticipated Start Date: January, 2025 Employment Type: Full-time (average of 40+ hours per week) Location...  ...Group emphasizes teamwork and encourages collaboration at all levels. As such, an employees willingness to work in-office will be... 

Motion Recruitment Partners LLC

Senior Embedded Software Engineer Job at Motion Recruitment Partners LLC

The opportunity pertains to a full-time Senior Embedded Software Engineer role based out of Roanoke, VA. Applicants should have extensive experience in C, C++, along with Python. The ideal candidate is one that has a top-secret clearance or the eligibility to obtain one... 

Fidelity Investments

Principal UX Accessibility Specialist Job at Fidelity Investments

 ...Job Description: Role Overview As a Principal UX Accessibility Specialist, you will help Fidelity Investments centralized User Experience Design (UXD) organization to shape its UX accessibility strategy and practice for its customer-facing web, mobile...