Data Engineer Job at VDart Inc, New York, NY

Njd0Z010VTFiV2ZVNDVuQmF2ZTFSRjhWRlE9PQ==
  • VDart Inc
  • New York, NY

Job Description

Job Role: Data Engineer

Job Location: Dallas, TX & NYC, NY

Experience: Max 8 Years

Job type : Fulltime

Skills: SQL, Tableau, Python , Databricks , ETL Pipeline

Job Responsibilities

  • Design, develop & implement ETL processes on Azure/AWS Cloud using Databricks and PySpark.
  • Advanced SQL knowledge, capable to write optimized queries for faster data workflows.
  • Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.
  • Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies, and best practices.
  • Experience with handling Realtime, Change Data Feed and Unstructured data is a plus.

Qualification:

  • Bachelor's degree or master's degree in computer science.
  • Proven work experience in Databricks, Spark, Python, SQL, Any RDBMS.
  • Experience with handling Realtime, Change Data Feed and Unstructured data is a plus.
  • Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS.
  • Strong database fundamentals including SQL, performance, and schema design.
  • Understanding of CI/CD framework is an added advantage.
  • Ability to interpret/write custom shell scripts. Python scripting is a plus.
  • Experience with Azure platform and data bricks/similar platform
  • Experience with Git / Azure DevOps
  • To be able to work in a fast-paced agile development environment

Job Tags

Full time, Work experience placement,

Similar Jobs

Medisys Health Network, Inc.

Epic Rehab System Analyst Job at Medisys Health Network, Inc.

 ...Job Description Epic System Analyst (Rehab) The Clinical Systems Analyst - Rehab will be responsible for implementing/developing Epic and related applications. This position will develop, implement, manage and provide ongoing support for clinical information... 

Veterans Affairs, Veterans Health Administration

Transportation Assistant Job at Veterans Affairs, Veterans Health Administration

 ..., budget and maintain consistence in fleet services using the CARS program. Assume full management of the vehicle fleet service....  ...Virtual: This is not a virtual position. Position Description/PD#: Transportation Assistant/PD035530 Relocation/Recruitment Incentives: Critical... 

Seminole Gaming

DIGITAL MARKETING SPECIALIST Job at Seminole Gaming

 ...bonus opportunity & much more! Responsibilities The Digital Marketing Specialist will be primarily responsible for developing,...  ...required. Minimum of three (3) years' experience in professional Internet Marketing. Ability to successfully handle extensive... 

ITG Communications, LLC

Utility Locator Job at ITG Communications, LLC

 ...Job Description ITG Communications is hiring an Underground Locator in Lehigh Acres, FL. The Utility Locator is responsible for identifying and marking underground utilities to ensure safe excavation and construction activities. This role uses locating equipment,... 

Sunny Health and Fitness

Fitness App Casting for Personal Trainers, Fitness Instructors, Coaches Job at Sunny Health and Fitness

 ...Requirements: Enthusiastic, outgoing personality. Complies with minimum age limits that may be required locally or by insurance. Good communication and leadership skills. Ability to work well with others. Completes tasks in a professional manner. Creates...