Job Description

Job Role: Data Engineer

Job Location: Dallas, TX & NYC, NY

Experience: Max 8 Years

Job type : Fulltime

Skills: SQL, Tableau, Python , Databricks , ETL Pipeline

Job Responsibilities

Design, develop & implement ETL processes on Azure/AWS Cloud using Databricks and PySpark.
Advanced SQL knowledge, capable to write optimized queries for faster data workflows.
Must be extremely well versed with handling large volume data and work using different tools to derive the required solution.
Work with onshore team, business analysts and other data engineering teams to ensure alignment of requirements, methodologies, and best practices.
Experience with handling Realtime, Change Data Feed and Unstructured data is a plus.

Qualification:

Bachelor's degree or master's degree in computer science.
Proven work experience in Databricks, Spark, Python, SQL, Any RDBMS.
Experience with handling Realtime, Change Data Feed and Unstructured data is a plus.
Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS.
Strong database fundamentals including SQL, performance, and schema design.
Understanding of CI/CD framework is an added advantage.
Ability to interpret/write custom shell scripts. Python scripting is a plus.
Experience with Azure platform and data bricks/similar platform
Experience with Git / Azure DevOps
To be able to work in a fast-paced agile development environment

Job Tags

Full time, Work experience placement,

Similar Jobs

Exemplar Genetics LLC

Director of Veterinary Services Job at Exemplar Genetics LLC

...*Status: Full-time/ Exempt **Position Description* Exemplar is seeking a highly skilled and motivated Director of Veterinary Services and Attending Veterinarian to join our executive leadership team. This individual will play a central role in guiding the company...

Postal Jobs Assist

Mail Processor - No Experience Required Job at Postal Jobs Assist

Role Overview USPS is accepting applications for PSE Mail Processing Clerks nationwide. This role is vital to ensuring the timely and accurate processing of mail. USPS provides comprehensive training to help you succeed, even if you have no prior experience. Position Details...

Talent Groups

SQL Database Administrator Job at Talent Groups

...offering a hybrid remote work environment. The ideal candidate brings deep expertise in Microsoft SQL Server, T-SQL development, and database architecture, and enjoys working across both strategic design and hands-on execution. This role plays a critical part in...

Woofies

Weekend Administrative Assistant Job at Woofies

...administrative tasks as assigned Qualifications/Skills: ~ MUST LOVE ANIMALS AND PEOPLE ~1-3 years of customer service or data entry experience ~ Detailed-oriented ~ Previous use of scheduling software desired, but not necessary ~ Proficient in Outlook ~...

Hiring Winners

Benefits Manager - Fred Haas Companies Job at Hiring Winners

...Benefits Manager - Fred Haas Companies Fred Haas Companies is seeking an experienced and strategic Benefits Manager to lead and manage all aspects of employee benefits across our dynamic dealership network. This individual will play a critical role in implementing...

Data Engineer Job at VDart Inc, New York, NY

Njd0Z010VTFiV2ZVNDVuQmF2ZTFSRjhWRlE9PQ==