Data Engineer Job at Qode, Pennsylvania

bkdJaEU4ZXRnMWhUaWVvZXNwMmEreWNqbkE9PQ==
  • Qode
  • Pennsylvania

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:

  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.

Preferred Qualifications:

  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Full time,

Similar Jobs

Express Employment Professionals - Pittsburgh West

Precision CNC Machinist - Mills & Lathes Job at Express Employment Professionals - Pittsburgh West

 ...McKees Rocks and help turn detailed blueprints into precision circular metal parts. As a key member of our clients team, youll operate CNC mills and lathes, dialing in feeds, speeds, and tooling to hit tight tolerances while keeping safety and quality front and center.... 

Victoria Logistics Carrier LLC

Sprinter/Cargo Van Owner Operator Job at Victoria Logistics Carrier LLC

 ...VICTORIA LOGISTICS CARRIER does not hire company drivers. You are submitting the application to execute a written independent contractor agreement as an owner-operator. Vehicle Requirements: Sprinter should not be older than 2016. All vehicles should have a... 

Child Development Schools

Cook Job at Child Development Schools

 ...the Future of Early Childhood Education! At Child Development Schools and (local affiliate companies) , we're not just offering jobs;...  ...Term Disability for full time employees. Your Role as Childcare Cook: As a cook, you will be responsible for preparing nutritious... 

Leidos

Military Family Life School Counselor - Whidbey Island, WA Job at Leidos

 ...hiring licensed behavioral health professionals to join our Military and Family Life Counselor (MFLC) Child and Youth Behavioral team to support NAS Whidbey Island, WA.This is a 9 month school calendar position that will reflect the school calendar that you would support.... 

CHS Recruiting

Orthopedic Spine Surgeon (Physician) - Flexible Schedule Options Job at CHS Recruiting

OPEN POSITION: - Physician - Spine Surgery - Orthopedic Surgery - Interventional Pain Procedures SCHEDULE OPTIONS:- Full-Time - Part...  ...ankle and foot. POSITION DESCRIPTION: The new spine surgeon will see patients in an established office and surgery...