Collibra Data Lineage Automation Engineer Job at Alignity Solutions, Mc Lean, IL

bm1RakVjT29pbHBRamVvZnRaeVUvaUFnbVE9PQ==
  • Alignity Solutions
  • Mc Lean, IL

Job Description

Do you love a career where you Experience , Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the   meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees.

If you are a Collibra  Data Lineage Automation Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Requirements

Position Title:  Collibra  Data Lineage Automation Engineer

Location: Onsite – 5 days/week in McLean, VA

Work Type: 1099 / C2C / W2

Work Authorization: U.S. Citizens, Green Card holders, H1B, H4 EAD

Requirements

We are seeking a highly experienced Collibra  Data Lineage Automation Engineer   to lead the design, implementation, and scaling of automated end-to-end data lineage solutions across a complex enterprise ecosystem. The ideal candidate will have deep expertise in lineage frameworks (e.g., Spline, OpenLineage) , a strong foundation in AI/ML-driven metadata intelligence , and proven experience delivering lineage automation in hybrid cloud and legacy environments .

This is a hands-on engineering role with significant influence on architecture, governance, and enterprise data strategy.

Key Responsibilities

  • Lead the implementation of automated lineage across diverse systems:

    • Cloud platforms (e.g., Snowflake, AWS )

    • Legacy RDBMS and ETLs (e.g., SQL Server, Oracle )

    • NoSQL databases (e.g., MongoDB)

    • BI/reporting tools (e.g., Tableau, Power BI)

  • Design and extend lineage capture frameworks ( Spline, OpenLineage, Marquez ) for enterprise-wide adoption.

  • Build custom connectors, extractors, and agents to capture lineage in systems not natively supported.

  • Integrate lineage with metadata/governance platforms ( Collibra, Alation ) to ensure usability and traceability.

  • Apply AI/ML techniques to infer lineage from logs, query patterns, or unstructured code (e.g., Java-based ETLs).

  • Develop reusable lineage components and promote automation-first, reusable design principles.

  • Collaborate with architecture, governance, and engineering teams to define lineage standards, storage models, and best practices .

Required Skills & Experience

  • Proven success implementing automated lineage solutions in hybrid environments (cloud + legacy).

  • Hands-on experience with Spline, OpenLineage, Marquez , or similar open-source lineage frameworks.

  • Deep knowledge of metadata capture, ETL tracing, and query execution mapping .

  • Strong AI/ML background , with experience in:

    • Metadata intelligence

    • NLP-based code parsing

    • Pattern detection in lineage gaps

  • Programming expertise in Python, Scala, or Java .

  • Strong SQL skills with hands-on exposure to logs/queries from Snowflake, SQL Server, Oracle, MongoDB , etc.

  • Experience integrating lineage into data governance platforms (e.g., Collibra, Alation).

Nice-to-Have / Big Plus Skills

  • Hands-on experience with commercial lineage tools (evaluation or implementation).

  • Background in regulated industries (finance, healthcare, insurance).

  • Familiarity with event-driven architectures for real-time lineage propagation.

  • Exposure to data mesh and domain-driven lineage approaches .

Ideal Candidate Profile

  • Has successfully delivered automated lineage at enterprise scale .

  • Operates at the intersection of data engineering, metadata management, and AI innovation .

  • Acts as a strategic thought partner to architects, governance leads, and business stakeholders.

  • Brings an automation-first, reusable component mindset to all lineage solutions.

Benefits

Visit us at  . Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message:   Click Here

Clients Testimonial:   Click Here

Job Tags

Contract work, H1b,

Similar Jobs

Gama Aviation

HEMS Co-Pilot (WAA) at Gama Aviation Job at Gama Aviation

 ...candidates Opportunities for professional development Gama Aviation are a market-leading provider of flight services with a varied...  ...with Wales Air Ambulance, we are seeking to recruit additional pilots for our rotary operation based at Cardiff.Flying in a stunning... 

C&S Wholesale Grocers

Warehouse Order Selector Job at C&S Wholesale Grocers

Position Overview Our focus is simple but meaningful, from our distribution centers to our offices every employee of C&S and their family of companies works to help feed local families, neighbors and communities. As a Warehouse Selector, youll pick, gather & organize...

LaSalle Network

Part-Time Junior Accountant Job at LaSalle Network

 ...day-to-day financial tasks, including data entry, reconciliations, accounts payable/...  ...Responsibilities: Assist with entering and coding invoices into the accounting system...  ...top talent with opportunities, from entry-level positions to the C-suite. With units specializing... 

EssilorLuxottica Group

Sales Associate Ross Park Mall Job at EssilorLuxottica Group

Requisition ID:896071 Store # :002018 Sunglass Hut Position: Part-Time Total Rewards: Benefits/Incentive Information At Sunglass Hut, we're always in the sun. Youll find a dynamic space with endless possibilities to grow your career. We are a culture...

One Robert Wood Johnson Place

Security Officer Job at One Robert Wood Johnson Place

 ...Job Title: Security Officer Location: Main Hospital - New Brunswick Department Name: Security Req #: 0000206714 Status: Hourly Shift: Evening Pay Range: $18.50 - $18.50 per hour Pay Transparency: The above reflects the anticipated hourly wage range...