Collibra Data Lineage Automation Engineer Job at Alignity Solutions, Mc Lean, IL

bm1RakVjT29pbHBRamVvZnRaeVUvaUFnbVE9PQ==
  • Alignity Solutions
  • Mc Lean, IL

Job Description

Do you love a career where you Experience , Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the   meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees.

If you are a Collibra  Data Lineage Automation Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Requirements

Position Title:  Collibra  Data Lineage Automation Engineer

Location: Onsite – 5 days/week in McLean, VA

Work Type: 1099 / C2C / W2

Work Authorization: U.S. Citizens, Green Card holders, H1B, H4 EAD

Requirements

We are seeking a highly experienced Collibra  Data Lineage Automation Engineer   to lead the design, implementation, and scaling of automated end-to-end data lineage solutions across a complex enterprise ecosystem. The ideal candidate will have deep expertise in lineage frameworks (e.g., Spline, OpenLineage) , a strong foundation in AI/ML-driven metadata intelligence , and proven experience delivering lineage automation in hybrid cloud and legacy environments .

This is a hands-on engineering role with significant influence on architecture, governance, and enterprise data strategy.

Key Responsibilities

  • Lead the implementation of automated lineage across diverse systems:

    • Cloud platforms (e.g., Snowflake, AWS )

    • Legacy RDBMS and ETLs (e.g., SQL Server, Oracle )

    • NoSQL databases (e.g., MongoDB)

    • BI/reporting tools (e.g., Tableau, Power BI)

  • Design and extend lineage capture frameworks ( Spline, OpenLineage, Marquez ) for enterprise-wide adoption.

  • Build custom connectors, extractors, and agents to capture lineage in systems not natively supported.

  • Integrate lineage with metadata/governance platforms ( Collibra, Alation ) to ensure usability and traceability.

  • Apply AI/ML techniques to infer lineage from logs, query patterns, or unstructured code (e.g., Java-based ETLs).

  • Develop reusable lineage components and promote automation-first, reusable design principles.

  • Collaborate with architecture, governance, and engineering teams to define lineage standards, storage models, and best practices .

Required Skills & Experience

  • Proven success implementing automated lineage solutions in hybrid environments (cloud + legacy).

  • Hands-on experience with Spline, OpenLineage, Marquez , or similar open-source lineage frameworks.

  • Deep knowledge of metadata capture, ETL tracing, and query execution mapping .

  • Strong AI/ML background , with experience in:

    • Metadata intelligence

    • NLP-based code parsing

    • Pattern detection in lineage gaps

  • Programming expertise in Python, Scala, or Java .

  • Strong SQL skills with hands-on exposure to logs/queries from Snowflake, SQL Server, Oracle, MongoDB , etc.

  • Experience integrating lineage into data governance platforms (e.g., Collibra, Alation).

Nice-to-Have / Big Plus Skills

  • Hands-on experience with commercial lineage tools (evaluation or implementation).

  • Background in regulated industries (finance, healthcare, insurance).

  • Familiarity with event-driven architectures for real-time lineage propagation.

  • Exposure to data mesh and domain-driven lineage approaches .

Ideal Candidate Profile

  • Has successfully delivered automated lineage at enterprise scale .

  • Operates at the intersection of data engineering, metadata management, and AI innovation .

  • Acts as a strategic thought partner to architects, governance leads, and business stakeholders.

  • Brings an automation-first, reusable component mindset to all lineage solutions.

Benefits

Visit us at  . Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message:   Click Here

Clients Testimonial:   Click Here

Job Tags

Contract work, H1b,

Similar Jobs

Smart Ops Club Business Coaching

Client Operations & Data Virtual Assistant (Part-Time | Remote) Job at Smart Ops Club Business Coaching

Smart Ops Club helps home-service business owners improve operations and profitability. We need a **VA skilled in financial data review and client organization**.**Responsibilities:*** Analyze P&Ls, payroll, and job costing documents* Summarize insights and prepare...

Cardiac Study Center

Remote Triage Clinic Registered Nurse (RN) (per diem) Job at Cardiac Study Center

 ...mission is to elevate patient health through compassionate, innovative...  ...you work with us? Work-from-home flexibility Join a...  ...Specialized cardiac care Develop your nursing expertise in cardiovascular...  ...required in Olympia WA . Occasional travel and intermittent onsite... 

Johnson County Community College

Adjunct Assistant Professor, Automation Engineer Technology Job at Johnson County Community College

 ...Johnson County Community College Position, Department: Adjunct Assistant Professor, Automation Engineer Technology, Academic Affairs Type of Position: Adjunct Faculty, Exempt Work Schedule, Hours per week: Determined based on department need, Determined based... 

Zed Industries

Growth Product Manager Job at Zed Industries

 ...initiatives Establish growth frameworks and processes that can scale with the company Requirements ~5+ years of experience in product management or marketing with a focus on growth ~ Proven track record of driving significant user and revenue growth metrics ~ Strong... 

Paragon Logistics

26ft Box Truck Delivery Driver $23.75/Hr + $35.63/Hr Ot | Benefits + Pto | $49,400+/Yr | Local Routes | Amazon | No Cdl | Liberty Mo Job at Paragon Logistics

 ...23.75/hr + $35.63/hr overtime delivering Amazons heavy & bulky packages with Paragon Logistics...  ...No CDL required just bring your standard drivers license (Class E in MO)and start your...  ...and bulky Amazon packages in a26 box truck with just a standard drivers license (no...