Data Engineer

About Us

At Legal Doctrine, we are building the leading legal knowledge platform in Africa. Our mission is to make legal information more accessible, structured, and actionable. With the expansion of our platform to cover
legal texts from 20+ African countries

, we are seeking a talented
Data Engineer

to join our tech team and help us scale.

Role Overview

As a
Data Engineer

, you will be responsible for designing, building, and maintaining data pipelines to ingest, clean, transform, and structure heterogeneous legal text sources from multiple African jurisdictions. You will work closely with our
Machine Learning, Product, and Engineering teams

to ensure that data is reliable, scalable, and ready for downstream processing (NLP, search, classification, etc.).

Key Responsibilities

• Design and implement
  ETL/ELT pipelines

to integrate legal documents from diverse data sources.
- Solid knowledge of scraping tools like Scrapy and Selenium)
- Standardize, clean, and normalize data into formats compatible with our internal systems.
- Collaborate with ML engineers to provide structured data for
NLP and AI models

(classification, segmentation, retrieval).
- Optimize database storage, indexing, and query performance for large-scale legal corpora.
- Monitor data quality, implement validation checks, and resolve inconsistencies.
- Work with stakeholders to understand legal data structures and provide scalable solutions.

Requirements

• Proven experience as a
  Data Engineer

or similar role.
- Strong skills in
Python

(Pandas, PySpark, or similar libraries).
- Experience with
databases

(MongoDB, PostgreSQL, SQL, or NoSQL in general ).
- Knowledge of
ETL tools/data pipeline orchestration

(Airflow, Prefect, dbt, or similar).
- Familiarity with
data modeling

and working with heterogeneous/unstructured text data.
- Understanding of
APIs, web scraping, and data ingestion from external sources

.
- Good knowledge of
cloud infrastructure

(AWS, GCP, or Azure) is a plus.
- Previous experience with
large-scale text data / NLP pipelines

is a strong advantage.
- Strong problem-solving mindset, with attention to scalability and performance.

What We Offer

• Opportunity to work on
  cutting-edge AI and NLP projects

in the legal tech industry.
- A collaborative and international team environment.
- Flexible working conditions (hybrid/remote options).
- Competitive salary and growth opportunities.