Skip to content
View algorithmy1's full-sized avatar

Block or report algorithmy1

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
algorithmy1/README.md
Abdallah Terrab - Data Engineer and Data Architect

I build data platforms and intelligent products that connect reliable pipelines, clear architecture, useful interfaces, and operational reality.

GitHub Based in Paris Experience

What I am building

K0 logo K0

From issue to verified pull request.

K0 coordinates durable repository-role workflows. It authorizes work, snapshots the committed workflow, invokes AI or human roles, validates evidence, follows explicit graph edges, and keeps human review at the closing boundary.

work in progress · open-source release coming

Atomic Accounting logo Atomic Accounting

Exact accounting with an auditable agent boundary.

An independently installable accounting kernel for immutable double-entry records, evidence-backed proposals, human approval, receipt-safe posting, reproducible statements, and typed access for applications and agents.

work in progress · open-source release coming

Data engineering and agentic systems.

Data engineering is the foundation of my work: ingestion and transformation, orchestration, data contracts, catalog identities, lineage, quality, governed access, and the cloud platforms that keep those capabilities dependable.

I am interested in agents that can do meaningful work without making authority ambiguous. That means explicit roles, typed tools, least-privilege access, durable state, resumable execution, observable events, verifiable evidence, and human checkpoints where judgment or irreversible action begins.

My recent work connects agent orchestration with real platform boundaries: metadata discovery, document consultation, controlled read-only SQL, delegated specialists, asynchronous tool execution, usage accounting, and failure-aware client events.

Experience

PeriodRole and focus
2021‑now Decathlon Decathlon Technology - Data Architect & Data Engineer Consultant.
Customer analytics and Customer 360; privacy and GDPR-aware ingestion, feature engineering, behavioral analysis, dashboards, and recommendation pipelines. Data-platform architecture spanning batch and streaming systems, observability, OpenLineage and Marquez, metadata, catalog identities, data contracts, quality, governed discovery, and controlled data access. Requirements, roadmaps, technical reviews, CI/CD, reliability, mentoring, and knowledge sharing. Delivered +15 professional Spark, Airflow, and dbt training sessions to +150 participants.
2022‑now TID Consultancy - Founder & CEO.
Data and cloud architecture, AI integration, governance, mentoring, and delivery.
2022‑now ReaLift
WOA Shoes
Realift & WOA - CTO / Co-Founder; Head of ML / Solution Architect.
Measurement and size-recommendation services, AWS/ML architecture, personalized-footwear commerce, and production workflows.
2020‑2022 ESEM Paris - Master 2 Big Data & AI Lecturer.
Lectures, practical classes, projects, and assessments.
2017‑2021 TotalEnergies Total - Data Scientist & Data Engineer.
Pricing, revenue management, customer analytics, recommendations, data APIs, and industrial analytics.
2016‑2017 LIMOS LIMOS - R&D Engineer.
Graph optimization, routing and spectrum assignment, scientific computing, and parallel systems.
2015‑2016 JPI-Conseil - Java & Android Developer.
Medical-team applications, APIs, SQL, tests, and user workshops.

Open source

Talks and teaching

Technology

Python  Apache Spark  Databricks  AWS  Apache Airflow  Apache Kafka  Kubernetes  Docker  PostgreSQL  OpenLineage  Marquez  LangGraph  LangChain  FastAPI  TypeScript  React  dbt

Scala  Next.js  Flask  Django  Talend  Dataiku  Apache Hadoop  Apache Hive  pandas  NumPy  TensorFlow  scikit-learn  MongoDB  Microsoft Azure  Google Cloud  FluxCD  GitHub Actions  Jenkins  OpenAPI

Amazon S3  Amazon EMR  AWS Glue  Amazon Redshift  Amazon EKS  Amazon ECR  AWS Lambda  Amazon SQS  Amazon SageMaker  Amazon DynamoDB  Amazon Bedrock  Amazon MWAA  Amazon CloudWatch  AWS CodeArtifact  AWS IAM

JavaScript  Java  Bash  Git  Linux  nginx  Android Studio  Shopify  C  C++  PHP

Area Technologies and practices
Languages and formats Python · SQL · Scala · TypeScript · JavaScript · Java · C · C++ · Fortran · PHP · Bash · MATLAB · YAML · XML · JSON · PDF processing
Data engineering PySpark · Apache Spark · Hadoop · Hive · Airflow · MWAA · Kafka · dbt · Talend for Big Data · Dataiku · Google Cloud Data Fusion · Azure Data Factory · ETL/ELT · DataFrames · materialized views
Data platforms and governance Databricks · Unity Catalog · AWS Glue · OpenLineage · Marquez · metadata platforms · data contracts · data quality · catalog identity reconciliation · dataset discovery · lineage · Gold/Silver/Insight models
Cloud and storage AWS · Azure · GCP · S3 · EMR · Redshift · EKS · Lambda · SQS · SageMaker · DynamoDB · Azure Data Lake · BigQuery · PostgreSQL · MongoDB · Algolia
Applications and APIs React · Next.js · FastAPI · Flask · Django · OpenAPI · DocAPI · REST APIs · SSO · Shopify · storefronts · back-office systems · web dashboards · Android
Generative AI and agents LLMs · AWS Bedrock · LangGraph · LangChain · LiteLLM · MCP · tool calling · multi-agent delegation · document search · controlled SQL access · token accounting · asynchronous execution · delegated event streaming
Machine learning and analytics NumPy · pandas · SciPy · scikit-learn · TensorFlow · TensorFlow C++ · NLTK · NetworkX · BigQuery ML · Azure ML · clustering · collaborative filtering · recommendation systems · neural networks · Power BI · Google Data Studio · seaborn · Matplotlib
Scientific computing MPI · graph algorithms · routing and spectrum assignment · linear and nonlinear optimization · parallel computing
Platform engineering Docker · Kubernetes · EKS · FluxCD · Kustomize · nginx · IAM · GitHub Actions · Jenkins · ECR · CodeArtifact · Nexus · Code Factory · Vault · Checkmarx · CloudWatch · CI/CD · observability · logging · alerting
Testing and reliability TDD · unit testing · integration testing · pytest · AsyncMock · asyncio · Vitest · Testing Library · typed interfaces · immutable records · receipt-safe retries · reproducible builds
Delivery and collaboration Git · GitHub · Bitbucket · Jira · Confluence · Linux · technical specifications · architecture reviews · evidence-backed delivery
Business systems and sources SAP · Lisa · Shopify · e-commerce and order workflows · pricing and revenue-management data · customer analytics

Building systems that stay understandable after the prototype.

Pinned Loading

  1. OpenLineage/OpenLineage OpenLineage/OpenLineage Public

    An Open Standard for lineage metadata collection

    Java 2.7k 540

  2. MarquezProject/marquez MarquezProject/marquez Public

    Collect, aggregate, and visualize a data ecosystem's metadata

    Java 2.3k 410