The challenge
Business and analytics teams were spending too much time finding trustworthy data, understanding ownership and navigating fragmented metadata across enterprise systems.
Enterprise Data / AI
Enterprise Supply Chain Data Marketplace
An enterprise data marketplace initiative combining metadata, governance and AI-assisted discovery across supply-chain data products.
Role
AI Engineer
Context
Global Supply Chain Enterprise
Period
2023–2026
What I built
Built AI-assisted discovery capabilities around a governed data marketplace, connecting metadata from Unity Catalog, Collibra and ServiceNow. The work included semantic discovery, metadata pipelines and generative AI features that made data products easier to understand and reuse.
Architecture
- Enterprise metadata ingestion pipelines
- Unity Catalog, Collibra and ServiceNow integration
- Semantic search over governed data products
- LLM-assisted metadata and glossary generation
- Role-aware enterprise discovery workflows
Outcomes
- Program-level annual savings estimated at approximately £5M
- Faster governed discovery across enterprise data assets
- Improved reuse of existing data products and metadata
Technology
PythonSQLUnity CatalogCollibraServiceNowLLMs