{"id":67859,"date":"2023-07-26T12:17:17","date_gmt":"2023-07-26T12:17:17","guid":{"rendered":"https:\/\/expleo.com\/global\/en\/?post_type=case-studies&#038;p=67859"},"modified":"2023-09-08T09:24:12","modified_gmt":"2023-09-08T09:24:12","slug":"technical-metadata-integration-complex-technology","status":"publish","type":"case-studies","link":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/","title":{"rendered":"Managing technical metadata integration with complex technology"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"67859\" class=\"elementor elementor-67859\" data-elementor-post-type=\"case-studies\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-a7e4a12 gg-simple-text gg-container-small gg-article-content elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"a7e4a12\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-884b6e6\" data-id=\"884b6e6\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-c1203c6 elementor-widget elementor-widget-heading\" data-id=\"c1203c6\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\"><b>Project Background<\/b><\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-6cd5838 elementor-widget elementor-widget-text-editor\" data-id=\"6cd5838\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>The client has custom REST API services that processes the external feeds, execute data quality rules, transforms and loads content into their data mart. End to end lineage is not available in the current systems.\u00a0 Requirement to view end-to-end lineage from a field on an incoming data feed to a column in their data mart, enriched with business metadata. All metadata sources required for supporting lineage were hosted on their AWS VPC, while DGC was on the Collibra Cloud, and as per the enterprise security standards, no direct inbound connections could be made to the enterprise VPC (i.e., no Collibra Gateway deployment)<\/p><p>Client wanted a centralised notification for approved metadata changes, that could be consumed by downstream applications. Custom processes for governing the business and technical metadata including definition, modification linkage and approval had to be supported with entitlements managed both at a functional area and data domain level.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1edd9a9 elementor-widget elementor-widget-heading\" data-id=\"1edd9a9\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Solution<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-476d01b elementor-widget elementor-widget-text-editor\" data-id=\"476d01b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li><strong>Solution <\/strong>Integration templates were designed to load the technical metadata from the REST api interfaces and from the related data mart hosted in\u00a0<strong>AWS Relational Data Service<\/strong>. The integrations had to use\u00a0<strong>credentials stored in Hashi Vault\u00a0<\/strong>for connecting to metadata sources. The integration endpoints needed to be authenticated using\u00a0<strong>HantWeb<\/strong>.<\/li><li>For supporting centralised notifications, a generic workflow was designed to detect new assets, changes to asset attributes (modification or deletion) and write a JSON message\u00a0<strong>to anAmazon SQS queue<\/strong>, which is then consumed by downstream applications.<\/li><li>Custom workflows were designed to propose and approve business assets such as Business Term, Glossary, Vocabulary as well as manage the linkage between the technical assets and the business assets. Additional workflows were defined to promote a business asset from local to the enterprise glossary and move business assets between functional area glossaries.<\/li><li><strong>DevOps build and deploy scripts\u00a0<\/strong>were also developed.<\/li><li><strong>Cloud Formation Scripts\u00a0<\/strong>were designed and developed to instantiate Mule servers and the Mule Management Console on AWS, and to help scale the Mule infrastructure on demand.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-8cfc546 elementor-widget elementor-widget-heading\" data-id=\"8cfc546\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Outcome<\/h2>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-88c32c5 elementor-widget elementor-widget-text-editor\" data-id=\"88c32c5\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<ul><li>Provided the client the ability to improve the users\u2019 trust in data by providing the needed technical lineage across their data marts right from the external feeds through the applied data quality rules and transformations.<\/li><li>Provided the users a unified interface for downstream applications to consume approved metadata changes from Collibra.<\/li><\/ul>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>\/*! elementor &#8211; v3.12.1 &#8211; 02-04-2023 *\/ .elementor-heading-title{padding:0;margin:0;line-height:1}.elementor-widget-heading .elementor-heading-title[class*=elementor-size-]&gt;a{color:inherit;font-size:inherit;line-height:inherit}.elementor-widget-heading .elementor-heading-title.elementor-size-small{font-size:15px}.elementor-widget-heading .elementor-heading-title.elementor-size-medium{font-size:19px}.elementor-widget-heading .elementor-heading-title.elementor-size-large{font-size:29px}.elementor-widget-heading .elementor-heading-title.elementor-size-xl{font-size:39px}.elementor-widget-heading .elementor-heading-title.elementor-size-xxl{font-size:59px} Project Background The client has custom REST API services that processes the external feeds, execute data quality rules, transforms and loads content into their data mart. End to end lineage is not available in the current systems.&nbsp; Requirement to view end-to-end [&hellip;]<\/p>\n","protected":false},"featured_media":67891,"template":"","meta":{"_oasis_is_in_workflow":0,"_oasis_original":0,"_oasis_task_priority":"","_angie_page":false,"service-grey-banner":"false","service-grey-banner-link":"","footnotes":""},"case-study-single-templates":[318],"topic":[154,212,145],"industry-taxonomy":[38],"country":[118],"service":[216,48],"class_list":["post-67859","case-studies","type-case-studies","status-publish","has-post-thumbnail","hentry","case-study-single-templates-new-template","topic-compliance-and-regulation","topic-data-science-and-cybersecurity","topic-digital-transformation","industry-taxonomy-banking-and-financial-services","country-india","service-digital-transformation","service-big-data-analytics-ai-and-advanced-algorithms"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.0 (Yoast SEO v27.4) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Expleo | Managing Technical Metadata integration<\/title>\n<meta name=\"description\" content=\"Client wanted a centralised notification for approved metadata changes, that could be consumed by downstream applications.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Managing technical metadata integration with complex technology\" \/>\n<meta property=\"og:description\" content=\"Client wanted a centralised notification for approved metadata changes, that could be consumed by downstream applications.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/\" \/>\n<meta property=\"og:site_name\" content=\"Global EN\" \/>\n<meta property=\"article:modified_time\" content=\"2023-09-08T09:24:12+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/expleo.com\/global\/en\/wp-content\/uploads\/2023\/07\/mobile-banking-1024x454.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"454\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/case-studies\\\/technical-metadata-integration-complex-technology\\\/\",\"url\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/case-studies\\\/technical-metadata-integration-complex-technology\\\/\",\"name\":\"Expleo | Managing Technical Metadata integration\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/case-studies\\\/technical-metadata-integration-complex-technology\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/case-studies\\\/technical-metadata-integration-complex-technology\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/mobile-banking.jpg\",\"datePublished\":\"2023-07-26T12:17:17+00:00\",\"dateModified\":\"2023-09-08T09:24:12+00:00\",\"description\":\"Client wanted a centralised notification for approved metadata changes, that could be consumed by downstream applications.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/case-studies\\\/technical-metadata-integration-complex-technology\\\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/case-studies\\\/technical-metadata-integration-complex-technology\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/case-studies\\\/technical-metadata-integration-complex-technology\\\/#primaryimage\",\"url\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/mobile-banking.jpg\",\"contentUrl\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/mobile-banking.jpg\",\"width\":1624,\"height\":720,\"caption\":\"Businessman using mobile online banking and payment, Digital marketing. Finance and banking networking. Online shopping and icon customer network connection, cyber security. Business technology.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/case-studies\\\/technical-metadata-integration-complex-technology\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Case Studies\",\"item\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/case-studies\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Managing technical metadata integration with complex technology\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/\",\"name\":\"Expleo | EN\",\"description\":\"Expleo\",\"publisher\":{\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/#organization\",\"name\":\"Expleo | EN\",\"url\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/wp-content\\\/uploads\\\/2019\\\/02\\\/expleo-logo-and-tagline.png\",\"contentUrl\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/wp-content\\\/uploads\\\/2019\\\/02\\\/expleo-logo-and-tagline.png\",\"width\":1600,\"height\":774,\"caption\":\"Expleo | EN\"},\"image\":{\"@id\":\"https:\\\/\\\/expleo.com\\\/global\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Expleo | Managing Technical Metadata integration","description":"Client wanted a centralised notification for approved metadata changes, that could be consumed by downstream applications.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/","og_locale":"en_GB","og_type":"article","og_title":"Managing technical metadata integration with complex technology","og_description":"Client wanted a centralised notification for approved metadata changes, that could be consumed by downstream applications.","og_url":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/","og_site_name":"Global EN","article_modified_time":"2023-09-08T09:24:12+00:00","og_image":[{"width":1024,"height":454,"url":"https:\/\/expleo.com\/global\/en\/wp-content\/uploads\/2023\/07\/mobile-banking-1024x454.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Estimated reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/","url":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/","name":"Expleo | Managing Technical Metadata integration","isPartOf":{"@id":"https:\/\/expleo.com\/global\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/#primaryimage"},"image":{"@id":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/#primaryimage"},"thumbnailUrl":"https:\/\/expleo.com\/global\/en\/wp-content\/uploads\/2023\/07\/mobile-banking.jpg","datePublished":"2023-07-26T12:17:17+00:00","dateModified":"2023-09-08T09:24:12+00:00","description":"Client wanted a centralised notification for approved metadata changes, that could be consumed by downstream applications.","breadcrumb":{"@id":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/#primaryimage","url":"https:\/\/expleo.com\/global\/en\/wp-content\/uploads\/2023\/07\/mobile-banking.jpg","contentUrl":"https:\/\/expleo.com\/global\/en\/wp-content\/uploads\/2023\/07\/mobile-banking.jpg","width":1624,"height":720,"caption":"Businessman using mobile online banking and payment, Digital marketing. Finance and banking networking. Online shopping and icon customer network connection, cyber security. Business technology."},{"@type":"BreadcrumbList","@id":"https:\/\/expleo.com\/global\/en\/case-studies\/technical-metadata-integration-complex-technology\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/expleo.com\/global\/en\/"},{"@type":"ListItem","position":2,"name":"Case Studies","item":"https:\/\/expleo.com\/global\/en\/case-studies\/"},{"@type":"ListItem","position":3,"name":"Managing technical metadata integration with complex technology"}]},{"@type":"WebSite","@id":"https:\/\/expleo.com\/global\/en\/#website","url":"https:\/\/expleo.com\/global\/en\/","name":"Expleo | EN","description":"Expleo","publisher":{"@id":"https:\/\/expleo.com\/global\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/expleo.com\/global\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/expleo.com\/global\/en\/#organization","name":"Expleo | EN","url":"https:\/\/expleo.com\/global\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/expleo.com\/global\/en\/#\/schema\/logo\/image\/","url":"https:\/\/expleo.com\/global\/en\/wp-content\/uploads\/2019\/02\/expleo-logo-and-tagline.png","contentUrl":"https:\/\/expleo.com\/global\/en\/wp-content\/uploads\/2019\/02\/expleo-logo-and-tagline.png","width":1600,"height":774,"caption":"Expleo | EN"},"image":{"@id":"https:\/\/expleo.com\/global\/en\/#\/schema\/logo\/image\/"}}]}},"hreflang":{"rendered":"","structure":[]},"_links":{"self":[{"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/case-studies\/67859","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/case-studies"}],"about":[{"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/types\/case-studies"}],"version-history":[{"count":0,"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/case-studies\/67859\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/media\/67891"}],"wp:attachment":[{"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/media?parent=67859"}],"wp:term":[{"taxonomy":"case-study-single-templates","embeddable":true,"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/case-study-single-templates?post=67859"},{"taxonomy":"topic","embeddable":true,"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/topic?post=67859"},{"taxonomy":"industry-taxonomy","embeddable":true,"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/industry-taxonomy?post=67859"},{"taxonomy":"country","embeddable":true,"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/country?post=67859"},{"taxonomy":"service","embeddable":true,"href":"https:\/\/expleo.com\/global\/en\/wp-json\/wp\/v2\/service?post=67859"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}