The Smart Data Fabric’s pillars

Data Fabric’s differentiation by innovation

Thanks to innovative techniques, our Data Fabric differentiates itself by: a unique data integration pattern: easy data integration by automated data blending (without having to know schemas upfront). With this, the Data Fabric excels in complex infrastructures (blends data from across hundreds and even thousands of data sources fully automated!) creating high-quality data from any source (also unstructurered data) automated streaming of high-quality data sets that matches your query, to your own applications & platforms (data modelling) enriching data with (external) reference sources, normalising data and the ability to write back to your data sources. This makes data curation & normalisation of your data sources (e.g. MDM & ERP systems) possible support for any data protection regulation and policies in combination with anonymisation and pseudonymisation of 115 different PII’s that are automatically identified. Each country can apply its own data protection policies. The Data Fabric can be setup in such a way that data will not cross borders and that specific types of data are not being blended data insights and automation of data management tasks and much more “Data integration (49%) and data preparation (37%) are among the top three technologies that organizations would like to automate by 2020 .” Ehtisham Zaidi, Eric Thoo, Guido De Simoni, Mark Beyer - Gartner - The Data Fabric can automate nearly everything; the Data Fabric is 100% focussed on streamlining every part of the data process by i.a.: Reinforcement Learning Simple Annotation and Labelling Graph-based Data Stewarding

Crawling data fully automated from internal and

external data resources

The Data Fabric is a data integration platform ( iPaaS ) capable of delivering Data as a Service ( DaaS ). The Data Fabric includes over 220 out-of-the-box integrations (connectors). Crawlers collect fully automated all content from structured data, unstructured data and image-only files from any internal source (including legacy systems). Data from external sources can be collected as well (e.g. data enrichment/records completion). After applying innovative techniques to the data collected, high-quality data is generated and many use cases can be dealt with.

Blending and cleansing data: creating high-quality

data

“How good is your data quality?” During the data crawling process, the collected data gets cleansed fully automated. By i.a. ‘natural language processing’, triangulation and fuzzy merging techniques, data will be organised , de-duplicated and enriched , data relations put in place and data will be blended . In addition, 18 data   quality   metrics and a range of algorithms e nsures that high-quality data is created. These automated data preparation steps are the first steps allowing your organisation to turn your data into information and the first steps to data curation and normalisation. The Data Fabric is capable to write back to over 350 sources. After verification by a data steward or data engineer, data curation and data normalisation at your data sources (e.g. MDM & ERP systems) can be applied.

Data analyses and more

The Data Fabric uses five different types of databases but one single query language is used. Any (subset) of the high-quality data can be streamed. With this, information can be delivered near to real-time, as soon as that data is processed or added in your organisation. But also, machine learning, artificial intelligence, data analyses, data science and business intelligence applications will greatly benefit by automated streaming of the required data to those applications that you already use.

Data as a Service: DaaS-style architecture

July 25, 2019: Gartner states in their “Hype Cycle Report for Enterprise Information Management” the following: "Data and analytics leaders such as data architects should consider DaaS-style architecture as one option to expand and complement the existing data management strategy and infrastructure . … DaaS can serve as a means of addressing the growing variety of data, and this is sometimes represented as part of a new value statement for building this type of infrastructure.” September 11, 2019: Gartner concludes in “Modern Data and Analytics Requirements Demand a Convergence of Data Management Capabilities” the following: “Due to changing requirements, modern data and analytics use cases need a portfolio of capabilities that cannot be fulfilled by existing, stand-alone products. Data and analytics leaders must invest in new data management solutions that leverage aggregated and integrated capabilities .” The Data Fabric delivers DaaS: high-quality data from the Data Fabric can be streamed via push and pull techniques to Data Warehouses, Power BI, Google BigQuery or any tool that needs cleansed and deduplicated data. The Data Fabric can offer extra functionalities for platforms such as Azure, Hadoop and IBM data lake. The Data Fabric also features “ Keep   Me   In The   loop ”, unified view and more. The Data Fabric fits in any infrastructure while making processes more efficient and saving time and money.

Data insight and data management

While crawling for content, the Data Fabric also includes the access rights , metadata and log files . This enables you to apply (automated) data management tasks while gaining data insights. This makes governance, risk management and compliance support possible in several areas, including: Automatic classification of documents via machine learning techniques Monitoring ‘data leaks’ for example given, documents categorised as sensitive Acquiring insights regarding personally identifiable information . Reports can be generated and information provided about the data locations without having to involve any other department. Data can be anonymised or pseudonymised fully automated when data is streamed for analysis (BI, data science, etc.). Fully automated application of data retention policies . ‘Data lifecycle management’ (DLM) can be fully automated or applied after an approval loop by data owners.

Data becomes information

Through data integration, the cleansing, blending and enrichments of data, the dashboards and alerts, the data analysis and BI possibilities, the unique 'unified view', the ability to add external data sources, the real time processing of information that becomes immediately available for knowledge workers, management or data scientists, being able to find a needle in a haystack, acquiring data insight and more, data will be converted into information . Because the Data Fabric can establish relationships between data and is strong in ‘data lineage’, not only applications in the area of unstructured data are on the horizon, but also on structured data. Establishing relations between records and analysing them is possible, example given for ERP systems. This allows the realisation of unprecedented insights. By processing external data sources, many other applications are also possible including ‘know your customer’ (KYC) and a 360- degree view of employees and organisations. The Data Fabric is of great value for board of directors and management, marketing, HRM, recruitment, data scientists & analysts, IT and knowledge workers amongst other people and departments. If you would like to obtain more information about our Data Fabric or if you have any questions about the many other use cases the Data Fabric has to offer you, please feel free to contact us!

The Data Fabric summarised

1 . The Data Fabric creates a unique, solid, flexible and scalable data foundation that fits in any (complex) infrastructure 2 . Innovative techniques ensure the creation of high-quality data without having to know how data (records) could blend 3 . (High quality) data sets matching a defined query, can be streamed to other applications and platforms (push and pull) 4 . Writing back to original sources (with intervention of a data steward, data engineer or data protection officer) is supported 5 . By combining the integrated functionalities like data lineage, meta data collection and creation, data catalog, streaming & write back capabilities, machine learning capabilities, automated fraud detection and more, many data related use cases can be dealt with and solved. As such, the Data Fabric can be called a Smart Data Fabric ! With the Data Fabric, you can get insights and control over your data and information out of your valuable data, without changing your way of working and while reusing the infrastructure you already have invested in. The Data Fabric increases efficiency in multiple ways and will save you lots of time and money. With this, the Data Fabric has a high ROI. We are happy to make this visible for your organisation by mapping several value metrics. There is much more to tell about the Data Fabric’s possibilities and its innovative techniques. Feel free to contact us. +91 74 066 24 888 datafabric@s10group.com

What is the Smart Data Fabric and how

does it work?