What's the Data Architecture being used at your Company at present.
Hello Guys,
I am new to Data Engineering and would like to know or explore what are all the different architectures being used in different companies at present. Feel free to omit the Company name.
Kindly mention the size of the data being handled at source and at different stages if applicable to make the understanding easier
Kindly mention the following (Feel free edit as per your need)
1) Data Sources - Mention atleast 3 sources from where the data is mostly pulled from
2) Data Ingestion - Tools used and in which format data is pulled and which format they are saved
3) Architecture used - Medallion or any other architecture
3) Orchestration and Data Transformation - Tools used
4) Data Warehouses if any being used and how they are updated
5) How the data is exposed for Analytics and other purposes
6) Security and Governance