Challenge : These files cannot be opened in Excel or Notepad
We should connect with the Central Analytics Team. They can help us in dealing with this data format.
Hey! Have we received the data for Rebel Foods audit from the client?
Yes, we have received the data, However the data is in semi-structured format. We are not able to structure it. It will take a lot of time to achieve the same and after that we will be able to get the correct analytics results.
The Audit team and the Central Analytics team discuss the difficulty that the Audit team is experiencing and exchange data with the Central Analytics Team via One Drive.
Challenge : Because the files were too huge to post in a database all at once, the Central Analytics Team created a bespoke data pipeline in Python to upload the data in SQL Database in tiny pieces.
Sure let's discussthe requirement in detail.
Sure
We are unable to access the files due to their large size, and hence could not inspect or analyze the data - even to choose analytics that could be conducted, Could you share the first 1000 lines of Data from each report so we can inspect the data?
Thanks for sharing the data with us. We would need your assistance to perform some tests on the complete dataset and also prepare dashboards in Power BI
Thank you for your assistance with data handling, analytics, and visualization. Your support has been quite beneficial. It aided the audit team in uncovering fascinating insights, adding significant value to the engagement. In our interactions, we will continue to rely on the central analytics team.