Using a consultative approach, InfoCepts solved our client’s technology, data, and operational problems while building a modern, big data platform. An assessment phase included workshops and technical discussions at several organizational levels to identify gaps in data elements, assess impact on the business, and grasp modernization requirements. From this our team designed a future-proof, three-year modernization roadmap.
A scrum-based, cross-skilled data engineering team worked in collaboration with the client and developed big data platform operations to address new business requirements and manage data delivery. Its technology expertise and agile implementation helped assure all development within various business units met critical SLAs on time.
Our team monitored over 1000 jobs for failures and engineered permanent fixes, so data is synchronized between our client’s two data centers. In addition, our team enhanced SQL code, automated the identification of unused jobs in the workflow and removed superfluous dependencies for improved orchestration. Our team ensured faster execution in which 5 TB of semi-structured and complex data on a 700-node cluster was processed within a few hours.
The optimization phase being complete, InfoCepts is now helping our client to migrate its on-premise solution to AWS.