Prepare to manage the “evolution” of AI-based solutions with “DataOps”
Conclusion: The development of AI-based solutions is heavily dependent on various types of data input in the form of either:
- Large data sets used to conduct experiments to develop models and algorithms for predictive analytics, optimisation and decision recommendations; or
- Enriched and tagged corpuses of images, audio, video and unstructured text used to train neural networks using deep learning techniques.
While at first the data management needs of AI-based solution development might leverage both data scientists and their existing business intelligence platforms to exploit these types of data, the actual lifecycle management needs of AI developers will expand quickly beyond the boundary of the traditional enterprise data warehouse.
Therefore, like the source code and configuration data underpinning transactional business applications, the raw data and algorithms of AI solutions must be managed by evolving DevOps practices towards a comprehensive “DataOps” model.
About The Advisor
Sam Higgins was an IBRS advisor between 2017 and 2020 with over 20 years of both tactical and strategic experience in the application of information and communications technology (ICT) to achieve business outcomes from large complex organisations. Through previous roles as a leading ICT executive, strategist, architect, industry analyst, program consultant and advisor, Sam has developed an extensive knowledge of key markets including as-a-Service (Cloud) computing, enterprise architecture (including service-orientation and information management), enterprise applications and development, business intelligence; along with ICT management and governance practices such as ICT planning, strategic sourcing, portfolio and project management. Sam’s knowledge of service-oriented architecture and associated business models is widely recognised, and he was a contributing author on the Paul Allen book Service-orientation: Winning Strategies and Best Practices, released in 2006 by Cambridge University Press. As the former Research Director for Longhaus he undertook the first in depth research into the implications of cloud computing and other “as-a-Service” ICT offerings on the Australian and near shore markets. The 2010 report entitled, Defining cloud computing highlights provider gaps in the Australian ICT market, was widely reported in both the online ICT industry press and mainstream media.