In the context of AI governance, an AI systems development process is a set of practices designed to ensure that all AI projects solve the problems for which they were planned and adhere to AI ethical principles. As an inherently operational process, AI systems development should adhere to parliament’s AI policy, as well as follow the institution’s data management and security management procedures.
In a parliamentary context, an AI systems development process is relevant to AI governance as a way of reducing ethical and operational risks. Details of how it does this are given below.
Preserving the privacy of data subjects
Personal data should be protected not only in the development phases, but also in the AI system’s outputs.
Ensuring transparency throughout the development and maintenance phases
AI systems often imply complexity, making their internal decision-making processes opaque. For this reason, practices should be scrutinized in order improve transparency throughout the AI system life cycle – from initial project planning until the AI system is withdrawn from operation. This approach should make it easier to explain the AI system’s outcomes and ensure that the development phases respect parliament’s rules and are compliant with regulations.
Reducing biases and discrimination
Techniques to identify groups that are to be protected from biases should be applied throughout the process, from planning to deployment. While AI systems are in operation, continuous monitoring helps to minimize new biases not seen in the development phase.
Creating accountability
Through systematic steps for planning, implementing, testing and improving, practices are delegated and approved by key stakeholders, with individual roles and responsibilities clearly defined. The AI system’s functionality should be documented in such a way that it can be audited.
Improving robustness and safety
The systems development process should focus on improving robustness and safety, through a system architecture that prioritizes cybersecurity and through extensive testing.
Maintaining human autonomy
Humans should play a continuous verification role in order to ensure that the AI system’s outputs are reliable, both during development and following deployment in a live environment. This human oversight will ensure that the system continues to adhere to the ethical principles considered in the project phase, and allows for new ethical risks to be identified.
Guaranteeing regulatory compliance
AI systems are required to comply with various legal and regulatory requirements, established both internally and within parliament’s country or region.