Avoiding unethical and costly commercial mistakes with AI

A mathematical means of helping regulators and business manage Artificial Intelligence systems’ biases towards making unethical, and potentially very costly and damaging commercial choices has been developed by researchers. Researchers from the University of Warwick, Imperial College London, EPFL (Lausanne) and Sciteb have developed  an ethical eye on AI methodology.

Artificial intelligence (AI) is increasingly deployed in commercial situations. Consider for example using AI to set prices of insurance products to be sold to a customer. There are legitimate reasons for setting different prices for different people, but it may also be profitable to ‘game’ their psychology or willingness to shop around.

The AI has a vast number of potential strategies to choose from, but some are unethical and will incur not just moral cost but a significant potential economic penalty as stakeholders will apply some penalty if they find that such a strategy has been used – regulators may levy significant fines of billions of Dollars, Pounds or Euros and customers may boycott you – or both.

So in an environment in which decisions are increasingly made without human intervention, there is therefore a very strong incentive to know under what circumstances AI systems might adopt an unethical strategy  and reduce that risk or eliminate entirely if possible.

Mathematicians and statisticians from University of Warwick, Imperial, EPFL and Sciteb have come together to help business and regulators creating a new “Unethical Optimization Principle” and provide a simple formula to estimate its impact. They have laid out the full details in a paper bearing the name “An unethical optimization principle”, published in Royal Society Open Science on  Wednesday 1st July 2020.

The four authors of the paper are Nicholas Beale of Sciteb; Heather Battey of the Department of Mathematics, Imperial College London; Anthony C. Davison of the Institute of Mathematics, Ecole Polytechnique Fédérale de Lausanne; and Professor Robert MacKay of the Mathematics Institute of the University of Warwick.

Professor Robert MacKay of the Mathematics Institute of the University of Warwick said: “Our suggested ‘Unethical Optimization Principle’ can be used to help regulators, compliance staff and others to find problematic strategies that might be hidden in a large strategy space. Optimisation can be expected to choose disproportionately many unethical strategies, inspection of which should show where problems are likely to arise and thus suggest how the AI search algorithm should be modified to avoid them in future.

Related Posts
Others have also viewed

AI-powered digital twins redefine BMW’s approach to global factory planning

BMW is reinventing the digital twin by embedding AI at its core, enabling intelligent assistants, ...

Industrial AI will not deliver if it is treated as a goal rather than a tool

The accelerating shift toward industrial AI promises efficiency, agility, and sustainability gains. Still, manufacturers must ...

How AI is transforming manufacturing for the future

AI is changing how manufacturers operate, from streamlining processes to enhancing efficiency and decision-making. Mark ...

The truth about AI in manufacturing is messier than you think

Executives are under pressure to deploy AI, but many efforts stall before they start. Successful ...