Dr. Yaozhang Pan, Head of Data Science, Shopee
However, it is important to make the systems transparent and explainable to users. AI is being widely used in many areas today, such as to decide on loans, insurance claims and job applications, and even in the judicial system. If your mortgage, job interviews, or written judgement are decided by an algorithm, you would want to be sure its assessment is fair. This is impossible if the people using AI do not understand how it works.
At Shopee, we rely heavily on AI to identify fraudsters and spam listings. We put a lot of effort into educating every local operation team to ensure that they have a good understanding of how the systems work. We also build numerous explanation tools to help teams understand why the models make certain decisions.
Data Security and Privacy
AI-enabled systems rely heavily on data, so AI experts need to access vast amounts of data, including sensitive personal data, in order to build AI models. As a result, the risk of a data breach arises.
At Shopee, we have a dedicated Developmental Operations team that controls data warehouse access hierarchically. The team also develops up-to-date network security technologies to avoid any intentional or unintentional data leakage.
Human Safety
People in the AI industry expect that autonomous systems such as self-driving cars, Unmanned Aerial Vehicles or robotics will be seamlessly integrated into society in the future. However, if the AI-enabled systems are deployed across public or industrial areas, we will first have to ensure that human safety will not be compromised by these autonomous systems.
Fairness and Nondiscriminatory
A machine learning AI-enabled system is developed using training data. A machine learning model typically relies on the training data to recognise and identify patterns and make predictions for new data. Since we only work with a small sample of data, this causes skewed and incomplete training data sets. Also, real-world data usually have natural bias. Some examples include over-policing of minority groups and discrimination in access to loans. If we do not correct biases in the data, it is likely that AI-enabled systems will further amplify existing discrimination. At Shopee, we specifically design algorithms to counter the possible bias of training data by balancing factors such as gender and age in our user data.
Human Control
As we build trust in AI-enabled systems, we should continue to exercise our ability to judge the correctness of decisions made by these systems. We should also actively challenge decisions made by AI-enabled systems that we believe to be unfair. As such, no matter how advanced AI becomes, we should always ensure human control of it. At Shopee, we make sure all AI-enabled systems follow Standard Operating Procedures to bring in regular human intervention.
As a result of the above challenges, we continuously drive the notion of responsible AI at Shopee. We make sure that every employee working with AI is aware of the impact that AI-enabled systems can have when implemented in different situations. We believe in building responsible AI-enabled systems and we make sure to account for decisions made by these systems. AI-enabled systems need to be programmed to act responsibly and fair within their boundaries for sustainable and trustworthy outcomes. This is the only way towards successful and sustainable use of AI in our organisation.
