口头答复 · 2026-10-07 · 届国会 15
前沿 AI 安全监管与跨部门事故报告框架
前沿 AI 安全监管与跨部门事故报告框架
陈以君(Charlene Chen)、朱佩玲(Choo Pei Ling)、叶汉荣(Yip Hon Weng)、任梓铭(Alex Yam)等议员就新加坡 AI 安全院对前沿 AI 模型的独立测试能力、跨部门事故报告框架,以及类似澳大利亚自主 AI 代理越权访问事件对政府系统韧性的影响,询问数码发展及新闻部长。高级政务部长陈杰豪(Tan Kiat How)代为答复,指现有网络安全、数据保护与关键信息基础设施监管框架同样适用于代理型 AI 系统,政府正通过 GovTech 等机构试验负责任地部署代理 AI,并持续审视是否需要强化相关框架,但未承诺设定强制性前沿 AI 安全测试的具体门槛或时间表。
为什么重要
陈杰豪在口头追问中表示,现有网络安全、个人数据保护和关键信息基础设施框架已适用于代理式 AI,政府正检讨加强,但未承诺强制安全测试或报告门槛
关键要点
- • 现有的指导方针、法规、风险管理流程和监督机制同样适用于代理型 AI 系统,包括维持人类问责的原则。
- • 政府通过 GovTech 等机构在公共服务领域试验代理 AI 的应用,以了解如何负责任地落实相关系统。
- • 新加坡 AI 安全院持续与国际同行紧密合作,分享 AI 安全的最佳实践。
- • 新加坡最近在联合国等多边场合与志同道合的国家签署支持声明,加强 AI 安全领域的国际合作。
- • 现有事故报告框架(例如个人数据保护法)已设定门槛,不论机构是否使用 AI 工具均需遵守,企业也须管理员工未经批准使用生成式 AI(影子 AI)带来的风险。
政府立场是,现有网络安全、数据保护及关键信息基础设施监管框架已适用于代理型 AI,相关框架正接受审视并强化,但政府未承诺为前沿 AI 模型设定强制性测试要求或具体门槛和时间表。
议员们担心,现有框架可能未能明确界定 AI 事故的报告门槛、及时掌握海外开发商的通报义务,也未能为受 AI 系统影响的公众提供足够的保护与申诉渠道。
这显示新加坡倾向于将代理型 AI 的风险纳入现有网络安全、数据保护和关键信息基础设施监管体系,而非另立专门的强制性前沿 AI 法规,同时通过内部试验与国际合作逐步调整监管力度。
“因此,现有的指导方针和法规,包括风险管理流程和监督机制,同样适用于代理型 AI 系统。”
参与人员 (5)
完整译文(中文)
Hansard 原始记录
10 陈以君博士询问数码发展及新闻部部长(a)新加坡 AI 安全研究所独立评估先进人工智能模型的能力是否受到开发者提供的访问权限不足的限制;(b)在无法获取访问权限的情况下如何评估风险;以及(c)是否将要求对被评估为构成足够高风险的人工智能系统进行独立安全测试。
11 陈以君博士询问数码发展及新闻部部长(a)政府是否已评估现有行业事件报告要求是否充分涵盖涉及人工智能系统的严重事件;以及(b)在存在缺陷的地方,是否会考虑跨行业报告框架处理严重人工智能事件。
12 任梓铭先生鉴于最近澳大利亚政府系统被自主人工智能代理非法访问,询问数码发展及新闻部部长(a)新加坡是否已评估政府数字系统抵御类似代理人工智能行为的韧性;以及(b)现有网络安全和事件报告框架是否充分处理未被人工操作者具体指导的人工智能系统的自主行为。
13 朱佩玲博士询问数码发展及新闻部部长(a)政府是否会为在新加坡部署的前沿人工智能模型引入强制性安全要求,包括部署前风险评估、独立安全测试、防止滥用的保护措施和严重事件的报告;以及(b)如果是这样,随着人工智能能力的发展,这些要求将如何实施和更新。
14 叶汉荣先生鉴于新加坡支持对前沿人工智能的国际监督,询问数码发展及新闻部部长(a)当无法获得独立测试访问权时,部长如何确定海外模型是否足够安全以部署在基本服务中;以及(b)哪些考虑因素会证明在部署前需要可验证的安全证据是合理的,而不是依赖开发者的保证。
15 朱佩玲博士询问数码发展及新闻部部长(a)政府是否设定了阈值或指标,以确定何时快速的人工智能模型进步将需要超越现有网络安全要求的额外保护措施;以及(b)新加坡是否与外国政府、主要人工智能开发者和国际网络安全机构就跨境人工智能赋能的网络事件建立了应急安排。
数码发展及新闻部高级政务部长(陈杰豪先生)(代表数码发展及新闻部部长):议长先生,关于今天议程上第10至15项问题,这些问题已在昨天的国会会议中第45至51项问题和第33项书面回复问题的回复中进行了处理。[请参阅《新加坡数字系统对代理人工智能行为的韧性评估》,官方报告,2026年10月6日,第96卷,第38期,口头答复问题中未在问题时间结束前答复的部分。]
议长先生:陈博士。
陈以君博士(Tampines):感谢议长。在昨天的回复中,部长提到了从事件和接近事件中学习的重要性。高级政务部长能否澄清什么阈值会使人工智能(AI)事件需要报告,以及即使人工干预防止了实际伤害,重大的接近事件是否也应该报告?
我的第二个补充问题是,部长的大部分回复都集中在政府系统和基本服务上。但人工智能系统也越来越多地由私人组织部署。对于可能受到人工智能系统无意行为严重影响的普通公民,例如涉及其个人或财务信息,现有什么保护措施和救济途径?他们是否有权被告知人工智能相关事件已影响到他们?
我最后的补充问题。如果发现新加坡已部署的人工智能系统对公众构成直接和严重风险,我们的监管机构目前是否有权要求暂停或限制其使用,同时调查风险,包括当基础模型来自海外的情况?
陈杰豪先生:议长先生,我感谢议员提出的三个补充问题。它们大体上围绕同一主题展开,涉及我们如何思考风险和我们的应对措施。所以,让我一起回复她的三个补充问题。
首先,让我说我们认识到人工智能,尤其是越来越多的代理和自主人工智能系统,带来了新的机会和风险。代理系统的区别在于这些系统可以执行操作,与外部系统交互并调整其行为以减少人工监督。所以,我们的回应集中在两个方面。
首先,我们应该认识到来自代理人工智能和议员提到的一些自主系统的许多风险是现有挑战的延伸。因此,无论影响是针对个人还是针对关键信息基础设施系统或其他基本数字服务,这些都是我们今天面临的相同挑战的延伸。
因此,现有的指导方针和法规,包括风险管理流程和监督也适用于代理人工智能系统。保持人工问责制和实施充分控制和护栏的原则也适用。此外,我们长期以来加强数据保护、网络安全和韧性的努力有助于保护人工智能代理交互的系统。
当然,我们正在审查如何调整和加强这些框架和系统,以适应代理系统自主性的增加,同时也在监测这个新兴领域的国际发展。
所以,我想强调的第一点是这些风险已经存在于我们身边。是的,可能有一些新的方面,但这些是现有的风险,现有框架适用,我们正在审查如何加强它们。
其次,我们还必须发展自己的内部能力。我们正在开发超越现有框架和方法的能力。我们正在运行试验和实验,以跟上不断发展的技术,并了解负责任地实施代理系统需要什么。我们当然在政府内部这样做——政府科技局(GovTech)这样做,政府内许多其他机构已经在正确的保护措施下这样做,并负责任地这样做。
我鼓励所有私人部门组织,即使那些没有运营关键信息基础设施或基本数字服务的组织,在部署人工智能代理和系统时也要采取适当的谨慎态度和责任。但我们正在开发能力,这是一个新的、新兴的和快速发展的领域。我们将继续跟踪它并在需要时更新我们的框架和法规。
议长先生:任梓铭先生。
任梓铭先生(Marsiling-Yew Tee):感谢议长。我感谢高级政务部长的回复和部长昨天的回复。我想关注澳大利亚OpenAI案的一个特殊方面,我认为这对我们特别重要。
澳大利亚政府只在事件发生三个月后才了解到非法访问,因为开发者最终识别并将其披露给澳大利亚政府。所以,在我们的本地例子中,我们的法律要求CII和关键基础设施公司报告事件。但今天,开发者,特别是那些海外的开发者,是否有明确的义务迅速及早通知我们的当局,以便我们可以采取适当的措施?
第二个问题是关于测试。我相当确定我们的本地机构,包括网络安全局和我们数码发展及新闻部下的机构对系统和代理进行了相当强大的测试,并开发模型。虽然我支持更强有力的独立测试,但我们最近看到的例子都在开发者工作的范围内,甚至那些测试也已经失控。没有发生任何恶意的事情。只是开发者在测试他们的模型,那些也已经失控了。那么,我们还能采取什么其他保护措施来确保即使在我们自己的测试能力中发现危险,也不会对其他第三方造成风险?
陈杰豪先生:议长先生,让我依次回复议员的问题。
第一个是关于正在进行的事项;这仍然是一个活跃的问题。我从公开报道中读到,议员提到的前沿人工智能公司正在与澳大利亚政府进行通信往来。所以,这是一个活跃的问题,我们在监测它。我想说,我们当然欢迎前沿人工智能公司承担更大的责任来理解和管理他们开发的系统产生的风险,这包括早期识别新兴能力和风险,并在这些系统广泛部署前实施保护措施。
在这些系统或人工智能前沿模型的能力对他人造成伤害或产生影响的地方,我们当然欢迎他们承担责任并尽快纠正问题。
同时,我认为过去几个月的局面已发生了巨大变化。我们看到针对我们的威胁格局——我们面临不同的网络风险、数字风险——来自网络犯罪分子、网络黑客、高级持续威胁(APT),这些是国家赞助、国家支持的行为人,或者只是为了刺激而采用数字解决方案入侵另一个系统的个人。
针对任何组织、任何经济体的风险与几个月前相比非常不同。它不再只是关于最前沿的人工智能模型被用来检测漏洞或能够通过自主链接操作来利用漏洞,但还有许多开源人工智能模型在网上可以自由下载。不良行为者可以使用这些能力对组织造成网络威胁或进行犯罪活动。
所以,威胁格局非常不同。这不仅仅是关于前沿人工智能模型的开发者构成风险,但还有许多许多行为者可以下载开放权重模型,适应它们,创建自己的工具,创建自己的上下文并将其用于不当目的。所以,我们不能只是等待别人告诉我们他们正在入侵我们。新加坡和我们的组织,特别是那些运营关键信息基础设施的组织,有责任采取必要的保护措施。
我们可以做许多事情,运营这些基本服务的组织也可以做许多事情。
首先,确保建立基本的网络卫生措施。我经常用一个比喻:当你构建信息技术系统时,就像在你的建筑物上建造新房间、新翼或新附属建筑。有时,你可能不知道是否锁上了所有门或固定了所有窗户。代理人或恶意行为者利用相同的漏洞——未上锁的门或不安全的窗户——进入我们的系统,无论是通过人工智能手段还是更传统的常规手段。
因此,首先要采取必要的预防措施:改进网络卫生,消除我们的漏洞,并继续积极监测我们系统内的异常行为。这些事情——基本卫生——是我们可以做的事情。
第二,即使恶意行为者使用人工智能能力,我们也应该能够在我们自己的系统内部署这些人工智能能力,以确保我们更早地发现我们的漏洞,我们应该有优势,因为我们了解我们自己的系统。我们知道建筑物的布局和蓝图。我们知道附属建筑在哪里。我们知道关键服务在建筑物中的位置。因此,我们利用人工智能为我们自己带来优势。这是我认为我们应该做的第二件事。
第三,更重要的是,我们不应该让对这些风险的恐惧或焦虑阻止我们充分利用这项技术。因此,我们应该利用这项技术来创造价值、新产品、新服务,为我们的人民创造新机会。但你要负责任地这样做,采取正确的保障措施,在过程中学习和适应。
就议员的观点而言,这些是我们可以做的实际事情,无需等待他人告诉我们他们已经在攻击我们。
议长先生:朱佩玲博士。
朱佩玲博士(Chua Chu Kang):谢谢议长先生,我感谢高级政务部长的澄清和回应。我有几个补充问题。
第一,根据高级政务部长所分享的内容,他能否进一步阐述什么会促使政府从指导转向强制性保障措施,在部署前沿人工智能系统之前?例如,当它表现出大幅提升的自主性、跨越外部系统的行动能力,或现有保障措施无法充分包含的风险。
第二个补充问题,如果达到这样的触发点,这些更强的保障措施或用高级政务部长之前的术语「AI capabilities」能多快应用,包括模型在海外开发的情况?
最后,我们是否已有通过与外国对口部门和主要人工智能开发商联合演习测试的跨境应急安排,它们是否规定了预警、信息共享和遏制的明确责任?
陈杰豪先生:先生,让我依次解决朱博士的问题。她问是否有任何阈值将指导方针转变为强制性要求。这是我们必须继续监测和审查的事情。但让我说,我们正在处理的风险和我们可以采取的缓解这些风险的步骤实际上不是新风险。这些是现有风险——无论是对我们关键信息基础设施的网络攻击,还是由于在基本数字服务内使用人工智能机器人或代理造成的服务中断,例如在金融服务或其他公用事业。这些是现有风险。从网络安全的角度来看,部门监管机构必须与那些关键信息基础设施服务的运营商密切合作,以查看需要采取的保障措施。
因此,无论是自愿性保障措施,例如在某些使用情况下使用代理式人工智能,还是需要为某些部署采取的任何类型的保障措施,这些都必须在部门监管机构和基本服务运营商之间讨论。
当然,我们在公共服务内的不同服务中也这样做。例如,在政府内,政府科技局与公共服务的不同服务所有者密切合作,以查看我们如何负责任地使用人工智能。
关于国际参与,这是一个非常初期、新兴的领域。我们读到头条新闻。例如,我们欢迎关于人工智能安全的更多对话。对于新加坡,我们尝试发挥建设性的作用,例如通过我们主办的技术和科学会议。我们在新加坡举办许多这样的会议,汇集该领域的杰出人物和技术上可信的前沿专业人士来到新加坡,不仅是为了彼此对话,还要与我们互动并与我们分享他们的观点。
我们也一直与不同的人工智能安全研究所密切合作。我们在新加坡的人工智能安全研究所一直与其他国际对口单位密切合作,以分享最佳实践。
因此,我们深入参与正在进行的科学和工程对话。但这是一个新领域,仍在讨论中。最近,在多边论坛(如联合国)上,我们欢迎更多志同道合的国家一起合作。新加坡最近与志同道合的国家签署了一份支持声明,以加强关于人工智能安全的国际合作。这是我们将继续与国际对口单位密切合作的事情。
议长先生:最后一个补充问题,叶汉荣先生。
叶汉荣先生(Yio Chu Kang):谢谢议长先生。我感谢高级政务部长的回应。只是一个很简短的补充问题。这真的是要回应人工智能发展速度的问题。
由于前沿模型及其能力在部署后迅速变化,部委是否会考虑为基本服务使用要求定期重新评估和明确的事件报告安排,而不是将部署前保证视为一次性练习?
我提出这个问题是因为这将有助于在系统快速演变时维护公众信任。
陈杰豪先生:先生,我感谢议员的问题。现有的法规和规则确实有事件报告框架。鉴于不同的威胁格局和运营环境,我们将继续审查这些框架,以查看它们是否需要更新。但这些事件报告框架阈值已经到位。例如,根据《个人数据保护法》。
无论是否使用人工智能工具,组织都仍需遵守这些现有义务。这包括采取合理的安全措施保护个人数据,以及适当的政策和实践来满足其数据保护义务。
一些议员可能在新闻中看到,最近发生了一个事件,原因是一个组织的员工个人使用生成式人工智能工具,开发了一个用于发送营销电子邮件的电子邮件分发脚本,但操作不当,导致个人数据被泄露。
这个案例强调了组织需要管理与人工智能工具广泛个人使用相关的风险,这是许多组织面临的另一个风险——不仅仅是前沿人工智能模型,还有业界所谓的「shadow AI」。这意味着组织可能不知道你的员工可能在将人工智能工具带入你的组织系统中,而这些工具没有得到组织的批准或认可。但它非常容易访问;你在手机上下载它,在工作场所为自己使用它,而没有必要的保障措施。
因此,随着人工智能工具变得更容易获得,员工可能会主动使用它们,这是值得称赞的——我们不应该阻止这种生产性的人工智能使用。但组织需要了解这些工具如何被使用,并采取适当的政策和保障措施。
因此,这些报告阈值和框架已经到位。重要的是,组织需要建立一种文化,在鼓励员工使用人工智能工具的同时,具备正确的保障措施,并注意到因为现在更容易将人工智能工具引入任何组织,所以引入了新的风险。
英文原文
SPRS Hansard 原始记录 · 抓取日期:2026-10-21
10 Dr Charlene Chen asked the Minister for Digital Development and Information (a) whether the Singapore AI Safety Institute's ability to independently evaluate advanced AI models has been constrained by insufficient access from developers; (b) how risks are assessed where such access is unavailable; and (c) whether independent safety testing will be required for AI systems assessed to pose sufficiently high risks.
11 Dr Charlene Chen asked the Minister for Digital Development and Information (a) whether the Government has assessed whether existing sectoral incident-reporting requirements adequately capture serious incidents involving AI systems; and (b) where gaps remain, whether a cross-sector reporting framework for serious AI incidents will be considered.
12 Mr Alex Yam asked the Minister for Digital Development and Information in light of the recent unauthorised access of the Australian government's systems by an autonomous AI agent (a) whether Singapore has assessed the resilience of Government digital systems against similar agentic AI behaviour; and (b) whether existing cybersecurity and incident-reporting frameworks adequately address autonomous actions by AI systems that were not specifically directed by human operators.
13 Dr Choo Pei Ling asked the Minister for Digital Development and Information (a) whether the Government will introduce mandatory safety requirements for frontier AI models deployed in Singapore, including pre-deployment risk assessments, independent safety testing, safeguards against misuse and reporting of serious incidents; and (b) if so, how will these requirements be enforced and updated as AI capabilities evolve.
14 Mr Yip Hon Weng asked the Minister for Digital Development and Information following Singapore’s support for international oversight of frontier AI (a) how the Ministry determines whether overseas models are sufficiently safe for deployment in essential services when independent testing access is unavailable; and (b) which considerations would justify requiring verifiable safety evidence before deployment, rather than relying on developers' assurances.
15 Dr Choo Pei Ling asked the Minister for Digital Development and Information (a) whether the Government has set thresholds or indicators for when rapid AI model advancements will require additional safeguards beyond existing cybersecurity requirements; and (b) whether Singapore has contingency arrangements with foreign governments, major AI developers, and international cybersecurity bodies for cross-border AI-enabled cyber incidents.
The Senior Minister of State for Digital Development and Information (Mr Tan Kiat How) (for the Minister for Digital Development and Information) : Sir, for the Question Nos 10 to 15 on the Order Paper today, these questions have been addressed in the reply to Question Nos 45 to 51 and Question No 33 for written reply at yesterday's Parliamentary Sitting. [ Please refer to " Assessment of Singapore's Digital Systems' Resilience Against Agentic AI Behaviours ", Official Report, 6 October 2026, Vol 96, Issue 38, Written Answers to Questions for Oral Answer not Answered by End of Question Time section. ]
Mr Speaker : Dr Chen.
Dr Charlene Chen (Tampines) : Thank you, Speaker. In her reply yesterday, the Minister mentioned the importance of learning from both incidents and near misses. Could the Senior Minister of State clarify what threshold would make an artificial intelligence (AI) incident reportable, and whether significant near misses should also be reported even when human intervention prevents actual harm?
My second supplementary question is, much of the Ministry's response has focused on Government systems and essential services. But AI systems are also increasingly being deployed by private organisations. For an ordinary citizen who may be seriously affected by an unintended action of an AI system, for example, involving their personal or financial information, what protections and avenues for redress are in place? And would they have a right to be informed that an AI-related incident has affected them?
My last supplementary question. If an AI system already deployed in Singapore is found to pose an immediate and serious risk to the public, do our regulators currently have the power to require its use to be suspended or restricted while the risk is investigated, including if the underlying model comes from overseas?
Mr Tan Kiat How : Sir, I thank the Member for her three supplementary questions. They are broadly aligned to the same theme, around how we are thinking about risks and what the responses are. So, let me take all her three supplementary questions together.
First, let me say that we recognise that AI, and increasingly, agentic and autonomous AI systems, presents new opportunities and risks. The difference for agentic systems is that these systems can execute actions, interact with external systems and adapt their behaviour to reduce human oversight. So, our response focuses on two areas.
First, we should recognise that many risks arising from agentic AI and some of the autonomous systems that the Member has alluded to are extensions of existing challenges. So, whether the impact is on the individual or the impact is on a critical information infrastructure system or another essential digital service, these are extensions of the same challenges that we face today.
Therefore, existing guidelines and regulations, including risk management processes and oversight also apply to agentic AI systems. The principle of maintaining human accountability and putting in place sufficient controls and guardrails also applies. In addition, our longstanding efforts into strengthening data protection, cybersecurity and resilience help protect the systems that AI agents interact with.
Of course, we are reviewing how to adapt and strengthen these frameworks and systems to account for the increased autonomy of agentic systems, while also monitoring international developments in this emerging field.
So, the first point that I would like to emphasise is that these risks are already with us. Yes, there might be some new dimensions to it, but these are existing risks, and existing frameworks apply and we are reviewing how to strengthen them.
Second, we have to also develop our own internal capabilities. We are developing capabilities to go beyond existing frameworks and approaches. We are running trials and experiments to stay abreast of the evolving technology and to understand what it takes to implement agentic systems responsibly. We certainly do so within the Government – the Government Technology Agency of Singapore (GovTech) does it and many other agencies within the Government are already doing it with the right safeguards and doing so responsibly.
I encourage all private sector organisations, even those who are not running critical information infrastructure or essential digital services, to also take appropriate care and responsibility when deploying AI agents and systems within their operations. But we are developing capabilities and this is a new area, emerging area, and rapidly evolving. We will continue to keep track of it and update our frameworks and regulations where needed.
Mr Speaker : Mr Alex Yam.
Mr Alex Yam (Marsiling-Yew Tee) : Thank you, Speaker. I thank the Senior Minister of State for his response and the Minister's reply yesterday. I want to focus on a particular aspect of the Open AI case in Australia, which I think is particularly important for us.
The Australian government was made aware of the unauthorised access only three months after the incident, because the developer eventually identified and disclosed it to the Australian government. So, in our local example, our legislation requires CII and critical infrastructure companies to report incidents. But is there a clear obligation today for developers, especially those who are overseas, to notify our authorities promptly and early so that we can take the appropriate measures?
The second question is about testing. I am quite certain that our local agencies, including the Cyber Security Agency and our agencies under the Ministry of Digital Development and Information do quite robust testings of systems and agents, and develop and models. While I support stronger independent testing, the examples that we have seen recently were within bounds of the developers' work and even those testing have gone out of hand. There is nothing nefarious that is going on. It is just a developer testing their model and those have also gone out of hand. So, what other safeguards can we put in place to ensure that even in our own testing capabilities, to discover dangers that we do not in itself create risk for other third parties as well?
Mr Tan Kiat How : Sir, let me address the Member's question in turn.
The first is around the ongoing matter; it is still a live issue. I have read publicly that the frontier AI company the Member mentioned is in correspondence with the Australian government. So, it is a live issue and we are monitoring it. I would say that we certainly welcome frontier AI companies to take greater responsibility in understanding and managing the risk arising from the systems that they develop, and this includes identifying emerging capabilities and risk early, and putting in place safeguards before these systems are widely deployed.
Where these systems or the AI frontier models' capabilities have caused harm or have caused impact on others, we certainly welcome that they take responsibility and to rectify the issue as soon as possible.
At the same time, I think the landscape has changed drastically over the last few months. We look at the threat landscape arrayed against us – and we have different cyber risk, digital risk that are arrayed against us – from cyber criminals, cyber hackers, advanced persistent threat (APT), which are state-sponsored, state-supported actors, or just individuals who, for the thrill of it, adopt digital solutions to hack into another system.
The risk arrayed against any organisation, any economy is very different compared to a few months ago. It is no longer just about the most frontier AI models being used to detect vulnerabilities or being able to exploit vulnerabilities by autonomously chaining actions together, but there are many open AI models out there online that is freely downloadable. Bad actors can use those capabilities to create cyber threats against organisations or for criminal enterprise.
So, the threat landscape is very different. It is not just about developers of frontier AI models being a risk, but there are many, many actors out there who can download open-weight models, adapt them, create their own harness, create their own contexts and use them for bad purposes. So, we cannot just wait for other people to tell us that they are hacking us. It is the onus on Singapore and our organisations, especially those running critical information infrastructure, to take the necessary safeguards.
There are many things that we can do, many things that the organisations running these essential services can do.
Firstly, making sure basic cyber hygiene is put in place. I often use an analogy: when you build information technology systems, it is like building new rooms and new wings or new annexes to your building. Sometimes, you may not know whether you have locked all your doors or secured all your windows. The agents or bad actors exploit the same vulnerabilities – an unlocked door or the unsecured window – to enter our systems, whether through AI means or more traditional conventional means.
So, first and foremost, take the necessary precaution: improve cyber hygiene, close down our vulnerabilities and continue an active monitoring of anomalous behaviour within our system. These are things – basic hygiene – things that we can do.
Second, even as bad actors use AI capabilities, we should as well be able to deploy those AI capabilities within our own system to make sure that we detect our vulnerabilities earlier, and we should have an advantage because we know our own system. We know the layout, the blueprint of our building. We know where the annexes are. We know where the critical services are in that building. So, we use AI to our own advantage. And that is the second thing I think we should do.
Thirdly, more importantly, is that we should not allow fear or anxiety about those risks to prevent us from making full use of the technology. So, we should use the technology to create value, new products, new services, create new opportunities for our people. But you do so responsibly, putting the right safeguards, learning along the way and adapting.
To the Member’s point, these are practical things we can do, without waiting for someone else to tell us that they have been hacking us.
Mr Speaker : Dr Choo Pei Ling.
Dr Choo Pei Ling (Chua Chu Kang) : Thank you, Speaker, and I thank the Senior Minister of State for his clarifications and response. I have a few supplementary questions.
One, based on what the Senior Minister of State has shared, could he further elaborate what would trigger the Government to move from guidance to mandatory safeguards before deployment of a frontier AI system? For example, when it demonstrates substantially greater autonomy, the ability to act across external systems or risks that existing safeguards cannot adequately contain.
The second supplementary question, if such a trigger is reached, how quickly can these stronger safeguards or in the Senior Minister of State’s previous terms, “AI capabilities” be applied, including where the model is developed overseas?
And lastly, have we had cross-border contingency arrangements that have been tested through joint exercises with foreign counterparts and major AI developers, and do they establish clear responsibilities for early warning, information sharing and containment?
Mr Tan Kiat How : Sir, let me address Dr Choo’s questions in turn. She asked whether there are any thresholds that turn the guidelines into mandatory requirements. This is something that we have to continue monitoring and reviewing. But let me say that the risk that we are dealing with and the steps that we can take to mitigate those risks are actually not new risks. These are existing risks – whether there is a cyberattack on our critical information infrastructure, or there is a service disruption caused by using AI bots or agents within an essential digital service, for example, in the financial services or other utilities. These are existing risks. From a cybersecurity point of view, the sectoral regulators would have to work closely with the operators of those critical information infrastructure services to look at the safeguards that need to be put in place.
So, whether it is a voluntary safeguard, for example, on the use of agentic AI in certain use cases or whatever kind of safeguards that needs to be put in place for certain deployment, those will have to be discussed between the sectoral regulators and the essential services operators.
And certainly, we do so for different services within the Public Service. For example, within the Government, GovTech works very closely with the different service owners of the public services to see how we use AI responsibly.
On international engagements, this is a very nascent, emerging area. We read the headlines. We welcome, for example, greater conversation and dialogue on AI safety. For Singapore, we try to play a constructive role, for instance through technical and scientific conferences, which we host. And there are a number of these conferences that we hold in Singapore with luminaries and very technically credible, frontier professionals in this space who are coming to Singapore, to not just have a conversation among themselves, but also interact with us and share their perspectives with us.
We have been also working very closely with different AI safety institutes. Our AI Safety Institute in Singapore has been working very closely with other international counterparts to share best practices.
So, we are deeply plugged into the scientific and engineering conversations that are happening. But this is a new area, something that is still being discussed. More recently, at multilateral fora, like the United Nations, we welcome more like-minded countries to work together. Singapore has recently signed a statement of support with like-minded countries to have greater international collaboration on AI safety. This is something we will continue to work on very closely with our international counterparts.
Mr Speaker : Last supplementary question, Mr Yip Hon Weng.
Mr Yip Hon Weng (Yio Chu Kang) : Thank you, Mr Speaker. I thank the Senior Minister of State for his response. Just a very short supplementary question. It is really to respond to the issue of the speed of development of AI.
As frontier models and their capabilities change rapidly after deployment, will the Ministry consider requiring periodic re-evaluation and clear incident reporting arrangements for essential service use, rather than treating pre-deployment assurance as a once-off exercise?
I ask this because this would help preserve public trust when systems evolve rapidly.
Mr Tan Kiat How : Sir, I thank the Member for his question. The existing regulations and rules do have incident reporting frameworks. We will continue to review those frameworks to see whether they need to be updated, given the different threat landscape and operating environment. But those incident reporting frameworks thresholds are already in place. For example, under the Personal Data Protection Act.
Regardless whether there are AI tools being used, organisations remain subject to those existing obligations. This includes putting in place reasonable security arrangements to protect personal data, and appropriate policies and practices to meet their data protection obligations.
Some Members will have seen in the news that there was a recent incident that occurred due to personal use of a GenAI tool by an organisation's employee who developed an email distribution script for sending marketing emails, but did so incorrectly, resulting in personal data being revealed.
This case underscores the need for organisations to manage the risk associated with widespread personal use of AI tools, which is another risk that many organisations face – so, not just frontier AI models, but what, in the industry, they call “shadow AI”. Which means that organisations may not know that your employee may be bringing AI tools into your organisation’s system and these are not sanctioned or approved by the organisation. But it is so easily accessible; you download it on your phone, use it for yourself in the workplace, without the necessary safeguards.
So, as AI tools become more accessible, employees may use them on their own initiative, which is something commendable – we should not discourage such productive use of AI. But organisations need to be aware of how these tools are being used, and put appropriate policies and safeguards in place.
So, those reporting thresholds and frameworks are in place. Importantly, it is for organisations to build a culture while encouraging employees to use AI tools to have the right safeguards and to be mindful that new risks are introduced because it is so much easier to bring AI tools into any organisation today.