The misuse of artificial intelligence technology Grok (Grok AI) on the X (Twitter) platform has caused widespread concern across society. While useful for obtaining information quickly, Grok AI has recently been exploited to generate pornographic images from photos uploaded by users. This feature has negative impacts, as it can severely affect users’ mental and psychological well-being.
Indonesia’s Ministry of Communication and Digital Affairs has decided to block access to the Grok AI application to protect the public from the risk of exposure to fabricated pornographic content.
This government action has drawn international media attention, with Indonesia described as the first country to decisively block Grok over concerns about the spread of AI-generated pornographic content.
The decision to shut down access to Grok AI has been positively received by Iradat Wirid, Deputy Executive Secretary of the Center for Digital Society at Universitas Gadjah Mada (CfDS UGM). According to Wirid, the government’s move is a commendable step toward safeguarding privacy and reducing people’s inclination to use Grok AI for harmful purposes.
For him, the misuse of Grok AI technology reflects a disconnect between business logic and moral human values. It also points to problematic ethical AI processes within Grok AI on the X platform.
Such challenges, he noted, often accompany the emergence of new technological innovations. To mitigate potential negative impacts, the government must establish clear AI safeguards.
“The Indonesian government must maintain independence in formulating policies that address violations of democratic boundaries and not merely rely on external regulations,” he said on Monday (Jan. 19).
Furthermore, Wirid emphasized that protection through digital literacy must go hand in hand with technological innovation. However, the current situation reveals an imbalance between technological information and public literacy, particularly concerning the use of personal data and social media.
The public needs to understand relevant legal frameworks governing these issues, such as the Personal Data Protection Law and the Law on Sexual Violence Crimes.
The government must take firm action against platforms that harm the public and create the potential for gender-based online sexual violence, especially given that the majority of victims in such cases are women.
Therefore, the government needs to place greater emphasis on educating the public about personal data protection in the realm of social media.
“At this point, the only real protection we have is ourselves by reducing the amount of content we share and strengthening public awareness of digital literacy,” Wirid said.
He stressed that technological development involves human involvement, from algorithm design and technological crises to real-world implementation. This is essential because only humans possess moral judgment and a sense of responsibility.
Humans must remain the primary controllers of technological advancement so that technology and human realities in digital spaces can align, thereby reducing incidents that harm individuals.
“Technological innovation without responsibility amounts to a retreat of the human role,” he asserted.
Author: Jesi
Editor: Gusti Grehenson
Post-editor: Rajendra Arya
Illustration: Reuters