{"id":"f-86c21c4f86-2834203e-05dd-5a3c-bc04-235a15dc6344","title":"AI Safety Push: Anthropic hires manager to handle chemical, explosive threat risks","description":"Anthropic says that the role of the manager will be to design and implement evaluation methodologies for 'assessing AI model capabilities' related to chemical weapons, explosives synthesis, and energetic materials.","timestamp":1774084260,"category":"technology","headline":"AI Safety Push: Anthropic hires manager to handle chemical, explosive threat risks","modifiedHeadline":"AI Firm Hires Expert for Explosives Risk","subCategories":["scid_b7e786a9"],"subcategoriesName":["Artificial Intelligence"],"region":"IN","bundleMetaData":{"bundleId":"c35cfc57-1bba-4539-a24c-695ea99ac023","bundleTitle":"Mastering AI","cardData":null},"iabCategoryId":"597","iabCategoryName":"Artificial Intelligence","fcSummary":"ai firms like anthropic and openai are hiring specialists to manage risks related to chemical weapons and explosives, aiming to shape how ai handles sensitive information. this follows growing scrutiny over ai's potential existential threats and recent us government involvement in military operations. experts caution that this approach could inadvertently provide ai tools with dangerous information, despite safeguards. concerns remain about ai's deployment in sensitive applications.","summary":"Anthropic hires manager to assess AI risks linked to explosives & chemicals, following OpenAI's similar move amid rising AI safety concerns.","ctaUrl":"https://trends.glance.com/newz/news/IN/en/firstpost/f-86c21c4f86-2834203e-05dd-5a3c-bc04-235a15dc6344","sourceUrl":"https://www.firstpost.com/tech/ai-safety-push-anthropic-hires-manager-to-handle-chemical-explosive-threat-risks-13990273.html","bannerImage":"https://g-mob.glance-cdn.com/public/fc/image/Rem4bZYB9OK0.webp","content":"The United States-based artificial intelligence (AI) firm Anthropic has posted a vacancy on LinkedIn to hire a Policy Manager dealing with chemical weapons and high yield explosives. The company says that the role is to shape how AI systems handle sensitive chemical and explosives information.\n\n
\n
\n In the recruitment post, the company says that the role of the hired person will be to design and implement evaluation methodologies for 'assessing AI model capabilities' related to chemical weapons, explosives synthesis, and energetic materials.\n
\n
\n The firm says that the applicants should have a minimum 5 years of experience in chemical weapons or explosives defense, with 'deep expertise in energetic materials, chemical weapon agents, or related areas.'\n
\n

'Responsible AI'

\n
\n Anthropic is not the only firm to hire someone for such a role. Earlier, OpenAI had posted a similar kind of \nvacancy\n. The San Francisco-based company planned to recruit a researcher, related to frontier biological and chemical risks, in its preparedness team.\n
\n
\n Acknowledging that while the frontier AI models have the potential to benefit humanity, they also pose severe risks, the company said, \"To ensure that AI promotes positive change, the Preparedness team helps us prepare for the development of increasingly capable frontier AI models.\" This team by OpenAI is constituted to identify, track, and prepare for catastrophic risks related to frontier AI models.\n\n
\n
\n However, experts warn that there lies an inherent risk of this approach. It could give AI tools information about weapons - even if they have been instructed not to use it.\n
\n

AI- New frontier of War

\n
\n The AI industry has recently come under heavy scrutiny about the potential existential threats posed by the technology. Recently, the US government has called on AI firms while launching its war in Iran and also military operations in Venezuela.\n
\n
\n Previously, Anthropic has decided to take legal action against the US government, which designated the company a supply chain risk. The firm insisted that its systems must not be used by the government in either fully autonomous weapons or mass surveillance.\n\n
\n
\n Anthropic co-founder Dario Amodei had said in February that the technology is not good enough yet, and should not be used for these (war) purposes.\n
\n
\n However, a report by BBC says that Anthropic's AI assistant, Claude, has not yet been phased out, and is still embedded in systems provided by Palantir and is also being deployed by the US in the US-Israel Iran war.","readDurationInMinutes":"4","author":{"name":"Firstpost","logo":"https://glance-mob.glance-cdn.com/public/bubble/png/28d65284-7c7e-4e74-a1da-84b4daef1e4c.jpeg"},"ism":false,"analyticsResponses":[{"measurementId":"DUMMy","type":"GA"}],"pointerSummary":["AI firm Anthropic seeks a Policy Manager to handle chemical weapons data.","Applicants need 5 yrs experience in explosives/chemical defense; OpenAI did similar.","Experts warn AI risk: data access could aid weapons, despite safety protocols."],"tags":["AISafety","Anthropic","ChemicalWeapons","Explosives","EnergeticMaterials","PolicyManager","ResponsibleAI","OpenAI","FrontierAI","CatastrophicRisks","AIWarfare","USGovernment","Palantir","ClaudeAI","USIsraelIranWar","DarioAmodei"],"redirectionEnabled":false,"consent":true}

AI Safety Push: Anthropic hires manager to handle chemical, explosive threat risks

SUMMARY