433 articles tagged with Safety/Alignment
🤖 Guided Model Alignment Frameworks Gain Traction in AI ResearchResearchers are increasingly focusing on inference time alignment methods to improve the performance of large langua...
I've spent the last year building production AI pipelines for SaaS platforms. The prompts were solid....
A former engineer at Elon Musk’s xAI who now heads a think tank focused on AI safety filed a lawsuit claiming he was fired from the SpaceX subsidiary for raising concerns about the...
🤖 AI red teaming comes of age📝 When Ram Shankar Siva Kumar launched Microsoft’s AI red team in 2019, the discipline barely existed. “The running jok...https://www.csoonline.com/art...
Large Language Models (LLMs) are increasingly used for code generation, raising concerns that they may be misused to produce malicious code. Meanwhile, Grammar-Constrained Decoding...
Make yourself and your family AI-scam proof, step by step → https://neuralnutshell.com Roman Yampolsky, who coined the term ...
SAN FRANCISCO--(BUSINESS WIRE)--The Center for AI Safety (CAIS), a nonprofit focused on reducing societal-scale risks from artificial intelligence, today announced the appointment ...
Conditioning a language model on additional context, such as feedback on a previous attempt, typically improves its response. Self-distillation trains the model to retain this impr...
Built on pretrained vision foundation models (VFMs), representation autoencoders (RAEs) have recently emerged as a promising approach for constructing semantically rich latent spac...
Survey reveals 80% would jailbreak their Kindle before letting Amazon winAndroid Authity readers want control over their pre-2012 Kindle devices.https://www.androidauthority.com/su...
Prior work has shown that fine-tuning large language models on malicious or incorrect outputs in narrow domains can induce broad misalignment and harmful behavior, a phenomenon kno...
Large language models (LLMs) increasingly participate in emotionally sensitive social conversations, where responses may shift from balanced support toward excessive validation or ...
Over the past few months I built an AI-assisted delivery framework — not to write code faster, but to...
MIT researchers gathered April 30 to examine what happens when AI logic doesn't match human reasoning. A central warning: replacing institutions with AI before understanding how th...
The Argument The AI safety conversation is dominated by two camps: the alignment...
Representation alignment with pretrained vision models has recently shown strong potential for accelerating diffusion transformer training. By aligning intermediate diffusion featu...
https://80000hours.org/podcast/episodes/claude-mythos-hacking-alignment/Scary if true.#AI #cybersecurity
@bbc_news 4/2. Situational Awareness and DeceptionDuring safety testing, AI labs put models through "alignment checks" to make sure they aren't doing anything dangerous. However, b...
A better question than "what is your p-doom?" is " what's the likelihood that, at any point in History, #AI alignment becomes more important than human alignment?"
Anthropic just filed for an IPO at a $965 billion valuation.The company that markets itself on AI safety now has public market shareholders to answer to.Public companies face press...
🔥 TRENDING📢 AI Safety Report 2026: Warum Experten ein neues AI Safety Institute in Deutschland fordern - Table.Briefings🔗 https://news.google.com/rss/articles/CBMiwAFBVV95cUxNNGJDZ...
🔥 TRENDING📢 AI Safety Report 2026: Bestehende KI-Sicherheitspraktiken reichen nicht aus - heise online🔗 https://news.google.com/rss/articles/CBMitAFBVV95cUxPS3h3aDF6cks5aWR6TGxvRjQ...
Multicultural multi-agent systems are increasingly deployed in globally diverse settings, where different agents are grounded in different cultural backgrounds. Existing cultural e...
Бот, который отказался блокировать Red TeamВо время настройки SOAR произошёл любопытный случай. Я прямо разрешил AI предложить блокировку атакующей машины. Он прочитал инструкцию. ...