mrlloyd.net's Tech Brief

Artificial Intelligence

Models, research and the companies building them.

How we built ChatGPT’s novel ad stack for user trust and relevance

OpenAI developed a novel ad stack for ChatGPT using large language models to understand conversational intent and deliver relevant ads. The ad stack is designed to keep ads separate from answers. The system is capable of handling a large volume of conversations.

Why it matters: This technology allows for more targeted and relevant advertising in conversational AI systems.

Using thousands of AI agents to uncover new leads in biological data

OpenAI, PerturbAI, and Scripps Research collaborated on a project using thousands of AI agents to analyze data from millions of brain cells. The AI agents were distributed across multiple machines to process the large dataset. This approach allowed the team to uncover new leads in biological research.

Why it matters: This approach demonstrates the potential of distributed AI to accelerate scientific research and discovery in complex fields like biology.

Democratic governance of frontier AI, part II: Empowering cyber defenders

OpenAI has outlined a plan to empower cyber defenders with frontier AI, stronger safeguards, and modernized cybersecurity. The plan aims to improve the resilience of public institutions. The blueprint is part of a broader effort to promote democratic governance of AI.

Why it matters: This plan could help protect against AI-powered cyber threats and strengthen the security of public institutions.

Cloudflare links vulnerability discovery to defense with OpenAI

Cloudflare has partnered with OpenAI to use its Daybreak tool to identify vulnerabilities in its systems and propose fixes. The partnership aims to improve the security of Cloudflare's services. Cloudflare's developers are also using OpenAI's Codex to build and improve their code.

Why it matters: This partnership may help Cloudflare identify and fix security vulnerabilities more efficiently, potentially reducing the risk of data breaches.

Judge dismisses Sam Altman’s sister’s sexual abuse lawsuit

A US District Judge has dismissed a lawsuit filed by Ann Altman against her brother Sam Altman, OpenAI CEO, alleging childhood sexual abuse. The lawsuit was dismissed with prejudice, meaning it cannot be refiled. The judge cited Ann Altman's failure to comply with court deadlines.

Why it matters: This ruling has significant implications for Ann Altman's ability to pursue her claims against her brother.

Google’s more personalized Gemini AI is heading to your car

Google's Gemini AI assistant in cars will now be able to access user information from Gmail, Calendar, Maps, Photos, and other Google apps. This allows users to ask more personalized questions, such as flight status or navigation to a specific location. The update is rolling out to Android Auto and cars with Google built-in.

Why it matters: This update enables users to access more convenient and personalized features in their cars, such as automated navigation and information retrieval.

Meta drops the word "train" from its commercial TOS after AI backlash

Meta has updated its commercial terms of service to remove the word 'train' after facing backlash over its AI scraping policy. The updated terms still allow Meta to scrape business pages for data. Experts say the changes do not go far enough to protect users from invasive scraping.

Why it matters: The update may not alleviate concerns about Meta's ability to scrape business pages without permission.

Gemini's Personal Intelligence is coming to cars

Google is rolling out Personal Intelligence to Android Auto and Google Built-in, allowing users to access more personalized AI-powered features in their vehicles. The feature uses data from connected apps like Gmail and Calendar to provide more accurate and convenient responses. Personal Intelligence is optional and can be turned off in the car's settings.

Why it matters: This update may raise concerns about data sharing and user privacy, and users should review their settings to ensure they are comfortable with the amount of data being shared with Google's AI.

Ukraine’s drone rescue of wounded soldier puts much touted idea into practice

Ukraine's military successfully used a drone to evacuate a wounded soldier from the frontline, showcasing a new method for casualty evacuation. The operation involved a heavy hexacopter drone with a winch and carabiners to secure the soldier. The drone flew for 1 hour and 14 minutes, covering nearly 39 miles.

Why it matters: This development highlights the potential for drones to improve the safety and efficiency of casualty evacuation in combat zones.

NVIDIA Cosmos3-H-Dreams: Bringing Clinical Surgery to Life Through Generative Simulation

NVIDIA has introduced Cosmos3-H-Dreams, a generative simulation model that brings interactive and realistic surgical simulation to clinical scenes. The model is trained on video and kinematics recordings from the CMR Surgical Versius platform and can simulate complex anatomy, tissue motion, and occlusion. It can run interactively on a single NVIDIA RTX PRO 6000 GPU.

Why it matters: This technology has the potential to improve surgical training and planning by providing a realistic and interactive simulation environment.

Meta pauses Muse sharing after researchers find AI chats on the web

Meta has paused a feature in its AI assistant Muse that allows users to share conversations with others through links, after researchers found over 6,800 of these links publicly available on the web. The links were discovered through public DNS records, and contained sensitive information such as a marketing company's revenue and a workplace's calendar. The feature allowed users to share conversations with others through a link, but the design of the links made them easy to find.

Why it matters: This highlights the potential risks of sharing sensitive information through AI-powered chat platforms.

Meta tries to scapegoat staff who downloaded torrents to spare execs

Meta has been ordered to identify executives who authorized staff to download copyrighted books from shadow libraries to train AI, after the company tried to blame staff for the actions. The order could expose a wider range of supervisors and executives involved in the decision-making process. Meta had argued that no one at the company made a decision to pirate books, but staff testified that they were directed to do so by their superiors.

Why it matters: This order could provide evidence that Meta was involved in copyright infringement and may have to pay damages to authors and publishers.

FairStress: A deeper evaluation of fairness in LLM decision-making

Hugging Face introduced FairStress, a benchmark for measuring demographic fairness in large language models (LLMs) beyond the final answer. The benchmark tests how LLMs respond to persuasive arguments and demographic information in various scenarios. FairStress is available for download and will be integrated into Olmo-eval, an open workbench for model evaluations.

Why it matters: This benchmark can help developers identify and address potential biases in LLMs that may affect people's opportunities and resources.

The new economics of enterprise AI

Enterprise AI is shifting from isolated experiments to a foundational infrastructure, requiring companies to focus on efficiency rather than just consumption. This shift changes the question from 'can we use it?' to 'how efficiently are we using it?' and introduces new metrics such as effective cost per useful outcome. Companies need to weigh not just what they consume, but how efficiently they operate the system.

Why it matters: Understanding the economics of enterprise AI is crucial for companies to optimize their AI infrastructure and reduce costs.

ALTK-Evolve: How learned memory tops the τ²-bench leaderboard on customer service tasks without a frontier model

Researchers used GPT-4.1 to create a learned memory system that improved a basic customer service agent's performance on the τ²-bench benchmark, outperforming retail entries without updating model weights. The system extracts guidelines from the agent's training attempts and applies them to subsequent conversations. The approach also improved performance when used with frontier models.

Why it matters: This approach can help improve the reliability and capability of customer service agents without requiring significant updates to the underlying model.

Spotify pulled 50 million AI slop and spam tracks from its recommendations

Spotify removed over 50 million AI-generated songs from user recommendations over the past year. The company made changes to its music recommendation system to highlight human-made music. Spotify uses a combination of methods to identify AI-generated content, including listener engagement and third-party AI detection tools.

Why it matters: This change may improve the listening experience for Spotify users by reducing the presence of low-quality or unwanted AI-generated music in their recommendations.

Adobe Lightroom mobile can now open closed eyes in photos with a simple tap

Adobe has updated its Lightroom mobile app to include a feature that uses generative AI to open closed eyes in photos with a single tap. The feature, called Open Eyes Quick Action, uses other images of the same person in the user's Lightroom library as reference to match the lighting and pose of the subject's eyes. The feature is available now for iOS, iPadOS, and Android devices.

Why it matters: This update can be useful for photographers who want to quickly fix photos with closed eyes without needing to use more advanced editing tools or subscribe to a paid plan.

Meta Muse exposes users' personal and business secrets when they share conversations

Researchers discovered that Meta's Muse AI assistant can expose users' personal and business secrets when they share conversations through web links. The links, which contain sensitive information, can be easily found using a passive DNS search. This is due to a design decision that includes the conversation title in the URL, making it searchable.

Why it matters: This vulnerability highlights concerns about the level of access required by Muse and whether it is justified by its benefits.

AI adoption by industry shows what other sectors can learn

A recent survey by TripleTen found that AI adoption rates vary across industries, with tech and finance leading the way, while healthcare and education are slower to adopt. The survey also identified key skills that are in demand, including the ability to judge whether AI output is correct or not. Workers who learn these skills and implement AI tools in their workplaces are more likely to have a voice in shaping organizational policy and have better career prospects.

Why it matters: Understanding the current state of AI adoption and the skills in demand can help workers and leaders in non-tech industries prepare for the shift and make informed decisions about training and resource allocation.

Franchisee reconciles cash in 94% less time with ChatGPT Work

An independent Schlotzsky's and Cinnabon franchisee used ChatGPT Work to automate menu repricing, reducing the time required from 20 hours to 1 hour, and potentially freeing up $100,000 in cash flow.

Why it matters: This implementation demonstrates the potential for AI-powered tools to streamline business operations and improve financial efficiency.

A visit to Samsung’s massive new semiconductor hub

Samsung is building a massive new semiconductor manufacturing complex in Pyeongtaek, South Korea, to meet growing demand for memory chips driven by the AI boom. The complex already has three operating fabs and a fourth is coming online, with a fifth fab under construction. Thousands of workers, including hundreds of women, are employed on site, with safety being a top priority.

Why it matters: The expansion is crucial for Samsung to reclaim its lead in the global market for high-bandwidth memory chips.

Terminal X matches senior investor judgment 88.6% with GPT-6.1

Terminal X's Eval Agent uses GPT-6.1 to evaluate investment decisions, achieving an 88.6% match with senior investor judgment. The evaluation process involves a 54-criterion rubric. The model catches 25% more deviances from a fund's mandate compared to previous versions.

Why it matters: This development may improve the accuracy of investment decisions by leveraging AI-powered evaluation tools.

MPS in PyTorch 2.15

PyTorch 2.15 adds support for FP8 tensors on Macs with Apple silicon, improving memory efficiency and speeding up linear layers and mixture-of-experts layers for language-model decoding. The update also includes new Metal kernels for complex-valued computations and convolutions, and improves performance for video decoding and softmax operations. The release requires an Apple silicon Mac with macOS 15 or later and Python 3.11 or later.

Why it matters: This update is significant for developers who run models on Macs with Apple silicon, as it improves performance and memory efficiency for various tasks, including language-model decoding and video decoding.

AnyLanguageModel 1.0: One Year of Local Models on Apple Platforms

Hugging Face released AnyLanguageModel 1.0, a drop-in replacement for Apple's Foundation Models framework, with improved support for local and hosted models, and a shared API for choosing the right model for each task. The update includes support for open-weight models, hosted providers, and accelerated model downloads. AnyLanguageModel now works on Linux and has improved reasoning and token usage features.

Why it matters: Developers can now use a unified API to choose between local and hosted models, making it easier to integrate language models into their apps.

Hugging Face ❤️ TorchTPU: TPUs, Natively

Hugging Face has released TorchTPU, a native PyTorch backend for TPUs, allowing users to run PyTorch models on Google's Tensor Processing Units (TPUs) without needing to use torch_xla or JAX. This provides native support for TPUs in the Hugging Face ecosystem, including Transformers, Diffusers, and Kernels. Users can now run models on TPUs with a single command, without needing to modify their code.

Why it matters: This release simplifies the process of running PyTorch models on TPUs, making it easier for developers to access the performance benefits of TPUs without requiring additional software or modifications to their code.

OpenAI acquires Orchestra Bio

OpenAI has acquired Orchestra Bio, a company that specializes in AI-powered operations for life sciences R&D. The acquisition aims to help biopharma teams accelerate drug development and advance new treatments. Orchestra Bio's technology will be integrated into OpenAI's platform.

Why it matters: This acquisition could lead to faster and more efficient drug development processes in the biopharma industry.

The fossil fuel comeback is here

The US is building more fossil fuel infrastructure than in the past decade, driven by growing energy demands from data centers, factories, and electric vehicles. The Trump administration has prioritized fossil fuels over renewables, leading to a shift in the energy landscape. Renewable energy growth has slowed down, with wind and solar production increasing but still lagging behind fossil fuels.

Why it matters: This shift in energy priorities could lead to higher electricity prices and more pollution for decades to come.

CoreWeave’s debt is becoming the whole AI industry’s problem

CoreWeave's debt has slipped into distressed territory, with investors demanding a 1,000 basis point yield increase, causing its shares to drop over 20% since Tuesday. The company's debt is valued at over $35 billion, with $103.7 billion in remaining performance obligations from customers. CoreWeave's business model is based on selling compute, which it does not make money from, and it has a significant amount of expensive debt.

Why it matters: This development highlights the financial risks associated with the AI industry's debt and the potential consequences for companies like CoreWeave.

Accused OpenAI spy had folder called “Saudi Gov Docs,” FBI says

A US court has denied the release of a former OpenAI engineer accused of spying on the company, citing concerns that the Saudi government will help him flee the country. The engineer, Abdulrahman Alfozan, had accessed a folder called 'Saudi Gov Docs' on his iPhone and had been in contact with a member of the Saudi royal family. Alfozan had also booked a one-way ticket to Riyadh, Saudi Arabia, which was allegedly paid for by the Saudi government.

Why it matters: The case highlights the risks of espionage and the potential for foreign governments to interfere with investigations.

Making the internet better for AI agents might make it worse for everyone else

Personal AI agents are being used to perform tasks on the internet, but their presence is causing issues for websites and may lead to the internet being redesigned for them instead of humans. Many websites are blocking AI agents due to concerns about security and advertising. The use of AI agents is growing rapidly, with 5 million downloads of Meta's Muse app in its first month.

Why it matters: The shift towards an AI-optimized internet could make it more difficult for humans to use the web for everyday tasks.