Story Arc · 92 stories
Multimodal AI
AI that sees, hears, and speaks — the shift from text-only models to systems that handle images, audio, and video together.
- AI NewsReplit’s CEO says the future of work is the ‘self-driving company’
Replit CEO Amjad Masad outlines a vision of 'self-driving companies' in which AI agents handle routine daily work and people focus on higher-level decisions.
- AI NewsOpen From Data Center to Desktop: NVIDIA Expands Nemotron Family With Highest Efficiency Super VL and …
NVIDIA released Nemotron 3.5 Super VL, an open 120-billion-parameter model, alongside two new Nemotron 3.5 Bolt edge models aimed at local agentic workloads.
- AI NewsYouTube Music launches new labels as AI-generated music floods streaming platforms
YouTube Music is introducing labels that flag songs generated fully or partially by AI, shown on the player page, as AI-created music proliferates on streaming services.
- AI NewsApple discloses deal to hire team and license tech from personalized podcast startup Huxe
Apple disclosed a deal to hire the team and license technology from Huxe, a personalized podcast startup, prompting questions about possible AI-generated podcast plans.
- AI NewsGoogle’s AI note-taking app transcribes your meetings completely offline
Google launched Google AI Edge Foresight, a free experimental macOS app that transcribes and summarizes meetings offline using its on-device EmbeddingGemma 2 model.
- AI NewsChatGPT’s ‘Intelligent UI’ update fills its responses with pictures, charts, and but…
OpenAI is adding an 'Intelligent UI' feature to ChatGPT that pairs text replies with interactive visuals like charts, forms, and buttons, rolling out to all users alongside GPT-6.
- AI NewsSean Parker is rebuilding Stability AI around music
Sean Parker is said to be rebuilding Stability AI around music, now operating with support and funding from the music labels.
- AI NewsGoogle’s new Guided Vision feature can help you read the fine print
Google is launching Guided Vision in Gemini Live on compatible Android devices, using AI to give real-time audio descriptions of what the phone camera points at.
- AI NewsOpenAI launches Dots, its Muse competitor
At DevDay, OpenAI announced Dots, always-on AI assistants powered by GPT-6 Astra that work across connected apps in the background, competing with Meta's Muse.
- AI NewsIntroducing Quine: An AI research system designed for the complexity of biology
Microsoft Research unveiled Quine, an early-stage effort to build a multimodal world model of biology that connects insights across biological scales to help scientists prioritize hypotheses before lab testing.
- AI NewsBuild real-time voice applications with vLLM-Omni on SageMaker AI – Part 1
AWS walks through deploying the Qwen3-TTS model on SageMaker AI using the vLLM-Omni Deep Learning Container, streaming generated speech over a persistent bidirectional connection via a Gradio application.
- AI NewsEngram is a sampler that turns broken AI hallucinations into music
Music startup Thoughtful Things has launched a Kickstarter for Engram, a sampler and groovebox that runs a local, custom-trained AI model to distort audio and hallucinate new experimental sounds.
- AI NewsI created an interactive digital avatar of myself — and you can talk to it
A TechCrunch AI writer created an interactive digital avatar of themselves and trained it to discuss venture fraud, reflecting on the trade-offs of AI clones.
- AI NewsAccelerate multimodal RL training with SkyRL on Amazon SageMaker HyperPod
AWS details how to use SkyRL on SageMaker HyperPod to post-train a Qwen3-VL-8B vision-language model with GRPO, covering setup, job execution, and adapter hosting.
- AI NewsDeploying real-time personalized speech with Qwen3-TTS on Amazon SageMaker AI
A guide to deploying the Qwen3-TTS-12Hz-1.7B-Base text-to-speech model via Amazon SageMaker JumpStart to a real-time endpoint, with voice cloning from short reference clips.
- AI NewsGemini 3.8 Live with Live Avatar gives Google’s AI a face
Google's Gemini 3.8 Live update introduces Live Avatar, an animated persona that lip-syncs and shows facial expressions in real time, initially limited to Gemini Enterprise customers.
- AI NewsSpeaker-labeled transcription with WhisperX on SageMaker AI
AWS explains how to deploy the WhisperX Deep Learning Container on Amazon SageMaker AI real-time and asynchronous endpoints for word-level, speaker-labeled transcription.
- AI NewsEverything is spying on you and there’s no opting out
An opinion piece examines privacy concerns after Apple announced Apple Watch features that continuously listen and summarize nearby speech, drawing warnings from experts.
- AI NewsMuse is coming to Meta smart glasses
Meta announced it is working on bringing its Muse agent to smart glasses, allowing voice activation for tasks such as guiding workouts, logging meals, and shopping.
- AI News**Know Who Spoke When: Build Real-Time, Multi-Speaker AI with NVIDIA Nemotron 3 Diarization**
The article discusses the implementation of NVIDIA Nemotron 3 for creating real-time, multi-speaker AI systems. The focus is on effective diarization for audio applications.
- AI NewsThe US spent billions on border surveillance. Why can’t it catch people before they die?
An MIT Technology Review report questions why extensive US border surveillance technology did not prevent migrant deaths, centered on a man who crossed near three surveillance towers in New Mexico in 2024.
- AI NewsIntroducing Kimi K3 on Amazon Bedrock
Moonshot AI's Kimi K3 is now available on Amazon Bedrock as an open-weight option for coding and knowledge work, featuring native vision, a 1M-token context window, and prompt caching.
- AI NewsSnap is launching a new Specs AI tool, and it’s coming to iOS and Mac
Snap is introducing Specs Intelligence, an AI assistant that connects digital accounts to help with tasks and travel, launching alongside its Specs AR glasses and available on iOS and Mac.
- AI NewsThis doorbell camera lets a human security guard watch your front door
SimpliSafe launched the Video Doorbell Series 2 with 2K resolution and dual-band Wi-Fi, combining AI threat detection with live agents who can intervene remotely.
- AI NewsFashion app Daydream uses Apple Intelligence to help you shop the outfits in your camera roll
Daydream's fashion app now uses Apple Intelligence in iOS 27 to convert saved outfit photos into shoppable results and let users search products through Siri.
- AI NewsUniversal Music is launching an AI music platform with ElevenLabs
Universal Music Group is launching an AI music platform with ElevenLabs, allowing users to create remixes and mashups from its licensed catalog under a multiyear deal.
- AI NewsSuno releases its first AI music model made with record industry help
Suno's v6 is its first AI music model developed with record industry backing, trained on newly licensed data and offered in three variants including a free mini model.
- AI NewsRead the Apple document explaining how new listening features still protect your privacy
Apple announced new Siri Audio Intelligence features and published a document explaining that raw audio is processed in dedicated hardware and not saved or accessible to apps or Apple.
- AI NewsRecreating a 70-year love story frame by frame
Google DeepMind and filmmakers used AI to recreate an unrecorded 70-year love story in the short film "Love, Rendered."
- AI NewsAmazon Prime Video’s new AI tech matches lips to dubbed audio
Prime Video is rolling out AI technology that matches actors' mouth movements to human-dubbed audio, debuting on the German series Maxton Hall with plans to expand.
- AI NewsChatGPT Sketch turns your bad drawings into detailed AI images
OpenAI announced ChatGPT Images 2.5, including a new Sketch feature that converts user doodles drawn inside ChatGPT into AI-generated images based on text instructions.
- AI NewsAdobe is trying to make its AI generators idiot-proof in Premiere
Adobe is revamping AI in Premiere with a Generative Media tool that lets editors create video and audio clips without leaving the timeline.
- AI NewsDeploy a multimodal WhatsApp ordering assistant with Amazon Bedrock AgentCore
AWS explains how to build a WhatsApp ordering assistant on Amazon Bedrock AgentCore with Amazon Nova 2, accepting text, voice notes, and real-time calls on one number with shared memory across channels.
- AI NewsRoland is getting into generative AI music with Melody Flip
Roland has launched Melody Flip, a DAW plug-in that marks its entry into generative AI music, generating musical elements rather than fully polished songs.
- AI NewsData from drones in Ukraine is fueling a new Wild West marketplace
Data generated by drones on Ukraine's battlefields is fueling an emerging defense-sector marketplace, with the value of that data expected to outlast the conflicts themselves.
- AI NewsNeoMME: an efficient Multimodal-native and Multilingual Encoder
Hugging Face has unveiled NeoMME, a new encoder designed for efficient multimodal and multilingual processing.
- AI NewsModernizing and scaling support operations with generative AI on AWS
AWS describes building a generative AI support operations platform that converts training videos into structured SOPs, applies RAG to guide ticket resolution, and predicts SLA risk to prioritize work.
- AI NewsMusicians-turned-detectives are hunting for AI grifters
As generative audio tools grow more sophisticated, AI-generated music derived from human artists is spreading online, prompting musicians to investigate creators who deny using the technology.
- AI NewsGoogle’s AI note-taking app now allows you to interact with books
Google's Gemini Notebook can now import purchased Google Play Books via a new Expert Intelligence feature, letting users query titles and generate plans, infographics, and AI podcasts from their contents.
- AI NewsGoogle’s new AI transcription edits out your ‘ums’ and ‘ahs’
Google's new Gemini 3.5 Transcribe model adds transcription that detects specialized jargon, supports more than 85 languages, and edits out filler words like 'ums' and 'ahs'.
- AI NewsBuilding a restaurant telephony AI host with Amazon Connect
A tutorial on building a telephony AI host that answers calls and takes restaurant orders end to end using Amazon Connect and Amazon Bedrock AgentCore.
- AI NewsFlock CEO calls for ‘compromise’ as surveillance company faces growing backlash
Surveillance company Flock Safety is facing rising public criticism over fears its technology could be misused, and its CEO has called for a compromise.
- AI NewsImplement vector-prompt document classification using Amazon Bedrock
AWS outlines a multi-agent document classification approach on Amazon Bedrock that combines text analysis with Claude Haiku 4.5 and visual similarity search using Titan Multimodal Embeddings to classify insurance documents.
- AI NewsSuno is trying to look more like a real music production tool
Suno's Studio 2.0 adds MIDI support and a built-in synth, pushing the generative AI music tool closer to a traditional digital audio workstation.
- AI NewsTwitch streamers can now opt out from training Amazon’s AI
Twitch has added an option letting users exclude their content from future training of Amazon's generative AI models, while other AI-supported features continue to work.
- AI NewsGoogle’s Gemini app surges to 1 billion users
Google's Gemini app has reached 1 billion users, with the company reporting 63% of users engage via voice and more than 150 million images generated daily.
- AI NewsGeneral Catalyst leads $1.1B round into 2-month-old River AI
River AI, founded by xAI co-founder Igor Babuschkin, secured $1.1 billion in a General Catalyst-led round to pursue a vision for personal agents.
- AI NewsBuild Low-Latency Multilingual Voice Agents: Open Weights & Full Deployment Control with NVIDIA Magpie…
A Hugging Face Blog post covers NVIDIA Magpie TTS, positioned for building low-latency multilingual voice agents with open weights and full deployment control.
- AI NewsMeta’s new Glimmer AI model offers a hint at Zuckerberg’s personal intelligence vision
Meta's new open-weight Muse Glimmer model offers an early look at Mark Zuckerberg's personal superintelligence vision and questions of AI ownership and access.
- AI NewsBose CEO Lila Snyder on the fight for high-quality audio
In a Decoder interview, Bose CEO Lila Snyder describes the company's transformation into a B2B technology licensor and reflects on AI wearables and a disrupted headphones market.
- AI NewsFenix Flexin isn’t even denying using AI to make ‘Rubberz’ anymore
Fenix Flexin appears to admit using AI for the song 'Rubberz' after producer Medasin's claims and an AI detector identified the track as made with the tool Treblo.
- AI NewsSure seems like Fenix Flexin used AI music generator Treblo
Treblo launched an open-source classifier that detects songs generated by its own AI music tool, and the tool flagged Fenix Flexin's track 'Rubberz' as very likely Treblo-made.
- AI NewsMeet Wrinkles, an app that uncovers the hidden stories of the places around you
Wrinkles is an app that uses AI to provide audio tours, revealing hidden histories and local stories, available on both iOS and Android.
- AI NewsSpotify expands AI remix and covers project with Merlin partnership
Merlin, representing more than 30,000 independent labels and distributors, is backing Spotify's upcoming paid AI-powered remix and covers product, joining Universal Music Group.
- AI NewsHow we built a realtime system for responsive voice AI in six months
OpenAI details GPT-Live, a realtime voice AI system built over six months that uses a turnless speech model and low-latency architecture for continuous, more natural voice interaction.
- AI NewsSmallest.ai raises $13M to build ultra-fast voice AI that sounds genuinely human
Smallest.ai raised $13M to build ultra-fast voice AI models designed to make AI phone calls pass the Turing test.
- AI NewsGoogle DeepMind’s new AI model can control a robot’s entire body
Google DeepMind says Gemini Robotics 2 can control a humanoid robot's entire body, expanding beyond the previous model's upper-body focus to full-body motion.
- AI NewsGemini Robotics ER 2: powering robotics with video understanding, task orchestration, and multi-robot …
Google DeepMind introduced Gemini Robotics ER 2, a model aimed at helping robots reason, collaborate, and solve real-world tasks through improved video understanding and tool orchestration.
- AI NewsHow AgentCore Gateway supports the MCP 2026-07-28 spec
The Model Context Protocol released its 2026-07-28 spec, its largest revision yet, and AWS details how to enable it on AgentCore Gateway via a single UpdateGateway call.
- AI NewsFish Audio raises $52M seed to build AI voice models for creators and enterprises
Fish Audio raised a $52M seed round to develop AI voice models. It reports over 8 million users of its open-source or hosted models and $21M in annual recurring revenue.
- AI NewsSamsung’s chip workers are jumping ship to rival SK Hynix
MIT Technology Review reports that engineers at Samsung's semiconductor division are increasingly applying to work for its South Korean rival SK Hynix.
- AI NewsAre brain waves the next unlock for physical AI?
A look at the data needs of frontier physical AI models, which reportedly require multiple camera angles, dense annotation, and potentially brain wave readings.
- AI NewsMidjourney bought the astrology app Co-Star
Midjourney, known for AI image generation, has acquired the personalized astrology app Co-Star. The deal reportedly closed in spring, with terms undisclosed.
- AI NewsOpenAI’s new voice mode makes it to the ChatGPT desktop app
OpenAI has added voice mode to the ChatGPT desktop app. ChatGPT Voice can operate alongside ChatGPT Work and Codex to complete tasks and control agents.
- AI NewsAnthropic updates Claude voice mode with more capable models
Anthropic has updated Claude's voice mode with more capable models, adding the ability to perform tasks such as rescheduling meetings and drafting emails.
- AI NewsClaude’s voice mode is now available for Opus and Sonnet
Anthropic is bringing Claude's voice mode to its Opus and Sonnet models, moving beyond the faster Haiku model, and extending voice into apps like Gmail, Slack, and Canva.
- AI NewsRunway launches AI model router as generative media gets crowded
Runway has introduced the Media Router, which automatically picks the best generative model for image, video, or audio requests depending on whether a developer prioritizes quality, speed, or cost.
- AI NewsHere’s what Samsung’s smart glasses actually look like
Samsung has shown its upcoming AI smart glasses in person, unveiling two new designs and initial specs including 9-hour battery life, with a fall launch planned.
- AI NewsMeta made its own AI detection system. It should have just used Google’s
Meta unveiled Content Seal, an invisible watermarking tool that flags images from its AI model, but the tool is seen as less accessible and reliable than existing options like SynthID and C2PA.
- AI NewsMusic streamer Deezer says more than 50% of daily uploads are AI-generated
Music streaming service Deezer says AI-generated tracks now account for more than 50% of daily uploads, reaching over 90,000 tracks per day in June.
- AI NewsAdobe’s ‘natural look’ camera app embraces generative AI
Adobe is adding a generative AI suite called AI Playground to its experimental Project Indigo camera app, offered as an opt-out experiment to a small percentage of users.
- AI NewsAt SIGGRAPH, NVIDIA Advances Graphics and Simulation With Agentic and Physical AI
NVIDIA used SIGGRAPH to showcase graphics and simulation advances driven by agentic and physical AI, spanning media, content creation and robotics.
- AI NewsI hate that I don’t hate this song made with Suno
A Verge opinion piece on 1010Benja's use of generative AI music tool Suno, focusing on the track "Semiramis' Dream" from his latest EP.
- AI NewsIntroducing Grok on Amazon Bedrock
Amazon Bedrock now offers access to Grok 4.3, positioned for agentic and enterprise workloads with features such as configurable reasoning effort, tool calling, and multi-turn conversations.
- AI NewsGoogle Vids now lets you star in your own AI videos
Google Vids is introducing personalized AI avatars that let users appear in their own AI videos, along with Gemini Omni-powered generation and editing from prompts and reference images.
- AI NewsGoogle is renaming NotebookLM to Gemini Notebook
Google is rebranding NotebookLM as Gemini Notebook. The app remains standalone but will integrate more closely with Gemini and Google Search.
- AI NewsBuilding a restaurant telephony AI host with Amazon Bedrock AgentCore and Amazon Nova 2 Sonic
AWS details how to build a telephony AI host that answers calls and takes restaurant orders using Amazon Bedrock AgentCore, Nova 2 Sonic, and the Model Context Protocol.
- AI NewsAgentic vision: Building visual intelligence with Amazon Bedrock and MCP servers
AWS describes a Computer Vision MCP Server built with Amazon Bedrock, offering a standardized interface for AI systems to process visual information and make decisions.
- GuidesHow Speech-to-Text Works: From Sound Waves to Transcripts
Speech recognition went from a brittle research problem to a solved-ish commodity in about three years. Here is the pipeline that made it work — and where it still breaks.
- AI NewsIntroducing Real World VoiceEQ: Measuring the human quality of voice AI
Hugging Face has launched Real World VoiceEQ, a new measurement tool that evaluates the human quality of voice AI systems.
- AI NewsSpotify expands its AI push with a ChatGPT-like music assistant
Spotify is introducing an AI-powered conversational feature that lets Premium subscribers chat with the app to find music, podcasts, audiobooks, and more.
- AI NewsWaze is getting a bunch of new AI-powered features
Waze is gaining four new updates, two of which use Google's Gemini assistant, including conversational voice reporting and a new Destination Search feature.
- AI NewsApple’s failed self-driving car program left a legacy of powerful AI chips
Apple's shelved self-driving car project drove the creation of the Neural Engine, the on-device AI processor first shipped in the iPhone X and A11 Bionic.
- Use CasesAI Voice Agents in Call Centers: What Works, What Frustrates
AI voice agents can now hold a real phone conversation. Here is where they genuinely help in call centers, where they backfire, and how to roll them out so customers don't revolt.
- GuidesHow AI Image Generation Works: Diffusion Models Explained
AI image generators don't paint — they denoise. Here is how diffusion models turn random static into a picture that matches your prompt, explained without the math degree.
- GuidesHow CLIP and Multimodal Search Work: One Space for Text and Images
Searching photos by typing a description, or matching an image to a caption, relies on one clever idea: putting text and images into the same mathematical space. Here is how CLIP made that work.
- AI NewsAutomatically redact PII in images with Amazon Nova
Amazon Nova introduces a multi-step pipeline that uses contextual vision reasoning for the redaction of PII in images, leveraging advanced tools for improved accuracy.
- AI NewsMultimodal AI Goes Mainstream: One Model, Many Senses
The leading AI models no longer just read and write text — they see images and hear audio too. Here is what 'multimodal' means and why it has become the default expectation.
- Use CasesAI in Manufacturing: Predictive Maintenance and Quality Inspection
On the factory floor, AI quietly prevents breakdowns and catches defects. Here is how predictive maintenance and computer-vision inspection work, and what deploying them actually requires.
- AI ToolsGitHub Copilot: The AI Pair Programmer That Went Mainstream
GitHub Copilot brought AI code completion to millions of developers inside their editors. Here is what it does well, where it needs supervision, and how it fits a modern workflow.
- AI ToolsStable Diffusion: The Open Model That Democratized AI Image Generation
Stable Diffusion made high-quality text-to-image generation open and runnable on consumer GPUs, sparking a vast ecosystem of tools and fine-tunes. Here is what it is and why it mattered.
- ResearchCLIP: Teaching AI to Connect Images and Words
CLIP learned to link pictures and language by studying hundreds of millions of image–caption pairs from the web. It quietly became the foundation for image search and generation.