Meta delays new business terms after publisher pushback on AI scraping
Meta is postponing its new business terms to November 20th following publisher pushback over concerns the terms could allow scraping of news sites for AI training.
#datasets
22 articles tagged with “datasets”.
Beyond tree cover: mapping the world’s forest types
Google DeepMind describes a global map that classifies each 10-meter patch of land on Earth into distinct forest types, going beyond basic tree-cover data.
Meta removes language that may have allowed it to scrape news sites
Following backlash, Meta has updated its commercial terms to remove language that suggested it could scrape content, including from news sites, to train its AI.
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
A Hugging Face blog post describes scaling Indic language pretraining to 2.8 trillion tokens and introduces an open data generation pipeline.
Making global data easier to explore
Google and the UN system introduced the UN System Data Commons, an open platform designed to make global statistics easier to access and search.
New insights from Google’s AI & Economy ATLAS
Google has turned its AI & Economy ATLAS, based on millions of global data points, into an interactive and open-access experience.
Mathematicians want proof OpenAI didn’t use their work
A second mathematician has publicly challenged OpenAI over the origins of the data behind its mathematical results, alleging dishonesty and a lack of transparency.
Data from drones in Ukraine is fueling a new Wild West marketplace
Data generated by drones on Ukraine's battlefields is fueling an emerging defense-sector marketplace, with the value of that data expected to outlast the conflicts themselves.
Nvidia is buying Hugging Face for almost $13 billion
Nvidia has agreed to buy Hugging Face for $12.93 billion, placing the widely used open-source AI model and dataset platform under the chipmaker's ownership.
AI-powered metadata correction and harmonization
An AWS blog post describes AI-powered approaches to metadata correction and harmonization, including human-in-the-loop validation and autonomous agent workflows, plus production governance considerations.
AI data startup Micro1 reaches $500M gross run rate amid AI training boom
Micro1, an AI data startup, has hit a $500 million gross run rate as rising demand for AI training data drives rapid growth across the sector.
A third of web pages published since ChatGPT’s launch show signs of AI authorship, study finds
A study reports that about one-third of web pages published since ChatGPT's launch show signs of AI authorship, suggesting AI now writes or edits a large share of new web content.
Amazon, which started off selling books, is destroying rare texts to train AI
According to TechCrunch, Amazon is reportedly destroying rare books to train large language models, which value such texts because they contain material not already available online.
Amazon will train on Twitch streamers’ content by default, unless they opt out
Amazon plans to train AI on Twitch streamers' content by default, with an opt-out option. Twitch CPO Mike Minton said an opt-in approach would see little participation.
How ONESTRUCTION built the Ishigaki-IDS foundation model with AWS GenAIIC
ONESTRUCTION, advised by the AWS Generative AI Innovation Center, built Ishigaki-IDS, a foundation model for construction and BIM workflows using synthetic data and a three-stage training pipeline on Amazon EC2.
Are brain waves the next unlock for physical AI?
A look at the data needs of frontier physical AI models, which reportedly require multiple camera angles, dense annotation, and potentially brain wave readings.
You can’t ignore Google Zero anymore
A Vergecast episode discusses "Google Zero" — the fading of search traffic to websites — alongside Reddit's AI training deal and publishers considering blocking Google's crawlers.
The risk of weather data sabotage is rising
An analysis of the rising risk of weather data sabotage, noting that forecasts inform high-stakes decisions across airlines, power grids, and farming.
Aurora 1.5: Extending open foundation models for weather and Earth-system applications
Aurora 1.5 expands Microsoft Research's open foundation model for weather and Earth-system applications, adding more variables, hourly resolution, and ensemble forecasting.
Data for Agents
The Hugging Face Blog discusses key aspects of data utilization for enhancing AI agents.
NVIDIA and Hugging Face Bring New Models and Frameworks to LeRobot for the Open Robotics Community
NVIDIA and Hugging Face are working together to provide new models and frameworks aimed at the open robotics community, leveraging shared resources for innovation.
What Are Embeddings and Vector Search? A Plain-English Guide
Embeddings are how AI turns words into numbers that capture meaning — the quiet engine behind semantic search, recommendations, and RAG. Here is the concept without the math.